2023-12-07T09:42:32.941 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T09:42:32.942 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --name vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi --archive /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865 --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/orig.config.yaml 2023-12-07T09:42:32.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:42:33.076 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865 branch: wip-vshankar-testing-20231127.102654-r2 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7481865' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102654-r2 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102654-r2 sha1: 3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1098 sha1: 3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 sleep_before_teardown: 0 subset: 854/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102654-r2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh7IohZXctJxzWSQcXdoedlQsCFs/6i+OOU6mb2eAxbe+6PVlcgVdsNJi/UxM9KPXej+j6EFoQrBzuXva83530= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZNgc0FESPAPeleHTMuq3nqgKH5dEkd4OeaOJcyEP7k1nQp7mISc2Y0/xOjnmOVbRBv8L7FFKey3HkAGcUSIgA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-07_09:28:49 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-07T09:42:33.076 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa; will attempt to use it 2023-12-07T09:42:33.077 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks 2023-12-07T09:42:33.077 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-07T09:42:33.079 INFO:teuthology.task.internal:Checking packages... 2023-12-07T09:42:33.103 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0' 2023-12-07T09:42:33.103 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T09:42:33.103 INFO:teuthology.packaging:ref: None 2023-12-07T09:42:33.103 INFO:teuthology.packaging:tag: None 2023-12-07T09:42:33.103 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102654-r2 2023-12-07T09:42:33.103 INFO:teuthology.packaging:sha1: 3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 2023-12-07T09:42:33.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102654-r2 2023-12-07T09:42:33.245 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:42:33.245 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-07T09:42:33.250 INFO:teuthology.task.internal:no buildpackages task found 2023-12-07T09:42:33.251 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-07T09:42:33.397 INFO:teuthology.task.internal:Saving configuration 2023-12-07T09:42:33.414 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-07T09:42:33.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T09:42:33.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:37:02.887386', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOOOOsoJ+BRA6Hibdi9XL2qZVK7KJb3BbrGoYeMosYEF'} 2023-12-07T09:42:33.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:37:02.886059', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAtzgCNvH3cdtCa2CHuUCDTQaVApOxB83zgNTXhSO19y'} 2023-12-07T09:42:33.470 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-07T09:42:33.476 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-07T09:42:33.476 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-07T09:42:33.476 INFO:teuthology.run_tasks:Running task console_log... 2023-12-07T09:42:33.600 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f11bbc000d0>, signals=[15]) 2023-12-07T09:42:33.601 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-07T09:42:33.607 INFO:teuthology.task.internal:Opening connections... 2023-12-07T09:42:33.607 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:42:33.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:42:33.686 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:42:33.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:42:33.758 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-07T09:42:33.765 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-12-07T09:42:33.771 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-12-07T09:42:33.771 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-07T09:42:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2023-12-07T09:42:33.818 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-07T09:42:33.841 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-12-07T09:42:33.846 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-12-07T09:42:33.846 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-12-07T09:42:33.898 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-07T09:42:33.898 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-07T09:42:33.899 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2023-12-07T09:42:33.899 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-12-07T09:42:33.932 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-07T09:42:33.942 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-07T09:42:33.967 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-07T09:42:33.967 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-12-07T09:42:33.970 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2023-12-07T09:42:33.974 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-07T09:42:33.993 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-07T09:42:33.993 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-12-07T09:42:34.018 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2023-12-07T09:42:34.036 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-07T09:42:34.123 INFO:teuthology.run_tasks:Running task kernel... 2023-12-07T09:42:34.138 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-07T09:42:34.139 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-07T09:42:34.139 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-07T09:42:34.139 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T09:42:34.141 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T09:42:34.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:42:34.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:42:34.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-07T09:42:34.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-07T09:42:34.348 DEBUG:teuthology.task.kernel:sha1 for client.0 is 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-07T09:42:34.348 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "9471594ae3a4c6992c4327df9a789df8f2b6aeae"... 2023-12-07T09:42:34.348 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-12-07T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-56-generic 2023-12-07T09:42:34.354 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-07T09:42:34.354 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-07T09:42:34.354 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-07T09:42:34.355 DEBUG:teuthology.orchestra.run.smithi089:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-07T09:42:34.414 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-07T09:42:34.530 DEBUG:teuthology.task.kernel:sha1 for client.1 is 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-07T09:42:34.530 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "9471594ae3a4c6992c4327df9a789df8f2b6aeae"... 2023-12-07T09:42:34.531 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-12-07T09:42:34.536 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2023-12-07T09:42:34.536 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-07T09:42:34.536 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-07T09:42:34.537 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-07T09:42:34.537 DEBUG:teuthology.orchestra.run.smithi097:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: git config --global init.defaultBranch 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 2023-12-07T09:42:34.541 INFO:teuthology.orchestra.run.smithi089.stderr:hint: git branch -m 2023-12-07T09:42:34.546 INFO:teuthology.orchestra.run.smithi089.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-07T09:42:34.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-07T09:42:34.593 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-07T09:42:34.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-07T09:42:34.670 DEBUG:teuthology.orchestra.run.smithi089:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-07T09:42:34.737 INFO:teuthology.orchestra.run.smithi097.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-07T09:42:34.737 INFO:teuthology.orchestra.run.smithi097.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: git config --global init.defaultBranch 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 2023-12-07T09:42:34.738 INFO:teuthology.orchestra.run.smithi097.stderr:hint: git branch -m 2023-12-07T09:42:34.739 INFO:teuthology.orchestra.run.smithi097.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-07T09:42:34.742 DEBUG:teuthology.orchestra.run.smithi097:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-07T09:42:34.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-07T09:42:34.866 DEBUG:teuthology.orchestra.run.smithi097:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-07T09:43:38.430 INFO:teuthology.orchestra.run.smithi089.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-07T09:43:38.430 INFO:teuthology.orchestra.run.smithi089.stderr: * [new branch] main -> origin/main 2023-12-07T09:43:38.461 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190312 -> 20190312 2023-12-07T09:43:38.461 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190416 -> 20190416 2023-12-07T09:43:38.462 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190514 -> 20190514 2023-12-07T09:43:38.462 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190618 -> 20190618 2023-12-07T09:43:38.462 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190717 -> 20190717 2023-12-07T09:43:38.462 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190815 -> 20190815 2023-12-07T09:43:38.462 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190923 -> 20190923 2023-12-07T09:43:38.462 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20191022 -> 20191022 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20191215 -> 20191215 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200122 -> 20200122 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200316 -> 20200316 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200421 -> 20200421 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200519 -> 20200519 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200619 -> 20200619 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200721 -> 20200721 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200817 -> 20200817 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200918 -> 20200918 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201022 -> 20201022 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201118 -> 20201118 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201218 -> 20201218 2023-12-07T09:43:38.464 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210208 -> 20210208 2023-12-07T09:43:38.465 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210315 -> 20210315 2023-12-07T09:43:38.465 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210511 -> 20210511 2023-12-07T09:43:38.465 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210716 -> 20210716 2023-12-07T09:43:38.465 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210818 -> 20210818 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210919 -> 20210919 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20211027 -> 20211027 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20211216 -> 20211216 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220209 -> 20220209 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220310 -> 20220310 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220411 -> 20220411 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220509 -> 20220509 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220610 -> 20220610 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220708 -> 20220708 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220815 -> 20220815 2023-12-07T09:43:38.467 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220913 -> 20220913 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221012 -> 20221012 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221109 -> 20221109 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221214 -> 20221214 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230117 -> 20230117 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230210 -> 20230210 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230310 -> 20230310 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230404 -> 20230404 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230515 -> 20230515 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230625 -> 20230625 2023-12-07T09:43:38.468 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230804 -> 20230804 2023-12-07T09:43:38.469 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230919 -> 20230919 2023-12-07T09:43:38.469 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20231030 -> 20231030 2023-12-07T09:43:38.469 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20231111 -> 20231111 2023-12-07T09:43:42.443 INFO:teuthology.orchestra.run.smithi089.stderr:Updating files: 51% (1673/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 65% (2116/3254) Updating files: 65% (2122/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2658/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-07T09:43:42.447 INFO:teuthology.orchestra.run.smithi089.stdout:HEAD is now at c004dbee Merge branch 'robot/patch-0-1701808157' into 'main' 2023-12-07T09:43:42.468 INFO:teuthology.task.kernel:Downloading kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on client.0... 2023-12-07T09:43:42.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-07T09:43:42.616 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g9471594ae3a4/ 2023-12-07T09:43:42.616 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g9471594ae3a4_6.6.0-g9471594ae3a4-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g9471594ae3a4/ --input-file=- 2023-12-07T09:43:42.618 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi089.front.sepia.ceph.com to complete... 2023-12-07T09:43:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07 09:43:46 URL:https://3.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g9471594ae3a4/linux-image-6.6.0-g9471594ae3a4_6.6.0-g9471594ae3a4-1_amd64.deb [38939402/38939402] -> "/tmp/linux-image.deb" [1] 2023-12-07T09:43:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:FINISHED --2023-12-07 09:43:46-- 2023-12-07T09:43:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:Total wall clock time: 3.9s 2023-12-07T09:43:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:Downloaded: 1 files, 37M in 3.7s (10.1 MB/s) 2023-12-07T09:43:46.646 INFO:teuthology.task.kernel:Installing kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on client.0... 2023-12-07T09:43:46.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo dpkg -i /tmp/linux-image.deb 2023-12-07T09:43:46.945 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-6.6.0-g9471594ae3a4. 2023-12-07T09:43:48.948 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-07T09:43:48.952 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-07T09:43:49.201 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-6.6.0-g9471594ae3a4 (6.6.0-g9471594ae3a4-1) ... 2023-12-07T09:43:52.480 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-6.6.0-g9471594ae3a4 (6.6.0-g9471594ae3a4-1) ... 2023-12-07T09:43:52.588 INFO:teuthology.orchestra.run.smithi089.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g9471594ae3a4 2023-12-07T09:43:52.973 INFO:teuthology.orchestra.run.smithi097.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-07T09:43:52.973 INFO:teuthology.orchestra.run.smithi097.stderr: * [new branch] main -> origin/main 2023-12-07T09:43:53.003 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190312 -> 20190312 2023-12-07T09:43:53.004 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190416 -> 20190416 2023-12-07T09:43:53.004 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190514 -> 20190514 2023-12-07T09:43:53.004 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190618 -> 20190618 2023-12-07T09:43:53.004 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190717 -> 20190717 2023-12-07T09:43:53.004 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190815 -> 20190815 2023-12-07T09:43:53.004 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190923 -> 20190923 2023-12-07T09:43:53.005 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20191022 -> 20191022 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20191215 -> 20191215 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200122 -> 20200122 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200316 -> 20200316 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200421 -> 20200421 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200519 -> 20200519 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200619 -> 20200619 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200721 -> 20200721 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200817 -> 20200817 2023-12-07T09:43:53.006 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200918 -> 20200918 2023-12-07T09:43:53.009 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20201022 -> 20201022 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20201118 -> 20201118 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20201218 -> 20201218 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210208 -> 20210208 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210315 -> 20210315 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210511 -> 20210511 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210716 -> 20210716 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210818 -> 20210818 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210919 -> 20210919 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20211027 -> 20211027 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20211216 -> 20211216 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220209 -> 20220209 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220310 -> 20220310 2023-12-07T09:43:53.010 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220411 -> 20220411 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220509 -> 20220509 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220610 -> 20220610 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220708 -> 20220708 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220815 -> 20220815 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220913 -> 20220913 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20221012 -> 20221012 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20221109 -> 20221109 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20221214 -> 20221214 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230117 -> 20230117 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230210 -> 20230210 2023-12-07T09:43:53.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230310 -> 20230310 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230404 -> 20230404 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230515 -> 20230515 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230625 -> 20230625 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230804 -> 20230804 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230919 -> 20230919 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20231030 -> 20231030 2023-12-07T09:43:53.012 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20231111 -> 20231111 2023-12-07T09:43:56.992 INFO:teuthology.orchestra.run.smithi097.stderr:Updating files: 51% (1673/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 65% (2116/3254) Updating files: 65% (2119/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-07T09:43:56.997 INFO:teuthology.orchestra.run.smithi097.stdout:HEAD is now at c004dbee Merge branch 'robot/patch-0-1701808157' into 'main' 2023-12-07T09:43:57.018 INFO:teuthology.task.kernel:Downloading kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on client.1... 2023-12-07T09:43:57.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-07T09:43:57.163 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g9471594ae3a4/ 2023-12-07T09:43:57.164 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g9471594ae3a4_6.6.0-g9471594ae3a4-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g9471594ae3a4/ --input-file=- 2023-12-07T09:43:57.166 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi097.front.sepia.ceph.com to complete... 2023-12-07T09:44:02.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07 09:44:02 URL:https://3.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g9471594ae3a4/linux-image-6.6.0-g9471594ae3a4_6.6.0-g9471594ae3a4-1_amd64.deb [38939402/38939402] -> "/tmp/linux-image.deb" [1] 2023-12-07T09:44:02.871 INFO:teuthology.orchestra.run.smithi097.stderr:FINISHED --2023-12-07 09:44:02-- 2023-12-07T09:44:02.871 INFO:teuthology.orchestra.run.smithi097.stderr:Total wall clock time: 5.7s 2023-12-07T09:44:02.871 INFO:teuthology.orchestra.run.smithi097.stderr:Downloaded: 1 files, 37M in 5.4s (6.85 MB/s) 2023-12-07T09:44:02.874 INFO:teuthology.task.kernel:Installing kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on client.1... 2023-12-07T09:44:02.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo dpkg -i /tmp/linux-image.deb 2023-12-07T09:44:03.208 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-6.6.0-g9471594ae3a4. 2023-12-07T09:44:05.192 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-07T09:44:05.196 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-07T09:44:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-6.6.0-g9471594ae3a4 (6.6.0-g9471594ae3a4-1) ... 2023-12-07T09:44:08.768 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-6.6.0-g9471594ae3a4 (6.6.0-g9471594ae3a4-1) ... 2023-12-07T09:44:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g9471594ae3a4 2023-12-07T09:44:13.621 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2023-12-07T09:44:13.636 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-07T09:44:13.656 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-12-07T09:44:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-07T09:44:13.977 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-6.6.0-g9471594ae3a4 2023-12-07T09:44:14.320 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-07T09:44:14.336 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-07T09:44:14.400 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-07T09:44:14.406 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-07T09:44:14.584 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-07T09:44:14.584 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-07T09:44:14.584 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-07T09:44:14.624 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-12-07T09:44:14.786 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-deb -c /tmp/linux-image.deb 2023-12-07T09:44:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./ 2023-12-07T09:44:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./boot/ 2023-12-07T09:44:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4415617 2023-12-05 02:18 ./boot/System.map-6.6.0-g9471594ae3a4 2023-12-07T09:44:14.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 169214 2023-12-05 02:18 ./boot/config-6.6.0-g9471594ae3a4 2023-12-07T09:44:14.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11352832 2023-12-05 02:18 ./boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-07T09:44:14.867 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/ 2023-12-07T09:44:14.867 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/ 2023-12-07T09:44:14.867 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/postinst.d/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/postrm.d/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/preinst.d/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/prerm.d/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ 2023-12-07T09:44:14.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 490233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-07T09:44:14.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 152241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-07T09:44:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/ 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/ 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/ 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpuid.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/msr.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/ 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 354433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-07T09:44:14.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 881625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-07T09:44:14.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2275865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/af_alg.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/algif_hash.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/algif_skcipher.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ansi_cprng.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/anubis.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/arc4.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/asymmetric_keys/ 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-07T09:44:14.885 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/ 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_memcpy.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_pq.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_tx.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_xor.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/raid6test.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authenc.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authencesn.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blake2b_generic.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_common.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_generic.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/camellia_generic.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast5_generic.ko 2023-12-07T09:44:14.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast6_generic.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast_common.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ccm.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cmac.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crc32_generic.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cryptd.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_engine.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_simd.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_user.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cts.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/des_generic.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/dh_generic.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/echainiv.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/essiv.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/fcrypt.ko 2023-12-07T09:44:14.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/khazad.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lrw.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4hc.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/md4.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/michael_mic.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcbc.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcrypt.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/rmd160.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/seed.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/serpent_generic.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 149193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tcrypt.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tea.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_common.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_generic.ko 2023-12-07T09:44:14.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/vmac.ko 2023-12-07T09:44:14.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/wp512.ko 2023-12-07T09:44:14.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xcbc.ko 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xor.ko 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xts.ko 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xxhash_generic.ko 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_extlog.ko 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-07T09:44:14.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_pad.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/apei/ 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/apei/einj.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ec_sys.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/platform_profile.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbs.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbshc.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/video.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/acard-ahci.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 88865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci_platform.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 88289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci_platform.ko 2023-12-07T09:44:14.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_acpi.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ali.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_amd.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_artop.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atiixp.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atp867x.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd640.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd64x.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cypress.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_efar.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt366.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt37x.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it8213.ko 2023-12-07T09:44:14.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it821x.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_jmicron.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_legacy.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_marvell.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_mpiix.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_netcell.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ninja32.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87410.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87415.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_oldpiix.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_opti.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_optidma.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pcmcia.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-07T09:44:14.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_piccolo.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_radisys.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rdc.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rz1000.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sch.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_serverworks.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sil680.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sl82c105.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_triflex.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_via.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pdc_adma.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_inic162x.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_mv.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_nv.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_promise.ko 2023-12-07T09:44:14.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_qstor.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil24.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sis.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_svw.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sx4.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_uli.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_via.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_vsc.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ks0108.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/ 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/bcma.ko 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/ 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/ 2023-12-07T09:44:14.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/aoe.ko 2023-12-07T09:44:14.897 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/ 2023-12-07T09:44:14.897 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 965585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/drbd.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 173225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/floppy.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/ 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/nbd.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/ 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 110385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/null_blk.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/pktcdvd.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 263769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/rbd.ko 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/ 2023-12-07T09:44:14.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/ 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/zram.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/applicom.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hangcheck-timer.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/ 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/via-rng.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 148601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-07T09:44:14.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 139313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/lp.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/ 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/mwave.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/nvram.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ppdev.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tlclk.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/ 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-07T09:44:14.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/ 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/ 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-palmas.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-si5351.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-twl6040.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-wm831x.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/ 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-07T09:44:14.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 243025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 438761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-aes.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-sha.ko 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/ 2023-12-07T09:44:14.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/ 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/dca.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/ 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/amd64_edac.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/e752x_edac.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/edac_mce_amd.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3000_edac.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3200_edac.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5100_edac.ko 2023-12-07T09:44:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5400_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7300_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7core_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i82975x_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ie31200_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/sb_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/x38_edac.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/ 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-gpio.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-max14577.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-max77693.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-max8997.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-palmas.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-07T09:44:14.951 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/ 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/efi/ 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/ 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-arizona.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-da9052.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-da9055.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-dln2.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-generic.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ich.ko 2023-12-07T09:44:14.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-kempld.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-max7300.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-max730x.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-max732x.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-sch.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-07T09:44:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-vx855.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/ 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-a4tech.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-apple.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-appleir.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-aureal.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-axff.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-belkin.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-cherry.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-chicony.ko 2023-12-07T09:44:14.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-cp2112.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-cypress.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-dr.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elecom.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elo.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-emsff.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ezkey.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gaff.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-generic.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gt683r.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gyration.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtekff.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-hyperv.ko 2023-12-07T09:44:14.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-icade.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kensington.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-keytouch.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kye.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lcpower.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-led.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lenovo.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lg-g15.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-magicmouse.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-microsoft.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-monterey.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-multitouch.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ntrig.ko 2023-12-07T09:44:14.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ortek.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-penmount.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-petalynx.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-picolcd.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-pl.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-plantronics.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-primax.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-rmi.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-common.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-07T09:44:14.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-saitek.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-samsung.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sjoy.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sony.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-speedlink.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-steelseries.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sunplus.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tivo.ko 2023-12-07T09:44:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tmff.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-topseed.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-twinhan.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-uclogic.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-waltop.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 143473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-wiimote.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-xinmo.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zpff.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zydacron.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 267825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/uhid.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/ 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-07T09:44:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 217873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/wacom.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/ 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_balloon.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_utils.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 305465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_vmbus.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru3.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7414.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7418.ko 2023-12-07T09:44:14.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adc128d818.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1025.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1026.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1029.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1031.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm9240.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ads7828.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7410.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7411.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7462.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7470.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7475.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7x10.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/amc6821.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/applesmc.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asb100.ko 2023-12-07T09:44:14.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asc7621.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/atxp1.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/coretemp.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dme1737.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds1621.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds620.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc1403.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc2103.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc6w201.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71805f.ko 2023-12-07T09:44:14.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71882fg.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f75375s.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fam15h_power.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fschmd.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g760a.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g762.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl518sm.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl520sm.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hih6130.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5500_temp.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5k_amb.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmaem.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmpex.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina209.ko 2023-12-07T09:44:14.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina2xx.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 130449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/it87.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/jc42.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k10temp.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k8temp.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lineage-pem.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm63.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm73.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm75.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm77.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm78.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm80.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm83.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm85.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm87.ko 2023-12-07T09:44:14.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm90.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm92.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm93.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95234.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95241.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95245.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc2945.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4151.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4215.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4222.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4245.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4260.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4261.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max16065.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1619.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1668.ko 2023-12-07T09:44:14.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max197.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6639.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6650.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6697.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mcp3021.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6683.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775-core.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct7802.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87360.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87427.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pcf8591.ko 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ 2023-12-07T09:44:14.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/powr1220.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5627.ko 2023-12-07T09:44:14.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5636.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht15.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht21.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/shtc1.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sis5595.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47b397.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m1.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m192.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/thmc50.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp102.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp103.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp401.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp421.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via-cputemp.ko 2023-12-07T09:44:14.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via686a.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt1211.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt8231.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627ehf.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627hf.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83781d.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83791d.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83792d.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83793.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83795.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l785ts.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l786ng.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-07T09:44:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/ 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/ 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/ 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-07T09:44:14.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-07T09:44:14.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-mux.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-smbus.ko 2023-12-07T09:44:14.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-stub.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/ 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 273609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 879969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_core.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 324217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 282273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/ 2023-12-07T09:44:14.973 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 493073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/ 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 419737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/ 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 739025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 296625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 153697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/usnic/ 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 168969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-07T09:44:14.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 263081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 111425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 129529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/evbug.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/ff-memless.ko 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/ 2023-12-07T09:44:14.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/gameport.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/joydev.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/ 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-07T09:44:14.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/lm8323.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/lm8333.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/qt1070.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/qt2160.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/stowaway.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-07T09:44:14.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/matrix-keymap.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/ 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/appletouch.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/bcm5974.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/cyapatp.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-07T09:44:14.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 335929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/psmouse.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/sermouse.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/ 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/ 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/altera_ps2.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/arc_ps2.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/ct82c710.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/parkbd.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/pcips2.ko 2023-12-07T09:44:14.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/ps2mult.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serio_raw.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serport.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/sparse-keymap.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/ 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/ 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/ 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-88pm860x.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-adp5520.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-bd2802.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-blinkm.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-da903x.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-da9052.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-gpio.ko 2023-12-07T09:44:14.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3530.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3533.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm355x.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3642.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp3944.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp8788.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-max8997.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-mc13783.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-pca9532.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-pca955x.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-pca963x.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-ss4200.ko 2023-12-07T09:44:14.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-tca6507.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-wm8350.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/ 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/ 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 654969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/bcache.ko 2023-12-07T09:44:14.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bio-prison.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bufio.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache-smq.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 156009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-crypt.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-delay.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-era.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-flakey.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log-userspace.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-mirror.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-multipath.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-queue-length.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-raid.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-region-hash.ko 2023-12-07T09:44:14.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-round-robin.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-service-time.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-snapshot.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-switch.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 181865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-thin-pool.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-verity.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-zero.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/faulty.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/linear.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/multipath.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/ 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 199937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid0.ko 2023-12-07T09:44:14.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid1.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 158681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid10.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 395721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid456.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/ 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/ 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 178137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptbase.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptctl.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptfc.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptlan.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptsas.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptscsih.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptspi.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/ 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/88pm800.ko 2023-12-07T09:44:14.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/88pm805.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/88pm80x.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/arizona-i2c.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/arizona.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/bcm590xx.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/dln2.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/janz-cmodio.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/kempld-core.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lm3533-core.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lp3943.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_ich.ko 2023-12-07T09:44:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_sch.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/max8907.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/menf21bmc.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/pcf50633.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/retu-mfd.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/si476x-core.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/sm501.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/tps65010.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/tps6507x.ko 2023-12-07T09:44:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/viperboard.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/vx855.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wl1273-core.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wm8994.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ad525x_dpot.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/ 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds9802als.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds990x.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/bh1770glc.ko 2023-12-07T09:44:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/c2port/ 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/c2port/core.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/ 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/cb710.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ds1682.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/dummy-irq.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/echo/ 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/echo/echo.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/ 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/at24.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/max6875.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/enclosure.ko 2023-12-07T09:44:14.989 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/genwqe/ 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 152201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hmc6352.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hpilo.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ibmasm/ 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ics932s401.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29003.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29020.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/ 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/ 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-me.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-txe.ko 2023-12-07T09:44:14.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 310113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/phantom.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ti-st/ 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_7xx1.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_core.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tsl2550.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_balloon.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/ 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 183609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/ 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 490129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/bonding.ko 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/ 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/ 2023-12-07T09:44:14.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 453737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dummy.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/eql.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/ 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 130553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-07T09:44:14.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/ 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/ 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/ 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/ 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/ 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-07T09:44:14.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/ 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-07T09:44:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-07T09:44:14.995 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/ 2023-12-07T09:44:14.995 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 176761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1421497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 132089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 312081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/ 2023-12-07T09:44:15.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 323513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 193497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 347417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1044497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 166193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 204345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-07T09:44:15.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/ 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/ 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dnet.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/ 2023-12-07T09:44:15.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 281137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ethoc.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fealnx.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fujitsu/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 295577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 584497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 246209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-07T09:44:15.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 925825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 302937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/ 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 514641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 734305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 151769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/jme.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/ 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-07T09:44:15.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 727601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 278937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1113681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 95665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-07T09:44:15.063 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/ 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 150905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/ 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 136721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/ 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/ 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 227897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-07T09:44:15.064 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 672049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/ 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/ 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 189801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/samsung/ 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/ 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1052497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-07T09:44:15.065 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/ 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/ 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/ 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/ 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-07T09:44:15.066 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 487025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/ 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 166097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/ 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/ 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/ 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/ 2023-12-07T09:44:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/ 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/ 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/defxx.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/skfp/ 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 216985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/geneve.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/ 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 235521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/ 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ifb.ko 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ 2023-12-07T09:44:15.068 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvlan.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvtap.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/ 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mii.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/netconsole.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/nlmon.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/ 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-07T09:44:15.069 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/amd.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm87xx.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/broadcom.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/cicada.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/davicom.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/et1011c.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/icplus.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/lxt.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/marvell.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/micrel.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/national.ko 2023-12-07T09:44:15.070 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/phylink.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/qsemi.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/realtek.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/smsc.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ste10Xp.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/vitesse.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/plip/ 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/plip/plip.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_async.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppoe.ko 2023-12-07T09:44:15.071 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppox.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pptp.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sb1000.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/ 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slip.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sungem_phy.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tap.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/ 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_random.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/veth.ko 2023-12-07T09:44:15.072 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 144297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 297329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/vxlan.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 144585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ntb.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 265121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme-core.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/ 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 133841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport.ko 2023-12-07T09:44:15.073 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_cs.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_pc.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_serial.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/ 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/ 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pci-stub.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/xen-pcifront.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/ 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/i82092.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 145809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pcmcia.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-07T09:44:15.074 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pd6729.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 112889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/broadcom/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/samsung/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/ 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-07T09:44:15.075 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/ 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acerhdf.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 127441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-07T09:44:15.076 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/hdaps.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/ 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel_ips.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-07T09:44:15.077 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/ 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/da9030_battery.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/da9052-battery.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-07T09:44:15.078 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/gpio-charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max14577_charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max17040_battery.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max17042_battery.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max8903_charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max8925_power.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/sbs-battery.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/test_power.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-07T09:44:15.079 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/wm831x_power.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/wm8350_power.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/ 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/ 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/ 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps_parport.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/pps_core.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp_kvm.ko 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/ 2023-12-07T09:44:15.080 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-da9052.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-da9055.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-da9063.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-07T09:44:15.081 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-em3027.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max6900.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8907.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8925.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8997.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8998.ko 2023-12-07T09:44:15.082 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-palmas.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-07T09:44:15.083 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-x1205.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-9xxx.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-sas.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-xxxx.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 135185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/BusLogic.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/a100u2w.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/ 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 272305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-07T09:44:15.084 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/advansys.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/ 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 356201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 295801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic94xx/ 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 189185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/am53c974.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/ 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/atp870u.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/ 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 246985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/ 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1171945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/bfa.ko 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/ 2023-12-07T09:44:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 237273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/ 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ch.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/ 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 308921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/ 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 146689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dc395x.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dmx3191d.ko 2023-12-07T09:44:15.086 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/ 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 212425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esp_scsi.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/ 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 158505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fdomain.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/ 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 263489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/fnic.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 201817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hpsa.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hptiop.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hv_storvsc.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/imm.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/initio.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 266537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ipr.ko 2023-12-07T09:44:15.087 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ips.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/ 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 317153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/isci.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/ 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 314865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/libfc.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 145585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/ 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 216665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/libsas.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/ 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2197249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/ 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-07T09:44:15.088 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 310617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/ 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 659825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/ 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvumi.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/ 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/ 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 364105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-07T09:44:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pmcraid.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ppa.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla1280.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/ 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1876689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/ 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 559033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qlogicfas408.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/raid_class.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 238761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_debug.ko 2023-12-07T09:44:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 173937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 279313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ses.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/st.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/stex.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 162121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/virtio_scsi.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/wd719x.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/xen-scsifront.ko 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ 2023-12-07T09:44:15.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 129441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ssb.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/ 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/ 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 736601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/ 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_file.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_iblock.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 930257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_mod.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_pscsi.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_user.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/ 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/ 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/ 2023-12-07T09:44:15.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-07T09:44:15.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/moxa.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/mxser.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_gsm.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_hdlc.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/nozomi.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/ 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/ 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-07T09:44:15.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/altera_uart.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/arc_uart.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/ 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/rp2.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/ 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 531265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-07T09:44:15.095 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/ 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_aec.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_cif.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_mf624.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_netx.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pci_generic.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_sercos3.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/ 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/c67x00/ 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 144377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-07T09:44:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/ 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-acm.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usblp.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usbtmc.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/common/ 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/common/ulpi.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc2/ 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/ 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-07T09:44:15.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 448505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/ 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/ 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 92489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-07T09:44:15.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/ 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-07T09:44:15.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 161225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/ 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 157681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-07T09:44:15.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 156073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/ 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811_cs.ko 2023-12-07T09:44:15.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/ 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/mdc800.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/microtek.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/adutux.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/appledisplay.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/cytherm.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ehset.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi26.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi62.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ezusb.ko 2023-12-07T09:44:15.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/idmouse.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/iowarrior.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ldusb.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/legousbtower.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/lvstest.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/ 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usb3503.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usblcd.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbtest.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/uss720.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/yurex.ko 2023-12-07T09:44:15.103 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/mon/ 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/mon/usbmon.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/musb/ 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 301697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/ 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-generic.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/aircable.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ark3116.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ch341.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cp210x.ko 2023-12-07T09:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cyberjack.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/empeg.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/f81232.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 175137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 137081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_ti.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipaq.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipw.ko 2023-12-07T09:44:15.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ir-usb.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mct_u232.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/metro-usb.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7720.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7840.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mxuport.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/navman.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/omninet.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/opticon.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 191137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/option.ko 2023-12-07T09:44:15.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/oti6858.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/pl2303.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcaux.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcserial.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/quatech2.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/safe_serial.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/sierra.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ssu100.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/symbolserial.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_debug.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usbserial.ko 2023-12-07T09:44:15.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/visor.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/whiteheat.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/uas.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-karma.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-07T09:44:15.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 179969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/usb-storage.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/ 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/ 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/ 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 154297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-07T09:44:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/ 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_net.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_scsi.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/ 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/ 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/apple_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/bd6107.ko 2023-12-07T09:44:15.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lcd.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/ 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ 2023-12-07T09:44:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2482.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2490.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/ 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-07T09:44:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/wire.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/acquirewdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/advantechwdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/dw_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/hpwdt.ko 2023-12-07T09:44:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/i6300esb.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ib700wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ibmasr.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it87_wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/machzwd.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-07T09:44:15.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/nv_tco.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/retu_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/softdog.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-07T09:44:15.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/via_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wdt_pci.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/xen_wdt.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/ 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-evtchn.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntalloc.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntdev.ko 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/ 2023-12-07T09:44:15.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 176377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-privcmd.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-scsiback.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 166425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/9p.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/adfs/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/adfs/adfs.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 163593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/affs.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/afs/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 932817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/afs/kafs.ko 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/autofs/ 2023-12-07T09:44:15.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/autofs/autofs4.ko 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/ 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/befs.ko 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/bfs/ 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/bfs/bfs.ko 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/binfmt_misc.ko 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/ 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 3402729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/btrfs.ko 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/ 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 306009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/cachefiles.ko 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ 2023-12-07T09:44:15.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1333017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ceph.ko 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/ 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/coda.ko 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/configfs/ 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/configfs/configfs.ko 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/ 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/cramfs.ko 2023-12-07T09:44:15.162 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/ 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 642513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/dlm.ko 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/efs/ 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/efs/efs.ko 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/ 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1505025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/f2fs.ko 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/ 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/msdos.ko 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/freevxfs/ 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/freevxfs/freevxfs.ko 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/ 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 226481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/fscache.ko 2023-12-07T09:44:15.163 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/cuse.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1231529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/gfs2.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/hfs.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 222817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/hfsplus.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hpfs/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 192329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hpfs/hpfs.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/isofs.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 419497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/jfs.ko 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/ 2023-12-07T09:44:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 280313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/lockd.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/ 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/minix.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/ 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/netfs.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/ 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/ 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/ 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/ 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1055721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfs.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv2.ko 2023-12-07T09:44:15.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv3.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2042137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv4.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/ 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/grace.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/nfs_acl.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/ 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1516873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/nfsd.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/ 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 592833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/nilfs2.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/ 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-celtic.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-centeuro.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-croatian.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-cyrillic.ko 2023-12-07T09:44:15.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-gaelic.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-greek.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-iceland.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-inuit.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-roman.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-romanian.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-turkish.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ascii.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1250.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1251.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1255.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp737.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp775.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp850.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp852.ko 2023-12-07T09:44:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp855.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp857.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp860.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp861.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp862.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp863.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp864.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp865.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp866.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp869.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp874.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp932.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp936.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 165745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp949.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 118121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp950.ko 2023-12-07T09:44:15.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_euc-jp.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-1.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-13.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-14.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-15.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-2.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-3.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-4.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-5.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-6.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-7.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-9.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-r.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-ru.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-u.ko 2023-12-07T09:44:15.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_utf8.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ntfs/ 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 219417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ntfs/ntfs.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 244409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 440737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2592433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-07T09:44:15.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/omfs/ 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/omfs/omfs.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/ 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 352161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/overlay.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ramoops.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx4/ 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx4/qnx4.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx6/ 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx6/qnx6.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/ 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/quota_tree.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/quota_v1.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/quota_v2.ko 2023-12-07T09:44:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 532673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/reiserfs.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/romfs.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2668401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/cifs.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_arc4.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_md4.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 134641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/squashfs.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/sysv.ko 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/ 2023-12-07T09:44:15.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 247737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/udf.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 162497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ufs.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/ 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4011017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/xfs.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/ 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/locking/ 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/locking/locktorture.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/time/ 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/time/test_udelay.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/torture.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc-itu-t.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc7.ko 2023-12-07T09:44:15.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc8.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/ 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libarc4.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libdes.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/interval_tree_test.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/libcrc32c.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lru_cache.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/ 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4_compress.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4hc_compress.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/ 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/cordic.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/memory-notifier-error-inject.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/notifier-error-inject.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/percpu_test.ko 2023-12-07T09:44:15.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/pm-notifier-error-inject.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/ 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 143433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/raid6_pq.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/rbtree_test.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/ 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test-kstrtox.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test-string_helpers.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4760425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_bpf.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_firmware.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_module.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_user_copy.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_bm.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_fsm.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_kmp.ko 2023-12-07T09:44:15.175 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/xz/ 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/xz/xz_dec_test.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/mm/ 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/mm/hwpoison-inject.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/ 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/6lowpan.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_dest.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_fragment.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_hop.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_mobility.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_routing.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_udp.ko 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/ 2023-12-07T09:44:15.176 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/garp.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/mrp.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/p8022.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/psnap.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/stp.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/ 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/8021q.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/ 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 198337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_fd.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_rdma.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_virtio.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/ 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 649297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/batman-adv.ko 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/ 2023-12-07T09:44:15.177 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/br_netfilter.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 777689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/bridge.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-07T09:44:15.178 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtables.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/ 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1046833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/libceph.ko 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/ 2023-12-07T09:44:15.179 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/pktgen.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/ 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 194209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_diag.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv4.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv6.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/ 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 390473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/dsa_core.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_brcm.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_dsa.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_none.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_trailer.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/hsr/ 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/hsr/hsr.ko 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ 2023-12-07T09:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 254625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ah4.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/esp4.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/fou.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/gre.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/inet_diag.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_gre.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_tunnel.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_vti.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipcomp.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipip.ko 2023-12-07T09:44:15.181 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-07T09:44:15.182 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_bic.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_dctcp.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_diag.ko 2023-12-07T09:44:15.183 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_highspeed.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_htcp.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_hybla.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_illinois.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_lp.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_scalable.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_vegas.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_veno.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_westwood.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_yeah.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tunnel4.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_diag.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_tunnel.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ 2023-12-07T09:44:15.184 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ah6.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/esp6.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/fou6.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_gre.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_tunnel.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_vti.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ipcomp6.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/mip6.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-07T09:44:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-07T09:44:15.186 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/sit.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/tunnel6.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/ 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/af_key.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/ 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_core.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_eth.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip.ko 2023-12-07T09:44:15.187 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip6.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_netlink.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ppp.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/lapb/ 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/lapb/lapb.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/ 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 267913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc2.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/ 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 290417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/mac802154.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/ 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/mpls_gso.ko 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ 2023-12-07T09:44:15.188 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 112849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 112585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 111585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-07T09:44:15.189 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 411729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-07T09:44:15.190 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conncount.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 408257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 118145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-07T09:44:15.191 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_log_syslog.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 95353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_irc.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_sip.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 615649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_tables.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-07T09:44:15.192 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_log.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_chain_nat.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_compat.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_ct.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fib.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_hash.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_limit.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_log.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_masq.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_nat.ko 2023-12-07T09:44:15.193 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_numgen.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_osf.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_queue.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_redir.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject_inet.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_socket.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_synproxy.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_tproxy.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/x_tables.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_AUDIT.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CT.ko 2023-12-07T09:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_DSCP.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HL.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HMARK.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LED.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LOG.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NETMAP.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFLOG.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_RATEEST.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_SECMARK.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-07T09:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TEE.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TPROXY.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TRACE.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_addrtype.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_bpf.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cgroup.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cluster.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_comment.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connbytes.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlabel.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlimit.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connmark.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_conntrack.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cpu.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dccp.ko 2023-12-07T09:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_devgroup.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dscp.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ecn.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_esp.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hashlimit.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_helper.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hl.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipcomp.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_iprange.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipvs.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_l2tp.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_length.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_limit.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mac.ko 2023-12-07T09:44:15.197 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mark.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_multiport.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nat.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nfacct.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_osf.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_owner.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_physdev.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_pkttype.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_policy.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_quota.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_rateest.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_realm.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_recent.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_sctp.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_set.ko 2023-12-07T09:44:15.198 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_socket.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_state.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_statistic.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_string.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpmss.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpudp.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_time.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_u32.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/ 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/netlink_diag.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/ 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/nsh.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/ 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 380033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/openvswitch.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-geneve.ko 2023-12-07T09:44:15.199 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-gre.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-vxlan.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/ 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/af_packet_diag.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/phonet/ 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 110201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/phonet/phonet.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/phonet/pn_pep.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/ 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 251481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 164937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_rdma.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_tcp.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rxrpc/ 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 819657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rxrpc/rxrpc.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/ 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_csum.ko 2023-12-07T09:44:15.200 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_gact.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_ipt.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_mirred.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_nat.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_pedit.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_police.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_simple.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_skbedit.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_vlan.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_basic.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_bpf.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_cgroup.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_flow.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_fw.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_route.ko 2023-12-07T09:44:15.201 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_u32.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_cmp.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_ipset.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_meta.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_nbyte.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_text.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_u32.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_choke.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_codel.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_drr.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq_codel.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_gred.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hfsc.ko 2023-12-07T09:44:15.202 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hhf.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_htb.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_ingress.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio_lib.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_multiq.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_netem.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_pie.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_plug.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_prio.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_qfq.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_red.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfb.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfq.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_tbf.ko 2023-12-07T09:44:15.203 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_teql.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/ 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 929745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp_diag.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/ 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/ 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 336529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1520097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/sunrpc.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/ 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 707657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/ 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/diag.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 862665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/tipc.ko 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/ 2023-12-07T09:44:15.204 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/unix_diag.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/ 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/x25/ 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/x25/x25.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/ 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_algo.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_user.ko 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/virt/ 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/ 2023-12-07T09:44:15.205 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/irqbypass.ko 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 640081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.alias 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 624107 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.alias.bin 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7663 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23428 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin.alias.bin 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9821 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin.bin 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70004 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin.modinfo 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 146313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.dep 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 232548 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.dep.bin 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 210 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.devname 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72606 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.order 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 879 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.softdep 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 254438 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.symbols 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 309363 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.symbols.bin 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/ 2023-12-07T09:44:15.206 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/share/ 2023-12-07T09:44:15.207 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/share/doc/ 2023-12-07T09:44:15.207 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/share/doc/linux-image-6.6.0-g9471594ae3a4/ 2023-12-07T09:44:15.207 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 171 2023-12-05 02:18 ./usr/share/doc/linux-image-6.6.0-g9471594ae3a4/changelog.Debian.gz 2023-12-07T09:44:15.207 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 691 2023-12-05 02:18 ./usr/share/doc/linux-image-6.6.0-g9471594ae3a4/copyright 2023-12-07T09:44:15.208 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9471594ae3a4 2023-12-07T09:44:15.208 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g9471594ae3a4 2023-12-07T09:44:15.208 DEBUG:teuthology.orchestra.run.smithi089:> egrep '(submenu|menuentry.*6.6.0-g9471594ae3a4).*{' /boot/grub/grub.cfg 2023-12-07T09:44:15.214 INFO:teuthology.orchestra.run.smithi089.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-07T09:44:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g9471594ae3a4' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g9471594ae3a4-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-07T09:44:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g9471594ae3a4 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g9471594ae3a4-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-07T09:44:15.215 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-07T09:44:15.215 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g9471594ae3a4 2023-12-07T09:44:15.215 DEBUG:teuthology.orchestra.run.smithi089:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-07T09:44:15.258 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi089.front.sepia.ceph.com to complete... 2023-12-07T09:44:15.640 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2023-12-07T09:44:15.641 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-07T09:44:15.670 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-12-07T09:44:15.839 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-07T09:44:15.845 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-6.6.0-g9471594ae3a4 2023-12-07T09:44:16.059 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-07T09:44:16.064 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-07T09:44:16.105 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-07T09:44:16.110 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-07T09:44:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-07T09:44:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-07T09:44:16.274 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-07T09:44:16.295 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-12-07T09:44:30.253 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2023-12-07T09:44:30.268 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-07T09:44:30.296 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2023-12-07T09:44:30.609 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-07T09:44:30.629 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-6.6.0-g9471594ae3a4 2023-12-07T09:44:30.947 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-07T09:44:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-07T09:44:31.020 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-07T09:44:31.026 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-07T09:44:31.183 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-07T09:44:31.183 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-07T09:44:31.183 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-07T09:44:31.218 INFO:teuthology.orchestra.run.smithi097.stderr:done 2023-12-07T09:44:31.452 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-deb -c /tmp/linux-image.deb 2023-12-07T09:44:31.461 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./ 2023-12-07T09:44:31.461 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./boot/ 2023-12-07T09:44:31.461 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 4415617 2023-12-05 02:18 ./boot/System.map-6.6.0-g9471594ae3a4 2023-12-07T09:44:31.470 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 169214 2023-12-05 02:18 ./boot/config-6.6.0-g9471594ae3a4 2023-12-07T09:44:31.471 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11352832 2023-12-05 02:18 ./boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-07T09:44:31.487 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/ 2023-12-07T09:44:31.487 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/postinst.d/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/postrm.d/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/preinst.d/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./etc/kernel/prerm.d/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ 2023-12-07T09:44:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 490233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-07T09:44:31.490 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-07T09:44:31.490 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 93113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 152241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-07T09:44:31.491 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/ 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/ 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/ 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpuid.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/msr.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/ 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 354433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-07T09:44:31.492 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 881625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-07T09:44:31.493 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2275865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm.ko 2023-12-07T09:44:31.506 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ 2023-12-07T09:44:31.506 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/af_alg.ko 2023-12-07T09:44:31.506 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/algif_hash.ko 2023-12-07T09:44:31.506 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/algif_skcipher.ko 2023-12-07T09:44:31.506 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ansi_cprng.ko 2023-12-07T09:44:31.506 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/anubis.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/arc4.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/asymmetric_keys/ 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/ 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_memcpy.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_pq.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_tx.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_xor.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/raid6test.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authenc.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authencesn.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blake2b_generic.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_common.ko 2023-12-07T09:44:31.507 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/camellia_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast5_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast6_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast_common.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ccm.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cmac.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crc32_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cryptd.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_engine.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_simd.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_user.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cts.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/des_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/dh_generic.ko 2023-12-07T09:44:31.508 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/echainiv.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/essiv.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/fcrypt.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/khazad.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lrw.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4hc.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/md4.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/michael_mic.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcbc.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcrypt.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/rmd160.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/seed.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/serpent_generic.ko 2023-12-07T09:44:31.509 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 149193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tcrypt.ko 2023-12-07T09:44:31.510 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tea.ko 2023-12-07T09:44:31.510 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_common.ko 2023-12-07T09:44:31.510 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_generic.ko 2023-12-07T09:44:31.510 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/vmac.ko 2023-12-07T09:44:31.511 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/wp512.ko 2023-12-07T09:44:31.511 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xcbc.ko 2023-12-07T09:44:31.511 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xor.ko 2023-12-07T09:44:31.512 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xts.ko 2023-12-07T09:44:31.512 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xxhash_generic.ko 2023-12-07T09:44:31.512 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ 2023-12-07T09:44:31.512 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ 2023-12-07T09:44:31.512 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_extlog.ko 2023-12-07T09:44:31.512 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_pad.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/apei/ 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/apei/einj.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ec_sys.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/platform_profile.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbs.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbshc.ko 2023-12-07T09:44:31.513 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/video.ko 2023-12-07T09:44:31.514 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ 2023-12-07T09:44:31.514 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/acard-ahci.ko 2023-12-07T09:44:31.514 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 88865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci.ko 2023-12-07T09:44:31.514 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci_platform.ko 2023-12-07T09:44:31.514 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 88289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci.ko 2023-12-07T09:44:31.514 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci_platform.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_acpi.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ali.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_amd.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_artop.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atiixp.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atp867x.ko 2023-12-07T09:44:31.515 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd640.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd64x.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cypress.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_efar.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt366.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt37x.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it8213.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it821x.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_jmicron.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_legacy.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_marvell.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_mpiix.ko 2023-12-07T09:44:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_netcell.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ninja32.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87410.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87415.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_oldpiix.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_opti.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_optidma.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pcmcia.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_piccolo.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_radisys.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rdc.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rz1000.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sch.ko 2023-12-07T09:44:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_serverworks.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sil680.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sl82c105.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_triflex.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_via.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pdc_adma.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_inic162x.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_mv.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_nv.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_promise.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_qstor.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil24.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sis.ko 2023-12-07T09:44:31.518 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_svw.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sx4.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_uli.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_via.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_vsc.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ks0108.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/ 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 124473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/bcma.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/ 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/ 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/aoe.ko 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/ 2023-12-07T09:44:31.519 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 965585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/drbd.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 173225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/floppy.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/ 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 94297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 115793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/nbd.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/ 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 110385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/null_blk.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 98193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/pktcdvd.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 263769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/rbd.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/ 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 98145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/ 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/zram.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/applicom.ko 2023-12-07T09:44:31.520 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hangcheck-timer.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/ 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/via-rng.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 148601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 139313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/lp.ko 2023-12-07T09:44:31.521 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/ 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 84097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/mwave.ko 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/nvram.ko 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ppdev.ko 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tlclk.ko 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/ 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-07T09:44:31.522 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/ 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-07T09:44:31.523 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/ 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-palmas.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-si5351.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-twl6040.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/clk/clk-wm831x.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/ 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-07T09:44:31.524 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 243025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp.ko 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/ 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/ 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-07T09:44:31.525 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 438761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-07T09:44:31.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-07T09:44:31.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-07T09:44:31.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-aes.ko 2023-12-07T09:44:31.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-sha.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/ 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/ 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/dca.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/ 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 79953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/amd64_edac.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/e752x_edac.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/edac_mce_amd.ko 2023-12-07T09:44:31.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3000_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3200_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5100_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5400_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7300_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7core_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i82975x_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ie31200_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/sb_edac.ko 2023-12-07T09:44:31.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/x38_edac.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/ 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-gpio.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-max14577.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-max77693.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-max8997.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-palmas.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/ 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/efi/ 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-07T09:44:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/ 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-arizona.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-da9052.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-da9055.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-dln2.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-generic.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ich.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-kempld.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-07T09:44:31.619 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-max7300.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-max730x.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-max732x.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-sch.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-07T09:44:31.620 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-vx855.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/ 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-a4tech.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-apple.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-appleir.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-aureal.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-axff.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-belkin.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-cherry.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-chicony.ko 2023-12-07T09:44:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-cp2112.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-cypress.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-dr.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elecom.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elo.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-emsff.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ezkey.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gaff.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-generic.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gt683r.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gyration.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtekff.ko 2023-12-07T09:44:31.622 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-hyperv.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-icade.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kensington.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-keytouch.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kye.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lcpower.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-led.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lenovo.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lg-g15.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-magicmouse.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-microsoft.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-monterey.ko 2023-12-07T09:44:31.623 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-multitouch.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ntrig.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ortek.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-penmount.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-petalynx.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-picolcd.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-pl.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-plantronics.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-primax.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-rmi.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-common.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-07T09:44:31.624 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-saitek.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-samsung.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sjoy.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sony.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-speedlink.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-steelseries.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sunplus.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-07T09:44:31.625 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tivo.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tmff.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-topseed.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-twinhan.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-uclogic.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-waltop.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 143473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-wiimote.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-xinmo.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zpff.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zydacron.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 267825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/uhid.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/ 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-07T09:44:31.626 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 217873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/wacom.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/ 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_balloon.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_utils.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 305465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_vmbus.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru3.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7414.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7418.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adc128d818.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1025.ko 2023-12-07T09:44:31.627 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1026.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1029.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1031.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm9240.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ads7828.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7410.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7411.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7462.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7470.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7475.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7x10.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/amc6821.ko 2023-12-07T09:44:31.628 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/applesmc.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asb100.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asc7621.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/atxp1.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/coretemp.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 99601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dme1737.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds1621.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds620.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc1403.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc2103.ko 2023-12-07T09:44:31.629 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc6w201.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71805f.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 94457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71882fg.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f75375s.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fam15h_power.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fschmd.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g760a.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g762.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl518sm.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl520sm.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hih6130.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5500_temp.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5k_amb.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmaem.ko 2023-12-07T09:44:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmpex.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina209.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina2xx.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 130449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/it87.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/jc42.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k10temp.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k8temp.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lineage-pem.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm63.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm73.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm75.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm77.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm78.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm80.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm83.ko 2023-12-07T09:44:31.631 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm85.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm87.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm90.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm92.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm93.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95234.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95241.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95245.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc2945.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4151.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4215.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4222.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4245.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4260.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4261.ko 2023-12-07T09:44:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max16065.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1619.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1668.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max197.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6639.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6650.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6697.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mcp3021.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6683.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775-core.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct7802.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87360.ko 2023-12-07T09:44:31.633 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87427.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pcf8591.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-07T09:44:31.634 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/powr1220.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5627.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5636.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht15.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht21.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/shtc1.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sis5595.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47b397.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m1.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m192.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/thmc50.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp102.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp103.ko 2023-12-07T09:44:31.635 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp401.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp421.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via-cputemp.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via686a.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt1211.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt8231.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627ehf.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627hf.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83781d.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83791d.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83792d.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83793.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83795.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l785ts.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l786ng.ko 2023-12-07T09:44:31.636 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/ 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/ 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/ 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-07T09:44:31.637 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-07T09:44:31.638 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-07T09:44:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-07T09:44:31.641 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-07T09:44:31.641 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-mux.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-smbus.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-stub.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/ 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-07T09:44:31.642 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 273609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 879969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_core.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 324217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 282273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/ 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-07T09:44:31.643 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 493073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/ 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 419737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/ 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 739025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 296625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 153697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/usnic/ 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 168969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ 2023-12-07T09:44:31.644 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 263081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 111425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 128753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 129529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/ 2023-12-07T09:44:31.645 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/evbug.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/ff-memless.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/ 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/gameport.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/joydev.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/ 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-07T09:44:31.646 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/lm8323.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/lm8333.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/qt1070.ko 2023-12-07T09:44:31.647 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/qt2160.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/stowaway.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/matrix-keymap.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/ 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/appletouch.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/bcm5974.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/cyapatp.ko 2023-12-07T09:44:31.648 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 335929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/psmouse.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/sermouse.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/ 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 109873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/ 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/altera_ps2.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/arc_ps2.ko 2023-12-07T09:44:31.649 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/ct82c710.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/parkbd.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/pcips2.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/ps2mult.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serio_raw.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serport.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/sparse-keymap.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/ 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/ 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/ 2023-12-07T09:44:31.650 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-88pm860x.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-adp5520.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-bd2802.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-blinkm.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-da903x.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-da9052.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-gpio.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3530.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3533.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm355x.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3642.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp3944.ko 2023-12-07T09:44:31.651 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp8788.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-max8997.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-mc13783.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-pca9532.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-pca955x.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-pca963x.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-ss4200.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-tca6507.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-wm8350.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-07T09:44:31.652 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/ 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/ 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 654969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/bcache.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bio-prison.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bufio.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache-smq.ko 2023-12-07T09:44:31.653 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 156009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-crypt.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-delay.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-era.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-flakey.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log-userspace.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-mirror.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-multipath.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-queue-length.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-raid.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-region-hash.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-round-robin.ko 2023-12-07T09:44:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-service-time.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 109529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-snapshot.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-switch.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 181865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-thin-pool.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-verity.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-zero.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/faulty.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/linear.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/multipath.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/ 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 199937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid0.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid1.ko 2023-12-07T09:44:31.655 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 158681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid10.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 395721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid456.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/ 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/ 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 178137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptbase.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptctl.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptfc.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptlan.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptsas.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 79041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptscsih.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptspi.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/ 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/88pm800.ko 2023-12-07T09:44:31.656 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/88pm805.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/88pm80x.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/arizona-i2c.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/arizona.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/bcm590xx.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/dln2.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/janz-cmodio.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/kempld-core.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lm3533-core.ko 2023-12-07T09:44:31.657 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lp3943.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_ich.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_sch.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/max8907.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/menf21bmc.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/pcf50633.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-07T09:44:31.658 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/retu-mfd.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/si476x-core.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/sm501.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/tps65010.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/tps6507x.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/viperboard.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/vx855.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wl1273-core.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wm8994.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ad525x_dpot.ko 2023-12-07T09:44:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/ 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds9802als.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds990x.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/bh1770glc.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/c2port/ 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/c2port/core.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/ 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/cb710.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ds1682.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/dummy-irq.ko 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/echo/ 2023-12-07T09:44:31.660 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/echo/echo.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/ 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/at24.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/max6875.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/enclosure.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/genwqe/ 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 152201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hmc6352.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hpilo.ko 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ibmasm/ 2023-12-07T09:44:31.661 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ics932s401.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29003.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29020.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/ 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/ 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-me.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-txe.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 310113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/phantom.ko 2023-12-07T09:44:31.662 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ti-st/ 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_7xx1.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_core.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tsl2550.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_balloon.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/ 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 183609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/ 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 490129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/bonding.ko 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/ 2023-12-07T09:44:31.663 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/ 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 453737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dummy.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/eql.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/ 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-07T09:44:31.664 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 130553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 99049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/ 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/ 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/ 2023-12-07T09:44:31.665 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/ 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/ 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/ 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 104673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-07T09:44:31.666 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 90257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/ 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 176761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1421497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 128569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-07T09:44:31.667 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 132089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 312081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 323513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 193497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 347417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-07T09:44:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1044497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 166193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/ 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 204345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/ 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 141225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-07T09:44:31.669 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/ 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dnet.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/ 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 281137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-07T09:44:31.670 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ethoc.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fealnx.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fujitsu/ 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 90465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 295577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 584497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 246209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-07T09:44:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 925825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 302937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/ 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 514641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 93593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 734305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 151769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-07T09:44:31.672 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 86921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/jme.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/ 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/ 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 727601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 278937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1113681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ 2023-12-07T09:44:31.673 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 95665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/ 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-07T09:44:31.674 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/ 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 150905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/ 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 136721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/ 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/ 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 227897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-07T09:44:31.675 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 672049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/ 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/ 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 189801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/samsung/ 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 104241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/ 2023-12-07T09:44:31.676 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1052497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/ 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/ 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/ 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-07T09:44:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/ 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 487025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/ 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 166097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/ 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-07T09:44:31.678 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/ 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 86529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/ 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/ 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/ 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/ 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/defxx.ko 2023-12-07T09:44:31.679 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/skfp/ 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 216985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/geneve.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/ 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 235521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/ 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ifb.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvlan.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvtap.ko 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/ 2023-12-07T09:44:31.680 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mii.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/netconsole.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/nlmon.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/ 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/amd.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-07T09:44:31.681 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm87xx.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/broadcom.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/cicada.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/davicom.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/et1011c.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/icplus.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/lxt.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/marvell.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 76113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/micrel.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/national.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/phylink.ko 2023-12-07T09:44:31.682 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/qsemi.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/realtek.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/smsc.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ste10Xp.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/vitesse.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/plip/ 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/plip/plip.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_async.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-07T09:44:31.683 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppoe.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppox.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pptp.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sb1000.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/ 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slip.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sungem_phy.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tap.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/ 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-07T09:44:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_random.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/veth.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/ 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 144297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/ 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 297329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/vxlan.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/ 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 144585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ntb.ko 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/ 2023-12-07T09:44:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/ 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 265121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme-core.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/ 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 133841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_cs.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 84465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_pc.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_serial.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/ 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/ 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-07T09:44:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pci-stub.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/xen-pcifront.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/ 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/i82092.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 145809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pcmcia.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pd6729.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 112889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/ 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/broadcom/ 2023-12-07T09:44:31.687 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/samsung/ 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/ 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/ 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/ 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/ 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-07T09:44:31.688 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/ 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acerhdf.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 127441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-07T09:44:31.689 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/hdaps.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/ 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel_ips.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-07T09:44:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/ 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-07T09:44:31.691 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/da9030_battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/da9052-battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/gpio-charger.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max14577_charger.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max17040_battery.ko 2023-12-07T09:44:31.692 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max17042_battery.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max8903_charger.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/max8925_power.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/sbs-battery.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/test_power.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/wm831x_power.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/power/supply/wm8350_power.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/ 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-07T09:44:31.693 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/ 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/ 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps_parport.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/pps_core.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp_kvm.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/ 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-07T09:44:31.694 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-da9052.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-da9055.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-da9063.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-07T09:44:31.695 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-em3027.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-07T09:44:31.696 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max6900.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8907.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8925.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8997.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max8998.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-palmas.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-07T09:44:31.697 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-07T09:44:31.698 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-x1205.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-9xxx.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-sas.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-xxxx.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 135185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/BusLogic.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/a100u2w.ko 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/ 2023-12-07T09:44:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 272305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/advansys.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/ 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 356201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 295801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic94xx/ 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 189185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/am53c974.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/ 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/atp870u.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/ 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 246985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-07T09:44:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/ 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1171945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/bfa.ko 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/ 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 237273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/ 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 115369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ch.ko 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/ 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 308921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/ 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 76145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-07T09:44:31.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 146689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dc395x.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dmx3191d.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/ 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 212425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esp_scsi.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/ 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 158505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fdomain.ko 2023-12-07T09:44:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/ 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 263489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/fnic.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 201817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hpsa.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hptiop.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hv_storvsc.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/imm.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/initio.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 266537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ipr.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ips.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/ 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 317153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/isci.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-07T09:44:31.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/ 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 314865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/libfc.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 145585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/ 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 216665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/libsas.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/ 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2197249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/ 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-07T09:44:31.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 310617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-07T09:44:31.795 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 84721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/ 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 659825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/ 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvumi.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/ 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-07T09:44:31.796 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/ 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 364105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pmcraid.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ppa.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla1280.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/ 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1876689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 85289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/ 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 559033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qlogicfas408.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/raid_class.ko 2023-12-07T09:44:31.797 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 238761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_debug.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 173937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 279313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ses.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 115889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/st.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/stex.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 162121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/virtio_scsi.ko 2023-12-07T09:44:31.798 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/wd719x.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/xen-scsifront.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 129441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ssb.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/ 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/ 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 736601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/ 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_file.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_iblock.ko 2023-12-07T09:44:31.799 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 930257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_mod.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_pscsi.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_user.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/ 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/ 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/ 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-07T09:44:31.800 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-07T09:44:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/moxa.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/mxser.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_gsm.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_hdlc.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/nozomi.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/ 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/ 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-07T09:44:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/altera_uart.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/arc_uart.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/ 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/rp2.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/ 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 531265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-07T09:44:31.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/ 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_aec.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_cif.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_mf624.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_netx.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pci_generic.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_sercos3.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/ 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/c67x00/ 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-07T09:44:31.804 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 144377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/ 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-acm.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usblp.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usbtmc.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/common/ 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/common/ulpi.ko 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc2/ 2023-12-07T09:44:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/ 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 448505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/ 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/ 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-07T09:44:31.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 92489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 85609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/ 2023-12-07T09:44:31.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-07T09:44:31.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 161225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/ 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 157681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 76057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-07T09:44:31.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 65809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 156073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/ 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-07T09:44:31.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811_cs.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/ 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/mdc800.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/microtek.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/adutux.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/appledisplay.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/cytherm.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ehset.ko 2023-12-07T09:44:31.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi26.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi62.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ezusb.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/idmouse.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/iowarrior.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ldusb.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/legousbtower.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/lvstest.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/ 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-07T09:44:31.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usb3503.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usblcd.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbtest.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/uss720.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/yurex.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/mon/ 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/mon/usbmon.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/musb/ 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 301697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/ 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-generic.ko 2023-12-07T09:44:31.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/aircable.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ark3116.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ch341.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cp210x.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cyberjack.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-07T09:44:31.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/empeg.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/f81232.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 175137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 137081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 124833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_ti.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipaq.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipw.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ir-usb.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 107521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-07T09:44:31.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mct_u232.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/metro-usb.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7720.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7840.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mxuport.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/navman.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/omninet.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/opticon.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 191137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/option.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/oti6858.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/pl2303.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcaux.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcserial.ko 2023-12-07T09:44:31.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/quatech2.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/safe_serial.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/sierra.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ssu100.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/symbolserial.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_debug.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usbserial.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/visor.ko 2023-12-07T09:44:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/whiteheat.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/uas.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-07T09:44:31.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-karma.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 179969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/usb-storage.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/ 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 107001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/ 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/ 2023-12-07T09:44:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 154297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/ 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_net.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_scsi.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/ 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/ 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-07T09:44:31.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/apple_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/bd6107.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lcd.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-07T09:44:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/ 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2482.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2490.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-07T09:44:31.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/ 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14153 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-07T09:44:31.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/wire.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/acquirewdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/advantechwdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/dw_wdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-07T09:44:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/hpwdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/i6300esb.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ib700wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ibmasr.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it87_wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/machzwd.ko 2023-12-07T09:44:31.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/nv_tco.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22265 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/retu_wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-07T09:44:31.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/softdog.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/via_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wdt_pci.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-07T09:44:31.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/xen_wdt.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/ 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-evtchn.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntalloc.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntdev.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/ 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 176377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-privcmd.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-scsiback.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/ 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ 2023-12-07T09:44:31.828 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 166425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/9p.ko 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/adfs/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/adfs/adfs.ko 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 163593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/affs.ko 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/afs/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 932817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/afs/kafs.ko 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/autofs/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/autofs/autofs4.ko 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/befs.ko 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/bfs/ 2023-12-07T09:44:31.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/bfs/bfs.ko 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/binfmt_misc.ko 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/ 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 3402729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/btrfs.ko 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/ 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 306009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/cachefiles.ko 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1333017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ceph.ko 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/ 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/coda.ko 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/configfs/ 2023-12-07T09:44:31.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/configfs/configfs.ko 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/ 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/cramfs.ko 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/ 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 642513 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/dlm.ko 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/efs/ 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/efs/efs.ko 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/ 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1505025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/f2fs.ko 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/ 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/msdos.ko 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/freevxfs/ 2023-12-07T09:44:31.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/freevxfs/freevxfs.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/ 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 226481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/fscache.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/ 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/cuse.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/ 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1231529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/gfs2.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/ 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 141209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/hfs.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/ 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 222817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/hfsplus.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hpfs/ 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 192329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hpfs/hpfs.ko 2023-12-07T09:44:31.832 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/isofs.ko 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 419497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/jfs.ko 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 280313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/lockd.ko 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/minix.ko 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 124649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/netfs.ko 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/ 2023-12-07T09:44:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/ 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/ 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 117465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1055721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfs.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv2.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 120177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv3.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2042137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv4.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/ 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/grace.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/nfs_acl.ko 2023-12-07T09:44:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/ 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1516873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/nfsd.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/ 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 592833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/nilfs2.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/ 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-celtic.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-centeuro.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-croatian.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-cyrillic.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-gaelic.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-greek.ko 2023-12-07T09:44:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-iceland.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-inuit.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-roman.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-romanian.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-turkish.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ascii.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1250.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1251.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1255.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp737.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp775.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp850.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp852.ko 2023-12-07T09:44:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp855.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp857.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp860.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp861.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp862.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp863.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp864.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp865.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp866.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp869.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp874.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 94137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp932.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 142673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp936.ko 2023-12-07T09:44:31.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 165745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp949.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 118121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp950.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_euc-jp.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-1.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-13.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-14.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-15.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-2.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-3.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-4.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-5.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-6.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-7.ko 2023-12-07T09:44:31.838 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-9.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-r.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-ru.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-u.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_utf8.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ntfs/ 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 219417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ntfs/ntfs.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 244409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 440737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-07T09:44:31.839 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2592433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/omfs/ 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/omfs/omfs.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/ 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 352161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/overlay.ko 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ 2023-12-07T09:44:31.840 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ramoops.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx4/ 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx4/qnx4.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx6/ 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/qnx6/qnx6.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/ 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/quota_tree.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/quota_v1.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/quota/quota_v2.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/ 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 532673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/reiserfs.ko 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/ 2023-12-07T09:44:31.841 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/romfs.ko 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/ 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/ 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2668401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/cifs.ko 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/ 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_arc4.ko 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_md4.ko 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/ 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 134641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/squashfs.ko 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/ 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 90721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/sysv.ko 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/ 2023-12-07T09:44:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 247737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/udf.ko 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 162497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ufs.ko 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/ 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 4011017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/xfs.ko 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/ 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/locking/ 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/locking/locktorture.ko 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/time/ 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/time/test_udelay.ko 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/torture.ko 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ 2023-12-07T09:44:31.843 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc-itu-t.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc7.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc8.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/ 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libarc4.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libdes.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/interval_tree_test.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/libcrc32c.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lru_cache.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/ 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4_compress.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4hc_compress.ko 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/ 2023-12-07T09:44:31.844 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/cordic.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/memory-notifier-error-inject.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/notifier-error-inject.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/percpu_test.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/pm-notifier-error-inject.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/ 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 143433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/raid6_pq.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/rbtree_test.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/ 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test-kstrtox.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test-string_helpers.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 4760425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_bpf.ko 2023-12-07T09:44:31.845 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_firmware.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_module.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/test_user_copy.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_bm.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_fsm.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_kmp.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/xz/ 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/lib/xz/xz_dec_test.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/mm/ 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/mm/hwpoison-inject.ko 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/ 2023-12-07T09:44:31.846 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/6lowpan.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_dest.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_fragment.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_hop.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_mobility.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_routing.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_udp.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/ 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/garp.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/mrp.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/p8022.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/psnap.ko 2023-12-07T09:44:31.847 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/stp.ko 2023-12-07T09:44:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/ 2023-12-07T09:44:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/8021q.ko 2023-12-07T09:44:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/ 2023-12-07T09:44:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 198337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet.ko 2023-12-07T09:44:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_fd.ko 2023-12-07T09:44:31.849 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26345 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_rdma.ko 2023-12-07T09:44:31.849 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_virtio.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/ 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 649297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/batman-adv.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/ 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/br_netfilter.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 777689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/bridge.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-07T09:44:31.850 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13217 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8385 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-07T09:44:31.851 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtables.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/ 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1046833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/libceph.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/ 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/pktgen.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/ 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 194209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_diag.ko 2023-12-07T09:44:31.852 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv4.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv6.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/ 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 390473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/dsa_core.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_brcm.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_dsa.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_none.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_trailer.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/hsr/ 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 99729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/hsr/hsr.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 254625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154.ko 2023-12-07T09:44:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ah4.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/esp4.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/fou.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/gre.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/inet_diag.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_gre.ko 2023-12-07T09:44:31.854 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61225 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_tunnel.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_vti.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipcomp.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipip.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-07T09:44:31.855 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11305 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18161 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-07T09:44:31.856 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_bic.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_dctcp.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_diag.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_highspeed.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_htcp.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_hybla.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_illinois.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_lp.ko 2023-12-07T09:44:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_scalable.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_vegas.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_veno.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_westwood.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_yeah.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tunnel4.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_diag.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_tunnel.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ah6.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/esp6.ko 2023-12-07T09:44:31.858 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/fou6.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_gre.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 93577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_tunnel.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_vti.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ipcomp6.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19017 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/mip6.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-07T09:44:31.859 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11121 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-07T09:44:31.860 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25945 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9009 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/sit.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/tunnel6.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/ 2023-12-07T09:44:31.861 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82833 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/af_key.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/ 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125281 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_core.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25953 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_eth.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36713 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip6.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_netlink.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ppp.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/lapb/ 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47977 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/lapb/lapb.ko 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/ 2023-12-07T09:44:31.862 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 267913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc2.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/ 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 290417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/mac802154.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/ 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/mpls_gso.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26913 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-07T09:44:31.863 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103417 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 112849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 109593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 112585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 111585 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 114465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 411729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-07T09:44:31.864 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7689 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10681 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7697 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10993 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-07T09:44:31.865 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conncount.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 408257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33761 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 118145 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 107233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66641 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-07T09:44:31.866 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10113 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9593 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_log_syslog.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 95353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11857 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_irc.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28929 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_sip.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-07T09:44:31.867 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 615649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_tables.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42561 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30233 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30569 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_log.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10457 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_chain_nat.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_compat.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_ct.ko 2023-12-07T09:44:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9601 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fib.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14185 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_hash.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_limit.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_log.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_masq.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_nat.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13673 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_numgen.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11841 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_osf.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_queue.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_redir.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject.ko 2023-12-07T09:44:31.869 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject_inet.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_socket.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_synproxy.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_tproxy.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/x_tables.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_AUDIT.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CT.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_DSCP.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HL.ko 2023-12-07T09:44:31.870 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13369 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HMARK.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13889 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LED.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11489 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LOG.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NETMAP.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFLOG.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_RATEEST.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14337 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_SECMARK.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-07T09:44:31.871 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17361 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TEE.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TPROXY.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8321 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TRACE.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_addrtype.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_bpf.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cgroup.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cluster.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_comment.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10465 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connbytes.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlabel.ko 2023-12-07T09:44:31.872 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlimit.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13129 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connmark.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_conntrack.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cpu.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dccp.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_devgroup.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8801 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dscp.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ecn.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_esp.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hashlimit.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_helper.ko 2023-12-07T09:44:31.873 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7865 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hl.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipcomp.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_iprange.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11785 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipvs.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16041 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_l2tp.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8001 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_length.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10209 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_limit.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7545 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mac.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mark.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11825 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_multiport.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nat.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nfacct.ko 2023-12-07T09:44:31.874 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_osf.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_owner.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_physdev.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_pkttype.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11985 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_policy.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_quota.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_rateest.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_realm.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_recent.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13329 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_sctp.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_set.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_socket.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9505 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_state.ko 2023-12-07T09:44:31.875 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9473 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_statistic.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8809 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_string.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8553 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpmss.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15777 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpudp.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_time.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_u32.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/ 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13969 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/netlink_diag.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/ 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/nsh.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/ 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 380033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/openvswitch.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-geneve.ko 2023-12-07T09:44:31.876 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-gre.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-vxlan.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/ 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13057 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/af_packet_diag.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/phonet/ 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 110201 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/phonet/phonet.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54721 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/phonet/pn_pep.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/ 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 251481 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 164937 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_rdma.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67377 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_tcp.ko 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rxrpc/ 2023-12-07T09:44:31.877 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 819657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/rxrpc/rxrpc.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/ 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32241 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_csum.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23577 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_gact.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26873 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_ipt.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_mirred.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_nat.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43449 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_pedit.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_police.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_simple.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35297 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_skbedit.ko 2023-12-07T09:44:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_vlan.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_basic.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33961 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_bpf.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19169 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_cgroup.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31401 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_flow.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31769 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_fw.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38425 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_route.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_u32.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7441 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_cmp.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_ipset.ko 2023-12-07T09:44:31.879 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33289 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_meta.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_nbyte.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_text.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7249 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_u32.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_choke.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20849 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_codel.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34633 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_drr.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33609 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31617 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq_codel.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35433 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_gred.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49817 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hfsc.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22089 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hhf.ko 2023-12-07T09:44:31.880 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66393 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_htb.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26073 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_ingress.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30273 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10793 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio_lib.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26065 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_multiq.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36137 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_netem.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27497 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_pie.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_plug.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_prio.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_qfq.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32905 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_red.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26881 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfb.ko 2023-12-07T09:44:31.881 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31353 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfq.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28897 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_tbf.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28105 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_teql.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/ 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 929745 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19033 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp_diag.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/ 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/ 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 336529 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54737 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1520097 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/sunrpc.ko 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/ 2023-12-07T09:44:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 707657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/ 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10025 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/diag.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 862665 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/tipc.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/ 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15729 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/unix_diag.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/ 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 85409 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68049 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 96193 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10705 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17521 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/x25/ 2023-12-07T09:44:31.883 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125177 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/x25/x25.ko 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/ 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22657 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_algo.ko 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20649 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102257 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_user.ko 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/virt/ 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/ 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15537 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/irqbypass.ko 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 640081 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.alias 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 624107 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.alias.bin 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7663 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23428 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin.alias.bin 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9821 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin.bin 2023-12-07T09:44:31.884 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70004 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.builtin.modinfo 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 146313 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.dep 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 232548 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.dep.bin 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 210 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.devname 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72606 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.order 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 879 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.softdep 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 254438 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.symbols 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 309363 2023-12-05 02:18 ./lib/modules/6.6.0-g9471594ae3a4/modules.symbols.bin 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/ 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/share/ 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/share/doc/ 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-12-05 02:18 ./usr/share/doc/linux-image-6.6.0-g9471594ae3a4/ 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 171 2023-12-05 02:18 ./usr/share/doc/linux-image-6.6.0-g9471594ae3a4/changelog.Debian.gz 2023-12-07T09:44:31.885 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 691 2023-12-05 02:18 ./usr/share/doc/linux-image-6.6.0-g9471594ae3a4/copyright 2023-12-07T09:44:31.886 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9471594ae3a4 2023-12-07T09:44:31.886 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g9471594ae3a4 2023-12-07T09:44:31.886 DEBUG:teuthology.orchestra.run.smithi097:> egrep '(submenu|menuentry.*6.6.0-g9471594ae3a4).*{' /boot/grub/grub.cfg 2023-12-07T09:44:31.893 INFO:teuthology.orchestra.run.smithi097.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-07T09:44:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g9471594ae3a4' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g9471594ae3a4-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-07T09:44:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g9471594ae3a4 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g9471594ae3a4-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-07T09:44:31.894 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-07T09:44:31.894 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g9471594ae3a4 2023-12-07T09:44:31.894 DEBUG:teuthology.orchestra.run.smithi097:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-07T09:44:31.939 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi097.front.sepia.ceph.com to complete... 2023-12-07T09:44:32.361 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2023-12-07T09:44:32.362 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-07T09:44:32.394 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2023-12-07T09:44:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-07T09:44:32.642 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-6.6.0-g9471594ae3a4 2023-12-07T09:44:32.929 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-07T09:44:32.934 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-07T09:44:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-07T09:44:32.981 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-07T09:44:33.121 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-07T09:44:33.121 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-07T09:44:33.121 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-07T09:44:33.137 INFO:teuthology.orchestra.run.smithi097.stderr:done 2023-12-07T09:44:47.411 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-07T09:44:47.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:44:47.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:04.274 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-07T09:45:04.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:45:04.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:05.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-07T09:45:14.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:45:14.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:17.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-07T09:45:22.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-07T09:45:29.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:45:29.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:31.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:45:31.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:33.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-07T09:45:34.850 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-07T09:45:46.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:45:46.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:48.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:45:48.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:45:51.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-07T09:46:05.286 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-07T09:46:09.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:46:09.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:46:09.405 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-07T09:46:10.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:46:10.074 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g9471594ae3a4"... 2023-12-07T09:46:10.075 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-12-07T09:46:10.123 INFO:teuthology.orchestra.run.smithi089.stdout:6.6.0-g9471594ae3a4 2023-12-07T09:46:10.123 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9471594ae3a4 vs 6.6.0-g9471594ae3a4 2023-12-07T09:46:10.123 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T09:46:10.123 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-07T09:46:11.125 DEBUG:teuthology.parallel:result is None 2023-12-07T09:46:20.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:46:20.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:46:20.773 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-12-07T09:46:21.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:46:21.468 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g9471594ae3a4"... 2023-12-07T09:46:21.468 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-12-07T09:46:21.518 INFO:teuthology.orchestra.run.smithi097.stdout:6.6.0-g9471594ae3a4 2023-12-07T09:46:21.518 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9471594ae3a4 vs 6.6.0-g9471594ae3a4 2023-12-07T09:46:21.518 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T09:46:21.518 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-07T09:46:22.519 DEBUG:teuthology.parallel:result is None 2023-12-07T09:46:22.519 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-07T09:46:22.541 INFO:teuthology.task.internal:Creating test directory... 2023-12-07T09:46:22.541 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T09:46:22.545 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T09:46:22.554 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-07T09:46:22.566 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-07T09:46:22.600 INFO:teuthology.task.internal:Creating archive directory... 2023-12-07T09:46:22.600 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T09:46:22.604 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T09:46:22.643 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-07T09:46:22.650 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-07T09:46:22.650 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T09:46:22.666 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T09:46:22.755 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T09:46:22.777 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T09:46:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T09:46:22.802 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T09:46:22.804 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-07T09:46:22.811 INFO:teuthology.task.internal:Configuring sudo... 2023-12-07T09:46:22.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T09:46:22.815 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T09:46:22.837 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-07T09:46:22.847 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-07T09:46:22.847 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T09:46:22.878 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T09:46:22.886 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T09:46:22.939 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T09:46:22.991 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:46:22.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T09:46:23.060 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T09:46:23.069 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T09:46:23.123 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:46:23.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T09:46:23.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-12-07T09:46:23.205 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2023-12-07T09:46:23.332 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-07T09:46:23.340 INFO:teuthology.task.internal:Starting timer... 2023-12-07T09:46:23.340 INFO:teuthology.run_tasks:Running task pcp... 2023-12-07T09:46:23.372 INFO:teuthology.run_tasks:Running task selinux... 2023-12-07T09:46:23.402 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2023-12-07T09:46:23.403 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2023-12-07T09:46:23.403 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-07T09:46:23.403 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-07T09:46:23.403 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-07T09:46:23.403 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-07T09:46:23.437 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-07T09:46:23.438 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-07T09:46:23.457 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-07T09:46:23.458 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi097.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-07T09:55:08.077 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com')] 2023-12-07T09:55:08.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:55:08.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:55:08.159 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-07T09:55:08.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T09:55:08.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:55:08.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T09:55:08.354 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-12-07T09:55:08.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-07T09:55:08.473 INFO:teuthology.run_tasks:Running task clock... 2023-12-07T09:55:08.484 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-07T09:55:08.484 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T09:55:08.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T09:55:08.488 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T09:55:08.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Command line: ntpd -gq 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: ---------------------------------------------------- 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: ntp-4 is maintained by Network Time Foundation, 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: corporation. Support and training for ntp-4 are 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: available at https://www.nwtime.org/support 2023-12-07T09:55:08.524 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: ---------------------------------------------------- 2023-12-07T09:55:08.525 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: proto: precision = 0.042 usec (-24) 2023-12-07T09:55:08.525 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: basedate set to 2022-02-04 2023-12-07T09:55:08.525 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: gps base set to 2022-02-06 (week 2196) 2023-12-07T09:55:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-07T09:55:08.526 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-07T09:55:08.526 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: restrict ::: KOD does nothing without LIMITED. 2023-12-07T09:55:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-07T09:55:08.527 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listen and drop on 0 v6wildcard [::]:123 2023-12-07T09:55:08.528 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-07T09:55:08.528 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listen normally on 2 lo 127.0.0.1:123 2023-12-07T09:55:08.528 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2023-12-07T09:55:08.528 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listen normally on 4 lo [::1]:123 2023-12-07T09:55:08.528 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2023-12-07T09:55:08.528 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:08 ntpd[28041]: Listening on routing socket on fd #22 for interface updates 2023-12-07T09:55:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-07T09:55:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Command line: ntpd -gq 2023-12-07T09:55:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: ---------------------------------------------------- 2023-12-07T09:55:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: ntp-4 is maintained by Network Time Foundation, 2023-12-07T09:55:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-07T09:55:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: corporation. Support and training for ntp-4 are 2023-12-07T09:55:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: available at https://www.nwtime.org/support 2023-12-07T09:55:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: ---------------------------------------------------- 2023-12-07T09:55:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: proto: precision = 0.041 usec (-24) 2023-12-07T09:55:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: basedate set to 2022-02-04 2023-12-07T09:55:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: gps base set to 2022-02-06 (week 2196) 2023-12-07T09:55:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-07T09:55:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-07T09:55:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-07T09:55:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: restrict ::: KOD does nothing without LIMITED. 2023-12-07T09:55:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listen and drop on 0 v6wildcard [::]:123 2023-12-07T09:55:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-07T09:55:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listen normally on 2 lo 127.0.0.1:123 2023-12-07T09:55:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2023-12-07T09:55:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listen normally on 4 lo [::1]:123 2023-12-07T09:55:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2023-12-07T09:55:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:08 ntpd[27974]: Listening on routing socket on fd #22 for interface updates 2023-12-07T09:55:09.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:09.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:09.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:09.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:09 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:09.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:09 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:11.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:11.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:11 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:11.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:11.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:11 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:13.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:13.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:13.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:13 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:13.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:13.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:13.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:13.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:13.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:13 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.525 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:15.526 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:15.526 INFO:teuthology.orchestra.run.smithi089.stdout: 7 Dec 09:55:15 ntpd[28041]: ntpd: time slew -0.001684 s 2023-12-07T09:55:15.526 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew -0.001684s 2023-12-07T09:55:15.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-07T09:55:15.527 INFO:teuthology.orchestra.run.smithi089.stderr: 7 Dec 09:55:15 ntpd[28041]: can't open /var/log/ntpstats/loopstats.20231207: Permission denied 2023-12-07T09:55:15.558 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stdout: 7 Dec 09:55:15 ntpd[27974]: ntpd: time slew -0.000065 s 2023-12-07T09:55:15.559 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew -0.000065s 2023-12-07T09:55:15.560 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-07T09:55:15.560 INFO:teuthology.orchestra.run.smithi097.stderr: 7 Dec 09:55:15 ntpd[27974]: can't open /var/log/ntpstats/loopstats.20231207: Permission denied 2023-12-07T09:55:15.632 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2023-12-07T09:55:15.632 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2023-12-07T09:55:15.632 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.632 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.632 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.632 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.664 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2023-12-07T09:55:15.664 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2023-12-07T09:55:15.665 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.665 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.665 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.665 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T09:55:15.667 INFO:teuthology.run_tasks:Running task install... 2023-12-07T09:55:15.696 DEBUG:teuthology.task.install:project ceph 2023-12-07T09:55:15.696 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0'}} 2023-12-07T09:55:15.696 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0'} 2023-12-07T09:55:15.696 INFO:teuthology.task.install:Using flavor: default 2023-12-07T09:55:15.702 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-07T09:55:15.702 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-07T09:55:15.703 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2023-12-07T09:55:15.703 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2023-12-07T09:55:15.809 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-07T09:55:15.815 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-07T09:55:15.861 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-07T09:55:15.862 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2023-12-07T09:55:15.863 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-07T09:55:15.863 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-07T09:55:15.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 2023-12-07T09:55:15.889 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-07T09:55:15.889 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2023-12-07T09:55:15.890 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-07T09:55:15.890 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-07T09:55:15.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 2023-12-07T09:55:16.031 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default/ 2023-12-07T09:55:16.031 INFO:teuthology.task.install.deb:Package version is 19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:55:16.120 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default/ 2023-12-07T09:55:16.121 INFO:teuthology.task.install.deb:Package version is 19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:55:16.157 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:55:16.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-07T09:55:16.178 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2023-12-07T09:55:16.226 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:55:16.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-07T09:55:16.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2023-12-07T09:55:16.386 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-07T09:55:16.403 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-07T09:55:16.419 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy InRelease 2023-12-07T09:55:16.431 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-07T09:55:16.431 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-07T09:55:16.441 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-07T09:55:16.463 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-07T09:55:16.480 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy InRelease 2023-12-07T09:55:16.484 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-07T09:55:16.502 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-07T09:55:16.514 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-07T09:55:16.520 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,397 B] 2023-12-07T09:55:16.524 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-07T09:55:16.545 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,397 B] 2023-12-07T09:55:16.558 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-07T09:55:16.581 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-07T09:55:16.630 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-07T09:55:16.712 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-07T09:55:16.991 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 28.5 kB in 1s (48.7 kB/s) 2023-12-07T09:55:17.042 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 28.5 kB in 1s (49.8 kB/s) 2023-12-07T09:55:17.910 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-12-07T09:55:17.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-18-g3bd0bfa4-1jammy cephadm=19.0.0-18-g3bd0bfa4-1jammy ceph-mds=19.0.0-18-g3bd0bfa4-1jammy ceph-mgr=19.0.0-18-g3bd0bfa4-1jammy ceph-common=19.0.0-18-g3bd0bfa4-1jammy ceph-fuse=19.0.0-18-g3bd0bfa4-1jammy ceph-test=19.0.0-18-g3bd0bfa4-1jammy ceph-volume=19.0.0-18-g3bd0bfa4-1jammy radosgw=19.0.0-18-g3bd0bfa4-1jammy python3-rados=19.0.0-18-g3bd0bfa4-1jammy python3-rgw=19.0.0-18-g3bd0bfa4-1jammy python3-cephfs=19.0.0-18-g3bd0bfa4-1jammy python3-rbd=19.0.0-18-g3bd0bfa4-1jammy libcephfs2=19.0.0-18-g3bd0bfa4-1jammy libcephfs-dev=19.0.0-18-g3bd0bfa4-1jammy librados2=19.0.0-18-g3bd0bfa4-1jammy librbd1=19.0.0-18-g3bd0bfa4-1jammy rbd-fuse=19.0.0-18-g3bd0bfa4-1jammy python3-cephfs=19.0.0-18-g3bd0bfa4-1jammy cephfs-shell=19.0.0-18-g3bd0bfa4-1jammy cephfs-top=19.0.0-18-g3bd0bfa4-1jammy cephfs-mirror=19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:55:17.963 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-12-07T09:55:17.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-18-g3bd0bfa4-1jammy cephadm=19.0.0-18-g3bd0bfa4-1jammy ceph-mds=19.0.0-18-g3bd0bfa4-1jammy ceph-mgr=19.0.0-18-g3bd0bfa4-1jammy ceph-common=19.0.0-18-g3bd0bfa4-1jammy ceph-fuse=19.0.0-18-g3bd0bfa4-1jammy ceph-test=19.0.0-18-g3bd0bfa4-1jammy ceph-volume=19.0.0-18-g3bd0bfa4-1jammy radosgw=19.0.0-18-g3bd0bfa4-1jammy python3-rados=19.0.0-18-g3bd0bfa4-1jammy python3-rgw=19.0.0-18-g3bd0bfa4-1jammy python3-cephfs=19.0.0-18-g3bd0bfa4-1jammy python3-rbd=19.0.0-18-g3bd0bfa4-1jammy libcephfs2=19.0.0-18-g3bd0bfa4-1jammy libcephfs-dev=19.0.0-18-g3bd0bfa4-1jammy librados2=19.0.0-18-g3bd0bfa4-1jammy librbd1=19.0.0-18-g3bd0bfa4-1jammy rbd-fuse=19.0.0-18-g3bd0bfa4-1jammy python3-cephfs=19.0.0-18-g3bd0bfa4-1jammy cephfs-shell=19.0.0-18-g3bd0bfa4-1jammy cephfs-top=19.0.0-18-g3bd0bfa4-1jammy cephfs-mirror=19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:55:17.999 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-12-07T09:55:18.051 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-12-07T09:55:18.164 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-12-07T09:55:18.164 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-12-07T09:55:18.216 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-12-07T09:55:18.217 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-12-07T09:55:18.316 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2023-12-07T09:55:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-07T09:55:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-07T09:55:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-07T09:55:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-07T09:55:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-07T09:55:18.318 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-07T09:55:18.318 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-12-07T09:55:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-07T09:55:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-07T09:55:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-07T09:55:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-12-07T09:55:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-12-07T09:55:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-12-07T09:55:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-07T09:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: socat xmlstarlet 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: python3-watchdog 2023-12-07T09:55:18.321 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2023-12-07T09:55:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2023-12-07T09:55:18.369 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2023-12-07T09:55:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-07T09:55:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-07T09:55:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-07T09:55:18.369 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-07T09:55:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-07T09:55:18.370 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-07T09:55:18.370 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-12-07T09:55:18.370 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-12-07T09:55:18.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout: socat xmlstarlet 2023-12-07T09:55:18.373 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: python3-watchdog 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2023-12-07T09:55:18.374 INFO:teuthology.orchestra.run.smithi089.stdout: btrfs-tools 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-12-07T09:55:18.464 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-07T09:55:18.465 INFO:teuthology.orchestra.run.smithi097.stdout: radosgw rbd-fuse socat xmlstarlet 2023-12-07T09:55:18.515 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-12-07T09:55:18.515 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-07T09:55:18.515 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-07T09:55:18.515 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-07T09:55:18.515 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-07T09:55:18.517 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-07T09:55:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: radosgw rbd-fuse socat xmlstarlet 2023-12-07T09:55:18.534 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 114 newly installed, 0 to remove and 266 not upgraded. 2023-12-07T09:55:18.534 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 186 MB of archives. 2023-12-07T09:55:18.534 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 829 MB of additional disk space will be used. 2023-12-07T09:55:18.534 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-07T09:55:18.554 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-07T09:55:18.566 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-07T09:55:18.584 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 114 newly installed, 0 to remove and 266 not upgraded. 2023-12-07T09:55:18.585 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 186 MB of archives. 2023-12-07T09:55:18.585 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 829 MB of additional disk space will be used. 2023-12-07T09:55:18.585 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-07T09:55:18.602 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-07T09:55:18.610 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-18-g3bd0bfa4-1jammy [3,467 kB] 2023-12-07T09:55:18.612 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-07T09:55:18.612 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-07T09:55:18.643 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-07T09:55:18.647 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-07T09:55:18.654 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-07T09:55:18.663 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-07T09:55:18.674 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-07T09:55:18.677 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-07T09:55:18.688 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-07T09:55:18.726 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-07T09:55:18.728 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-07T09:55:18.730 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-07T09:55:18.735 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-07T09:55:18.735 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-07T09:55:18.738 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-07T09:55:18.738 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-07T09:55:18.744 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-07T09:55:18.745 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-07T09:55:18.745 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-07T09:55:18.746 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-07T09:55:18.746 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-07T09:55:18.752 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-07T09:55:18.758 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-07T09:55:18.759 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-07T09:55:18.762 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-07T09:55:18.762 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-07T09:55:18.762 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-07T09:55:18.763 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-07T09:55:18.773 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-07T09:55:18.773 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-07T09:55:18.774 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-07T09:55:18.775 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-07T09:55:18.777 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-07T09:55:18.779 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-07T09:55:18.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-07T09:55:18.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-07T09:55:18.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-07T09:55:18.782 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-07T09:55:18.783 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-07T09:55:18.786 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-18-g3bd0bfa4-1jammy [3,467 kB] 2023-12-07T09:55:18.795 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-07T09:55:18.796 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-07T09:55:18.797 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-07T09:55:18.797 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-07T09:55:18.812 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-07T09:55:18.815 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-07T09:55:18.815 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-07T09:55:18.816 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-07T09:55:18.816 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-07T09:55:18.817 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-07T09:55:18.817 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-07T09:55:18.817 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-07T09:55:18.817 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-07T09:55:18.818 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-07T09:55:18.819 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-07T09:55:18.819 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-07T09:55:18.819 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-07T09:55:18.820 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-07T09:55:18.820 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-07T09:55:18.829 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-07T09:55:18.830 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-07T09:55:18.831 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-07T09:55:18.831 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-07T09:55:18.845 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-18-g3bd0bfa4-1jammy [3,112 kB] 2023-12-07T09:55:18.846 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-07T09:55:18.846 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-07T09:55:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-07T09:55:18.849 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-07T09:55:18.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-07T09:55:18.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-07T09:55:18.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-07T09:55:18.859 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-07T09:55:18.859 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-07T09:55:18.878 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-07T09:55:18.884 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-07T09:55:18.885 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-07T09:55:18.885 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-07T09:55:18.886 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-07T09:55:18.893 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-07T09:55:18.894 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-07T09:55:18.895 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-07T09:55:18.896 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-07T09:55:18.897 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-07T09:55:18.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-07T09:55:18.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-07T09:55:18.900 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-07T09:55:18.901 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-07T09:55:18.902 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-07T09:55:18.916 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-07T09:55:18.916 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-07T09:55:18.917 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-07T09:55:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-07T09:55:18.918 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-07T09:55:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-07T09:55:18.920 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-07T09:55:18.935 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-07T09:55:18.935 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-07T09:55:18.935 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-07T09:55:18.936 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-07T09:55:18.937 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-07T09:55:18.937 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-07T09:55:18.946 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-07T09:55:18.946 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-07T09:55:18.947 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-18-g3bd0bfa4-1jammy [691 kB] 2023-12-07T09:55:18.950 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-07T09:55:18.963 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-07T09:55:18.964 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-07T09:55:18.965 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-07T09:55:18.970 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-18-g3bd0bfa4-1jammy [356 kB] 2023-12-07T09:55:18.970 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-07T09:55:18.972 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-07T09:55:18.972 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-07T09:55:18.976 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-07T09:55:18.980 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-07T09:55:18.980 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-07T09:55:18.980 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-07T09:55:18.981 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-18-g3bd0bfa4-1jammy [32.8 kB] 2023-12-07T09:55:18.982 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-18-g3bd0bfa4-1jammy [180 kB] 2023-12-07T09:55:18.988 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-18-g3bd0bfa4-1jammy [63.5 kB] 2023-12-07T09:55:18.990 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-18-g3bd0bfa4-1jammy [330 kB] 2023-12-07T09:55:18.996 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-07T09:55:18.998 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-07T09:55:18.998 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-07T09:55:18.999 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-07T09:55:18.999 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-07T09:55:19.001 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-07T09:55:19.001 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-07T09:55:19.002 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-07T09:55:19.003 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-18-g3bd0bfa4-1jammy [6,207 kB] 2023-12-07T09:55:19.005 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-07T09:55:19.006 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-07T09:55:19.006 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-07T09:55:19.013 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-07T09:55:19.014 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-07T09:55:19.026 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-07T09:55:19.028 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-07T09:55:19.029 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-07T09:55:19.051 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-07T09:55:19.051 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-07T09:55:19.060 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-07T09:55:19.061 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-07T09:55:19.061 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-07T09:55:19.062 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-07T09:55:19.063 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-07T09:55:19.063 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-07T09:55:19.067 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-07T09:55:19.081 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-07T09:55:19.083 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-07T09:55:19.083 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-07T09:55:19.103 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-07T09:55:19.106 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-07T09:55:19.106 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-07T09:55:19.111 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-07T09:55:19.114 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-07T09:55:19.115 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-07T09:55:19.115 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-07T09:55:19.125 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-07T09:55:19.127 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-07T09:55:19.128 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-07T09:55:19.144 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-07T09:55:19.145 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-07T09:55:19.145 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-07T09:55:19.147 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-07T09:55:19.148 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-07T09:55:19.219 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-18-g3bd0bfa4-1jammy [112 kB] 2023-12-07T09:55:19.223 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-18-g3bd0bfa4-1jammy [439 kB] 2023-12-07T09:55:19.239 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-18-g3bd0bfa4-1jammy [22.5 MB] 2023-12-07T09:55:20.034 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-18-g3bd0bfa4-1jammy [6,901 kB] 2023-12-07T09:55:20.279 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-18-g3bd0bfa4-1jammy [239 kB] 2023-12-07T09:55:20.284 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-18-g3bd0bfa4-1jammy [124 kB] 2023-12-07T09:55:20.291 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-18-g3bd0bfa4-1jammy [1,495 kB] 2023-12-07T09:55:20.350 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-18-g3bd0bfa4-1jammy [9,954 kB] 2023-12-07T09:55:20.565 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-18-g3bd0bfa4-1jammy [3,112 kB] 2023-12-07T09:55:20.861 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-18-g3bd0bfa4-1jammy [31.9 MB] 2023-12-07T09:55:21.320 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-18-g3bd0bfa4-1jammy [691 kB] 2023-12-07T09:55:21.417 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-18-g3bd0bfa4-1jammy [356 kB] 2023-12-07T09:55:21.473 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-18-g3bd0bfa4-1jammy [32.8 kB] 2023-12-07T09:55:21.476 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-18-g3bd0bfa4-1jammy [180 kB] 2023-12-07T09:55:21.502 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-18-g3bd0bfa4-1jammy [63.5 kB] 2023-12-07T09:55:21.520 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-18-g3bd0bfa4-1jammy [330 kB] 2023-12-07T09:55:21.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-18-g3bd0bfa4-1jammy [6,207 kB] 2023-12-07T09:55:22.268 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-18-g3bd0bfa4-1jammy [112 kB] 2023-12-07T09:55:22.275 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-18-g3bd0bfa4-1jammy [439 kB] 2023-12-07T09:55:22.320 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-18-g3bd0bfa4-1jammy [22.5 MB] 2023-12-07T09:55:22.401 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-18-g3bd0bfa4-1jammy [14.0 kB] 2023-12-07T09:55:22.401 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-18-g3bd0bfa4-1jammy [839 kB] 2023-12-07T09:55:22.435 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-18-g3bd0bfa4-1jammy [2,145 kB] 2023-12-07T09:55:22.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-18-g3bd0bfa4-1jammy [831 kB] 2023-12-07T09:55:22.608 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-18-g3bd0bfa4-1jammy [139 kB] 2023-12-07T09:55:22.614 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-18-g3bd0bfa4-1jammy [1,904 kB] 2023-12-07T09:55:22.727 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-18-g3bd0bfa4-1jammy [8,625 kB] 2023-12-07T09:55:23.232 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-18-g3bd0bfa4-1jammy [14.2 kB] 2023-12-07T09:55:23.232 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-18-g3bd0bfa4-1jammy [48.7 MB] 2023-12-07T09:55:25.820 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-18-g3bd0bfa4-1jammy [6,901 kB] 2023-12-07T09:55:26.821 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-18-g3bd0bfa4-1jammy [120 kB] 2023-12-07T09:55:26.822 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-18-g3bd0bfa4-1jammy [226 kB] 2023-12-07T09:55:26.824 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-18-g3bd0bfa4-1jammy [34.0 kB] 2023-12-07T09:55:26.825 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-18-g3bd0bfa4-1jammy [23.4 kB] 2023-12-07T09:55:26.826 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-18-g3bd0bfa4-1jammy [38.3 kB] 2023-12-07T09:55:26.828 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-18-g3bd0bfa4-1jammy [12.3 MB] 2023-12-07T09:55:27.718 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-18-g3bd0bfa4-1jammy [239 kB] 2023-12-07T09:55:27.751 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-18-g3bd0bfa4-1jammy [124 kB] 2023-12-07T09:55:27.812 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-18-g3bd0bfa4-1jammy [1,495 kB] 2023-12-07T09:55:28.273 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-18-g3bd0bfa4-1jammy [91.1 kB] 2023-12-07T09:55:28.308 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-18-g3bd0bfa4-1jammy [9,954 kB] 2023-12-07T09:55:28.845 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 186 MB in 10s (18.9 MB/s) 2023-12-07T09:55:28.990 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-07T09:55:29.058 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-07T09:55:29.062 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-07T09:55:29.097 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-07T09:55:29.375 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-07T09:55:29.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-07T09:55:29.424 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-07T09:55:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cmd2. 2023-12-07T09:55:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-07T09:55:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-07T09:55:30.172 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-07T09:55:30.185 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-07T09:55:30.264 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-07T09:55:30.559 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-07T09:55:30.573 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-07T09:55:30.617 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-07T09:55:30.820 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-18-g3bd0bfa4-1jammy [31.9 MB] 2023-12-07T09:55:30.979 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-07T09:55:30.993 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-07T09:55:31.037 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-07T09:55:31.757 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-07T09:55:31.773 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-07T09:55:31.824 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:55:32.219 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-07T09:55:32.233 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-07T09:55:32.268 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:55:32.614 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-07T09:55:32.628 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-07T09:55:32.672 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:55:33.041 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-07T09:55:33.056 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-07T09:55:33.099 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-07T09:55:33.411 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2023-12-07T09:55:33.425 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-librados2_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:33.469 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:33.847 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2023-12-07T09:55:33.861 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-librbd1_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:33.905 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:34.333 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2023-12-07T09:55:34.347 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:34.391 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:34.660 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2023-12-07T09:55:34.674 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-rados_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:34.718 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:35.005 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-07T09:55:35.019 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:55:35.055 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:35.315 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2023-12-07T09:55:35.330 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:35.374 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:35.676 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-07T09:55:35.691 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:55:35.734 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:36.056 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2023-12-07T09:55:36.071 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-07T09:55:36.114 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-07T09:55:36.450 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2023-12-07T09:55:36.465 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:36.509 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:36.870 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-07T09:55:36.884 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-07T09:55:36.928 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-07T09:55:37.256 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2023-12-07T09:55:37.271 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-librgw2_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:37.331 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:37.808 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2023-12-07T09:55:37.823 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-python3-rgw_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:37.875 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:38.203 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-07T09:55:38.217 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-07T09:55:38.261 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-07T09:55:38.606 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2023-12-07T09:55:38.620 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-libradosstriper1_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:38.664 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:39.100 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2023-12-07T09:55:39.115 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-ceph-common_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:39.158 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:40.239 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2023-12-07T09:55:40.254 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-ceph-base_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:40.298 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:40.394 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-18-g3bd0bfa4-1jammy [14.0 kB] 2023-12-07T09:55:40.394 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-18-g3bd0bfa4-1jammy [839 kB] 2023-12-07T09:55:40.662 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-18-g3bd0bfa4-1jammy [2,145 kB] 2023-12-07T09:55:40.960 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-07T09:55:40.973 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-07T09:55:41.018 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-07T09:55:41.304 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2023-12-07T09:55:41.318 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-07T09:55:41.362 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-07T09:55:41.408 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-18-g3bd0bfa4-1jammy [831 kB] 2023-12-07T09:55:41.726 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-18-g3bd0bfa4-1jammy [139 kB] 2023-12-07T09:55:41.755 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-18-g3bd0bfa4-1jammy [1,904 kB] 2023-12-07T09:55:41.874 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-07T09:55:41.888 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-07T09:55:41.932 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-07T09:55:42.209 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-07T09:55:42.224 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-07T09:55:42.259 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-07T09:55:42.455 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-18-g3bd0bfa4-1jammy [8,625 kB] 2023-12-07T09:55:42.529 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-07T09:55:42.543 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-07T09:55:42.587 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-07T09:55:42.906 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2023-12-07T09:55:42.921 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-12-07T09:55:42.965 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-07T09:55:43.250 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2023-12-07T09:55:43.265 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-12-07T09:55:43.309 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-07T09:55:43.586 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-07T09:55:43.601 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-07T09:55:43.636 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-07T09:55:43.948 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-07T09:55:43.962 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-07T09:55:44.006 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-07T09:55:44.351 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2023-12-07T09:55:44.366 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-12-07T09:55:44.409 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-07T09:55:44.477 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-18-g3bd0bfa4-1jammy [14.2 kB] 2023-12-07T09:55:44.477 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-18-g3bd0bfa4-1jammy [48.7 MB] 2023-12-07T09:55:44.720 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2023-12-07T09:55:44.736 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-12-07T09:55:44.778 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-07T09:55:45.065 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-07T09:55:45.080 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-07T09:55:45.123 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-07T09:55:45.425 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2023-12-07T09:55:45.440 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-07T09:55:45.484 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-07T09:55:45.812 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-07T09:55:45.827 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-07T09:55:45.893 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-07T09:55:46.206 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-07T09:55:46.221 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-07T09:55:46.265 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-07T09:55:46.542 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2023-12-07T09:55:46.557 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-07T09:55:46.700 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-07T09:55:47.053 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2023-12-07T09:55:47.068 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-07T09:55:47.115 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-07T09:55:47.415 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2023-12-07T09:55:47.430 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-07T09:55:47.473 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-07T09:55:47.776 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2023-12-07T09:55:47.791 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-07T09:55:47.834 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-07T09:55:48.128 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-07T09:55:48.143 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-07T09:55:48.187 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-07T09:55:48.498 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-07T09:55:48.513 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-07T09:55:48.556 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-07T09:55:48.843 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2023-12-07T09:55:48.858 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-12-07T09:55:48.900 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-07T09:55:49.245 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2023-12-07T09:55:49.260 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-07T09:55:49.295 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-07T09:55:49.650 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2023-12-07T09:55:49.665 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-12-07T09:55:49.699 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-07T09:55:49.994 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2023-12-07T09:55:50.008 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-12-07T09:55:50.043 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-18-g3bd0bfa4-1jammy [120 kB] 2023-12-07T09:55:50.044 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-18-g3bd0bfa4-1jammy [226 kB] 2023-12-07T09:55:50.050 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-18-g3bd0bfa4-1jammy [34.0 kB] 2023-12-07T09:55:50.050 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-18-g3bd0bfa4-1jammy [23.4 kB] 2023-12-07T09:55:50.052 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-07T09:55:50.059 INFO:teuthology.orchestra.run.smithi089.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-18-g3bd0bfa4-1jammy [38.3 kB] 2023-12-07T09:55:50.059 INFO:teuthology.orchestra.run.smithi089.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-18-g3bd0bfa4-1jammy [12.3 MB] 2023-12-07T09:55:50.388 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2023-12-07T09:55:50.403 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-07T09:55:50.447 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-07T09:55:50.766 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2023-12-07T09:55:50.781 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-07T09:55:50.824 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-07T09:55:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654-r2/3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-18-g3bd0bfa4-1jammy [91.1 kB] 2023-12-07T09:55:51.135 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-07T09:55:51.150 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-07T09:55:51.227 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-07T09:55:51.685 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 186 MB in 32s (5,722 kB/s) 2023-12-07T09:55:52.180 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-07T09:55:52.195 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:55:52.255 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:52.273 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-07T09:55:52.348 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-07T09:55:52.352 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-07T09:55:52.388 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-07T09:55:52.635 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-07T09:55:52.648 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:52.682 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-07T09:55:52.693 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:52.697 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-07T09:55:52.741 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-07T09:55:52.987 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-07T09:55:53.001 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-07T09:55:53.045 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-07T09:55:53.085 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cmd2. 2023-12-07T09:55:53.100 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-07T09:55:53.144 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-07T09:55:53.349 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2023-12-07T09:55:53.363 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-07T09:55:53.398 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-07T09:55:53.488 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-07T09:55:53.503 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-07T09:55:53.588 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-07T09:55:53.735 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2023-12-07T09:55:53.749 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-ceph-mgr_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:53.793 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:53.933 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-07T09:55:53.948 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-07T09:55:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-07T09:55:54.171 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2023-12-07T09:55:54.185 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-ceph-mon_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:54.229 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:54.311 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-07T09:55:54.326 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-07T09:55:54.403 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-07T09:55:54.848 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-07T09:55:54.863 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-07T09:55:54.915 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:55:54.999 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2023-12-07T09:55:55.014 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-ceph-osd_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:55.057 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:55.284 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-07T09:55:55.299 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-07T09:55:55.343 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:55:55.672 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-07T09:55:55.686 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-07T09:55:55.729 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:55:56.257 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-07T09:55:56.261 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2023-12-07T09:55:56.272 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-07T09:55:56.275 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-ceph_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:56.316 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-07T09:55:56.319 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:56.663 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2023-12-07T09:55:56.669 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librados2. 2023-12-07T09:55:56.678 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-ceph-fuse_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:56.684 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-librados2_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:56.721 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:56.727 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:57.094 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2023-12-07T09:55:57.106 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-ceph-mds_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:57.121 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librbd1. 2023-12-07T09:55:57.136 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-librbd1_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:57.149 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:57.607 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2023-12-07T09:55:57.622 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:57.666 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:57.711 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2023-12-07T09:55:57.726 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-cephadm_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:57.769 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:57.952 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2023-12-07T09:55:57.967 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-python3-rados_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:58.010 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:58.080 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-07T09:55:58.095 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-07T09:55:58.138 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-07T09:55:58.346 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-07T09:55:58.361 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:55:58.404 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:58.449 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-07T09:55:58.464 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-07T09:55:58.507 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-07T09:55:58.633 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2023-12-07T09:55:58.646 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:58.690 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:59.034 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-07T09:55:59.049 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:55:59.093 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:59.404 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-prettytable. 2023-12-07T09:55:59.420 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-07T09:55:59.462 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-07T09:55:59.471 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2023-12-07T09:55:59.484 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-07T09:55:59.529 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-07T09:55:59.748 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rbd. 2023-12-07T09:55:59.763 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:55:59.806 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rbd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:55:59.841 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2023-12-07T09:55:59.854 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-07T09:55:59.890 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-07T09:56:00.118 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-07T09:56:00.131 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-07T09:56:00.176 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-07T09:56:00.193 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-07T09:56:00.207 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:00.243 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:00.462 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2023-12-07T09:56:00.477 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-librgw2_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:00.512 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:00.571 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-07T09:56:00.585 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-12-07T09:56:00.629 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-07T09:56:00.941 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2023-12-07T09:56:00.955 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-07T09:56:00.981 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rgw. 2023-12-07T09:56:00.991 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-07T09:56:00.996 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-python3-rgw_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:01.065 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:01.302 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-07T09:56:01.316 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:01.352 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:01.392 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-07T09:56:01.407 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-07T09:56:01.451 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-07T09:56:01.703 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2023-12-07T09:56:01.714 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-07T09:56:01.718 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-libradosstriper1_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:01.728 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-07T09:56:01.772 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-07T09:56:01.778 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:02.173 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2023-12-07T09:56:02.188 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-ceph-common_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:02.231 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:02.276 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2023-12-07T09:56:02.290 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-07T09:56:02.327 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-07T09:56:02.821 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-07T09:56:02.835 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-07T09:56:02.879 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-07T09:56:03.240 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2023-12-07T09:56:03.255 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-07T09:56:03.298 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-07T09:56:03.379 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2023-12-07T09:56:03.394 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-ceph-base_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:03.447 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:03.898 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-07T09:56:03.912 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:03.965 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:04.141 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-07T09:56:04.155 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-07T09:56:04.200 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-07T09:56:04.470 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cheroot. 2023-12-07T09:56:04.483 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-07T09:56:04.528 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-07T09:56:04.856 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-07T09:56:04.869 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-07T09:56:04.905 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-07T09:56:04.918 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2023-12-07T09:56:04.933 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-12-07T09:56:04.976 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-07T09:56:05.208 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-07T09:56:05.222 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-07T09:56:05.283 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-07T09:56:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-07T09:56:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-07T09:56:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-07T09:56:05.594 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-07T09:56:05.609 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-07T09:56:05.653 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-07T09:56:05.698 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-07T09:56:05.714 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-07T09:56:05.765 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-07T09:56:05.931 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempora. 2023-12-07T09:56:05.945 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-12-07T09:56:05.981 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-07T09:56:06.084 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2023-12-07T09:56:06.100 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-12-07T09:56:06.134 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-07T09:56:06.408 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-portend. 2023-12-07T09:56:06.412 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2023-12-07T09:56:06.423 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-12-07T09:56:06.428 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-12-07T09:56:06.458 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-07T09:56:06.471 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-07T09:56:06.745 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-07T09:56:06.760 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-07T09:56:06.803 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-07T09:56:06.867 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-07T09:56:06.883 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-07T09:56:06.925 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-07T09:56:07.131 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-07T09:56:07.146 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-07T09:56:07.189 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-07T09:56:07.237 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2023-12-07T09:56:07.252 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-12-07T09:56:07.295 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-07T09:56:07.542 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-natsort. 2023-12-07T09:56:07.557 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-12-07T09:56:07.601 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-07T09:56:07.657 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-07T09:56:07.674 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-07T09:56:07.723 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-07T09:56:08.005 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-logutils. 2023-12-07T09:56:08.019 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-12-07T09:56:08.063 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-07T09:56:08.307 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-07T09:56:08.322 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-07T09:56:08.357 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-07T09:56:08.396 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-07T09:56:08.410 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:08.454 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-mako. 2023-12-07T09:56:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-07T09:56:08.743 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-07T09:56:08.756 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-07T09:56:08.770 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-07T09:56:08.815 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-07T09:56:09.080 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-07T09:56:09.095 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-07T09:56:09.138 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-07T09:56:09.159 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-07T09:56:09.173 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-07T09:56:09.217 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-07T09:56:09.466 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-07T09:56:09.470 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2023-12-07T09:56:09.480 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-07T09:56:09.483 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-07T09:56:09.524 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-07T09:56:09.528 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-07T09:56:09.789 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2023-12-07T09:56:09.793 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webob. 2023-12-07T09:56:09.802 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-07T09:56:09.808 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-07T09:56:09.843 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-07T09:56:09.847 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-07T09:56:10.142 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2023-12-07T09:56:10.156 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-07T09:56:10.192 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-07T09:56:10.213 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-waitress. 2023-12-07T09:56:10.228 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-07T09:56:10.274 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-07T09:56:10.563 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2023-12-07T09:56:10.577 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-ceph-test_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:10.583 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempita. 2023-12-07T09:56:10.597 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-07T09:56:10.621 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:10.641 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-07T09:56:10.961 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-paste. 2023-12-07T09:56:10.976 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-07T09:56:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-07T09:56:11.322 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-07T09:56:11.337 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-07T09:56:11.380 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-07T09:56:11.708 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-07T09:56:11.723 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-07T09:56:11.766 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-07T09:56:12.052 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webtest. 2023-12-07T09:56:12.067 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-12-07T09:56:12.110 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-07T09:56:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pecan. 2023-12-07T09:56:12.445 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-07T09:56:12.480 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-07T09:56:12.617 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2023-12-07T09:56:12.632 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-ceph-volume_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:12.736 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:12.810 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-certifi. 2023-12-07T09:56:12.824 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-12-07T09:56:12.860 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-07T09:56:13.207 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-idna. 2023-12-07T09:56:13.219 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-12-07T09:56:13.229 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-07T09:56:13.244 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-cephfs-mirror_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:13.263 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-07T09:56:13.287 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-mirror (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:13.566 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-urllib3. 2023-12-07T09:56:13.573 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-colorama. 2023-12-07T09:56:13.581 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-07T09:56:13.589 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-12-07T09:56:13.623 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-07T09:56:13.624 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-07T09:56:13.876 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-shell. 2023-12-07T09:56:13.891 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-cephfs-shell_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:13.926 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-shell (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:13.969 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests. 2023-12-07T09:56:13.983 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-07T09:56:14.027 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-07T09:56:14.170 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-top. 2023-12-07T09:56:14.185 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-cephfs-top_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:14.228 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-top (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:14.346 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-07T09:56:14.361 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-07T09:56:14.430 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-07T09:56:14.481 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-07T09:56:14.495 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-libcephfs-dev_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:14.539 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:14.716 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-07T09:56:14.731 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:14.774 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-modules-core (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:14.894 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2023-12-07T09:56:14.909 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-07T09:56:14.944 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-07T09:56:15.171 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-07T09:56:15.185 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:15.221 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:15.257 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-07T09:56:15.272 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-07T09:56:15.315 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-07T09:56:15.507 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-07T09:56:15.522 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-07T09:56:15.565 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-07T09:56:15.710 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-07T09:56:15.724 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-07T09:56:15.760 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-07T09:56:15.901 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-openssl. 2023-12-07T09:56:15.916 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-07T09:56:15.959 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-07T09:56:16.087 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2023-12-07T09:56:16.101 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-12-07T09:56:16.145 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-07T09:56:16.304 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2023-12-07T09:56:16.319 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-ceph-mgr_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:16.369 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:16.448 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2023-12-07T09:56:16.462 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-07T09:56:16.507 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-07T09:56:16.809 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2023-12-07T09:56:16.824 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-07T09:56:16.841 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2023-12-07T09:56:16.855 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-ceph-mon_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:16.890 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:16.901 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-07T09:56:17.262 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2023-12-07T09:56:17.277 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-12-07T09:56:17.312 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-07T09:56:17.624 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2023-12-07T09:56:17.638 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-07T09:56:17.682 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-07T09:56:17.736 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2023-12-07T09:56:17.750 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-ceph-osd_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:17.794 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:18.144 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-07T09:56:18.158 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-07T09:56:18.194 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-07T09:56:18.496 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2023-12-07T09:56:18.510 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-12-07T09:56:18.554 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-07T09:56:18.857 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2023-12-07T09:56:18.871 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-07T09:56:18.915 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-07T09:56:19.008 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2023-12-07T09:56:19.023 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-ceph_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:19.057 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:19.271 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2023-12-07T09:56:19.283 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-07T09:56:19.327 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-07T09:56:19.377 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2023-12-07T09:56:19.392 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-ceph-fuse_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:19.435 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:19.588 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-07T09:56:19.602 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-07T09:56:19.646 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-07T09:56:19.755 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2023-12-07T09:56:19.770 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-ceph-mds_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:19.805 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:20.183 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephadm. 2023-12-07T09:56:20.198 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-cephadm_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:20.241 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:20.400 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2023-12-07T09:56:20.414 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-radosgw_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:20.458 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:20.536 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-07T09:56:20.551 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-07T09:56:20.594 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-07T09:56:20.939 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-07T09:56:20.954 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-07T09:56:20.989 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-07T09:56:21.053 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2023-12-07T09:56:21.068 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-rbd-fuse_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:21.144 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:21.430 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-07T09:56:21.699 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-07T09:56:21.817 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-07T09:56:22.063 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-07T09:56:22.277 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-babel. 2023-12-07T09:56:22.291 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-07T09:56:22.352 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-07T09:56:22.488 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-07T09:56:22.689 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jinja2. 2023-12-07T09:56:22.702 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-07T09:56:22.747 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-07T09:56:23.117 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-07T09:56:23.124 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-07T09:56:23.131 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:23.137 INFO:teuthology.orchestra.run.smithi097.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-07T09:56:23.166 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:23.385 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:23.487 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-07T09:56:23.502 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-12-07T09:56:23.537 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-07T09:56:23.839 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-routes. 2023-12-07T09:56:23.855 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-07T09:56:23.898 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-07T09:56:23.938 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2023-12-07T09:56:24.091 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-07T09:56:24.184 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-07T09:56:24.200 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:24.242 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:24.367 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-07T09:56:24.627 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-07T09:56:24.679 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-07T09:56:24.693 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-07T09:56:24.738 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-07T09:56:24.753 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-07T09:56:25.012 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-07T09:56:25.241 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-joblib. 2023-12-07T09:56:25.255 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-07T09:56:25.272 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-07T09:56:25.301 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-07T09:56:25.414 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-07T09:56:25.653 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-07T09:56:25.667 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-07T09:56:25.711 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-07T09:56:25.716 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-07T09:56:26.039 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn. 2023-12-07T09:56:26.055 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-07T09:56:26.068 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-07T09:56:26.097 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-07T09:56:26.336 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-07T09:56:26.604 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-07T09:56:26.739 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-07T09:56:26.754 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:26.798 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:26.896 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-07T09:56:27.148 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-07T09:56:27.423 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-07T09:56:27.716 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:27.768 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cachetools. 2023-12-07T09:56:27.783 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-12-07T09:56:27.826 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-07T09:56:27.984 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-07T09:56:28.112 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-07T09:56:28.118 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-07T09:56:28.128 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-07T09:56:28.170 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-07T09:56:28.386 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-07T09:56:28.524 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-07T09:56:28.539 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-07T09:56:28.582 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-07T09:56:28.646 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-07T09:56:28.746 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-07T09:56:28.876 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rsa. 2023-12-07T09:56:28.892 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-12-07T09:56:28.934 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-07T09:56:29.098 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-07T09:56:29.198 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-07T09:56:29.263 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-google-auth. 2023-12-07T09:56:29.278 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-12-07T09:56:29.312 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-07T09:56:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-07T09:56:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-07T09:56:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-07T09:56:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-07T09:56:29.792 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-07T09:56:30.060 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-07T09:56:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-websocket. 2023-12-07T09:56:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-12-07T09:56:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-07T09:56:30.499 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-07T09:56:30.514 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-07T09:56:30.557 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-07T09:56:30.754 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-07T09:56:31.005 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-07T09:56:31.131 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-07T09:56:31.204 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-07T09:56:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:31.240 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-07T09:56:31.262 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:31.549 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-07T09:56:31.606 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-07T09:56:31.621 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-07T09:56:31.656 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-07T09:56:31.950 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-07T09:56:32.218 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-07T09:56:32.227 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-07T09:56:32.242 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-07T09:56:32.276 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-07T09:56:32.537 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2023-12-07T09:56:32.552 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-07T09:56:32.595 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-07T09:56:32.620 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-07T09:56:32.873 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2023-12-07T09:56:32.889 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-07T09:56:32.921 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-07T09:56:32.931 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-07T09:56:33.226 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2023-12-07T09:56:33.230 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-07T09:56:33.242 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-07T09:56:33.276 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-07T09:56:33.573 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-07T09:56:33.655 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2023-12-07T09:56:33.670 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-ceph-test_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:33.713 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:33.833 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-07T09:56:33.983 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:34.293 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1) ... 2023-12-07T09:56:34.636 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-07T09:56:35.542 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-volume. 2023-12-07T09:56:35.558 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-ceph-volume_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:35.617 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-volume (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:35.866 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:56:35.988 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-07T09:56:36.004 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-cephfs-mirror_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:36.025 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-07T09:56:36.046 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-mirror (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:36.310 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-07T09:56:36.400 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-colorama. 2023-12-07T09:56:36.415 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-12-07T09:56:36.428 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-07T09:56:36.458 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-07T09:56:36.545 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-07T09:56:36.694 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-shell. 2023-12-07T09:56:36.709 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-cephfs-shell_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:36.743 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-shell (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:36.830 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-07T09:56:36.946 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-top. 2023-12-07T09:56:36.962 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-cephfs-top_19.0.0-18-g3bd0bfa4-1jammy_all.deb ... 2023-12-07T09:56:37.004 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-top (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:37.098 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-07T09:56:37.282 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-07T09:56:37.298 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-libcephfs-dev_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:37.341 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:37.357 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:56:37.483 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-07T09:56:37.702 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2023-12-07T09:56:37.717 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-07T09:56:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-07T09:56:37.801 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-07T09:56:38.094 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-07T09:56:38.107 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-07T09:56:38.122 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-07T09:56:38.165 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-07T09:56:38.362 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-07T09:56:38.609 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-07T09:56:38.621 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-07T09:56:38.624 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-07T09:56:38.668 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-07T09:56:38.864 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-07T09:56:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastescript. 2023-12-07T09:56:38.987 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-12-07T09:56:39.029 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-07T09:56:39.165 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-07T09:56:39.291 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-07T09:56:39.382 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pluggy. 2023-12-07T09:56:39.398 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-07T09:56:39.441 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-07T09:56:39.583 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-07T09:56:39.718 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-07T09:56:39.768 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-psutil. 2023-12-07T09:56:39.784 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-07T09:56:39.826 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-07T09:56:40.011 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-07T09:56:40.180 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-py. 2023-12-07T09:56:40.196 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-12-07T09:56:40.237 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-07T09:56:40.320 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-07T09:56:40.566 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pygments. 2023-12-07T09:56:40.579 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-07T09:56:40.581 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-07T09:56:40.624 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-07T09:56:40.946 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-07T09:56:41.070 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-07T09:56:41.084 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-07T09:56:41.119 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-07T09:56:41.191 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-07T09:56:41.341 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-07T09:56:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-toml. 2023-12-07T09:56:41.396 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-12-07T09:56:41.439 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-07T09:56:41.735 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-07T09:56:41.767 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pytest. 2023-12-07T09:56:41.783 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-07T09:56:41.825 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-07T09:56:42.002 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-07T09:56:42.178 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplejson. 2023-12-07T09:56:42.194 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-07T09:56:42.262 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:56:42.270 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-07T09:56:42.413 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-07T09:56:42.539 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-07T09:56:42.555 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-07T09:56:42.589 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-07T09:56:42.723 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-07T09:56:43.031 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-07T09:56:43.293 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2023-12-07T09:56:43.308 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../112-radosgw_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:43.316 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-07T09:56:43.352 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:43.467 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-07T09:56:43.743 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-07T09:56:43.963 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2023-12-07T09:56:43.977 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../113-rbd-fuse_19.0.0-18-g3bd0bfa4-1jammy_amd64.deb ... 2023-12-07T09:56:44.020 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-07T09:56:44.020 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:44.287 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-07T09:56:44.313 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-07T09:56:44.568 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-07T09:56:44.672 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-07T09:56:44.693 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-07T09:56:44.954 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-07T09:56:44.964 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-07T09:56:45.317 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-07T09:56:45.363 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-07T09:56:45.442 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:45.602 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:45.728 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:45.914 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:45.930 INFO:teuthology.orchestra.run.smithi089.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-07T09:56:45.988 INFO:teuthology.orchestra.run.smithi089.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-07T09:56:46.025 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:46.037 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:46.149 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-07T09:56:46.434 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:46.586 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:46.599 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user cephadm....done 2023-12-07T09:56:46.711 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:46.785 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-07T09:56:46.920 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-07T09:56:46.920 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-07T09:56:47.061 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-07T09:56:47.320 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-07T09:56:47.471 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-07T09:56:47.614 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:47.730 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-07T09:56:47.848 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:48.007 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-07T09:56:48.116 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-07T09:56:48.183 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-top (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:48.309 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-07T09:56:48.443 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-07T09:56:48.812 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-07T09:56:49.105 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-07T09:56:49.372 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-07T09:56:49.588 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:49.674 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-07T09:56:49.739 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:49.848 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:49.925 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-07T09:56:49.974 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:50.100 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-shell (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:50.226 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:50.284 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-07T09:56:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:50.804 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2023-12-07T09:56:50.853 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-07T09:56:50.979 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-07T09:56:51.180 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2023-12-07T09:56:51.247 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-07T09:56:51.366 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2023-12-07T09:56:51.382 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-07T09:56:51.523 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-07T09:56:51.540 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-07T09:56:51.665 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-07T09:56:51.928 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-07T09:56:52.025 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-07T09:56:52.151 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-07T09:56:52.435 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-07T09:56:52.619 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-mirror (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:52.711 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-07T09:56:52.828 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-07T09:56:52.828 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-07T09:56:53.029 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-07T09:56:53.453 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:53.562 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:53.723 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-07T09:56:53.982 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-07T09:56:54.086 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-07T09:56:54.086 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-07T09:56:54.117 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-07T09:56:54.226 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-07T09:56:54.552 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-07T09:56:54.731 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:54.953 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-07T09:56:55.078 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-07T09:56:55.221 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-07T09:56:55.615 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-07T09:56:55.733 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:55.916 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-07T09:56:55.955 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-07T09:56:55.955 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-07T09:56:56.225 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-07T09:56:56.593 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:56.610 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-07T09:56:56.805 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-07T09:56:56.805 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-07T09:56:56.869 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-07T09:56:57.029 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:57.338 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-idna (3.3-1) ... 2023-12-07T09:56:57.444 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:57.681 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-07T09:56:57.773 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-07T09:56:57.773 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-07T09:56:58.404 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:58.530 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:58.665 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:58.857 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-07T09:56:58.857 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-07T09:56:58.929 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:56:59.063 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-07T09:56:59.343 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-07T09:56:59.449 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-07T09:56:59.483 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:59.558 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-07T09:56:59.625 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:59.768 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:56:59.868 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-07T09:56:59.911 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:00.161 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-07T09:57:00.281 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-07T09:57:00.411 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:57:00.538 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-07T09:57:00.855 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-07T09:57:01.115 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-07T09:57:01.380 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-07T09:57:01.441 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-07T09:57:01.709 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-07T09:57:01.860 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-07T09:57:01.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-07T09:57:01.940 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-12-07T09:57:01.968 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-07T09:57:02.105 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-12-07T09:57:02.106 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-12-07T09:57:02.228 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-07T09:57:02.257 INFO:teuthology.orchestra.run.smithi097.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-07T09:57:02.257 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-07T09:57:02.257 INFO:teuthology.orchestra.run.smithi097.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-07T09:57:02.257 INFO:teuthology.orchestra.run.smithi097.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-07T09:57:02.257 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-07T09:57:02.258 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-07T09:57:02.260 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-12-07T09:57:02.260 INFO:teuthology.orchestra.run.smithi097.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-07T09:57:02.260 INFO:teuthology.orchestra.run.smithi097.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-07T09:57:02.260 INFO:teuthology.orchestra.run.smithi097.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-07T09:57:02.261 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-07T09:57:02.261 INFO:teuthology.orchestra.run.smithi097.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-07T09:57:02.261 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-12-07T09:57:02.261 INFO:teuthology.orchestra.run.smithi097.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-07T09:57:02.261 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-07T09:57:02.261 INFO:teuthology.orchestra.run.smithi097.stdout: libengine-pkcs11-openssl 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-07T09:57:02.311 INFO:teuthology.orchestra.run.smithi097.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-07T09:57:02.312 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2023-12-07T09:57:02.312 INFO:teuthology.orchestra.run.smithi097.stdout: libssl3 2023-12-07T09:57:02.353 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-07T09:57:02.516 INFO:teuthology.orchestra.run.smithi097.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2023-12-07T09:57:02.516 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 54.6 MB of archives. 2023-12-07T09:57:02.516 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-07T09:57:02.516 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-07T09:57:02.655 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-07T09:57:03.009 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-07T09:57:03.123 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-07T09:57:03.265 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-07T09:57:03.300 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-07T09:57:03.302 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-07T09:57:03.307 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-07T09:57:03.311 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-07T09:57:03.311 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-07T09:57:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-07T09:57:03.317 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-07T09:57:03.424 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-07T09:57:03.482 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-07T09:57:03.482 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-07T09:57:03.738 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-07T09:57:03.741 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-07T09:57:04.034 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-07T09:57:04.465 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-07T09:57:04.721 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-07T09:57:04.760 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-07T09:57:04.762 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-07T09:57:04.762 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-07T09:57:04.765 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-07T09:57:04.765 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-07T09:57:04.769 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-07T09:57:04.791 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-07T09:57:04.798 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-07T09:57:04.846 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-07T09:57:04.962 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-07T09:57:05.225 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-07T09:57:05.510 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-07T09:57:05.700 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-07T09:57:05.700 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-07T09:57:05.727 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-07T09:57:05.761 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-07T09:57:05.804 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-07T09:57:05.811 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-07T09:57:05.813 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-07T09:57:05.814 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-07T09:57:05.814 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-07T09:57:05.842 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-07T09:57:05.846 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-07T09:57:05.887 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-07T09:57:06.230 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-07T09:57:06.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-07T09:57:06.539 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-07T09:57:06.552 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-07T09:57:06.552 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-07T09:57:06.552 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-07T09:57:06.644 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-07T09:57:06.658 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-07T09:57:06.823 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-07T09:57:06.950 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-07T09:57:07.114 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-07T09:57:07.116 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-07T09:57:07.234 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-07T09:57:07.506 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2023-12-07T09:57:07.510 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-07T09:57:07.646 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2023-12-07T09:57:07.778 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-07T09:57:07.813 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package flex. 2023-12-07T09:57:07.885 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139846 files and directories currently installed.) 2023-12-07T09:57:07.889 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-07T09:57:07.936 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-07T09:57:08.163 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-07T09:57:08.489 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-07T09:57:08.489 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-07T09:57:08.659 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-07T09:57:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-07T09:57:08.967 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:09.077 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:09.080 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-07T09:57:09.187 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsqlite3-mod-ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:09.389 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:09.515 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:09.642 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-07T09:57:09.702 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package bison. 2023-12-07T09:57:09.774 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139919 files and directories currently installed.) 2023-12-07T09:57:09.777 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-07T09:57:09.829 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-07T09:57:09.960 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:10.086 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-modules-core (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:10.211 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:10.230 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-07T09:57:10.244 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-07T09:57:10.280 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-07T09:57:10.423 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-07T09:57:10.423 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-07T09:57:10.608 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package dump. 2023-12-07T09:57:10.622 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-07T09:57:10.666 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking dump (0.4b47-3) ... 2023-12-07T09:57:10.986 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package indent. 2023-12-07T09:57:11.000 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:11.044 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-07T09:57:11.063 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:11.222 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:11.297 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-07T09:57:11.311 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-07T09:57:11.323 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-top (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:11.355 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-07T09:57:11.441 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-07T09:57:11.625 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-07T09:57:11.639 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-07T09:57:11.683 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-07T09:57:11.946 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-07T09:57:11.960 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-07T09:57:12.005 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-07T09:57:12.333 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-07T09:57:12.346 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-07T09:57:12.391 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:12.585 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-07T09:57:12.599 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-07T09:57:12.643 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:12.720 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rbd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:12.846 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:12.904 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjson-perl. 2023-12-07T09:57:12.918 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-07T09:57:12.962 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-07T09:57:12.972 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:13.098 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:13.233 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-shell (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:13.299 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-07T09:57:13.312 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-07T09:57:13.357 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-07T09:57:13.384 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:13.904 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2023-12-07T09:57:14.288 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2023-12-07T09:57:14.475 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2023-12-07T09:57:14.490 INFO:teuthology.orchestra.run.smithi089.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-07T09:57:14.633 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-07T09:57:14.769 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-07T09:57:14.784 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-07T09:57:14.819 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:15.003 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-07T09:57:15.063 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-07T09:57:15.078 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-07T09:57:15.121 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:15.464 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-07T09:57:15.480 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-07T09:57:15.524 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:15.685 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-mirror (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:15.843 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-07T09:57:15.858 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-07T09:57:15.893 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-07T09:57:15.913 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-07T09:57:15.913 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-07T09:57:16.179 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-07T09:57:16.194 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-07T09:57:16.237 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-07T09:57:16.545 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:16.598 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-07T09:57:16.613 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:16.656 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:16.671 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:16.984 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-07T09:57:16.998 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:17.042 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:57:17.178 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-07T09:57:17.178 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-07T09:57:17.329 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-07T09:57:17.343 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:17.378 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:57:17.639 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-07T09:57:17.653 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-07T09:57:17.697 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-07T09:57:17.733 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:18.116 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-07T09:57:18.184 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-07T09:57:18.198 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-07T09:57:18.242 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-07T09:57:18.570 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package modemmanager. 2023-12-07T09:57:18.584 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-07T09:57:18.628 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:18.792 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:19.022 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-07T09:57:19.022 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-07T09:57:19.267 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager. 2023-12-07T09:57:19.281 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-07T09:57:19.333 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-07T09:57:19.660 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:19.873 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-07T09:57:19.873 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-07T09:57:20.135 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ppp. 2023-12-07T09:57:20.149 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-07T09:57:20.486 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:20.491 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-07T09:57:20.793 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-07T09:57:20.793 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-07T09:57:20.823 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pptp-linux. 2023-12-07T09:57:20.837 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-07T09:57:20.881 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-07T09:57:21.133 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-07T09:57:21.147 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-07T09:57:21.192 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-07T09:57:21.421 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:21.494 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-07T09:57:21.509 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-07T09:57:21.553 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-common (238) ... 2023-12-07T09:57:21.572 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:21.715 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:21.858 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-07T09:57:21.872 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:21.915 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:21.933 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-07T09:57:21.933 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-07T09:57:22.453 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-common. 2023-12-07T09:57:22.467 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-07T09:57:22.528 INFO:teuthology.orchestra.run.smithi097.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-07T09:57:22.551 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-common (238) ... 2023-12-07T09:57:22.591 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-cephadm (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:22.734 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:22.860 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:23.001 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-14. 2023-12-07T09:57:23.016 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:23.044 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-volume (19.0.0-18-g3bd0bfa4-1jammy) ... 2023-12-07T09:57:23.054 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:23.406 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-07T09:57:24.196 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql. 2023-12-07T09:57:24.211 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-07T09:57:24.254 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql (14+238) ... 2023-12-07T09:57:24.498 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client. 2023-12-07T09:57:24.512 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-07T09:57:24.524 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-07T09:57:24.556 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client (14+238) ... 2023-12-07T09:57:24.808 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-07T09:57:24.823 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-07T09:57:24.867 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-07T09:57:24.990 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-07T09:57:24.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-07T09:57:25.071 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-12-07T09:57:25.245 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-12-07T09:57:25.245 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-12-07T09:57:25.402 INFO:teuthology.orchestra.run.smithi089.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-07T09:57:25.403 INFO:teuthology.orchestra.run.smithi089.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-07T09:57:25.403 INFO:teuthology.orchestra.run.smithi089.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-07T09:57:25.403 INFO:teuthology.orchestra.run.smithi089.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-07T09:57:25.403 INFO:teuthology.orchestra.run.smithi089.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-07T09:57:25.403 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2023-12-07T09:57:25.403 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-07T09:57:25.404 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-07T09:57:25.404 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-07T09:57:25.404 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-07T09:57:25.404 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-07T09:57:25.404 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-07T09:57:25.406 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-12-07T09:57:25.406 INFO:teuthology.orchestra.run.smithi089.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-07T09:57:25.406 INFO:teuthology.orchestra.run.smithi089.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-07T09:57:25.407 INFO:teuthology.orchestra.run.smithi089.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-07T09:57:25.407 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-07T09:57:25.407 INFO:teuthology.orchestra.run.smithi089.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-07T09:57:25.407 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-12-07T09:57:25.407 INFO:teuthology.orchestra.run.smithi089.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-07T09:57:25.407 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-07T09:57:25.408 INFO:teuthology.orchestra.run.smithi089.stdout: libengine-pkcs11-openssl 2023-12-07T09:57:25.455 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-12-07T09:57:25.456 INFO:teuthology.orchestra.run.smithi089.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-07T09:57:25.456 INFO:teuthology.orchestra.run.smithi089.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-07T09:57:25.456 INFO:teuthology.orchestra.run.smithi089.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-07T09:57:25.457 INFO:teuthology.orchestra.run.smithi089.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-07T09:57:25.457 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-07T09:57:25.457 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-07T09:57:25.457 INFO:teuthology.orchestra.run.smithi089.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-07T09:57:25.458 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2023-12-07T09:57:25.458 INFO:teuthology.orchestra.run.smithi089.stdout: libssl3 2023-12-07T09:57:25.511 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl8.6. 2023-12-07T09:57:25.513 INFO:teuthology.orchestra.run.smithi089.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2023-12-07T09:57:25.513 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 54.6 MB of archives. 2023-12-07T09:57:25.513 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-07T09:57:25.513 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-07T09:57:25.525 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-07T09:57:25.561 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-07T09:57:25.616 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-07T09:57:25.671 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-07T09:57:25.679 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-07T09:57:25.679 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-07T09:57:25.681 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-07T09:57:25.682 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-07T09:57:25.683 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-07T09:57:25.684 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-07T09:57:25.685 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-07T09:57:25.686 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-07T09:57:25.690 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-07T09:57:25.703 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-07T09:57:25.822 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl. 2023-12-07T09:57:25.836 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-07T09:57:25.884 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-07T09:57:25.915 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-07T09:57:25.917 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-07T09:57:25.918 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-07T09:57:25.920 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-07T09:57:25.921 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-07T09:57:25.925 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-07T09:57:25.927 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-07T09:57:25.937 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-07T09:57:25.937 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-07T09:57:25.957 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-07T09:57:25.958 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-07T09:57:25.968 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-07T09:57:25.990 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-07T09:57:25.994 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-07T09:57:25.995 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-07T09:57:25.995 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-07T09:57:25.996 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-07T09:57:26.007 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-07T09:57:26.009 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-07T09:57:26.158 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-07T09:57:26.159 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-07T09:57:26.159 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-07T09:57:26.159 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-07T09:57:26.159 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-07T09:57:26.159 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-07T09:57:26.172 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-07T09:57:26.172 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-07T09:57:26.233 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package wpasupplicant. 2023-12-07T09:57:26.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-07T09:57:26.316 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-07T09:57:26.548 INFO:teuthology.orchestra.run.smithi089.stdout:Preconfiguring packages ... 2023-12-07T09:57:26.662 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-07T09:57:26.676 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-07T09:57:26.720 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-07T09:57:26.722 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 54.6 MB in 1s (77.2 MB/s) 2023-12-07T09:57:26.864 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package flex. 2023-12-07T09:57:26.937 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139846 files and directories currently installed.) 2023-12-07T09:57:26.940 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-07T09:57:26.980 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-07T09:57:27.033 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-07T09:57:27.046 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-07T09:57:27.098 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-07T09:57:27.405 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-common (238) ... 2023-12-07T09:57:27.566 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-07T09:57:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-07T09:57:27.722 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-07T09:57:27.735 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-07T09:57:27.848 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:27.991 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-07T09:57:28.116 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-07T09:57:28.140 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-07T09:57:28.242 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:28.754 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package bison. 2023-12-07T09:57:28.827 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139919 files and directories currently installed.) 2023-12-07T09:57:28.830 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-07T09:57:28.882 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-07T09:57:29.249 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-07T09:57:29.273 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-07T09:57:29.288 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-07T09:57:29.332 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-07T09:57:29.340 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-07T09:57:29.677 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package dump. 2023-12-07T09:57:29.691 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-07T09:57:29.735 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking dump (0.4b47-3) ... 2023-12-07T09:57:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-07T09:57:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-07T09:57:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package indent. 2023-12-07T09:57:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:30.071 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-07T09:57:30.357 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-07T09:57:30.372 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-07T09:57:30.415 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-07T09:57:30.451 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-07T09:57:30.602 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-07T09:57:30.713 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-07T09:57:30.726 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-07T09:57:30.728 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-07T09:57:30.769 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-07T09:57:30.846 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-07T09:57:30.963 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:31.089 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-07T09:57:31.147 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-07T09:57:31.162 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-07T09:57:31.205 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-07T09:57:31.215 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-07T09:57:31.550 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-07T09:57:31.566 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-07T09:57:31.608 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:31.869 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-07T09:57:31.885 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-07T09:57:31.927 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:31.995 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-07T09:57:32.097 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up dump (0.4b47-3) ... 2023-12-07T09:57:32.180 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjson-perl. 2023-12-07T09:57:32.192 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-07T09:57:32.195 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-07T09:57:32.230 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-07T09:57:32.257 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:32.383 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-07T09:57:32.508 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-07T09:57:32.549 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-07T09:57:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-07T09:57:32.616 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-07T09:57:32.634 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-07T09:57:32.785 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-07T09:57:32.875 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-07T09:57:32.937 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-07T09:57:33.063 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-07T09:57:33.223 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-07T09:57:33.349 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:33.477 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-07T09:57:33.651 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client (14+238) ... 2023-12-07T09:57:33.802 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-07T09:57:34.386 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:57:34.386 INFO:teuthology.orchestra.run.smithi097.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-07T09:57:34.386 INFO:teuthology.orchestra.run.smithi097.stdout:which means they are currently configured by ifupdown: 2023-12-07T09:57:34.386 INFO:teuthology.orchestra.run.smithi097.stdout:- enp3s0f1 2023-12-07T09:57:34.386 INFO:teuthology.orchestra.run.smithi097.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-07T09:57:34.386 INFO:teuthology.orchestra.run.smithi097.stdout:remove their configuration from /etc/network/interfaces. 2023-12-07T09:57:34.387 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:57:34.445 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-07T09:57:34.461 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-07T09:57:34.495 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:34.517 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-07T09:57:34.756 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-07T09:57:34.772 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-07T09:57:34.814 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:34.930 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-07T09:57:35.167 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-07T09:57:35.183 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-07T09:57:35.226 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:35.528 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-07T09:57:35.570 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-07T09:57:35.586 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-07T09:57:35.628 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-07T09:57:35.939 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-07T09:57:35.955 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-07T09:57:35.997 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-07T09:57:36.205 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:36.342 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-07T09:57:36.348 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:36.358 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:36.400 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:36.474 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-07T09:57:36.600 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-common (238) ... 2023-12-07T09:57:36.761 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-07T09:57:36.777 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:36.820 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:57:37.097 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-07T09:57:37.113 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:37.147 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:57:37.408 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-07T09:57:37.423 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-07T09:57:37.466 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-07T09:57:37.500 INFO:teuthology.orchestra.run.smithi097.stdout:Adding user postgres to group ssl-cert 2023-12-07T09:57:37.771 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:57:37.772 INFO:teuthology.orchestra.run.smithi097.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-07T09:57:37.928 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-07T09:57:37.942 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-07T09:57:37.986 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-07T09:57:38.014 INFO:teuthology.orchestra.run.smithi097.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-07T09:57:38.014 INFO:teuthology.orchestra.run.smithi097.stdout:Removing obsolete dictionary files: 2023-12-07T09:57:38.322 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package modemmanager. 2023-12-07T09:57:38.337 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-07T09:57:38.380 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:38.739 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-07T09:57:39.011 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager. 2023-12-07T09:57:39.026 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-07T09:57:39.128 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-07T09:57:39.193 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:39.674 INFO:teuthology.orchestra.run.smithi097.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-07T09:57:39.693 INFO:teuthology.orchestra.run.smithi097.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-07T09:57:39.736 INFO:teuthology.orchestra.run.smithi097.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-07T09:57:39.736 INFO:teuthology.orchestra.run.smithi097.stdout:This user must also own the server process. 2023-12-07T09:57:39.736 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:57:39.736 INFO:teuthology.orchestra.run.smithi097.stdout:The database cluster will be initialized with locale "en_US". 2023-12-07T09:57:39.736 INFO:teuthology.orchestra.run.smithi097.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-07T09:57:39.737 INFO:teuthology.orchestra.run.smithi097.stdout:The default text search configuration will be set to "english". 2023-12-07T09:57:39.737 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:57:39.737 INFO:teuthology.orchestra.run.smithi097.stdout:Data page checksums are disabled. 2023-12-07T09:57:39.737 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:57:39.737 INFO:teuthology.orchestra.run.smithi097.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-07T09:57:39.738 INFO:teuthology.orchestra.run.smithi097.stdout:creating subdirectories ... ok 2023-12-07T09:57:39.738 INFO:teuthology.orchestra.run.smithi097.stdout:selecting dynamic shared memory implementation ... posix 2023-12-07T09:57:39.745 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ppp. 2023-12-07T09:57:39.760 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-07T09:57:39.761 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default max_connections ... 100 2023-12-07T09:57:39.796 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default shared_buffers ... 128MB 2023-12-07T09:57:39.810 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default time zone ... Etc/UTC 2023-12-07T09:57:39.811 INFO:teuthology.orchestra.run.smithi097.stdout:creating configuration files ... ok 2023-12-07T09:57:39.980 INFO:teuthology.orchestra.run.smithi097.stdout:running bootstrap script ... ok 2023-12-07T09:57:40.109 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-07T09:57:40.424 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pptp-linux. 2023-12-07T09:57:40.438 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-07T09:57:40.474 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-07T09:57:40.594 INFO:teuthology.orchestra.run.smithi097.stdout:performing post-bootstrap initialization ... ok 2023-12-07T09:57:40.727 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-07T09:57:40.741 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-07T09:57:40.785 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-07T09:57:41.113 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-07T09:57:41.127 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-07T09:57:41.171 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client-common (238) ... 2023-12-07T09:57:41.219 INFO:teuthology.orchestra.run.smithi097.stdout:syncing data to disk ... ok 2023-12-07T09:57:41.483 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-07T09:57:41.498 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:41.542 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:41.745 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-07T09:57:42.146 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-common. 2023-12-07T09:57:42.161 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-07T09:57:42.222 INFO:teuthology.orchestra.run.smithi089.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-07T09:57:42.253 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-common (238) ... 2023-12-07T09:57:42.745 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-14. 2023-12-07T09:57:42.760 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-07T09:57:42.798 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:43.998 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql. 2023-12-07T09:57:44.013 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-07T09:57:44.057 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql (14+238) ... 2023-12-07T09:57:44.494 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client. 2023-12-07T09:57:44.508 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-07T09:57:44.544 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client (14+238) ... 2023-12-07T09:57:44.771 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-07T09:57:44.786 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-07T09:57:44.829 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-07T09:57:44.867 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:57:44.993 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-07T09:57:45.119 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql (14+238) ... 2023-12-07T09:57:45.149 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package tcl8.6. 2023-12-07T09:57:45.163 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-07T09:57:45.207 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-07T09:57:45.246 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:57:45.379 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:45.527 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package tcl. 2023-12-07T09:57:45.542 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-07T09:57:45.589 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-07T09:57:45.665 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-07T09:57:45.665 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-07T09:57:45.887 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package wpasupplicant. 2023-12-07T09:57:45.903 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-07T09:57:45.937 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-07T09:57:46.308 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-07T09:57:46.324 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-07T09:57:46.340 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-07T09:57:46.366 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-07T09:57:46.667 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-07T09:57:46.745 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-07T09:57:46.761 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-07T09:57:46.804 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-07T09:57:46.818 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-07T09:57:47.095 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client-common (238) ... 2023-12-07T09:57:47.301 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-07T09:57:47.427 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-07T09:57:47.553 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:47.712 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-07T09:57:47.830 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-07T09:57:47.931 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:48.196 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-07T09:57:48.288 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-07T09:57:48.938 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-07T09:57:48.994 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-07T09:57:48.999 DEBUG:teuthology.parallel:result is None 2023-12-07T09:57:49.045 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-07T09:57:49.440 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-07T09:57:49.441 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-07T09:57:50.173 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-07T09:57:50.299 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-07T09:57:50.425 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-07T09:57:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-07T09:57:50.702 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:50.828 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-07T09:57:50.954 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-07T09:57:51.701 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-07T09:57:51.827 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up dump (0.4b47-3) ... 2023-12-07T09:57:51.922 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-07T09:57:51.987 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:57:52.130 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-07T09:57:52.264 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-07T09:57:52.365 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-07T09:57:52.491 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-07T09:57:52.580 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-07T09:57:52.645 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-07T09:57:52.770 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-07T09:57:52.972 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-07T09:57:53.081 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:53.190 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-07T09:57:53.358 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client (14+238) ... 2023-12-07T09:57:53.484 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-07T09:57:54.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:57:54.055 INFO:teuthology.orchestra.run.smithi089.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-07T09:57:54.056 INFO:teuthology.orchestra.run.smithi089.stdout:which means they are currently configured by ifupdown: 2023-12-07T09:57:54.056 INFO:teuthology.orchestra.run.smithi089.stdout:- enp3s0f1 2023-12-07T09:57:54.056 INFO:teuthology.orchestra.run.smithi089.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-07T09:57:54.056 INFO:teuthology.orchestra.run.smithi089.stdout:remove their configuration from /etc/network/interfaces. 2023-12-07T09:57:54.056 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:57:54.189 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-07T09:57:54.582 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-07T09:57:55.016 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-07T09:57:55.771 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-07T09:57:55.922 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-07T09:57:56.048 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-07T09:57:56.174 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-common (238) ... 2023-12-07T09:57:57.090 INFO:teuthology.orchestra.run.smithi089.stdout:Adding user postgres to group ssl-cert 2023-12-07T09:57:57.334 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:57:57.334 INFO:teuthology.orchestra.run.smithi089.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-07T09:57:57.602 INFO:teuthology.orchestra.run.smithi089.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-07T09:57:57.603 INFO:teuthology.orchestra.run.smithi089.stdout:Removing obsolete dictionary files: 2023-12-07T09:57:58.340 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-07T09:57:58.975 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-07T09:57:59.307 INFO:teuthology.orchestra.run.smithi089.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-07T09:57:59.333 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-07T09:57:59.394 INFO:teuthology.orchestra.run.smithi089.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-07T09:57:59.394 INFO:teuthology.orchestra.run.smithi089.stdout:This user must also own the server process. 2023-12-07T09:57:59.394 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:57:59.394 INFO:teuthology.orchestra.run.smithi089.stdout:The database cluster will be initialized with locale "en_US". 2023-12-07T09:57:59.394 INFO:teuthology.orchestra.run.smithi089.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-07T09:57:59.394 INFO:teuthology.orchestra.run.smithi089.stdout:The default text search configuration will be set to "english". 2023-12-07T09:57:59.395 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:57:59.395 INFO:teuthology.orchestra.run.smithi089.stdout:Data page checksums are disabled. 2023-12-07T09:57:59.395 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:57:59.395 INFO:teuthology.orchestra.run.smithi089.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-07T09:57:59.395 INFO:teuthology.orchestra.run.smithi089.stdout:creating subdirectories ... ok 2023-12-07T09:57:59.395 INFO:teuthology.orchestra.run.smithi089.stdout:selecting dynamic shared memory implementation ... posix 2023-12-07T09:57:59.420 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default max_connections ... 100 2023-12-07T09:57:59.455 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default shared_buffers ... 128MB 2023-12-07T09:57:59.469 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default time zone ... Etc/UTC 2023-12-07T09:57:59.469 INFO:teuthology.orchestra.run.smithi089.stdout:creating configuration files ... ok 2023-12-07T09:57:59.638 INFO:teuthology.orchestra.run.smithi089.stdout:running bootstrap script ... ok 2023-12-07T09:58:00.269 INFO:teuthology.orchestra.run.smithi089.stdout:performing post-bootstrap initialization ... ok 2023-12-07T09:58:00.949 INFO:teuthology.orchestra.run.smithi089.stdout:syncing data to disk ... ok 2023-12-07T09:58:01.476 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-07T09:58:04.625 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:58:04.759 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-07T09:58:04.886 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql (14+238) ... 2023-12-07T09:58:05.012 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-07T09:58:05.138 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-07T09:58:05.407 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-07T09:58:05.407 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-07T09:58:06.148 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-07T09:58:06.492 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-07T09:58:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-07T09:58:08.097 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-07T09:58:08.197 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-07T09:58:08.912 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-07T09:58:08.917 DEBUG:teuthology.parallel:result is None 2023-12-07T09:58:08.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 2023-12-07T09:58:09.140 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2023-12-07T09:58:09.163 INFO:teuthology.orchestra.run.smithi089.stdout:19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:58:09.163 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:58:09.163 INFO:teuthology.task.install:The correct ceph version 19.0.0-18-g3bd0bfa4-1jammy is installed. 2023-12-07T09:58:09.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3bd0bfa458b4399e7266c56d8215a2cf3a6091a0 2023-12-07T09:58:09.389 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2023-12-07T09:58:09.413 INFO:teuthology.orchestra.run.smithi097.stdout:19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:58:09.414 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-18-g3bd0bfa4-1jammy 2023-12-07T09:58:09.414 INFO:teuthology.task.install:The correct ceph version 19.0.0-18-g3bd0bfa4-1jammy is installed. 2023-12-07T09:58:09.414 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-07T09:58:09.414 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:09.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T09:58:09.435 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:09.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T09:58:09.481 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-07T09:58:09.481 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:09.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T09:58:09.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T09:58:09.568 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:09.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T09:58:09.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T09:58:09.652 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-07T09:58:09.652 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:09.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T09:58:09.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T09:58:09.736 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:09.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T09:58:09.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T09:58:09.820 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-07T09:58:09.820 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:09.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T09:58:09.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T09:58:09.900 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:09.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T09:58:09.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T09:58:09.984 INFO:teuthology.run_tasks:Running task ceph... 2023-12-07T09:58:10.053 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-07T09:58:10.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-12-07T09:58:10.057 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2023-12-07T09:58:10.078 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-07T09:58:10.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-07T09:58:10.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-07T09:58:10.145 INFO:tasks.ceph:Creating extra log directories... 2023-12-07T09:58:10.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-07T09:58:10.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-07T09:58:10.219 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-07T09:58:10.219 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-07T09:58:10.219 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-07T09:58:10.220 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:10.220 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-07T09:58:10.257 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:10.348 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:10.348 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-07T09:58:10.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:10.455 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-07T09:58:10.455 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-07T09:58:10.455 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865', 'branch': 'wip-vshankar-testing-20231127.102654-r2', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7481865', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102654-r2'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102654-r2', 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1098, 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0', 'sleep_before_teardown': 0, 'subset': '854/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102654-r2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh7IohZXctJxzWSQcXdoedlQsCFs/6i+OOU6mb2eAxbe+6PVlcgVdsNJi/UxM9KPXej+j6EFoQrBzuXva83530=', 'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZNgc0FESPAPeleHTMuq3nqgKH5dEkd4OeaOJcyEP7k1nQp7mISc2Y0/xOjnmOVbRBv8L7FFKey3HkAGcUSIgA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3bd0bfa458b4399e7266c56d8215a2cf3a6091a0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-07_09:28:49', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-07T09:58:10.456 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-07T09:58:10.461 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-07T09:58:10.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-12-07T09:58:10.516 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2023-12-07T09:58:10.568 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:10.568 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T09:58:10.585 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T09:58:10.585 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 895 Links: 1 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 09:51:35.106653518 +0000 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 09:51:34.710657057 +0000 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 09:51:34.710657057 +0000 2023-12-07T09:58:10.641 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 09:51:34.710657057 +0000 2023-12-07T09:58:10.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T09:58:10.702 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T09:58:10.703 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T09:58:10.703 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000381514 s, 1.3 MB/s 2023-12-07T09:58:10.704 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T09:58:10.755 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 914 Links: 1 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 09:51:35.810647230 +0000 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 09:51:35.418650733 +0000 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 09:51:35.418650733 +0000 2023-12-07T09:58:10.805 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 09:51:35.418650733 +0000 2023-12-07T09:58:10.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T09:58:10.871 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T09:58:10.871 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T09:58:10.871 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000364391 s, 1.4 MB/s 2023-12-07T09:58:10.873 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T09:58:10.927 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-12-07T09:58:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T09:58:10.977 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:10.977 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 929 Links: 1 2023-12-07T09:58:10.977 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:10.977 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 09:51:36.478641265 +0000 2023-12-07T09:58:10.978 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 09:51:36.066644945 +0000 2023-12-07T09:58:10.978 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 09:51:36.066644945 +0000 2023-12-07T09:58:10.978 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 09:51:36.066644945 +0000 2023-12-07T09:58:10.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T09:58:11.041 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T09:58:11.041 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T09:58:11.041 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000368744 s, 1.4 MB/s 2023-12-07T09:58:11.042 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T09:58:11.099 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-12-07T09:58:11.149 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T09:58:11.149 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 947 Links: 1 2023-12-07T09:58:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 09:51:37.178635011 +0000 2023-12-07T09:58:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 09:51:36.794638443 +0000 2023-12-07T09:58:11.150 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 09:51:36.794638443 +0000 2023-12-07T09:58:11.150 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 09:51:36.794638443 +0000 2023-12-07T09:58:11.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T09:58:11.212 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T09:58:11.212 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T09:58:11.212 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000383551 s, 1.3 MB/s 2023-12-07T09:58:11.214 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T09:58:11.267 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:11.267 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:11.267 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T09:58:11.277 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T09:58:11.277 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2023-12-07T09:58:11.328 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T09:58:11.328 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:11.329 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 892 Links: 1 2023-12-07T09:58:11.329 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:11.329 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-07 09:51:32.245494940 +0000 2023-12-07T09:58:11.329 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-07 09:51:31.861498370 +0000 2023-12-07T09:58:11.329 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-07 09:51:31.861498370 +0000 2023-12-07T09:58:11.329 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-07 09:51:31.861498370 +0000 2023-12-07T09:58:11.329 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T09:58:11.390 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-07T09:58:11.391 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-07T09:58:11.391 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000634966 s, 806 kB/s 2023-12-07T09:58:11.393 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T09:58:11.446 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2023-12-07T09:58:11.496 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 910 Links: 1 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-07 09:51:32.673491117 +0000 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-07 09:51:32.669491151 +0000 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-07 09:51:32.669491151 +0000 2023-12-07T09:58:11.497 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-07 09:51:32.669491151 +0000 2023-12-07T09:58:11.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T09:58:11.559 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-07T09:58:11.560 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-07T09:58:11.560 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000387282 s, 1.3 MB/s 2023-12-07T09:58:11.561 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T09:58:11.618 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2023-12-07T09:58:11.672 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T09:58:11.672 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:11.673 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-12-07T09:58:11.673 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:11.673 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-07 09:51:33.773481291 +0000 2023-12-07T09:58:11.673 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-07 09:51:33.337485186 +0000 2023-12-07T09:58:11.673 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-07 09:51:33.337485186 +0000 2023-12-07T09:58:11.673 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-07 09:51:33.337485186 +0000 2023-12-07T09:58:11.673 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T09:58:11.735 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-07T09:58:11.735 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-07T09:58:11.735 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000381788 s, 1.3 MB/s 2023-12-07T09:58:11.737 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T09:58:11.790 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2023-12-07T09:58:11.844 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 941 Links: 1 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-07 09:51:34.465475110 +0000 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-07 09:51:34.065478683 +0000 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-07 09:51:34.065478683 +0000 2023-12-07T09:58:11.845 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-07 09:51:34.065478683 +0000 2023-12-07T09:58:11.845 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T09:58:11.907 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-07T09:58:11.907 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-07T09:58:11.907 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000402332 s, 1.3 MB/s 2023-12-07T09:58:11.909 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T09:58:11.962 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:11.962 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-07T09:58:11.962 INFO:tasks.ceph:Generating config... 2023-12-07T09:58:11.964 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-07T09:58:11.964 INFO:tasks.ceph:[client] debug client = 20 2023-12-07T09:58:11.964 INFO:tasks.ceph:[client] debug ms = 1 2023-12-07T09:58:11.964 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-07T09:58:11.964 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-07T09:58:11.964 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-07T09:58:11.964 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-07T09:58:11.964 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-07T09:58:11.964 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-07T09:58:11.964 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-07T09:58:11.964 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-07T09:58:11.964 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-07T09:58:11.965 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-07T09:58:11.965 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-07T09:58:11.965 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-07T09:58:11.965 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-07T09:58:11.965 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-07T09:58:11.965 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-07T09:58:11.965 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-07T09:58:11.966 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-07T09:58:11.966 INFO:tasks.ceph:Setting up mon.a... 2023-12-07T09:58:11.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-07T09:58:12.014 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2023-12-07T09:58:12.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-07T09:58:12.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T09:58:12.141 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89'), ('mon.b', '172.21.15.97'), ('mon.c', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]')] 2023-12-07T09:58:12.141 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-07T09:58:12.142 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:12.142 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-07T09:58:12.193 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --add b 172.21.15.97 --addv c '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:12.284 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:12.284 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 06923b89-f6c6-4736-b27e-9e03456ddc01 2023-12-07T09:58:12.284 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = pacific 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 06923b89-f6c6-4736-b27e-9e03456ddc01 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2023-12-07T09:58:12.284349+0000 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:created 2023-12-07T09:58:12.284349+0000 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 16 (pacific) 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2023-12-07T09:58:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-07T09:58:12.287 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-07T09:58:12.295 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 06923b89-f6c6-4736-b27e-9e03456ddc01... 2023-12-07T09:58:12.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-07T09:58:12.340 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-07T09:58:12.380 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-12-07T09:58:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-12-07T09:58:12.380 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-12-07T09:58:12.381 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-12-07T09:58:12.382 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-12-07T09:58:12.383 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.89,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 06923b89-f6c6-4736-b27e-9e03456ddc01 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-12-07T09:58:12.384 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.385 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-12-07T09:58:12.386 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-12-07T09:58:12.387 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-12-07T09:58:12.388 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.389 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T09:58:12.390 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-12-07T09:58:12.391 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2023-12-07T09:58:12.392 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2023-12-07T09:58:12.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-07T09:58:12.394 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.89,172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790]" 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on skipped message = False 2023-12-07T09:58:12.395 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 06923b89-f6c6-4736-b27e-9e03456ddc01 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2023-12-07T09:58:12.396 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2023-12-07T09:58:12.397 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2023-12-07T09:58:12.398 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-12-07T09:58:12.399 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-07T09:58:12.400 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2023-12-07T09:58:12.401 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-12-07T09:58:12.402 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-12-07T09:58:12.403 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-12-07T09:58:12.405 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-07T09:58:12.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-07T09:58:12.501 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-07T09:58:12.502 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:12.502 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-07T09:58:12.511 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:12.511 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-07T09:58:12.565 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:58:12.565 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:12.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-07T09:58:12.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T09:58:12.641 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:12.641 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:12.693 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:58:12.693 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:12.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-07T09:58:12.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T09:58:12.729 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:12.729 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:12.780 INFO:tasks.ceph:Setting up mon nodes... 2023-12-07T09:58:12.780 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-07T09:58:12.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-07T09:58:12.835 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-07T09:58:12.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-07T09:58:12.900 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-07T09:58:12.919 INFO:tasks.ceph:Setting up mds nodes... 2023-12-07T09:58:12.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-07T09:58:12.974 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-07T09:58:12.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-07T09:58:12.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-07T09:58:13.095 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-07T09:58:13.100 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-07T09:58:13.121 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-07T09:58:13.181 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-07T09:58:13.185 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-07T09:58:13.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-07T09:58:13.302 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-07T09:58:13.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-07T09:58:13.326 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-07T09:58:13.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-07T09:58:13.369 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-07T09:58:13.386 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-07T09:58:13.429 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-07T09:58:13.446 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-07T09:58:13.446 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-07T09:58:13.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-07T09:58:13.467 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:13.467 INFO:tasks.ceph:role: osd.0 2023-12-07T09:58:13.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:58:13.467 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:13.536 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:13.537 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:13.537 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:13.997 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-07T09:58:14.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-07T09:58:14.000 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-07T09:58:14.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-07T09:58:14.135 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:14.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:14.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-07T09:58:14.196 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:14.196 INFO:tasks.ceph:role: osd.1 2023-12-07T09:58:14.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:58:14.197 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-07T09:58:14.263 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:14.263 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:14.264 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:14.746 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-07T09:58:14.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-07T09:58:14.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-07T09:58:14.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-07T09:58:14.915 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:14.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:14.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-07T09:58:14.976 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:14.976 INFO:tasks.ceph:role: osd.2 2023-12-07T09:58:14.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:58:14.977 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:15.045 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:15.522 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-07T09:58:15.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-07T09:58:15.525 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-07T09:58:15.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-07T09:58:15.686 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:15.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:15.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-07T09:58:15.754 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:15.754 INFO:tasks.ceph:role: osd.3 2023-12-07T09:58:15.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:58:15.754 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:16.281 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-07T09:58:16.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-07T09:58:16.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-07T09:58:16.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-07T09:58:16.415 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:16.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:16.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:16.547+0000 7fb3e89a1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-07T09:58:16.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:16.551+0000 7fb3e89a1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-07T09:58:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:16.551+0000 7fb3e89a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T09:58:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:16.551+0000 7fb3e89a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T09:58:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:16.551+0000 7fb3e89a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T09:58:16.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:16.559+0000 7fb3e89a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-07T09:58:19.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-07T09:58:19.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:19.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:19.671+0000 7f3e70167640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-07T09:58:19.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:19.671+0000 7f3e70167640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-07T09:58:19.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:19.671+0000 7f3e70167640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T09:58:19.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:19.671+0000 7f3e70167640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T09:58:19.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:19.671+0000 7f3e70167640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T09:58:19.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:19.671+0000 7f3e70167640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-07T09:58:22.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-07T09:58:22.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:22.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:22.795+0000 7fde01c3d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-07T09:58:22.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:22.795+0000 7fde01c3d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-07T09:58:22.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:22.795+0000 7fde01c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T09:58:22.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:22.795+0000 7fde01c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T09:58:22.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:22.795+0000 7fde01c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T09:58:22.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:22.799+0000 7fde01c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-07T09:58:25.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-07T09:58:25.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:25.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:25.922+0000 7fc9e6b4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-07T09:58:25.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:25.922+0000 7fc9e6b4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-07T09:58:25.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:25.922+0000 7fc9e6b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T09:58:25.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:25.922+0000 7fc9e6b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T09:58:25.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:25.922+0000 7fc9e6b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T09:58:25.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:25.926+0000 7fc9e6b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-07T09:58:28.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-07T09:58:28.941 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-07T09:58:28.964 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:28.964 INFO:tasks.ceph:role: osd.4 2023-12-07T09:58:28.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:58:28.964 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-07T09:58:29.036 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:29.037 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:29.508 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-07T09:58:29.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-07T09:58:29.511 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-07T09:58:29.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-07T09:58:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:29.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:29.652 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-07T09:58:29.720 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:29.720 INFO:tasks.ceph:role: osd.5 2023-12-07T09:58:29.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:58:29.720 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-07T09:58:29.793 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:29.793 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:29.793 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:29.793 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:29.793 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:29.793 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:29.794 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:29.794 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:29.794 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:29.794 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:30.276 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-07T09:58:30.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-07T09:58:30.279 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-07T09:58:30.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-07T09:58:30.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:30.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-07T09:58:30.525 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:30.525 INFO:tasks.ceph:role: osd.6 2023-12-07T09:58:30.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:58:30.525 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:30.597 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:31.077 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-07T09:58:31.080 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-07T09:58:31.080 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-07T09:58:31.183 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-07T09:58:31.201 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:31.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:31.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-07T09:58:31.265 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T09:58:31.265 INFO:tasks.ceph:role: osd.7 2023-12-07T09:58:31.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:58:31.265 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-07T09:58:31.337 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T09:58:31.337 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T09:58:31.338 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T09:58:31.793 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-07T09:58:31.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-07T09:58:31.796 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-07T09:58:31.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-07T09:58:31.939 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-07T09:58:31.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:58:31.940 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:32.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:32.207+0000 7ffbf5b67640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-07T09:58:32.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:32.211+0000 7ffbf5b67640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-07T09:58:32.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:32.211+0000 7ffbf5b67640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-07T09:58:32.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:32.211+0000 7ffbf5b67640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-07T09:58:32.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:32.211+0000 7ffbf5b67640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-07T09:58:32.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:32.219+0000 7ffbf5b67640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-07T09:58:35.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-07T09:58:35.242 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:35.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:35.338+0000 7fb0f9e2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-07T09:58:35.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:35.338+0000 7fb0f9e2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-07T09:58:35.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:35.338+0000 7fb0f9e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-07T09:58:35.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:35.338+0000 7fb0f9e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-07T09:58:35.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:35.338+0000 7fb0f9e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-07T09:58:35.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:35.342+0000 7fb0f9e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-07T09:58:38.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-07T09:58:38.346 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:38.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:38.438+0000 7f75d077e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-07T09:58:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:38.438+0000 7f75d077e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-07T09:58:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:38.438+0000 7f75d077e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-07T09:58:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:38.438+0000 7f75d077e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-07T09:58:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:38.438+0000 7f75d077e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-07T09:58:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:38.438+0000 7f75d077e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-07T09:58:40.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:40.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:41.430 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-07T09:58:41.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:41.542+0000 7f9c15e95640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-07T09:58:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:41.542+0000 7f9c15e95640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-07T09:58:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:41.542+0000 7f9c15e95640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-07T09:58:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:41.542+0000 7f9c15e95640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-07T09:58:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:41.542+0000 7f9c15e95640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-07T09:58:41.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:41.546+0000 7f9c15e95640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-07T09:58:44.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-07T09:58:44.548 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-07T09:58:44.548 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-07T09:58:44.571 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-07T09:58:44.635 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-07T09:58:44.702 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.703 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-07T09:58:44.766 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-07T09:58:44.830 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-07T09:58:44.894 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:44.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-07T09:58:44.958 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:44.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-07T09:58:44.979 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:44.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-07T09:58:45.039 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:45.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-07T09:58:45.099 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:45.100 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-07T09:58:45.163 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:45.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-07T09:58:45.223 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:45.223 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-07T09:58:45.283 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:45.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-07T09:58:45.343 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:45.344 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-07T09:58:45.353 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:45.353 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-07T09:58:45.396 INFO:tasks.ceph:Adding keys to all mons... 2023-12-07T09:58:45.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-07T09:58:45.400 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0l3FluC/UMRAA6hAJrSbSRn3I/3XeHlIBCQ== 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0l3Flf1wcOhAACzyi07iCb6OeVrox4hSSoQ== 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3Fl8di0BRAA6GZD2xbIkzOykVG6rHfqew== 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA4l3Fl/Z3VIBAASvuI7XuDpc3FH9/P7lhsww== 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA7l3FlC/M1KBAAjwhtKGKQ/HZ6yhpOCXV0kw== 2023-12-07T09:58:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA+l3Fl/y6sLxAAm8pKF8kx9qUmFNUmMbFBMw== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBBl3Fl+0hCNxAAIVwKiVgagVbLZsm7QcynUQ== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0l3FlefecNRAAaSFdy4bxWI1FH6tFc84Hqg== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlNmS9ChAAKeb6oUGcE358orATMWlpig== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3Fl/RH+ERAAAUPU8qglPPkntimRXcvGwg== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBIl3FlwbtwDBAAk6YFzxYayyMbAudT72sxGA== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBLl3Flwt1OFBAAoLwAtcuFIt/FW7gisMaV/w== 2023-12-07T09:58:45.447 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBOl3FlXhU/GhAA/4dl8x5v2OapJqCTPbYFwA== 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBRl3FlTTKFIBAAUuR+A3irHtSU67nIRnoFug== 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg== 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-12-07T09:58:45.448 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA== 2023-12-07T09:58:45.459 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2023-12-07T09:58:45.459 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA0l3FluC/UMRAA6hAJrSbSRn3I/3XeHlIBCQ== 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA0l3Flf1wcOhAACzyi07iCb6OeVrox4hSSoQ== 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA1l3Fl8di0BRAA6GZD2xbIkzOykVG6rHfqew== 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA4l3Fl/Z3VIBAASvuI7XuDpc3FH9/P7lhsww== 2023-12-07T09:58:45.460 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA7l3FlC/M1KBAAjwhtKGKQ/HZ6yhpOCXV0kw== 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA+l3Fl/y6sLxAAm8pKF8kx9qUmFNUmMbFBMw== 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBBl3Fl+0hCNxAAIVwKiVgagVbLZsm7QcynUQ== 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA0l3FlefecNRAAaSFdy4bxWI1FH6tFc84Hqg== 2023-12-07T09:58:45.461 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-12-07T09:58:45.462 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA1l3FlNmS9ChAAKeb6oUGcE358orATMWlpig== 2023-12-07T09:58:45.462 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-12-07T09:58:45.462 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA1l3Fl/RH+ERAAAUPU8qglPPkntimRXcvGwg== 2023-12-07T09:58:45.462 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2023-12-07T09:58:45.462 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBIl3FlwbtwDBAAk6YFzxYayyMbAudT72sxGA== 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBLl3Flwt1OFBAAoLwAtcuFIt/FW7gisMaV/w== 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBOl3FlXhU/GhAA/4dl8x5v2OapJqCTPbYFwA== 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBRl3FlTTKFIBAAUuR+A3irHtSU67nIRnoFug== 2023-12-07T09:58:45.463 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-12-07T09:58:45.464 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg== 2023-12-07T09:58:45.464 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-12-07T09:58:45.464 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA== 2023-12-07T09:58:45.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T09:58:45.493 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T09:58:45.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:45.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:45.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:45.627 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:45.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.803 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.860 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:45.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T09:58:45.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T09:58:45.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:45.977 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:46.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:46.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T09:58:46.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.098 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.215 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.272 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T09:58:46.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T09:58:46.329 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T09:58:46.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T09:58:46.390 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T09:58:46.446 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-07T09:58:46.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-07T09:58:46.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T09:58:46.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-07T09:58:46.602 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-07T09:58:46.623 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T09:58:46.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-07T09:58:46.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-07T09:58:46.819 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T09:58:46.929 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-07T09:58:46.950 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:46.953 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-07T09:58:47.003 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-07T09:58:47.004 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-07T09:58:47.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-07T09:58:47.008 INFO:tasks.ceph.mon.a:Started 2023-12-07T09:58:47.009 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-07T09:58:47.009 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-07T09:58:47.046 INFO:tasks.ceph.mon.b:Started 2023-12-07T09:58:47.047 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-07T09:58:47.047 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-07T09:58:47.050 INFO:tasks.ceph.mon.c:Started 2023-12-07T09:58:47.050 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-07T09:58:47.050 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-07T09:58:47.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-07T09:58:47.054 INFO:tasks.ceph.mgr.y:Started 2023-12-07T09:58:47.054 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-07T09:58:47.054 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-07T09:58:47.058 INFO:tasks.ceph.mgr.x:Started 2023-12-07T09:58:47.058 INFO:tasks.ceph:Setting crush tunables to default 2023-12-07T09:58:47.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2023-12-07T09:58:47.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.193+0000 7f2897fb8640 1 Processor -- start 2023-12-07T09:58:47.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.193+0000 7f2897fb8640 1 -- start start 2023-12-07T09:58:47.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2897fb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 0x7f28900aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2897fb8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2890152d90 con 0x7f28900a86d0 2023-12-07T09:58:47.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2897fb8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2890152480 con 0x7f2890156600 2023-12-07T09:58:47.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2897fb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900a9760 con 0x7f289014fd00 2023-12-07T09:58:47.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2895553640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2890156600 0x7f289014f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:40976/0 (socket says 172.21.15.89:40976) 2023-12-07T09:58:47.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2895553640 1 -- 172.21.15.89:0/2909803226 learned_addr learned my addr 172.21.15.89:0/2909803226 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:58:47.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2896555640 1 --2- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 0x7f28900aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2896555640 1 -- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 msgr2=0x7f28900aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-07T09:58:47.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2896555640 1 -- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 msgr2=0x7f28900aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-07T09:58:47.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2896555640 1 --2- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 0x7f28900aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-07T09:58:47.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.197+0000 7f2896555640 1 --2- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 0x7f28900aae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T09:58:47.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123850186 0 0) 0x7f2890152d90 con 0x7f28900a86d0 2023-12-07T09:58:47.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f287c003530 con 0x7f28900a86d0 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2807644227 0 0) 0x7f287c003530 con 0x7f28900a86d0 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 msgr2=0x7f28900aae40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 --2- 172.21.15.89:0/2909803226 >> v2:172.21.15.89:3300/0 conn(0x7f289014fd00 0x7f28900aae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 >> v1:172.21.15.97:6789/0 conn(0x7f2890156600 legacy=0x7f289014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890152740 con 0x7f28900a86d0 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f288c001680 con 0x7f28900a86d0 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 >> v1:172.21.15.89:6789/0 conn(0x7f28900a86d0 legacy=0x7f28900a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f287c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f287c0047d0 0x7f287c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f287c0051e0 0x7f287c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900a9760 con 0x7f287c0039d0 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c00c130 con 0x7f287c0047d0 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c00c2f0 con 0x7f287c0051e0 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895d54640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f287c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895553640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f287c0047d0 0x7f287c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2896555640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f287c0051e0 0x7f287c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895d54640 1 -- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f287c0051e0 msgr2=0x7f287c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895d54640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f287c0051e0 0x7f287c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895d54640 1 -- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f287c0047d0 msgr2=0x7f287c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895d54640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f287c0047d0 0x7f287c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2896555640 1 -- 172.21.15.89:0/2909803226 reap_dead start 2023-12-07T09:58:47.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.377+0000 7f2895d54640 1 -- 172.21.15.89:0/2909803226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c003530 con 0x7f287c0039d0 2023-12-07T09:58:47.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.381+0000 7f2895d54640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f287c003df0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f288c007f20 tx=0x7f288c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1feb51b124d3d434 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:47.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.381+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a5710 con 0x7f287c0039d0 2023-12-07T09:58:47.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.381+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c0a5890 con 0x7f287c0039d0 2023-12-07T09:58:47.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.381+0000 7f2894d52640 1 -- 172.21.15.89:0/2909803226 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a5c40 con 0x7f287c0039d0 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 -- 172.21.15.89:0/2909803226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 msgr2=0x7f287c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f287c003df0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f288c007f20 tx=0x7f288c01ca20 comp rx=0 tx=0).stop 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 -- 172.21.15.89:0/2909803226 shutdown_connections 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 --2- 172.21.15.89:0/2909803226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f287c003df0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 -- 172.21.15.89:0/2909803226 >> 172.21.15.89:0/2909803226 conn(0x7f28900c2a60 msgr2=0x7f28900c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 -- 172.21.15.89:0/2909803226 shutdown_connections 2023-12-07T09:58:47.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 -- 172.21.15.89:0/2909803226 wait complete. 2023-12-07T09:58:47.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 Processor -- start 2023-12-07T09:58:47.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.385+0000 7f2897fb8640 1 -- start start 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f28901ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f289014aa00 0x7f2890155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28901496b0 0x7f289014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890153e70 con 0x7f287c0039d0 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890155ca0 con 0x7f28901496b0 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289014ae60 con 0x7f289014aa00 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f28901ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f28901ee070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46094/0 (socket says 172.21.15.89:46094) 2023-12-07T09:58:47.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 -- 172.21.15.89:0/2278554265 learned_addr learned my addr 172.21.15.89:0/2278554265 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895553640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f289014aa00 0x7f2890155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2896555640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28901496b0 0x7f289014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 -- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f289014aa00 msgr2=0x7f2890155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f289014aa00 0x7f2890155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 -- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28901496b0 msgr2=0x7f289014ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28901496b0 0x7f289014ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 -- 172.21.15.89:0/2278554265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289014b130 con 0x7f287c0039d0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2896555640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28901496b0 0x7f289014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2895d54640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f28901ee070 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f288c0b0040 tx=0x7f287c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0bc070 con 0x7f287c0039d0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c0a5650 con 0x7f287c0039d0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289014b410 con 0x7f287c0039d0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0052d0 con 0x7f287c0039d0 2023-12-07T09:58:47.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2890154f60 con 0x7f287c0039d0 2023-12-07T09:58:47.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f288c0b4040 con 0x7f287c0039d0 2023-12-07T09:58:47.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f288c003a90 con 0x7f287c0039d0 2023-12-07T09:58:47.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.389+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289004e890 con 0x7f287c0039d0 2023-12-07T09:58:47.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.393+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f288c0b2070 con 0x7f287c0039d0 2023-12-07T09:58:47.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f28900bfff0 con 0x7f287c0039d0 2023-12-07T09:58:47.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f28867fc640 1 -- 172.21.15.89:0/2278554265 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f288c007b40 con 0x7f287c0039d0 2023-12-07T09:58:47.460 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2023-12-07T09:58:47.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 msgr2=0x7f28901ee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:47.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f28901ee070 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f288c0b0040 tx=0x7f287c005800 comp rx=0 tx=0).stop 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 shutdown_connections 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28901496b0 0x7f289014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f289014aa00 0x7f2890155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 --2- 172.21.15.89:0/2278554265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f287c0039d0 0x7f28901ee070 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 >> 172.21.15.89:0/2278554265 conn(0x7f28900c2a60 msgr2=0x7f28900c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 shutdown_connections 2023-12-07T09:58:47.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:47.457+0000 7f2897fb8640 1 -- 172.21.15.89:0/2278554265 wait complete. 2023-12-07T09:58:47.480 INFO:tasks.ceph:check_enable_crimson: False 2023-12-07T09:58:47.480 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-07T09:58:47.481 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:47.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-07T09:58:47.501 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:47.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-07T09:58:47.562 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:47.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-07T09:58:47.595 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:47.590+0000 7f2ecc649180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-07T09:58:47.617 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:47.613+0000 7f088282c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-07T09:58:47.626 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:58:47.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-07T09:58:47.690 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:47.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-07T09:58:47.711 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:47.711 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-07T09:58:47.773 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:47.773 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-07T09:58:47.840 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:58:47.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-07T09:58:47.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a 0 2023-12-07T09:58:48.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 Processor -- start 2023-12-07T09:58:48.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 -- start start 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 0x7f8f5406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f5406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5406cf70 con 0x7f8f54151d80 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f54152160 con 0x7f8f540c8430 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.074+0000 7f8f59ac9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540c6a30 con 0x7f8f540c7f20 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f52ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 0x7f8f5406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f53fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f5406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f52ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 0x7f8f5406b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44306/0 (socket says 172.21.15.97:44306) 2023-12-07T09:58:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f52ffd640 1 -- 172.21.15.97:0/3284487802 learned_addr learned my addr 172.21.15.97:0/3284487802 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f53fff640 1 -- 172.21.15.97:0/3284487802 >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 msgr2=0x7f8f5406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f53fff640 1 --2- 172.21.15.97:0/3284487802 >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 0x7f8f5406b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f53fff640 1 -- 172.21.15.97:0/3284487802 >> v1:172.21.15.89:6789/0 conn(0x7f8f54151d80 legacy=0x7f8f540c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f53fff640 1 -- 172.21.15.97:0/3284487802 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540c72d0 con 0x7f8f540c7f20 2023-12-07T09:58:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f52ffd640 1 --2- 172.21.15.97:0/3284487802 >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 0x7f8f5406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:48.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f53fff640 1 --2- 172.21.15.97:0/3284487802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f5406bc60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009d90 tx=0x7f8f4c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766655c7977ba3dc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f527fc640 1 -- 172.21.15.97:0/3284487802 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0a5950 con 0x7f8f540c7f20 2023-12-07T09:58:48.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f527fc640 1 -- 172.21.15.97:0/3284487802 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0a5ab0 con 0x7f8f540c7f20 2023-12-07T09:58:48.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.078+0000 7f8f527fc640 1 -- 172.21.15.97:0/3284487802 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0a5e40 con 0x7f8f540c7f20 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- 172.21.15.97:0/3284487802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 msgr2=0x7f8f5406bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/3284487802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f5406bc60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009d90 tx=0x7f8f4c01c890 comp rx=0 tx=0).stop 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- 172.21.15.97:0/3284487802 shutdown_connections 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/3284487802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f5406bc60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/3284487802 >> v2:172.21.15.97:3300/0 conn(0x7f8f540c8430 0x7f8f5406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- 172.21.15.97:0/3284487802 >> 172.21.15.97:0/3284487802 conn(0x7f8f540abd00 msgr2=0x7f8f540ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- 172.21.15.97:0/3284487802 shutdown_connections 2023-12-07T09:58:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- 172.21.15.97:0/3284487802 wait complete. 2023-12-07T09:58:48.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 Processor -- start 2023-12-07T09:58:48.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- start start 2023-12-07T09:58:48.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f540aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f540c8430 0x7f8f54145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f54151d80 0x7f8f54150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54145740 con 0x7f8f54151d80 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540ab5f0 con 0x7f8f540c8430 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f59ac9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540a9a40 con 0x7f8f540c7f20 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f540aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f540c8430 0x7f8f54145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f540aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:50728/0 (socket says 172.21.15.97:50728) 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f537fe640 1 -- 172.21.15.97:0/1211627373 learned_addr learned my addr 172.21.15.97:0/1211627373 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.082+0000 7f8f53fff640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f54151d80 0x7f8f54150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f52ffd640 1 -- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 msgr2=0x7f8f540aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f52ffd640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f540aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f52ffd640 1 -- 172.21.15.97:0/1211627373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f54151d80 msgr2=0x7f8f54150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f52ffd640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f54151d80 0x7f8f54150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f52ffd640 1 -- 172.21.15.97:0/1211627373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480094d0 con 0x7f8f540c8430 2023-12-07T09:58:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f52ffd640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f540c8430 0x7f8f54145200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800e8b0 tx=0x7f8f4800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48004030 con 0x7f8f540c8430 2023-12-07T09:58:48.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48004190 con 0x7f8f540c8430 2023-12-07T09:58:48.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48004520 con 0x7f8f540c8430 2023-12-07T09:58:48.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c009a70 con 0x7f8f540c8430 2023-12-07T09:58:48.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f540aa000 con 0x7f8f540c8430 2023-12-07T09:58:48.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8f4800cc40 con 0x7f8f540c8430 2023-12-07T09:58:48.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8f480137f0 con 0x7f8f540c8430 2023-12-07T09:58:48.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.086+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5404e890 con 0x7f8f540c8430 2023-12-07T09:58:48.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.098+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8f48020060 con 0x7f8f540c8430 2023-12-07T09:58:48.161 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:48.158+0000 7f2ecc649180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-07T09:58:48.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.166+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a", "id": 0} v 0) v1 -- 0x7f8f5406c5d0 con 0x7f8f540c8430 2023-12-07T09:58:48.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f3bfff640 1 -- 172.21.15.97:0/1211627373 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8f480290b0 con 0x7f8f540c8430 2023-12-07T09:58:48.177 INFO:teuthology.orchestra.run.smithi097.stdout:0 2023-12-07T09:58:48.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f540c8430 msgr2=0x7f8f54145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f540c8430 0x7f8f54145200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800e8b0 tx=0x7f8f4800ed70 comp rx=0 tx=0).stop 2023-12-07T09:58:48.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 shutdown_connections 2023-12-07T09:58:48.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f54151d80 0x7f8f54150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f540c8430 0x7f8f54145200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 --2- 172.21.15.97:0/1211627373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f540c7f20 0x7f8f540aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 >> 172.21.15.97:0/1211627373 conn(0x7f8f540abd00 msgr2=0x7f8f540c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 shutdown_connections 2023-12-07T09:58:48.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.174+0000 7f8f59ac9640 1 -- 172.21.15.97:0/1211627373 wait complete. 2023-12-07T09:58:48.189 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:48.185+0000 7f088282c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-07T09:58:48.197 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new d0f855f7-b40d-4225-9746-c81fc2f74753 1 2023-12-07T09:58:48.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.326+0000 7f178b6d6640 1 Processor -- start 2023-12-07T09:58:48.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f178b6d6640 1 -- start start 2023-12-07T09:58:48.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f178b6d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1784151d80 0x7f17840c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f178b6d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17840c8430 0x7f178406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f178b6d6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178406cf70 con 0x7f17840c7f20 2023-12-07T09:58:48.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f178b6d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1784152160 con 0x7f1784151d80 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f178b6d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17840c6a30 con 0x7f17840c8430 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17840c8430 0x7f178406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17840c8430 0x7f178406b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44332/0 (socket says 172.21.15.97:44332) 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 -- 172.21.15.97:0/1795272502 learned_addr learned my addr 172.21.15.97:0/1795272502 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1789472640 1 --2- 172.21.15.97:0/1795272502 >> v2:172.21.15.89:3300/0 conn(0x7f1784151d80 0x7f17840c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f177bfff640 1 -- 172.21.15.97:0/1795272502 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542552648 0 0) 0x7f178406cf70 con 0x7f17840c7f20 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f177bfff640 1 -- 172.21.15.97:0/1795272502 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1770003530 con 0x7f17840c7f20 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 -- 172.21.15.97:0/1795272502 >> v2:172.21.15.89:3300/0 conn(0x7f1784151d80 msgr2=0x7f17840c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 --2- 172.21.15.97:0/1795272502 >> v2:172.21.15.89:3300/0 conn(0x7f1784151d80 0x7f17840c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 -- 172.21.15.97:0/1795272502 >> v1:172.21.15.89:6789/0 conn(0x7f17840c7f20 legacy=0x7f178406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1788c71640 1 -- 172.21.15.97:0/1795272502 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840c72d0 con 0x7f17840c8430 2023-12-07T09:58:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.330+0000 7f1789472640 1 --2- 172.21.15.97:0/1795272502 >> v2:172.21.15.89:3300/0 conn(0x7f1784151d80 0x7f17840c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:48.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f1788c71640 1 --2- 172.21.15.97:0/1795272502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17840c8430 0x7f178406b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17840c7a40 tx=0x7f177401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b4e6eec4786a8c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f177bfff640 1 -- 172.21.15.97:0/1795272502 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740ab640 con 0x7f17840c8430 2023-12-07T09:58:48.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f177bfff640 1 -- 172.21.15.97:0/1795272502 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17740a7070 con 0x7f17840c8430 2023-12-07T09:58:48.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f177bfff640 1 -- 172.21.15.97:0/1795272502 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740ab9c0 con 0x7f17840c8430 2023-12-07T09:58:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 -- 172.21.15.97:0/1795272502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17840c8430 msgr2=0x7f178406b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1795272502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17840c8430 0x7f178406b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17840c7a40 tx=0x7f177401c440 comp rx=0 tx=0).stop 2023-12-07T09:58:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 -- 172.21.15.97:0/1795272502 shutdown_connections 2023-12-07T09:58:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1795272502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17840c8430 0x7f178406b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1795272502 >> v2:172.21.15.89:3300/0 conn(0x7f1784151d80 0x7f17840c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 -- 172.21.15.97:0/1795272502 >> 172.21.15.97:0/1795272502 conn(0x7f17840abd00 msgr2=0x7f17840ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 -- 172.21.15.97:0/1795272502 shutdown_connections 2023-12-07T09:58:48.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 -- 172.21.15.97:0/1795272502 wait complete. 2023-12-07T09:58:48.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.334+0000 7f178b6d6640 1 Processor -- start 2023-12-07T09:58:48.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- start start 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17840c7f20 0x7f17840aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17840c8430 0x7f17841451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 0x7f17841ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17841ecdb0 con 0x7f17840c7f20 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17841ed330 con 0x7f1784151d80 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17840ab810 con 0x7f17840c8430 2023-12-07T09:58:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 0x7f17841ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1788c71640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17840c8430 0x7f17841451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789472640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17840c7f20 0x7f17840aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 0x7f17841ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44346/0 (socket says 172.21.15.97:44346) 2023-12-07T09:58:48.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 -- 172.21.15.97:0/1649184771 learned_addr learned my addr 172.21.15.97:0/1649184771 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 -- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17840c8430 msgr2=0x7f17841451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17840c8430 0x7f17841451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 -- 172.21.15.97:0/1649184771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17840c7f20 msgr2=0x7f17840aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17840c7f20 0x7f17840aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 -- 172.21.15.97:0/1649184771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780009420 con 0x7f1784151d80 2023-12-07T09:58:48.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1789c73640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 0x7f17841ed7c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c730 tx=0x7f177c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c003b80 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c003d00 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c005310 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17740094d0 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f177c00a640 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17841458e0 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f177c00aad0 con 0x7f1784151d80 2023-12-07T09:58:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.338+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178404e890 con 0x7f1784151d80 2023-12-07T09:58:48.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.342+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f177c00ac90 con 0x7f1784151d80 2023-12-07T09:58:48.364 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:48.362+0000 7f2ecc649180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-07T09:58:48.394 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:48.393+0000 7f088282c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-07T09:58:48.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.410+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0f855f7-b40d-4225-9746-c81fc2f74753", "id": 1} v 0) v1 -- 0x7f178415ee20 con 0x7f1784151d80 2023-12-07T09:58:48.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f1779ffb640 1 -- 172.21.15.97:0/1649184771 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0f855f7-b40d-4225-9746-c81fc2f74753", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f177c02a0b0 con 0x7f1784151d80 2023-12-07T09:58:48.420 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 msgr2=0x7f17841ed7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 0x7f17841ed7c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c730 tx=0x7f177c00cbf0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 shutdown_connections 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784151d80 0x7f17841ed7c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f17840c8430 0x7f17841451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 --2- 172.21.15.97:0/1649184771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17840c7f20 0x7f17840aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 >> 172.21.15.97:0/1649184771 conn(0x7f17840abd00 msgr2=0x7f17840ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 shutdown_connections 2023-12-07T09:58:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.418+0000 7f178b6d6640 1 -- 172.21.15.97:0/1649184771 wait complete. 2023-12-07T09:58:48.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 18ffb54a-4429-4fd0-a386-e7e3e71837b6 2 2023-12-07T09:58:48.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.570+0000 7f4d0d432640 1 Processor -- start 2023-12-07T09:58:48.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.570+0000 7f4d0d432640 1 -- start start 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d0d432640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d080700f0 0x7f4d08070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d0d432640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d08071be0 con 0x7f4d08154000 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d0d432640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d08154b90 con 0x7f4d0806df30 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d0d432640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080a8710 con 0x7f4d080700f0 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d077fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4d0806df30 0x7f4d080714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46126/0 (socket says 172.21.15.97:46126) 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d077fe640 1 -- 172.21.15.97:0/2743025154 learned_addr learned my addr 172.21.15.97:0/2743025154 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-07T09:58:48.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d067fc640 1 --2- 172.21.15.97:0/2743025154 >> v2:172.21.15.89:3300/0 conn(0x7f4d080700f0 0x7f4d08070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d067fc640 1 -- 172.21.15.97:0/2743025154 >> v1:172.21.15.97:6789/0 conn(0x7f4d0806df30 legacy=0x7f4d080714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d067fc640 1 -- 172.21.15.97:0/2743025154 >> v1:172.21.15.89:6789/0 conn(0x7f4d08154000 legacy=0x7f4d081543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d05ffb640 1 -- 172.21.15.97:0/2743025154 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806716707 0 0) 0x7f4d08154b90 con 0x7f4d0806df30 2023-12-07T09:58:48.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.574+0000 7f4d067fc640 1 -- 172.21.15.97:0/2743025154 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080abd70 con 0x7f4d080700f0 2023-12-07T09:58:48.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d067fc640 1 --2- 172.21.15.97:0/2743025154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d080700f0 0x7f4d08070f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0097c0 tx=0x7f4cfc01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1eabdbbccf57428 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d05ffb640 1 -- 172.21.15.97:0/2743025154 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0a56b0 con 0x7f4d080700f0 2023-12-07T09:58:48.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d05ffb640 1 -- 172.21.15.97:0/2743025154 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc0a5810 con 0x7f4d080700f0 2023-12-07T09:58:48.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d05ffb640 1 -- 172.21.15.97:0/2743025154 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0a5ba0 con 0x7f4d080700f0 2023-12-07T09:58:48.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 -- 172.21.15.97:0/2743025154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d080700f0 msgr2=0x7f4d08070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 --2- 172.21.15.97:0/2743025154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d080700f0 0x7f4d08070f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0097c0 tx=0x7f4cfc01bf60 comp rx=0 tx=0).stop 2023-12-07T09:58:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 -- 172.21.15.97:0/2743025154 shutdown_connections 2023-12-07T09:58:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 --2- 172.21.15.97:0/2743025154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d080700f0 0x7f4d08070f90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 -- 172.21.15.97:0/2743025154 >> 172.21.15.97:0/2743025154 conn(0x7f4d080c2a60 msgr2=0x7f4d080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 -- 172.21.15.97:0/2743025154 shutdown_connections 2023-12-07T09:58:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 -- 172.21.15.97:0/2743025154 wait complete. 2023-12-07T09:58:48.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 Processor -- start 2023-12-07T09:58:48.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.578+0000 7f4d0d432640 1 -- start start 2023-12-07T09:58:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d0806df30 0x7f4d0806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 0x7f4d08152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d08154000 0x7f4d08153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08151bd0 con 0x7f4d08154000 2023-12-07T09:58:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08152a30 con 0x7f4d0806df30 2023-12-07T09:58:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08151e20 con 0x7f4d080700f0 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 0x7f4d08152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 0x7f4d08152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:50750/0 (socket says 172.21.15.97:50750) 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 -- 172.21.15.97:0/22408295 learned_addr learned my addr 172.21.15.97:0/22408295 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d06ffd640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d0806df30 0x7f4d0806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d077fe640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d08154000 0x7f4d08153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 -- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d0806df30 msgr2=0x7f4d0806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d0806df30 0x7f4d0806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 -- 172.21.15.97:0/22408295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d08154000 msgr2=0x7f4d08153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d08154000 0x7f4d08153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 -- 172.21.15.97:0/22408295 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009420 con 0x7f4d080700f0 2023-12-07T09:58:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d067fc640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 0x7f4d08152ec0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0af040 tx=0x7f4cfc019020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0bb070 con 0x7f4d080700f0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc0a5c40 con 0x7f4d080700f0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0b6460 con 0x7f4d080700f0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08152100 con 0x7f4d080700f0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d081526c0 con 0x7f4d080700f0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4cfc0b65e0 con 0x7f4d080700f0 2023-12-07T09:58:48.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4cfc0a9070 con 0x7f4d080700f0 2023-12-07T09:58:48.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.582+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d08152bc0 con 0x7f4d080700f0 2023-12-07T09:58:48.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.586+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4cfc0ad650 con 0x7f4d080700f0 2023-12-07T09:58:48.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.650+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "18ffb54a-4429-4fd0-a386-e7e3e71837b6", "id": 2} v 0) v1 -- 0x7f4d0804e890 con 0x7f4d080700f0 2023-12-07T09:58:48.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4cef7fe640 1 -- 172.21.15.97:0/22408295 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18ffb54a-4429-4fd0-a386-e7e3e71837b6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4cfc0ad830 con 0x7f4d080700f0 2023-12-07T09:58:48.663 INFO:teuthology.orchestra.run.smithi097.stdout:2 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 msgr2=0x7f4d08152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 0x7f4d08152ec0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0af040 tx=0x7f4cfc019020 comp rx=0 tx=0).stop 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 shutdown_connections 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d08154000 0x7f4d08153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4d080700f0 0x7f4d08152ec0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 --2- 172.21.15.97:0/22408295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4d0806df30 0x7f4d0806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.658+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 >> 172.21.15.97:0/22408295 conn(0x7f4d080c2a60 msgr2=0x7f4d080a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.662+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 shutdown_connections 2023-12-07T09:58:48.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.662+0000 7f4d0d432640 1 -- 172.21.15.97:0/22408295 wait complete. 2023-12-07T09:58:48.682 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 88e0d0d3-1306-4d18-8b59-87b4b49609be 3 2023-12-07T09:58:48.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 Processor -- start 2023-12-07T09:58:48.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 -- start start 2023-12-07T09:58:48.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae34151d80 0x7fae340c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae340c7f20 0x7fae3406be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3406cf70 con 0x7fae340c8430 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae34152160 con 0x7fae34151d80 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.814+0000 7fae3891c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340c6a30 con 0x7fae340c7f20 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae34151d80 0x7fae340c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae32d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae340c7f20 0x7fae3406be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae34151d80 0x7fae340c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44352/0 (socket says 172.21.15.97:44352) 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 -- 172.21.15.97:0/1329356721 learned_addr learned my addr 172.21.15.97:0/1329356721 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 -- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae340c7f20 msgr2=0x7fae3406be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 --2- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae340c7f20 0x7fae3406be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 -- 172.21.15.97:0/1329356721 >> v1:172.21.15.89:6789/0 conn(0x7fae340c8430 legacy=0x7fae3406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 -- 172.21.15.97:0/1329356721 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340c72d0 con 0x7fae34151d80 2023-12-07T09:58:48.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3259c640 1 --2- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae34151d80 0x7fae340c49a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae24009870 tx=0x7fae2401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0e1ba58e39ecf7a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3159a640 1 -- 172.21.15.97:0/1329356721 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240ab600 con 0x7fae34151d80 2023-12-07T09:58:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3159a640 1 -- 172.21.15.97:0/1329356721 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240ab760 con 0x7fae34151d80 2023-12-07T09:58:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.818+0000 7fae3159a640 1 -- 172.21.15.97:0/1329356721 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240abaf0 con 0x7fae34151d80 2023-12-07T09:58:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae34151d80 msgr2=0x7fae340c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 --2- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae34151d80 0x7fae340c49a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae24009870 tx=0x7fae2401c440 comp rx=0 tx=0).stop 2023-12-07T09:58:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- 172.21.15.97:0/1329356721 shutdown_connections 2023-12-07T09:58:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 --2- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae340c7f20 0x7fae3406be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 --2- 172.21.15.97:0/1329356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae34151d80 0x7fae340c49a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- 172.21.15.97:0/1329356721 >> 172.21.15.97:0/1329356721 conn(0x7fae340abd00 msgr2=0x7fae340ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- 172.21.15.97:0/1329356721 shutdown_connections 2023-12-07T09:58:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- 172.21.15.97:0/1329356721 wait complete. 2023-12-07T09:58:48.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 Processor -- start 2023-12-07T09:58:48.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- start start 2023-12-07T09:58:48.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae340c7f20 0x7fae34145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 0x7fae341ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae34151d80 0x7fae341eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341f1190 con 0x7fae340c7f20 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341f16c0 con 0x7fae340c8430 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3891c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae341f13e0 con 0x7fae34151d80 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae31d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 0x7fae341ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae32d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae34151d80 0x7fae341eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae31d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 0x7fae341ee6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44360/0 (socket says 172.21.15.97:44360) 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae31d9b640 1 -- 172.21.15.97:0/1980044755 learned_addr learned my addr 172.21.15.97:0/1980044755 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.822+0000 7fae3259c640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae340c7f20 0x7fae34145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae31d9b640 1 -- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae34151d80 msgr2=0x7fae341eec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae31d9b640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae34151d80 0x7fae341eec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae31d9b640 1 -- 172.21.15.97:0/1980044755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae340c7f20 msgr2=0x7fae34145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae31d9b640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae340c7f20 0x7fae34145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae31d9b640 1 -- 172.21.15.97:0/1980044755 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240094d0 con 0x7fae340c8430 2023-12-07T09:58:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae3259c640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae340c7f20 0x7fae34145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae32d9d640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae34151d80 0x7fae341eec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae31d9b640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 0x7fae341ee6f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b3e0 tx=0x7fae2800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28011830 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280119b0 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28011d60 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340aad20 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae341458a0 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae2801a700 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fae28019720 con 0x7fae340c8430 2023-12-07T09:58:48.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.826+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3406c8e0 con 0x7fae340c8430 2023-12-07T09:58:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.830+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fae28039ce0 con 0x7fae340c8430 2023-12-07T09:58:48.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.894+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88e0d0d3-1306-4d18-8b59-87b4b49609be", "id": 3} v 0) v1 -- 0x7fae340c9880 con 0x7fae340c8430 2023-12-07T09:58:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae22ffd640 1 -- 172.21.15.97:0/1980044755 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88e0d0d3-1306-4d18-8b59-87b4b49609be", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae28028030 con 0x7fae340c8430 2023-12-07T09:58:48.905 INFO:teuthology.orchestra.run.smithi097.stdout:3 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 msgr2=0x7fae341ee6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 0x7fae341ee6f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b3e0 tx=0x7fae2800b8a0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 shutdown_connections 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae34151d80 0x7fae341eec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae340c8430 0x7fae341ee6f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 --2- 172.21.15.97:0/1980044755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae340c7f20 0x7fae34145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 >> 172.21.15.97:0/1980044755 conn(0x7fae340abd00 msgr2=0x7fae3415e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 shutdown_connections 2023-12-07T09:58:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:48.902+0000 7fae3891c640 1 -- 172.21.15.97:0/1980044755 wait complete. 2023-12-07T09:58:48.925 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new fb307243-e50f-4819-af38-0ed8cbe5bf81 4 2023-12-07T09:58:49.018 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.014+0000 7f2ecc649180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-07T09:58:49.028 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.025+0000 7f088282c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-07T09:58:49.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 Processor -- start 2023-12-07T09:58:49.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 -- start start 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc541543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc5406df30 0x7efc540716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc54154920 con 0x7efc540700f0 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540a8710 con 0x7efc5406df30 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc59780640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc54071be0 con 0x7efc54154000 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc541543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc541543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:50776/0 (socket says 172.21.15.97:50776) 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 -- 172.21.15.97:0/1409600530 learned_addr learned my addr 172.21.15.97:0/1409600530 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc537fe640 1 --2- 172.21.15.97:0/1409600530 >> v2:172.21.15.89:3300/0 conn(0x7efc5406df30 0x7efc540716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 -- 172.21.15.97:0/1409600530 >> v2:172.21.15.89:3300/0 conn(0x7efc5406df30 msgr2=0x7efc540716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 --2- 172.21.15.97:0/1409600530 >> v2:172.21.15.89:3300/0 conn(0x7efc5406df30 0x7efc540716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 -- 172.21.15.97:0/1409600530 >> v1:172.21.15.89:6789/0 conn(0x7efc540700f0 legacy=0x7efc54070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.058+0000 7efc52ffd640 1 -- 172.21.15.97:0/1409600530 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54154b90 con 0x7efc54154000 2023-12-07T09:58:49.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc52ffd640 1 --2- 172.21.15.97:0/1409600530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc541543e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc4401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1584d2bd303c3b01 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc51ffb640 1 -- 172.21.15.97:0/1409600530 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440ab600 con 0x7efc54154000 2023-12-07T09:58:49.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc51ffb640 1 -- 172.21.15.97:0/1409600530 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440a7050 con 0x7efc54154000 2023-12-07T09:58:49.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc51ffb640 1 -- 172.21.15.97:0/1409600530 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440ab980 con 0x7efc54154000 2023-12-07T09:58:49.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 -- 172.21.15.97:0/1409600530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 msgr2=0x7efc541543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 --2- 172.21.15.97:0/1409600530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc541543e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc4401c420 comp rx=0 tx=0).stop 2023-12-07T09:58:49.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 -- 172.21.15.97:0/1409600530 shutdown_connections 2023-12-07T09:58:49.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 --2- 172.21.15.97:0/1409600530 >> v2:172.21.15.89:3300/0 conn(0x7efc5406df30 0x7efc540716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 --2- 172.21.15.97:0/1409600530 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc541543e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 -- 172.21.15.97:0/1409600530 >> 172.21.15.97:0/1409600530 conn(0x7efc540c2a60 msgr2=0x7efc540c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 -- 172.21.15.97:0/1409600530 shutdown_connections 2023-12-07T09:58:49.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 -- 172.21.15.97:0/1409600530 wait complete. 2023-12-07T09:58:49.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 Processor -- start 2023-12-07T09:58:49.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.066+0000 7efc59780640 1 -- start start 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5406df30 0x7efc541473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc540700f0 0x7efc541eec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc5414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540c4120 con 0x7efc5406df30 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc541ef150 con 0x7efc540700f0 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc54147a30 con 0x7efc54154000 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc5414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc527fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc540700f0 0x7efc541eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc5414cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:50786/0 (socket says 172.21.15.97:50786) 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 -- 172.21.15.97:0/2273036473 learned_addr learned my addr 172.21.15.97:0/2273036473 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc52ffd640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5406df30 0x7efc541473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 -- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc540700f0 msgr2=0x7efc541eec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc540700f0 0x7efc541eec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 -- 172.21.15.97:0/2273036473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5406df30 msgr2=0x7efc541473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5406df30 0x7efc541473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 -- 172.21.15.97:0/2273036473 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440094d0 con 0x7efc54154000 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc537fe640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc5414cde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009d30 tx=0x7efc4c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c009ba0 con 0x7efc54154000 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00f040 con 0x7efc54154000 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54147d10 con 0x7efc54154000 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0146c0 con 0x7efc54154000 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc540c45e0 con 0x7efc54154000 2023-12-07T09:58:49.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc4c014b20 con 0x7efc54154000 2023-12-07T09:58:49.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7efc4c01dc70 con 0x7efc54154000 2023-12-07T09:58:49.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.070+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc54147f50 con 0x7efc54154000 2023-12-07T09:58:49.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.074+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7efc4c03bce0 con 0x7efc54154000 2023-12-07T09:58:49.086 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.082+0000 7f2ecc649180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-07T09:58:49.091 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.089+0000 7f088282c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-07T09:58:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.138+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb307243-e50f-4819-af38-0ed8cbe5bf81", "id": 4} v 0) v1 -- 0x7efc5404e890 con 0x7efc54154000 2023-12-07T09:58:49.147 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.142+0000 7f2ecc649180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-07T09:58:49.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc3b7fe640 1 -- 172.21.15.97:0/2273036473 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb307243-e50f-4819-af38-0ed8cbe5bf81", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc4c02a070 con 0x7efc54154000 2023-12-07T09:58:49.150 INFO:teuthology.orchestra.run.smithi097.stdout:4 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 msgr2=0x7efc5414cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc5414cde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009d30 tx=0x7efc4c00c490 comp rx=0 tx=0).stop 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 shutdown_connections 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc54154000 0x7efc5414cde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc540700f0 0x7efc541eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 --2- 172.21.15.97:0/2273036473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5406df30 0x7efc541473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 >> 172.21.15.97:0/2273036473 conn(0x7efc540c2a60 msgr2=0x7efc5406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 shutdown_connections 2023-12-07T09:58:49.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.146+0000 7efc59780640 1 -- 172.21.15.97:0/2273036473 wait complete. 2023-12-07T09:58:49.152 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.149+0000 7f088282c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-07T09:58:49.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 7406c73f-f4e4-4b84-b98f-8dd5060c426e 5 2023-12-07T09:58:49.238 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.234+0000 7f2ecc649180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-07T09:58:49.239 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.237+0000 7f088282c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-07T09:58:49.298 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.297+0000 7f088282c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-07T09:58:49.300 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.294+0000 7f2ecc649180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-07T09:58:49.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 Processor -- start 2023-12-07T09:58:49.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 -- start start 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb9740c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb974157e30 0x7fb9741582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb974155210 con 0x7fb974151d80 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97406d5d0 con 0x7fb974157e30 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97c2aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9741554e0 con 0x7fb9740c7ee0 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb974157e30 0x7fb9741582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb979845640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb9740c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb974157e30 0x7fb9741582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44384/0 (socket says 172.21.15.97:44384) 2023-12-07T09:58:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 -- 172.21.15.97:0/1102295847 learned_addr learned my addr 172.21.15.97:0/1102295847 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 -- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 msgr2=0x7fb9740c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 --2- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb9740c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 -- 172.21.15.97:0/1102295847 >> v1:172.21.15.89:6789/0 conn(0x7fb974151d80 legacy=0x7fb9740abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb97a847640 1 -- 172.21.15.97:0/1102295847 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97406d1f0 con 0x7fb974157e30 2023-12-07T09:58:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.302+0000 7fb979845640 1 --2- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb9740c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:49.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97a847640 1 --2- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974157e30 0x7fb9741582c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009e50 tx=0x7fb96c01c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bea3e71cfaa7761f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb979044640 1 -- 172.21.15.97:0/1102295847 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0a56e0 con 0x7fb974157e30 2023-12-07T09:58:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb979044640 1 -- 172.21.15.97:0/1102295847 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0a5840 con 0x7fb974157e30 2023-12-07T09:58:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb979044640 1 -- 172.21.15.97:0/1102295847 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0a5bd0 con 0x7fb974157e30 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 -- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974157e30 msgr2=0x7fb9741582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974157e30 0x7fb9741582c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009e50 tx=0x7fb96c01c8f0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 -- 172.21.15.97:0/1102295847 shutdown_connections 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974157e30 0x7fb9741582c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/1102295847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb9740c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 -- 172.21.15.97:0/1102295847 >> 172.21.15.97:0/1102295847 conn(0x7fb9740c9fe0 msgr2=0x7fb9740ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 -- 172.21.15.97:0/1102295847 shutdown_connections 2023-12-07T09:58:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.306+0000 7fb97c2aa640 1 -- 172.21.15.97:0/1102295847 wait complete. 2023-12-07T09:58:49.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 Processor -- start 2023-12-07T09:58:49.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 -- start start 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb974148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 0x7fb97414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb974157e30 0x7fb9741ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740ab6f0 con 0x7fb974157e30 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9741439e0 con 0x7fb974151d80 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740ab940 con 0x7fb9740c7ee0 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb979845640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 0x7fb97414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb979845640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 0x7fb97414aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44390/0 (socket says 172.21.15.97:44390) 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb979845640 1 -- 172.21.15.97:0/2251008561 learned_addr learned my addr 172.21.15.97:0/2251008561 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb974148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a847640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb974157e30 0x7fb9741ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 -- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 msgr2=0x7fb97414aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 0x7fb97414aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 -- 172.21.15.97:0/2251008561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb974157e30 msgr2=0x7fb9741ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb974157e30 0x7fb9741ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 -- 172.21.15.97:0/2251008561 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009420 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb979845640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 0x7fb97414aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97a046640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb974148d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb970000f70 tx=0x7fb97000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700052d0 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970005430 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970003840 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c009b30 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97414e8a0 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.310+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb970003ca0 con 0x7fb9740c7ee0 2023-12-07T09:58:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.314+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb970011b10 con 0x7fb9740c7ee0 2023-12-07T09:58:49.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.314+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97404e890 con 0x7fb9740c7ee0 2023-12-07T09:58:49.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.314+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb970017070 con 0x7fb9740c7ee0 2023-12-07T09:58:49.387 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.385+0000 7f088282c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-07T09:58:49.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.382+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7406c73f-f4e4-4b84-b98f-8dd5060c426e", "id": 5} v 0) v1 -- 0x7fb9741ed3c0 con 0x7fb9740c7ee0 2023-12-07T09:58:49.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.386+0000 7fb96affd640 1 -- 172.21.15.97:0/2251008561 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7406c73f-f4e4-4b84-b98f-8dd5060c426e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb970011590 con 0x7fb9740c7ee0 2023-12-07T09:58:49.391 INFO:teuthology.orchestra.run.smithi097.stdout:5 2023-12-07T09:58:49.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 msgr2=0x7fb974148d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb974148d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb970000f70 tx=0x7fb97000c820 comp rx=0 tx=0).stop 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 shutdown_connections 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb974157e30 0x7fb9741ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb974151d80 0x7fb97414aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 --2- 172.21.15.97:0/2251008561 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9740c7ee0 0x7fb974148d10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 >> 172.21.15.97:0/2251008561 conn(0x7fb9740c9fe0 msgr2=0x7fb9740c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 shutdown_connections 2023-12-07T09:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.390+0000 7fb97c2aa640 1 -- 172.21.15.97:0/2251008561 wait complete. 2023-12-07T09:58:49.393 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.390+0000 7f2ecc649180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-07T09:58:49.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9 6 2023-12-07T09:58:49.451 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.449+0000 7f088282c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-07T09:58:49.458 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.454+0000 7f2ecc649180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-07T09:58:49.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 Processor -- start 2023-12-07T09:58:49.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 -- start start 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe258151d80 0x7fe2580c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2580c7f20 0x7fe25806be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25806cf70 con 0x7fe2580c8430 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe258152160 con 0x7fe2580c7f20 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25fe94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2580c6a30 con 0x7fe258151d80 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25dc30640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe258151d80 0x7fe2580c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25dc30640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe258151d80 0x7fe2580c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44404/0 (socket says 172.21.15.97:44404) 2023-12-07T09:58:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25dc30640 1 -- 172.21.15.97:0/2638642478 learned_addr learned my addr 172.21.15.97:0/2638642478 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.542+0000 7fe25e431640 1 --2- 172.21.15.97:0/2638642478 >> v2:172.21.15.89:3300/0 conn(0x7fe2580c7f20 0x7fe25806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25dc30640 1 -- 172.21.15.97:0/2638642478 >> v2:172.21.15.89:3300/0 conn(0x7fe2580c7f20 msgr2=0x7fe25806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25dc30640 1 --2- 172.21.15.97:0/2638642478 >> v2:172.21.15.89:3300/0 conn(0x7fe2580c7f20 0x7fe25806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25dc30640 1 -- 172.21.15.97:0/2638642478 >> v1:172.21.15.89:6789/0 conn(0x7fe2580c8430 legacy=0x7fe25806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25dc30640 1 -- 172.21.15.97:0/2638642478 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580c72d0 con 0x7fe258151d80 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25dc30640 1 --2- 172.21.15.97:0/2638642478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe2580c49a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe25808b3e0 tx=0x7fe25401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a7fd3891233a407 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25cc2e640 1 -- 172.21.15.97:0/2638642478 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540ab640 con 0x7fe258151d80 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25cc2e640 1 -- 172.21.15.97:0/2638642478 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2540a7070 con 0x7fe258151d80 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25cc2e640 1 -- 172.21.15.97:0/2638642478 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540ab9c0 con 0x7fe258151d80 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25fe94640 1 -- 172.21.15.97:0/2638642478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 msgr2=0x7fe2580c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.546+0000 7fe25fe94640 1 --2- 172.21.15.97:0/2638642478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe2580c49a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe25808b3e0 tx=0x7fe25401c440 comp rx=0 tx=0).stop 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- 172.21.15.97:0/2638642478 shutdown_connections 2023-12-07T09:58:49.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 --2- 172.21.15.97:0/2638642478 >> v2:172.21.15.89:3300/0 conn(0x7fe2580c7f20 0x7fe25806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 --2- 172.21.15.97:0/2638642478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe2580c49a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- 172.21.15.97:0/2638642478 >> 172.21.15.97:0/2638642478 conn(0x7fe2580abd00 msgr2=0x7fe2580ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- 172.21.15.97:0/2638642478 shutdown_connections 2023-12-07T09:58:49.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- 172.21.15.97:0/2638642478 wait complete. 2023-12-07T09:58:49.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 Processor -- start 2023-12-07T09:58:49.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- start start 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 0x7fe2581ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2580c8430 0x7fe2581f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe25814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2581ed260 con 0x7fe2580c8430 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580c1bf0 con 0x7fe258151d80 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25fe94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580c1ed0 con 0x7fe2580c7f20 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 0x7fe2581ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 0x7fe2581ecd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:50810/0 (socket says 172.21.15.97:50810) 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25e431640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe25814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 -- 172.21.15.97:0/409391249 learned_addr learned my addr 172.21.15.97:0/409391249 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25d42f640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2580c8430 0x7fe2581f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 -- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 msgr2=0x7fe25814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe25814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 -- 172.21.15.97:0/409391249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2580c8430 msgr2=0x7fe2581f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2580c8430 0x7fe2581f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.550+0000 7fe25dc30640 1 -- 172.21.15.97:0/409391249 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540094d0 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe25dc30640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 0x7fe2581ecd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe254019050 tx=0x7fe25401ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540be3f0 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2540be550 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2581f03c0 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540be8c0 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2580c21b0 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe2540bed20 con 0x7fe2580c7f20 2023-12-07T09:58:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe2540c7da0 con 0x7fe2580c7f20 2023-12-07T09:58:49.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2581f08e0 con 0x7fe2580c7f20 2023-12-07T09:58:49.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.554+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe2581f08e0 con 0x7fe2580c7f20 2023-12-07T09:58:49.603 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.601+0000 7f088282c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-07T09:58:49.616 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.614+0000 7f2ecc649180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-07T09:58:49.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.622+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9", "id": 6} v 0) v1 -- 0x7fe25804e890 con 0x7fe2580c7f20 2023-12-07T09:58:49.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe24e7fc640 1 -- 172.21.15.97:0/409391249 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2540c7440 con 0x7fe2580c7f20 2023-12-07T09:58:49.632 INFO:teuthology.orchestra.run.smithi097.stdout:6 2023-12-07T09:58:49.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 msgr2=0x7fe2581ecd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 0x7fe2581ecd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe254019050 tx=0x7fe25401ac80 comp rx=0 tx=0).stop 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 shutdown_connections 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe258151d80 0x7fe25814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2580c8430 0x7fe2581f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 --2- 172.21.15.97:0/409391249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2580c7f20 0x7fe2581ecd20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 >> 172.21.15.97:0/409391249 conn(0x7fe2580abd00 msgr2=0x7fe25814fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 shutdown_connections 2023-12-07T09:58:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.626+0000 7fe25fe94640 1 -- 172.21.15.97:0/409391249 wait complete. 2023-12-07T09:58:49.650 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new f9be2c35-4439-4b94-bb78-245a9a5f6e64 7 2023-12-07T09:58:49.672 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:49.669+0000 7f088282c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-07T09:58:49.688 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:49.686+0000 7f2ecc649180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-07T09:58:49.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 Processor -- start 2023-12-07T09:58:49.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 -- start start 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbf300c7d80 0x7fbf300c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf300c6c80 0x7fbf3015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf301551a0 con 0x7fbf300af5a0 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf30152080 con 0x7fbf300c7d80 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf368c8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf300c4f60 con 0x7fbf300c6c80 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf360c7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf300c6c80 0x7fbf3015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf360c7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf300c6c80 0x7fbf3015ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44426/0 (socket says 172.21.15.97:44426) 2023-12-07T09:58:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf360c7640 1 -- 172.21.15.97:0/2447718946 learned_addr learned my addr 172.21.15.97:0/2447718946 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.782+0000 7fbf350c5640 1 --2- 172.21.15.97:0/2447718946 >> v2:172.21.15.89:3300/0 conn(0x7fbf300c7d80 0x7fbf300c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf360c7640 1 -- 172.21.15.97:0/2447718946 >> v2:172.21.15.89:3300/0 conn(0x7fbf300c7d80 msgr2=0x7fbf300c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:49.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf360c7640 1 --2- 172.21.15.97:0/2447718946 >> v2:172.21.15.89:3300/0 conn(0x7fbf300c7d80 0x7fbf300c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf360c7640 1 -- 172.21.15.97:0/2447718946 >> v1:172.21.15.89:6789/0 conn(0x7fbf300af5a0 legacy=0x7fbf300ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf360c7640 1 -- 172.21.15.97:0/2447718946 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300c48a0 con 0x7fbf300c6c80 2023-12-07T09:58:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf360c7640 1 --2- 172.21.15.97:0/2447718946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300c6c80 0x7fbf3015ef00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf3008bd70 tx=0x7fbf2801c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7031ffab044a23c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf348c4640 1 -- 172.21.15.97:0/2447718946 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280a5690 con 0x7fbf300c6c80 2023-12-07T09:58:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf348c4640 1 -- 172.21.15.97:0/2447718946 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf280a57f0 con 0x7fbf300c6c80 2023-12-07T09:58:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf348c4640 1 -- 172.21.15.97:0/2447718946 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280a5b80 con 0x7fbf300c6c80 2023-12-07T09:58:49.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf368c8640 1 -- 172.21.15.97:0/2447718946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300c6c80 msgr2=0x7fbf3015ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.786+0000 7fbf368c8640 1 --2- 172.21.15.97:0/2447718946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300c6c80 0x7fbf3015ef00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf3008bd70 tx=0x7fbf2801c9d0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- 172.21.15.97:0/2447718946 shutdown_connections 2023-12-07T09:58:49.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 --2- 172.21.15.97:0/2447718946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300c6c80 0x7fbf3015ef00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 --2- 172.21.15.97:0/2447718946 >> v2:172.21.15.89:3300/0 conn(0x7fbf300c7d80 0x7fbf300c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- 172.21.15.97:0/2447718946 >> 172.21.15.97:0/2447718946 conn(0x7fbf300720d0 msgr2=0x7fbf300724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- 172.21.15.97:0/2447718946 shutdown_connections 2023-12-07T09:58:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- 172.21.15.97:0/2447718946 wait complete. 2023-12-07T09:58:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 Processor -- start 2023-12-07T09:58:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- start start 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 0x7fbf30153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300c6c80 0x7fbf3014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf300c7d80 0x7fbf3014e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300c19e0 con 0x7fbf300c7d80 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf301503b0 con 0x7fbf300af5a0 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf368c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf301500d0 con 0x7fbf300c6c80 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 0x7fbf30153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 0x7fbf30153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44434/0 (socket says 172.21.15.97:44434) 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 -- 172.21.15.97:0/3748501402 learned_addr learned my addr 172.21.15.97:0/3748501402 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-07T09:58:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf360c7640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf300c7d80 0x7fbf3014e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf350c5640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300c6c80 0x7fbf3014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 -- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300c6c80 msgr2=0x7fbf3014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300c6c80 0x7fbf3014e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 -- 172.21.15.97:0/3748501402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf300c7d80 msgr2=0x7fbf3014e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf300c7d80 0x7fbf3014e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf358c6640 1 -- 172.21.15.97:0/3748501402 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28009b30 con 0x7fbf300af5a0 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.790+0000 7fbf360c7640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf300c7d80 0x7fbf3014e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:58:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf358c6640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 0x7fbf30153650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c500 tx=0x7fbf2c00c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:49.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c005220 con 0x7fbf300af5a0 2023-12-07T09:58:49.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c005380 con 0x7fbf300af5a0 2023-12-07T09:58:49.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c007270 con 0x7fbf300af5a0 2023-12-07T09:58:49.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf300c1390 con 0x7fbf300af5a0 2023-12-07T09:58:49.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf30153b90 con 0x7fbf300af5a0 2023-12-07T09:58:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbf2c0067e0 con 0x7fbf300af5a0 2023-12-07T09:58:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fbf2c01ba60 con 0x7fbf300af5a0 2023-12-07T09:58:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf30074970 con 0x7fbf300af5a0 2023-12-07T09:58:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.794+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbf2c016020 con 0x7fbf300af5a0 2023-12-07T09:58:49.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.862+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9be2c35-4439-4b94-bb78-245a9a5f6e64", "id": 7} v 0) v1 -- 0x7fbf3006c9a0 con 0x7fbf300af5a0 2023-12-07T09:58:49.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf267fc640 1 -- 172.21.15.97:0/3748501402 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9be2c35-4439-4b94-bb78-245a9a5f6e64", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf2c02a0b0 con 0x7fbf300af5a0 2023-12-07T09:58:49.870 INFO:teuthology.orchestra.run.smithi097.stdout:7 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 msgr2=0x7fbf30153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 0x7fbf30153650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c500 tx=0x7fbf2c00c9c0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 shutdown_connections 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf300c7d80 0x7fbf3014e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf300c6c80 0x7fbf3014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 --2- 172.21.15.97:0/3748501402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf300af5a0 0x7fbf30153650 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 >> 172.21.15.97:0/3748501402 conn(0x7fbf300720d0 msgr2=0x7fbf300aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 shutdown_connections 2023-12-07T09:58:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-07T09:58:49.866+0000 7fbf368c8640 1 -- 172.21.15.97:0/3748501402 wait complete. 2023-12-07T09:58:49.890 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-07T09:58:49.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-07T09:58:49.894 INFO:tasks.ceph.osd.0:Started 2023-12-07T09:58:49.894 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-07T09:58:49.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-07T09:58:49.898 INFO:tasks.ceph.osd.1:Started 2023-12-07T09:58:49.898 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-07T09:58:49.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-07T09:58:49.902 INFO:tasks.ceph.osd.2:Started 2023-12-07T09:58:49.902 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-07T09:58:49.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-07T09:58:49.906 INFO:tasks.ceph.osd.3:Started 2023-12-07T09:58:49.906 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-07T09:58:49.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-07T09:58:49.934 INFO:tasks.ceph.osd.4:Started 2023-12-07T09:58:49.935 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-07T09:58:49.935 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-07T09:58:49.938 INFO:tasks.ceph.osd.5:Started 2023-12-07T09:58:49.938 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-07T09:58:49.938 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-07T09:58:49.941 INFO:tasks.ceph.osd.6:Started 2023-12-07T09:58:49.941 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-07T09:58:49.942 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-07T09:58:49.945 INFO:tasks.ceph.osd.7:Started 2023-12-07T09:58:49.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:58:50.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 Processor -- start 2023-12-07T09:58:50.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 -- start start 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe94c0ca610 0x7fe94c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe94c0bd720 0x7fe94c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c155790 con 0x7fe94c06cd90 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c0c4b00 con 0x7fe94c0ca610 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe952c79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c0c4de0 con 0x7fe94c0bd720 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe951216640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe94c06cd90 0x7fe94c158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55352/0 (socket says 172.21.15.89:55352) 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe950a15640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe94c0ca610 0x7fe94c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe951216640 1 -- 172.21.15.89:0/119557605 learned_addr learned my addr 172.21.15.89:0/119557605 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe94bfff640 1 --2- 172.21.15.89:0/119557605 >> v2:172.21.15.97:3300/0 conn(0x7fe94c0bd720 0x7fe94c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe94b7fe640 1 -- 172.21.15.89:0/119557605 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652562345 0 0) 0x7fe94c155790 con 0x7fe94c06cd90 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe94b7fe640 1 -- 172.21.15.89:0/119557605 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe93c003530 con 0x7fe94c06cd90 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe950a15640 1 -- 172.21.15.89:0/119557605 >> v2:172.21.15.97:3300/0 conn(0x7fe94c0bd720 msgr2=0x7fe94c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:50.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe950a15640 1 --2- 172.21.15.89:0/119557605 >> v2:172.21.15.97:3300/0 conn(0x7fe94c0bd720 0x7fe94c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe950a15640 1 -- 172.21.15.89:0/119557605 >> v1:172.21.15.89:6789/0 conn(0x7fe94c06cd90 legacy=0x7fe94c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:50.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.137+0000 7fe950a15640 1 -- 172.21.15.89:0/119557605 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c157e30 con 0x7fe94c0ca610 2023-12-07T09:58:50.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe950a15640 1 --2- 172.21.15.89:0/119557605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c0c94c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0ca380 tx=0x7fe94001c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ad655e49000853 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:50.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe94b7fe640 1 -- 172.21.15.89:0/119557605 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0c52d0 con 0x7fe94c0ca610 2023-12-07T09:58:50.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe94b7fe640 1 -- 172.21.15.89:0/119557605 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9400a4860 con 0x7fe94c0ca610 2023-12-07T09:58:50.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe94b7fe640 1 -- 172.21.15.89:0/119557605 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9400a4bf0 con 0x7fe94c0ca610 2023-12-07T09:58:50.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 -- 172.21.15.89:0/119557605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 msgr2=0x7fe94c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:50.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 --2- 172.21.15.89:0/119557605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c0c94c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0ca380 tx=0x7fe94001c020 comp rx=0 tx=0).stop 2023-12-07T09:58:50.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 -- 172.21.15.89:0/119557605 shutdown_connections 2023-12-07T09:58:50.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 --2- 172.21.15.89:0/119557605 >> v2:172.21.15.97:3300/0 conn(0x7fe94c0bd720 0x7fe94c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 --2- 172.21.15.89:0/119557605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c0c94c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 -- 172.21.15.89:0/119557605 >> 172.21.15.89:0/119557605 conn(0x7fe94c071ea0 msgr2=0x7fe94c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:50.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 -- 172.21.15.89:0/119557605 shutdown_connections 2023-12-07T09:58:50.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.141+0000 7fe952c79640 1 -- 172.21.15.89:0/119557605 wait complete. 2023-12-07T09:58:50.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 Processor -- start 2023-12-07T09:58:50.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- start start 2023-12-07T09:58:50.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94c06cd90 0x7fe94c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:50.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe94c0bd720 0x7fe94c14cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:50.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:50.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c151a80 con 0x7fe94c0ca610 2023-12-07T09:58:50.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c1f1b00 con 0x7fe94c06cd90 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c1f24d0 con 0x7fe94c0bd720 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38992/0 (socket says 172.21.15.89:38992) 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 -- 172.21.15.89:0/1817723829 learned_addr learned my addr 172.21.15.89:0/1817723829 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe950a15640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94c06cd90 0x7fe94c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe94bfff640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe94c0bd720 0x7fe94c14cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 -- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe94c0bd720 msgr2=0x7fe94c14cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe94c0bd720 0x7fe94c14cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 -- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94c06cd90 msgr2=0x7fe94c1f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94c06cd90 0x7fe94c1f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 -- 172.21.15.89:0/1817723829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940009420 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe951216640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c152b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe94400cb40 tx=0x7fe94400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94400aca0 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94400ae00 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944012620 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c0aa460 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c0aaa20 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe944012a80 con 0x7fe94c0ca610 2023-12-07T09:58:50.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe944007740 con 0x7fe94c0ca610 2023-12-07T09:58:50.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.145+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c066ba0 con 0x7fe94c0ca610 2023-12-07T09:58:50.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.149+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe94c066ba0 con 0x7fe94c0ca610 2023-12-07T09:58:50.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.205+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe94c1f1c70 con 0x7fe94c0ca610 2023-12-07T09:58:50.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.205+0000 7fe9497fa640 1 -- 172.21.15.89:0/1817723829 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe944017070 con 0x7fe94c0ca610 2023-12-07T09:58:50.210 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:58:50.210 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":10,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:58:49.865809+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 msgr2=0x7fe94c152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c152b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe94400cb40 tx=0x7fe94400a060 comp rx=0 tx=0).stop 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 shutdown_connections 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94c0ca610 0x7fe94c152b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe94c0bd720 0x7fe94c14cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 --2- 172.21.15.89:0/1817723829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94c06cd90 0x7fe94c1f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 >> 172.21.15.89:0/1817723829 conn(0x7fe94c071ea0 msgr2=0x7fe94c0c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 shutdown_connections 2023-12-07T09:58:50.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:58:50.209+0000 7fe952c79640 1 -- 172.21.15.89:0/1817723829 wait complete. 2023-12-07T09:58:50.229 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-07T09:58:50.230 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-07T09:58:50.321 INFO:tasks.ceph.mgr.y.smithi089.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-07T09:58:50.322 INFO:tasks.ceph.mgr.y.smithi089.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-07T09:58:50.322 INFO:tasks.ceph.mgr.y.smithi089.stderr: from numpy import show_config as show_numpy_config 2023-12-07T09:58:50.323 INFO:tasks.ceph.mgr.x.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-07T09:58:50.323 INFO:tasks.ceph.mgr.x.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-07T09:58:50.323 INFO:tasks.ceph.mgr.x.smithi097.stderr: from numpy import show_config as show_numpy_config 2023-12-07T09:58:50.374 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:50.369+0000 7f088282c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-07T09:58:50.386 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:50.382+0000 7f2ecc649180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-07T09:58:50.511 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:50.509+0000 7f088282c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-07T09:58:50.521 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:50.518+0000 7f2ecc649180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-07T09:58:50.591 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T09:58:50.589+0000 7f025902f640 -1 Falling back to public interface 2023-12-07T09:58:50.595 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-12-07T09:58:50.593+0000 7f4e3d9ef640 -1 Falling back to public interface 2023-12-07T09:58:50.603 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-12-07T09:58:50.601+0000 7f7f3bfda640 -1 Falling back to public interface 2023-12-07T09:58:50.607 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-12-07T09:58:50.605+0000 7f2349ec9640 -1 Falling back to public interface 2023-12-07T09:58:50.617 INFO:tasks.ceph.osd.7.smithi097.stderr:2023-12-07T09:58:50.614+0000 7f106105d640 -1 Falling back to public interface 2023-12-07T09:58:50.618 INFO:tasks.ceph.osd.5.smithi097.stderr:2023-12-07T09:58:50.614+0000 7f6fd29c6640 -1 Falling back to public interface 2023-12-07T09:58:50.641 INFO:tasks.ceph.osd.4.smithi097.stderr:2023-12-07T09:58:50.638+0000 7f0caccd2640 -1 Falling back to public interface 2023-12-07T09:58:50.661 INFO:tasks.ceph.osd.6.smithi097.stderr:2023-12-07T09:58:50.658+0000 7fac14cba640 -1 Falling back to public interface 2023-12-07T09:58:50.687 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:50.685+0000 7f088282c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-07T09:58:50.722 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:50.718+0000 7f2ecc649180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-07T09:58:50.759 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:50.757+0000 7f088282c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-07T09:58:50.805 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:50.798+0000 7f2ecc649180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-07T09:58:50.896 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:50.893+0000 7f088282c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-07T09:58:50.942 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:50.938+0000 7f2ecc649180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-07T09:58:51.035 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T09:58:51.162 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.157+0000 7fbc4de32640 1 Processor -- start 2023-12-07T09:58:51.162 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.157+0000 7fbc4de32640 1 -- start start 2023-12-07T09:58:51.163 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4de32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480bd750 0x7fbc4814e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:51.163 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4de32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc4814e950 0x7fbc480c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4de32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480cad40 con 0x7fbc480c4ca0 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4de32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4806ceb0 con 0x7fbc4814e950 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4de32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480ca4a0 con 0x7fbc480bd750 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc4814e950 0x7fbc480c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc4814e950 0x7fbc480c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38996/0 (socket says 172.21.15.89:38996) 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 -- 172.21.15.89:0/3930684714 learned_addr learned my addr 172.21.15.89:0/3930684714 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc47fff640 1 --2- 172.21.15.89:0/3930684714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480bd750 0x7fbc4814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 -- 172.21.15.89:0/3930684714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480bd750 msgr2=0x7fbc4814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:51.164 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 --2- 172.21.15.89:0/3930684714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480bd750 0x7fbc4814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.165 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 -- 172.21.15.89:0/3930684714 >> v1:172.21.15.97:6789/0 conn(0x7fbc480c4ca0 legacy=0x7fbc48155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:51.165 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.161+0000 7fbc4d631640 1 -- 172.21.15.89:0/3930684714 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480ca780 con 0x7fbc4814e950 2023-12-07T09:58:51.166 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4d631640 1 --2- 172.21.15.89:0/3930684714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc480c6f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009e50 tx=0x7fbc4001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c625dc7ea989c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:51.167 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc477fe640 1 -- 172.21.15.89:0/3930684714 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400a57f0 con 0x7fbc4814e950 2023-12-07T09:58:51.167 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc477fe640 1 -- 172.21.15.89:0/3930684714 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400a5950 con 0x7fbc4814e950 2023-12-07T09:58:51.167 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc477fe640 1 -- 172.21.15.89:0/3930684714 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400a5ce0 con 0x7fbc4814e950 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 -- 172.21.15.89:0/3930684714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 msgr2=0x7fbc480c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3930684714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc480c6f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009e50 tx=0x7fbc4001ca10 comp rx=0 tx=0).stop 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 -- 172.21.15.89:0/3930684714 shutdown_connections 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3930684714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc480c6f90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3930684714 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480bd750 0x7fbc4814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 -- 172.21.15.89:0/3930684714 >> 172.21.15.89:0/3930684714 conn(0x7fbc48071e90 msgr2=0x7fbc480722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 -- 172.21.15.89:0/3930684714 shutdown_connections 2023-12-07T09:58:51.168 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 -- 172.21.15.89:0/3930684714 wait complete. 2023-12-07T09:58:51.169 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 Processor -- start 2023-12-07T09:58:51.169 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.165+0000 7fbc4de32640 1 -- start start 2023-12-07T09:58:51.171 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc480bd750 0x7fbc481f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:51.171 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480c4ca0 0x7fbc4814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:51.171 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc4814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:51.171 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480c1bc0 con 0x7fbc4814e950 2023-12-07T09:58:51.171 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480c4040 con 0x7fbc480bd750 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480c4490 con 0x7fbc480c4ca0 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc4814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc4814ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39010/0 (socket says 172.21.15.89:39010) 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 -- 172.21.15.89:0/3702733099 learned_addr learned my addr 172.21.15.89:0/3702733099 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4ce30640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc480bd750 0x7fbc481f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480c4ca0 0x7fbc4814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 -- 172.21.15.89:0/3702733099 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480c4ca0 msgr2=0x7fbc4814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480c4ca0 0x7fbc4814a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 -- 172.21.15.89:0/3702733099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc480bd750 msgr2=0x7fbc481f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc480bd750 0x7fbc481f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.172 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 -- 172.21.15.89:0/3702733099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009b30 con 0x7fbc4814e950 2023-12-07T09:58:51.173 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4d631640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc4814ab60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc4001a640 tx=0x7fbc400197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400b8670 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400b87d0 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400b8b60 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc480c1920 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc481f0f70 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc400c1400 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbc400b6440 con 0x7fbc4814e950 2023-12-07T09:58:51.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.169+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc480c41b0 con 0x7fbc4814e950 2023-12-07T09:58:51.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.173+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbc400dfce0 con 0x7fbc4814e950 2023-12-07T09:58:51.232 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc48068940 con 0x7fbc4814e950 2023-12-07T09:58:51.232 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc457fa640 1 -- 172.21.15.89:0/3702733099 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbc400ce030 con 0x7fbc4814e950 2023-12-07T09:58:51.233 INFO:teuthology.misc.health.smithi089.stdout: 2023-12-07T09:58:51.233 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":10,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:58:49.865809+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 msgr2=0x7fbc4814ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc4814ab60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc4001a640 tx=0x7fbc400197b0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 shutdown_connections 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc4814e950 0x7fbc4814ab60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc480c4ca0 0x7fbc4814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 --2- 172.21.15.89:0/3702733099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc480bd750 0x7fbc481f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 >> 172.21.15.89:0/3702733099 conn(0x7fbc48071e90 msgr2=0x7fbc480aa170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 shutdown_connections 2023-12-07T09:58:51.234 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:51.229+0000 7fbc4de32640 1 -- 172.21.15.89:0/3702733099 wait complete. 2023-12-07T09:58:51.251 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-07T09:58:51.574 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:51.569+0000 7f088282c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-07T09:58:51.618 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:51.614+0000 7f2ecc649180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-07T09:58:51.660 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:51.657+0000 7f088282c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-07T09:58:51.705 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:51.702+0000 7f2ecc649180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-07T09:58:51.850 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:51.845+0000 7f088282c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-07T09:58:51.895 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:51.890+0000 7f2ecc649180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-07T09:58:51.934 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:51.929+0000 7f088282c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-07T09:58:51.980 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:51.974+0000 7f2ecc649180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-07T09:58:52.259 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:52.256+0000 7f088282c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-07T09:58:52.306 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:52.302+0000 7f2ecc649180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-07T09:58:52.326 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:52.320+0000 7f088282c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-07T09:58:52.380 INFO:tasks.ceph.mgr.x.smithi097.stderr:2023-12-07T09:58:52.374+0000 7f2ecc649180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-07T09:58:53.349 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:53.344+0000 7f0828f73640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-07T09:58:53.349 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-12-07T09:58:53.344+0000 7f0828f73640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-07T09:58:54.433 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T09:58:54.428+0000 7f025902f640 -1 osd.0 0 log_to_monitors true 2023-12-07T09:58:54.446 INFO:tasks.ceph.osd.5.smithi097.stderr:2023-12-07T09:58:54.441+0000 7f6fd29c6640 -1 osd.5 0 log_to_monitors true 2023-12-07T09:58:54.520 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-12-07T09:58:54.516+0000 7f7f3bfda640 -1 osd.2 0 log_to_monitors true 2023-12-07T09:58:54.547 INFO:tasks.ceph.osd.7.smithi097.stderr:2023-12-07T09:58:54.541+0000 7f106105d640 -1 osd.7 0 log_to_monitors true 2023-12-07T09:58:54.609 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-12-07T09:58:54.604+0000 7f4e3d9ef640 -1 osd.3 0 log_to_monitors true 2023-12-07T09:58:54.612 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-12-07T09:58:54.608+0000 7f2349ec9640 -1 osd.1 0 log_to_monitors true 2023-12-07T09:58:54.620 INFO:tasks.ceph.osd.6.smithi097.stderr:2023-12-07T09:58:54.617+0000 7fac14cba640 -1 osd.6 0 log_to_monitors true 2023-12-07T09:58:54.807 INFO:tasks.ceph.osd.4.smithi097.stderr:2023-12-07T09:58:54.801+0000 7f0caccd2640 -1 osd.4 0 log_to_monitors true 2023-12-07T09:58:58.057 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T09:58:58.258 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.252+0000 7fca0a5b8640 1 Processor -- start 2023-12-07T09:58:58.258 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.252+0000 7fca0a5b8640 1 -- start start 2023-12-07T09:58:58.259 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca0a5b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fca04152060 0x7fca040722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca0a5b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca040c0e30 0x7fca04072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca0a5b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca04070780 con 0x7fca040a8e10 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca0a5b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca04158200 con 0x7fca04152060 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca0a5b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04155ae0 con 0x7fca040c0e30 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca03fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fca04152060 0x7fca040722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca08b55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca040c0e30 0x7fca04072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca08b55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca040c0e30 0x7fca04072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:43982/0 (socket says 172.21.15.89:43982) 2023-12-07T09:58:58.261 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca08b55640 1 -- 172.21.15.89:0/892436746 learned_addr learned my addr 172.21.15.89:0/892436746 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:58:58.262 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca03fff640 1 -- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca040c0e30 msgr2=0x7fca04072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:58:58.263 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca03fff640 1 --2- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca040c0e30 0x7fca04072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.263 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca03fff640 1 -- 172.21.15.89:0/892436746 >> v1:172.21.15.89:6789/0 conn(0x7fca040a8e10 legacy=0x7fca04158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:58.263 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.256+0000 7fca03fff640 1 -- 172.21.15.89:0/892436746 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca04070a60 con 0x7fca04152060 2023-12-07T09:58:58.265 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.260+0000 7fca03fff640 1 --2- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca04152060 0x7fca040722c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009d90 tx=0x7fc9fc01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce796aa850b0727d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:58.266 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.260+0000 7fca02ffd640 1 -- 172.21.15.89:0/892436746 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0a5920 con 0x7fca04152060 2023-12-07T09:58:58.266 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.260+0000 7fca02ffd640 1 -- 172.21.15.89:0/892436746 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0a5a80 con 0x7fca04152060 2023-12-07T09:58:58.266 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.260+0000 7fca02ffd640 1 -- 172.21.15.89:0/892436746 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0a5e10 con 0x7fca04152060 2023-12-07T09:58:58.267 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 -- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca04152060 msgr2=0x7fca040722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:58.267 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca04152060 0x7fca040722c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009d90 tx=0x7fc9fc01c8c0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.267 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 -- 172.21.15.89:0/892436746 shutdown_connections 2023-12-07T09:58:58.268 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca040c0e30 0x7fca04072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.268 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/892436746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca04152060 0x7fca040722c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.268 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 -- 172.21.15.89:0/892436746 >> 172.21.15.89:0/892436746 conn(0x7fca040c6430 msgr2=0x7fca040c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:58.268 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 -- 172.21.15.89:0/892436746 shutdown_connections 2023-12-07T09:58:58.268 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.264+0000 7fca0a5b8640 1 -- 172.21.15.89:0/892436746 wait complete. 2023-12-07T09:58:58.271 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 Processor -- start 2023-12-07T09:58:58.272 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 -- start start 2023-12-07T09:58:58.274 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca040a8e10 0x7fca04151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:58.274 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca040c0e30 0x7fca0414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:58.274 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca04152060 0x7fca0414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:58.274 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca040acba0 con 0x7fca040a8e10 2023-12-07T09:58:58.274 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0414fa70 con 0x7fca040c0e30 2023-12-07T09:58:58.274 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.268+0000 7fca0a5b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca040b9df0 con 0x7fca04152060 2023-12-07T09:58:58.276 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca037fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca040c0e30 0x7fca0414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:58.276 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca037fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca040c0e30 0x7fca0414eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:46470/0 (socket says 172.21.15.89:46470) 2023-12-07T09:58:58.276 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca037fe640 1 -- 172.21.15.89:0/524870149 learned_addr learned my addr 172.21.15.89:0/524870149 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:58:58.276 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca04152060 0x7fca0414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:58.276 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca03fff640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca040a8e10 0x7fca04151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:58.276 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 -- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca040c0e30 msgr2=0x7fca0414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca040c0e30 0x7fca0414eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 -- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca040a8e10 msgr2=0x7fca04151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca040a8e10 0x7fca04151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 -- 172.21.15.89:0/524870149 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009a70 con 0x7fca04152060 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca03fff640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca040a8e10 0x7fca04151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca08b55640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca04152060 0x7fca0414f530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400e590 tx=0x7fc9f400ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:58.277 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4004220 con 0x7fca04152060 2023-12-07T09:58:58.278 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f40043a0 con 0x7fca04152060 2023-12-07T09:58:58.278 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.272+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4004510 con 0x7fca04152060 2023-12-07T09:58:58.278 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.276+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca040ad050 con 0x7fca04152060 2023-12-07T09:58:58.279 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.276+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca040b9a80 con 0x7fca04152060 2023-12-07T09:58:58.282 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.276+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 4) v1 ==== 86114+0+0 (secure 0 0 0) 0x7fc9f4003860 con 0x7fca04152060 2023-12-07T09:58:58.283 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.280+0000 7fca00ff9640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9f0066890 0x7fc9f0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:58:58.283 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.280+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca040b9600 con 0x7fca04152060 2023-12-07T09:58:58.284 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.280+0000 7fca03fff640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9f0066890 0x7fc9f0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:58:58.285 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.280+0000 7fca03fff640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9f0066890 0x7fc9f0068d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0af000 tx=0x7fc9fc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:58:58.289 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.284+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fc9f40547f0 con 0x7fca04152060 2023-12-07T09:58:58.306 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.300+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9f404a280 con 0x7fca04152060 2023-12-07T09:58:58.629 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.624+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca041f1190 con 0x7fca04152060 2023-12-07T09:58:58.630 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.624+0000 7fca00ff9640 1 -- 172.21.15.89:0/524870149 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fca040b9600 con 0x7fca04152060 2023-12-07T09:58:58.630 INFO:teuthology.misc.health.smithi089.stdout: 2023-12-07T09:58:58.631 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":12,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:58:56.347059+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:58:58.634 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9f0066890 msgr2=0x7fc9f0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9f0066890 0x7fc9f0068d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0af000 tx=0x7fc9fc0a7070 comp rx=0 tx=0).stop 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca04152060 msgr2=0x7fca0414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca04152060 0x7fca0414f530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400e590 tx=0x7fc9f400ea50 comp rx=0 tx=0).stop 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 shutdown_connections 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9f0066890 0x7fc9f0068d50 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0af000 tx=0x7fc9fc0a7070 comp rx=0 tx=0).stop 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fca04152060 0x7fca0414f530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca040c0e30 0x7fca0414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 --2- 172.21.15.89:0/524870149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca040a8e10 0x7fca04151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:58:58.635 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.628+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 >> 172.21.15.89:0/524870149 conn(0x7fca040c6430 msgr2=0x7fca04072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:58:58.636 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.632+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 shutdown_connections 2023-12-07T09:58:58.636 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:58:58.632+0000 7fca0a5b8640 1 -- 172.21.15.89:0/524870149 wait complete. 2023-12-07T09:58:58.665 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-07T09:58:58.749 INFO:tasks.ceph.osd.5.smithi097.stderr:2023-12-07T09:58:58.741+0000 7f6fcf985640 -1 osd.5 0 waiting for initial osdmap 2023-12-07T09:58:58.755 INFO:tasks.ceph.osd.4.smithi097.stderr:2023-12-07T09:58:58.749+0000 7f0ca8459640 -1 osd.4 0 waiting for initial osdmap 2023-12-07T09:58:58.760 INFO:tasks.ceph.osd.7.smithi097.stderr:2023-12-07T09:58:58.753+0000 7f105c7e4640 -1 osd.7 0 waiting for initial osdmap 2023-12-07T09:58:58.778 INFO:tasks.ceph.osd.5.smithi097.stderr:2023-12-07T09:58:58.773+0000 7f6fc679c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.789 INFO:tasks.ceph.osd.4.smithi097.stderr:2023-12-07T09:58:58.785+0000 7f0ca0aa6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.794 INFO:tasks.ceph.osd.7.smithi097.stderr:2023-12-07T09:58:58.789+0000 7f1054e31640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.823 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-12-07T09:58:58.820+0000 7f4e39178640 -1 osd.3 0 waiting for initial osdmap 2023-12-07T09:58:58.827 INFO:tasks.ceph.osd.6.smithi097.stderr:2023-12-07T09:58:58.821+0000 7fac11c77640 -1 osd.6 0 waiting for initial osdmap 2023-12-07T09:58:58.829 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T09:58:58.824+0000 7f02547b6640 -1 osd.0 0 waiting for initial osdmap 2023-12-07T09:58:58.847 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-12-07T09:58:58.844+0000 7f2345650640 -1 osd.1 0 waiting for initial osdmap 2023-12-07T09:58:58.849 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-12-07T09:58:58.844+0000 7f4e317c5640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.854 INFO:tasks.ceph.osd.6.smithi097.stderr:2023-12-07T09:58:58.849+0000 7fac08a8e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.860 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T09:58:58.856+0000 7f024ce03640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.872 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-12-07T09:58:58.868+0000 7f233dc9d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:58:58.880 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-12-07T09:58:58.876+0000 7f7f37763640 -1 osd.2 0 waiting for initial osdmap 2023-12-07T09:58:58.916 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-12-07T09:58:58.912+0000 7f7f2fdb0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T09:59:05.472 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:05.608 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 Processor -- start 2023-12-07T09:59:05.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 -- start start 2023-12-07T09:59:05.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f701814ebd0 0x7f70180701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.610 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70180c2620 0x7f7018070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.610 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701806cf20 con 0x7f7018070c60 2023-12-07T09:59:05.610 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70180723e0 con 0x7f70180c2620 2023-12-07T09:59:05.610 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f701d45f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701806d200 con 0x7f701814ebd0 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70180c2620 0x7f7018070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70180c2620 0x7f7018070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42306/0 (socket says 172.21.15.89:42306) 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 -- 172.21.15.89:0/1935814452 learned_addr learned my addr 172.21.15.89:0/1935814452 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f7016ffd640 1 --2- 172.21.15.89:0/1935814452 >> v2:172.21.15.97:3300/0 conn(0x7f701814ebd0 0x7f70180701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 -- 172.21.15.89:0/1935814452 >> v2:172.21.15.97:3300/0 conn(0x7f701814ebd0 msgr2=0x7f70180701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 --2- 172.21.15.89:0/1935814452 >> v2:172.21.15.97:3300/0 conn(0x7f701814ebd0 0x7f70180701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 -- 172.21.15.89:0/1935814452 >> v1:172.21.15.97:6789/0 conn(0x7f7018070c60 legacy=0x7f7018154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.604+0000 7f700e7fc640 1 -- 172.21.15.89:0/1935814452 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701806d4e0 con 0x7f70180c2620 2023-12-07T09:59:05.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f700e7fc640 1 --2- 172.21.15.89:0/1935814452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70180c2620 0x7f7018070720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7018155a80 tx=0x7f700001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995b3ad2837b2132 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:05.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f70167fc640 1 -- 172.21.15.89:0/1935814452 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000a57d0 con 0x7f70180c2620 2023-12-07T09:59:05.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f70167fc640 1 -- 172.21.15.89:0/1935814452 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000a5930 con 0x7f70180c2620 2023-12-07T09:59:05.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f70167fc640 1 -- 172.21.15.89:0/1935814452 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000a5cc0 con 0x7f70180c2620 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 -- 172.21.15.89:0/1935814452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70180c2620 msgr2=0x7f7018070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 --2- 172.21.15.89:0/1935814452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70180c2620 0x7f7018070720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7018155a80 tx=0x7f700001c910 comp rx=0 tx=0).stop 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 -- 172.21.15.89:0/1935814452 shutdown_connections 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 --2- 172.21.15.89:0/1935814452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70180c2620 0x7f7018070720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 --2- 172.21.15.89:0/1935814452 >> v2:172.21.15.97:3300/0 conn(0x7f701814ebd0 0x7f70180701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 -- 172.21.15.89:0/1935814452 >> 172.21.15.89:0/1935814452 conn(0x7f70180c6060 msgr2=0x7f70180c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 -- 172.21.15.89:0/1935814452 shutdown_connections 2023-12-07T09:59:05.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.608+0000 7f701d45f640 1 -- 172.21.15.89:0/1935814452 wait complete. 2023-12-07T09:59:05.616 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 Processor -- start 2023-12-07T09:59:05.616 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 -- start start 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7018070c60 0x7f7018144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70180c2620 0x7f70180c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 0x7f70180c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701813fa40 con 0x7f701814ebd0 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701813f7a0 con 0x7f7018070c60 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70180c3d60 con 0x7f70180c2620 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 0x7f70180c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 0x7f70180c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42320/0 (socket says 172.21.15.89:42320) 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 -- 172.21.15.89:0/3009919829 learned_addr learned my addr 172.21.15.89:0/3009919829 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f7016ffd640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7018070c60 0x7f7018144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.619 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f700e7fc640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70180c2620 0x7f70180c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 -- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70180c2620 msgr2=0x7f70180c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70180c2620 0x7f70180c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 -- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7018070c60 msgr2=0x7f7018144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7018070c60 0x7f7018144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 -- 172.21.15.89:0/3009919829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000009b30 con 0x7f701814ebd0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f70177fe640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 0x7f70180c57a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f701000c3c0 tx=0x7f701000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100052d0 con 0x7f701814ebd0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010005430 con 0x7f701814ebd0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70180c4040 con 0x7f701814ebd0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.612+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010003840 con 0x7f701814ebd0 2023-12-07T09:59:05.620 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70180c5ce0 con 0x7f701814ebd0 2023-12-07T09:59:05.621 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70180689b0 con 0x7f701814ebd0 2023-12-07T09:59:05.621 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f70100039a0 con 0x7f701814ebd0 2023-12-07T09:59:05.621 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f700ffff640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6ff80668d0 0x7f6ff8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.621 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7010083550 con 0x7f701814ebd0 2023-12-07T09:59:05.622 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f7016ffd640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6ff80668d0 0x7f6ff8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.622 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.616+0000 7f7016ffd640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6ff80668d0 0x7f6ff8068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7018067710 tx=0x7f7008009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:05.627 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.624+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7010050b80 con 0x7f701814ebd0 2023-12-07T09:59:05.777 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.772+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70180c4e10 con 0x7f701814ebd0 2023-12-07T09:59:05.778 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.772+0000 7f700ffff640 1 -- 172.21.15.89:0/3009919829 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f70100541a0 con 0x7f701814ebd0 2023-12-07T09:59:05.778 INFO:teuthology.misc.health.smithi089.stdout: 2023-12-07T09:59:05.778 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":16,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:03.194859+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:05.780 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6ff80668d0 msgr2=0x7f6ff8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.780 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6ff80668d0 0x7f6ff8068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7018067710 tx=0x7f7008009190 comp rx=0 tx=0).stop 2023-12-07T09:59:05.780 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 msgr2=0x7f70180c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.780 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 0x7f70180c57a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f701000c3c0 tx=0x7f701000c880 comp rx=0 tx=0).stop 2023-12-07T09:59:05.780 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 shutdown_connections 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701814ebd0 0x7f70180c57a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6ff80668d0 0x7f6ff8068d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70180c2620 0x7f70180c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 --2- 172.21.15.89:0/3009919829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7018070c60 0x7f7018144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 >> 172.21.15.89:0/3009919829 conn(0x7f70180c6060 msgr2=0x7f70180c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 shutdown_connections 2023-12-07T09:59:05.781 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T09:59:05.776+0000 7f701d45f640 1 -- 172.21.15.89:0/3009919829 wait complete. 2023-12-07T09:59:05.798 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-07T09:59:05.798 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-07T09:59:05.798 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-07T09:59:05.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-07T09:59:05.802 INFO:tasks.ceph.mds.a:Started 2023-12-07T09:59:05.803 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-07T09:59:05.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-07T09:59:05.807 INFO:tasks.ceph.mds.c:Started 2023-12-07T09:59:05.807 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-07T09:59:05.808 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-07T09:59:05.811 INFO:tasks.ceph.mds.b:Started 2023-12-07T09:59:05.811 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-07T09:59:05.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-07T09:59:05.815 INFO:tasks.ceph.mds.d:Started 2023-12-07T09:59:05.815 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-07T09:59:05.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:05.902 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-12-07T09:59:05.903 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T09:59:05.951 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2023-12-07T09:59:05.951 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2023-12-07T09:59:05.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.956+0000 7fccc759e640 1 Processor -- start 2023-12-07T09:59:05.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.956+0000 7fccc759e640 1 -- start start 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc759e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc80ca620 0x7fccc80caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc759e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc80c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fccc80bd5a0 0x7fccc80c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc806b7d0 con 0x7fccc80bd5a0 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc759e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc8155160 con 0x7fccc80ca620 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc759e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc806b180 con 0x7fccc80c4890 2023-12-07T09:59:05.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fccc80bd5a0 0x7fccc80c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fccc80bd5a0 0x7fccc80c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42386/0 (socket says 172.21.15.89:42386) 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 -- 172.21.15.89:0/3045940600 learned_addr learned my addr 172.21.15.89:0/3045940600 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc659c640 1 --2- 172.21.15.89:0/3045940600 >> v2:172.21.15.97:3300/0 conn(0x7fccc80ca620 0x7fccc80caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc5d9b640 1 --2- 172.21.15.89:0/3045940600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc80c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 -- 172.21.15.89:0/3045940600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 msgr2=0x7fccc80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 --2- 172.21.15.89:0/3045940600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc80c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 -- 172.21.15.89:0/3045940600 >> v2:172.21.15.97:3300/0 conn(0x7fccc80ca620 msgr2=0x7fccc80caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 --2- 172.21.15.89:0/3045940600 >> v2:172.21.15.97:3300/0 conn(0x7fccc80ca620 0x7fccc80caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.960+0000 7fccc6d9d640 1 -- 172.21.15.89:0/3045940600 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc806b460 con 0x7fccc80bd5a0 2023-12-07T09:59:05.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc6d9d640 1 --2- 172.21.15.89:0/3045940600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80bd5a0 0x7fccc80c8450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fccc80ac950 tx=0x7fccc001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734170bbcd9c88d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:05.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc559a640 1 -- 172.21.15.89:0/3045940600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00a56c0 con 0x7fccc80bd5a0 2023-12-07T09:59:05.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc559a640 1 -- 172.21.15.89:0/3045940600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00a5820 con 0x7fccc80bd5a0 2023-12-07T09:59:05.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc559a640 1 -- 172.21.15.89:0/3045940600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00a5bb0 con 0x7fccc80bd5a0 2023-12-07T09:59:05.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 -- 172.21.15.89:0/3045940600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80bd5a0 msgr2=0x7fccc80c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 --2- 172.21.15.89:0/3045940600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80bd5a0 0x7fccc80c8450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fccc80ac950 tx=0x7fccc001c8b0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 -- 172.21.15.89:0/3045940600 shutdown_connections 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 --2- 172.21.15.89:0/3045940600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80bd5a0 0x7fccc80c8450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 --2- 172.21.15.89:0/3045940600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc80c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 --2- 172.21.15.89:0/3045940600 >> v2:172.21.15.97:3300/0 conn(0x7fccc80ca620 0x7fccc80caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 -- 172.21.15.89:0/3045940600 >> 172.21.15.89:0/3045940600 conn(0x7fccc80ac0a0 msgr2=0x7fccc80c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 -- 172.21.15.89:0/3045940600 shutdown_connections 2023-12-07T09:59:05.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 -- 172.21.15.89:0/3045940600 wait complete. 2023-12-07T09:59:05.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 Processor -- start 2023-12-07T09:59:05.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.964+0000 7fccc759e640 1 -- start start 2023-12-07T09:59:05.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80bd5a0 0x7fccc80acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 0x7fccc81ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80ab680 con 0x7fccc80ca620 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc814b440 con 0x7fccc80bd5a0 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc814a8f0 con 0x7fccc80c4890 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 0x7fccc81ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 0x7fccc81ecc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42402/0 (socket says 172.21.15.89:42402) 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 -- 172.21.15.89:0/2901128303 learned_addr learned my addr 172.21.15.89:0/2901128303 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc5d9b640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc659c640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80bd5a0 0x7fccc80acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 -- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 msgr2=0x7fccc814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc814ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 -- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80bd5a0 msgr2=0x7fccc80acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:05.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80bd5a0 0x7fccc80acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:05.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 -- 172.21.15.89:0/2901128303 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0009b30 con 0x7fccc80ca620 2023-12-07T09:59:05.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc6d9d640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 0x7fccc81ecc50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fccc001af60 tx=0x7fccc0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:05.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00b8670 con 0x7fccc80ca620 2023-12-07T09:59:05.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00b87f0 con 0x7fccc80ca620 2023-12-07T09:59:05.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc81f0d50 con 0x7fccc80ca620 2023-12-07T09:59:05.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00b8ba0 con 0x7fccc80ca620 2023-12-07T09:59:05.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc81f1030 con 0x7fccc80ca620 2023-12-07T09:59:05.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc814b640 con 0x7fccc80ca620 2023-12-07T09:59:05.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.968+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fccc00b8d00 con 0x7fccc80ca620 2023-12-07T09:59:05.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.972+0000 7fccb6ffd640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcca80668d0 0x7fcca8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:05.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.972+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fccc011f670 con 0x7fccc80ca620 2023-12-07T09:59:05.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.972+0000 7fccc659c640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcca80668d0 0x7fcca8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:05.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.972+0000 7fccc659c640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcca80668d0 0x7fcca8068d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b930 tx=0x7fccb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:05.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:05.976+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccc814b640 con 0x7fccc80ca620 2023-12-07T09:59:06.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.124+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccc814b640 con 0x7fccc80ca620 2023-12-07T09:59:06.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.124+0000 7fccb6ffd640 1 -- 172.21.15.89:0/2901128303 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fccc814b640 con 0x7fccc80ca620 2023-12-07T09:59:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:06.130 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":16,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:03.194859+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcca80668d0 msgr2=0x7fcca8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcca80668d0 0x7fcca8068d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b930 tx=0x7fccb8008040 comp rx=0 tx=0).stop 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 msgr2=0x7fccc81ecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 0x7fccc81ecc50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fccc001af60 tx=0x7fccc0019650 comp rx=0 tx=0).stop 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 shutdown_connections 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc80ca620 0x7fccc81ecc50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcca80668d0 0x7fcca8068d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fccc80c4890 0x7fccc814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 --2- 172.21.15.89:0/2901128303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80bd5a0 0x7fccc80acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 >> 172.21.15.89:0/2901128303 conn(0x7fccc80ac0a0 msgr2=0x7fccc80c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:06.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 shutdown_connections 2023-12-07T09:59:06.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.128+0000 7fccc759e640 1 -- 172.21.15.89:0/2901128303 wait complete. 2023-12-07T09:59:06.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:06.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:06.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 Processor -- start 2023-12-07T09:59:06.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 -- start start 2023-12-07T09:59:06.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ee414fcf0 0x7f9ee41567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee41500d0 0x7f9ee40c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee406f760 con 0x7f9ee40a7330 2023-12-07T09:59:06.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee4156d10 con 0x7f9ee414fcf0 2023-12-07T09:59:06.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee9da1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40adf90 con 0x7f9ee41500d0 2023-12-07T09:59:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9ee40a7330 0x7f9ee40a9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:38864/0 (socket says 172.21.15.89:38864) 2023-12-07T09:59:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee3fff640 1 -- 172.21.15.89:0/3952834354 learned_addr learned my addr 172.21.15.89:0/3952834354 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee37fe640 1 --2- 172.21.15.89:0/3952834354 >> v2:172.21.15.97:3300/0 conn(0x7f9ee414fcf0 0x7f9ee41567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9edbfff640 1 --2- 172.21.15.89:0/3952834354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee41500d0 0x7f9ee40c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee2ffd640 1 -- 172.21.15.89:0/3952834354 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247161736 0 0) 0x7f9ee406f760 con 0x7f9ee40a7330 2023-12-07T09:59:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9ee2ffd640 1 -- 172.21.15.89:0/3952834354 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed0003530 con 0x7f9ee40a7330 2023-12-07T09:59:06.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9edbfff640 1 -- 172.21.15.89:0/3952834354 >> v2:172.21.15.97:3300/0 conn(0x7f9ee414fcf0 msgr2=0x7f9ee41567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:06.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9edbfff640 1 --2- 172.21.15.89:0/3952834354 >> v2:172.21.15.97:3300/0 conn(0x7f9ee414fcf0 0x7f9ee41567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9edbfff640 1 -- 172.21.15.89:0/3952834354 >> v1:172.21.15.89:6789/0 conn(0x7f9ee40a7330 legacy=0x7f9ee40a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.288+0000 7f9edbfff640 1 -- 172.21.15.89:0/3952834354 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee406fc90 con 0x7f9ee41500d0 2023-12-07T09:59:06.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9edbfff640 1 --2- 172.21.15.89:0/3952834354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee41500d0 0x7f9ee40c3c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0097a0 tx=0x7f9ecc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6717f26b8dfac791 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee2ffd640 1 -- 172.21.15.89:0/3952834354 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0ac600 con 0x7f9ee41500d0 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee2ffd640 1 -- 172.21.15.89:0/3952834354 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0a8050 con 0x7f9ee41500d0 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee2ffd640 1 -- 172.21.15.89:0/3952834354 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0ac980 con 0x7f9ee41500d0 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 -- 172.21.15.89:0/3952834354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee41500d0 msgr2=0x7f9ee40c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/3952834354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee41500d0 0x7f9ee40c3c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0097a0 tx=0x7f9ecc01c3a0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 -- 172.21.15.89:0/3952834354 shutdown_connections 2023-12-07T09:59:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/3952834354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee41500d0 0x7f9ee40c3c50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/3952834354 >> v2:172.21.15.97:3300/0 conn(0x7f9ee414fcf0 0x7f9ee41567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 -- 172.21.15.89:0/3952834354 >> 172.21.15.89:0/3952834354 conn(0x7f9ee406a5a0 msgr2=0x7f9ee406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:06.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 -- 172.21.15.89:0/3952834354 shutdown_connections 2023-12-07T09:59:06.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.292+0000 7f9ee9da1640 1 -- 172.21.15.89:0/3952834354 wait complete. 2023-12-07T09:59:06.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 Processor -- start 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 -- start start 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee40a7330 0x7f9ee40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 0x7f9ee41532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ee41500d0 0x7f9ee41522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee414ad60 con 0x7f9ee414fcf0 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41484f0 con 0x7f9ee41500d0 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4150840 con 0x7f9ee40a7330 2023-12-07T09:59:06.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 0x7f9ee41532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 0x7f9ee41532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42404/0 (socket says 172.21.15.89:42404) 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 -- 172.21.15.89:0/652161153 learned_addr learned my addr 172.21.15.89:0/652161153 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee37fe640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee40a7330 0x7f9ee40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee3fff640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ee41500d0 0x7f9ee41522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 -- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee40a7330 msgr2=0x7f9ee40c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee40a7330 0x7f9ee40c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 -- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ee41500d0 msgr2=0x7f9ee41522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ee41500d0 0x7f9ee41522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 -- 172.21.15.89:0/652161153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0093b0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee37fe640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee40a7330 0x7f9ee40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9edbfff640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 0x7f9ee41532d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0af040 tx=0x7f9ecc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b7450 con 0x7f9ee414fcf0 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0b75b0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee4150b20 con 0x7f9ee414fcf0 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b7960 con 0x7f9ee414fcf0 2023-12-07T09:59:06.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.296+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40a6fa0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.300+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee414aeb0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.300+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ecc0b3070 con 0x7f9ee414fcf0 2023-12-07T09:59:06.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.300+0000 7f9ee0ff9640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9ec40668d0 0x7f9ec4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.300+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9ecc11e340 con 0x7f9ee414fcf0 2023-12-07T09:59:06.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.300+0000 7f9ee37fe640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9ec40668d0 0x7f9ec4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.300+0000 7f9ee37fe640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9ec40668d0 0x7f9ec4068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ee414bf60 tx=0x7f9ed4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:06.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.304+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ee414aeb0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.456+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ee414aeb0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.456+0000 7f9ee0ff9640 1 -- 172.21.15.89:0/652161153 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ee414aeb0 con 0x7f9ee414fcf0 2023-12-07T09:59:06.462 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:06.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9ec40668d0 msgr2=0x7f9ec4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9ec40668d0 0x7f9ec4068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ee414bf60 tx=0x7f9ed4008040 comp rx=0 tx=0).stop 2023-12-07T09:59:06.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 msgr2=0x7f9ee41532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 0x7f9ee41532d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0af040 tx=0x7f9ecc01abe0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 shutdown_connections 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ee41500d0 0x7f9ee41522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ee414fcf0 0x7f9ee41532d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9ec40668d0 0x7f9ec4068d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 --2- 172.21.15.89:0/652161153 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ee40a7330 0x7f9ee40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 >> 172.21.15.89:0/652161153 conn(0x7f9ee406a5a0 msgr2=0x7f9ee415d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 shutdown_connections 2023-12-07T09:59:06.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.460+0000 7f9ee9da1640 1 -- 172.21.15.89:0/652161153 wait complete. 2023-12-07T09:59:06.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:06.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2c1a1640 1 Processor -- start 2023-12-07T09:59:06.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2c1a1640 1 -- start start 2023-12-07T09:59:06.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2c1a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad2406d100 0x7fad2406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2c1a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2406bea0 con 0x7fad24152ce0 2023-12-07T09:59:06.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2c1a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad24159550 con 0x7fad2406db80 2023-12-07T09:59:06.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2c1a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad24159b10 con 0x7fad2406d100 2023-12-07T09:59:06.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad29f3d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fad24152ce0 0x7fad240700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:38872/0 (socket says 172.21.15.89:38872) 2023-12-07T09:59:06.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad29f3d640 1 -- 172.21.15.89:0/3886360672 learned_addr learned my addr 172.21.15.89:0/3886360672 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2a73e640 1 --2- 172.21.15.89:0/3886360672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad2406d100 0x7fad2406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad28f3b640 1 -- 172.21.15.89:0/3886360672 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547526182 0 0) 0x7fad2406bea0 con 0x7fad24152ce0 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad28f3b640 1 -- 172.21.15.89:0/3886360672 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad10003530 con 0x7fad24152ce0 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad28f3b640 1 -- 172.21.15.89:0/3886360672 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426225142 0 0) 0x7fad24159550 con 0x7fad2406db80 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2a73e640 1 -- 172.21.15.89:0/3886360672 >> v1:172.21.15.97:6789/0 conn(0x7fad2406db80 legacy=0x7fad240c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.616+0000 7fad2a73e640 1 -- 172.21.15.89:0/3886360672 >> v1:172.21.15.89:6789/0 conn(0x7fad24152ce0 legacy=0x7fad240700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2a73e640 1 -- 172.21.15.89:0/3886360672 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24159830 con 0x7fad2406d100 2023-12-07T09:59:06.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2a73e640 1 --2- 172.21.15.89:0/3886360672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad2406d100 0x7fad2406c940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009dc0 tx=0x7fad1c01c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6ede9a8ff5ac4dd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:06.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad28f3b640 1 -- 172.21.15.89:0/3886360672 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20001680 con 0x7fad2406d100 2023-12-07T09:59:06.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad28f3b640 1 -- 172.21.15.89:0/3886360672 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c0a55a0 con 0x7fad2406d100 2023-12-07T09:59:06.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad28f3b640 1 -- 172.21.15.89:0/3886360672 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0a5930 con 0x7fad2406d100 2023-12-07T09:59:06.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2c1a1640 1 -- 172.21.15.89:0/3886360672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad2406d100 msgr2=0x7fad2406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/3886360672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad2406d100 0x7fad2406c940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009dc0 tx=0x7fad1c01c720 comp rx=0 tx=0).stop 2023-12-07T09:59:06.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2c1a1640 1 -- 172.21.15.89:0/3886360672 shutdown_connections 2023-12-07T09:59:06.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/3886360672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad2406d100 0x7fad2406c940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.620+0000 7fad2c1a1640 1 -- 172.21.15.89:0/3886360672 >> 172.21.15.89:0/3886360672 conn(0x7fad240c2ad0 msgr2=0x7fad240c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:06.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 -- 172.21.15.89:0/3886360672 shutdown_connections 2023-12-07T09:59:06.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 -- 172.21.15.89:0/3886360672 wait complete. 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 Processor -- start 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 -- start start 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2406d100 0x7fad241f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 0x7fad240c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad24152ce0 0x7fad24145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad241f5560 con 0x7fad2406db80 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24158a70 con 0x7fad2406d100 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2c1a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad24157e60 con 0x7fad24152ce0 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 0x7fad240c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 0x7fad240c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42406/0 (socket says 172.21.15.89:42406) 2023-12-07T09:59:06.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 -- 172.21.15.89:0/1477089231 learned_addr learned my addr 172.21.15.89:0/1477089231 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad29f3d640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2406d100 0x7fad241f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2a73e640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad24152ce0 0x7fad24145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 -- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad24152ce0 msgr2=0x7fad24145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad24152ce0 0x7fad24145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 -- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2406d100 msgr2=0x7fad241f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2406d100 0x7fad241f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 -- 172.21.15.89:0/1477089231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009a70 con 0x7fad2406db80 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.624+0000 7fad2973c640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 0x7fad240c4c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c520 tx=0x7fad1400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14003600 con 0x7fad2406db80 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14003780 con 0x7fad2406db80 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14003b30 con 0x7fad2406db80 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24158140 con 0x7fad2406db80 2023-12-07T09:59:06.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24158700 con 0x7fad2406db80 2023-12-07T09:59:06.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2404e890 con 0x7fad2406db80 2023-12-07T09:59:06.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad14003c90 con 0x7fad2406db80 2023-12-07T09:59:06.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad1a7fc640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad08066900 0x7fad08068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:06.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad14083690 con 0x7fad2406db80 2023-12-07T09:59:06.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad29f3d640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad08066900 0x7fad08068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:06.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.628+0000 7fad29f3d640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad08066900 0x7fad08068dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad200016d0 tx=0x7fad20001620 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:06.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.632+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad14050cc0 con 0x7fad2406db80 2023-12-07T09:59:06.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.812+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad241f1110 con 0x7fad2406db80 2023-12-07T09:59:06.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.812+0000 7fad1a7fc640 1 -- 172.21.15.89:0/1477089231 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fad14017020 con 0x7fad2406db80 2023-12-07T09:59:06.819 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:06.819 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-07T09:59:06.819 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2023-12-07T09:59:06.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad08066900 msgr2=0x7fad08068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad08066900 0x7fad08068dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad200016d0 tx=0x7fad20001620 comp rx=0 tx=0).stop 2023-12-07T09:59:06.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 msgr2=0x7fad240c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 0x7fad240c4c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c520 tx=0x7fad1400c9e0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 shutdown_connections 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad08066900 0x7fad08068dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad24152ce0 0x7fad24145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2406db80 0x7fad240c4c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 --2- 172.21.15.89:0/1477089231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2406d100 0x7fad241f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 >> 172.21.15.89:0/1477089231 conn(0x7fad240c2ad0 msgr2=0x7fad24151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 shutdown_connections 2023-12-07T09:59:06.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:06.816+0000 7fad2c1a1640 1 -- 172.21.15.89:0/1477089231 wait complete. 2023-12-07T09:59:08.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:08.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 Processor -- start 2023-12-07T09:59:08.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 -- start start 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7f5014e9d0 0x7f7f50151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f500a8470 0x7f7f5006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5006d320 con 0x7f7f50070b80 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f500721b0 con 0x7f7f500a8470 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5719d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f500c2830 con 0x7f7f5014e9d0 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f47fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7f50070b80 0x7f7f500c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:38886/0 (socket says 172.21.15.89:38886) 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f47fff640 1 -- 172.21.15.89:0/2236437857 learned_addr learned my addr 172.21.15.89:0/2236437857 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5573a640 1 --2- 172.21.15.89:0/2236437857 >> v2:172.21.15.89:3300/0 conn(0x7f7f500a8470 0x7f7f5006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:08.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f54f39640 1 --2- 172.21.15.89:0/2236437857 >> v2:172.21.15.97:3300/0 conn(0x7f7f5014e9d0 0x7f7f50151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:08.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f477fe640 1 -- 172.21.15.89:0/2236437857 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277275849 0 0) 0x7f7f5006d320 con 0x7f7f50070b80 2023-12-07T09:59:08.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f477fe640 1 -- 172.21.15.89:0/2236437857 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f38003530 con 0x7f7f50070b80 2023-12-07T09:59:08.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5573a640 1 -- 172.21.15.89:0/2236437857 >> v2:172.21.15.97:3300/0 conn(0x7f7f5014e9d0 msgr2=0x7f7f50151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:08.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5573a640 1 --2- 172.21.15.89:0/2236437857 >> v2:172.21.15.97:3300/0 conn(0x7f7f5014e9d0 0x7f7f50151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:08.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5573a640 1 -- 172.21.15.89:0/2236437857 >> v1:172.21.15.89:6789/0 conn(0x7f7f50070b80 legacy=0x7f7f500c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:08.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.980+0000 7f7f5573a640 1 -- 172.21.15.89:0/2236437857 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50072450 con 0x7f7f500a8470 2023-12-07T09:59:08.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5573a640 1 --2- 172.21.15.89:0/2236437857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f5006d7b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f500c3980 tx=0x7f7f4801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b10c7f86943df4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:08.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f477fe640 1 -- 172.21.15.89:0/2236437857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480a5850 con 0x7f7f500a8470 2023-12-07T09:59:08.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f477fe640 1 -- 172.21.15.89:0/2236437857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f480a59b0 con 0x7f7f500a8470 2023-12-07T09:59:08.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f477fe640 1 -- 172.21.15.89:0/2236437857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480a5d40 con 0x7f7f500a8470 2023-12-07T09:59:08.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 -- 172.21.15.89:0/2236437857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 msgr2=0x7f7f5006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:08.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 --2- 172.21.15.89:0/2236437857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f5006d7b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f500c3980 tx=0x7f7f4801c880 comp rx=0 tx=0).stop 2023-12-07T09:59:08.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 -- 172.21.15.89:0/2236437857 shutdown_connections 2023-12-07T09:59:08.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 --2- 172.21.15.89:0/2236437857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f5006d7b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:08.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 --2- 172.21.15.89:0/2236437857 >> v2:172.21.15.97:3300/0 conn(0x7f7f5014e9d0 0x7f7f50151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:08.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 -- 172.21.15.89:0/2236437857 >> 172.21.15.89:0/2236437857 conn(0x7f7f500c2ad0 msgr2=0x7f7f500c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:08.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 -- 172.21.15.89:0/2236437857 shutdown_connections 2023-12-07T09:59:08.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.984+0000 7f7f5719d640 1 -- 172.21.15.89:0/2236437857 wait complete. 2023-12-07T09:59:08.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 Processor -- start 2023-12-07T09:59:08.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 -- start start 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f50070b80 0x7f7f501eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f50148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f5014e9d0 0x7f7f5014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50149dd0 con 0x7f7f500a8470 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f501ee3d0 con 0x7f7f50070b80 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500c1510 con 0x7f7f5014e9d0 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f50148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f50148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42416/0 (socket says 172.21.15.89:42416) 2023-12-07T09:59:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 -- 172.21.15.89:0/256796626 learned_addr learned my addr 172.21.15.89:0/256796626 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5573a640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f5014e9d0 0x7f7f5014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f54f39640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f50070b80 0x7f7f501eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 -- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f5014e9d0 msgr2=0x7f7f5014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f5014e9d0 0x7f7f5014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 -- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f50070b80 msgr2=0x7f7f501eae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f50070b80 0x7f7f501eae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 -- 172.21.15.89:0/256796626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009a70 con 0x7f7f500a8470 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f47fff640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f50148340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f40001ec0 tx=0x7f7f4000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40005d50 con 0x7f7f500a8470 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40007070 con 0x7f7f500a8470 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40007420 con 0x7f7f500a8470 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f50149810 con 0x7f7f500a8470 2023-12-07T09:59:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.988+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f501ee5e0 con 0x7f7f500a8470 2023-12-07T09:59:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.992+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5004e890 con 0x7f7f500a8470 2023-12-07T09:59:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.992+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7f40007580 con 0x7f7f500a8470 2023-12-07T09:59:08.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.992+0000 7f7f457fa640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f3c0668d0 0x7f7f3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:08.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.992+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f40083260 con 0x7f7f500a8470 2023-12-07T09:59:08.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.992+0000 7f7f54f39640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f3c0668d0 0x7f7f3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:08.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.992+0000 7f7f54f39640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f3c0668d0 0x7f7f3c068d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f5006e240 tx=0x7f7f4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:08.996+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f40050950 con 0x7f7f500a8470 2023-12-07T09:59:09.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f5014bdb0 con 0x7f7f500a8470 2023-12-07T09:59:09.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f457fa640 1 -- 172.21.15.89:0/256796626 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f7f40081e60 con 0x7f7f500a8470 2023-12-07T09:59:09.188 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:09.188 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4302,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-07T09:59:09.188 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 3 2023-12-07T09:59:09.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f3c0668d0 msgr2=0x7f7f3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f3c0668d0 0x7f7f3c068d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f5006e240 tx=0x7f7f4c008040 comp rx=0 tx=0).stop 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 msgr2=0x7f7f50148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f50148340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f40001ec0 tx=0x7f7f4000c960 comp rx=0 tx=0).stop 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 shutdown_connections 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f3c0668d0 0x7f7f3c068d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f5014e9d0 0x7f7f5014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f500a8470 0x7f7f50148340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 --2- 172.21.15.89:0/256796626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f50070b80 0x7f7f501eae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 >> 172.21.15.89:0/256796626 conn(0x7f7f500c2ad0 msgr2=0x7f7f50070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 shutdown_connections 2023-12-07T09:59:09.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.184+0000 7f7f5719d640 1 -- 172.21.15.89:0/256796626 wait complete. 2023-12-07T09:59:09.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:09.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.340+0000 7f91b5980640 1 Processor -- start 2023-12-07T09:59:09.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.340+0000 7f91b5980640 1 -- start start 2023-12-07T09:59:09.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91b5980640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006db80 0x7f91b006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91b5980640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91b006d100 0x7f91b00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91b5980640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b006bea0 con 0x7f91b0152ce0 2023-12-07T09:59:09.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91b5980640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b0159b10 con 0x7f91b006d100 2023-12-07T09:59:09.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91b5980640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0159550 con 0x7f91b006db80 2023-12-07T09:59:09.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91aeffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f91b0152ce0 0x7f91b00700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:38890/0 (socket says 172.21.15.89:38890) 2023-12-07T09:59:09.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91aeffd640 1 -- 172.21.15.89:0/815993699 learned_addr learned my addr 172.21.15.89:0/815993699 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:09.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91af7fe640 1 --2- 172.21.15.89:0/815993699 >> v2:172.21.15.89:3300/0 conn(0x7f91b006d100 0x7f91b00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91a7fff640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006db80 0x7f91b006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91af7fe640 1 -- 172.21.15.89:0/815993699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006db80 msgr2=0x7f91b006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:09.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91af7fe640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006db80 0x7f91b006c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91af7fe640 1 -- 172.21.15.89:0/815993699 >> v1:172.21.15.89:6789/0 conn(0x7f91b0152ce0 legacy=0x7f91b00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91af7fe640 1 -- 172.21.15.89:0/815993699 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0159830 con 0x7f91b006d100 2023-12-07T09:59:09.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91a7fff640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006db80 0x7f91b006c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:09.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91ae7fc640 1 -- 172.21.15.89:0/815993699 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056144889 0 0) 0x7f91b006bea0 con 0x7f91b0152ce0 2023-12-07T09:59:09.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91af7fe640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b006d100 0x7f91b00c19e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009d90 tx=0x7f91a801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c906271741cb7056 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.344+0000 7f91ae7fc640 1 -- 172.21.15.89:0/815993699 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80a5980 con 0x7f91b006d100 2023-12-07T09:59:09.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91ae7fc640 1 -- 172.21.15.89:0/815993699 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80a5ae0 con 0x7f91b006d100 2023-12-07T09:59:09.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91ae7fc640 1 -- 172.21.15.89:0/815993699 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80a5e70 con 0x7f91b006d100 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- 172.21.15.89:0/815993699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b006d100 msgr2=0x7f91b00c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b006d100 0x7f91b00c19e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009d90 tx=0x7f91a801c8c0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- 172.21.15.89:0/815993699 shutdown_connections 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b006d100 0x7f91b00c19e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 --2- 172.21.15.89:0/815993699 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006db80 0x7f91b006c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- 172.21.15.89:0/815993699 >> 172.21.15.89:0/815993699 conn(0x7f91b00c2ad0 msgr2=0x7f91b00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- 172.21.15.89:0/815993699 shutdown_connections 2023-12-07T09:59:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- 172.21.15.89:0/815993699 wait complete. 2023-12-07T09:59:09.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 Processor -- start 2023-12-07T09:59:09.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- start start 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006d100 0x7f91b01f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b006db80 0x7f91b014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 0x7f91b014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b014da30 con 0x7f91b0152ce0 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b014dd10 con 0x7f91b006db80 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91b5980640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01f1620 con 0x7f91b006d100 2023-12-07T09:59:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91af7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 0x7f91b014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91af7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 0x7f91b014f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42432/0 (socket says 172.21.15.89:42432) 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.348+0000 7f91af7fe640 1 -- 172.21.15.89:0/41108803 learned_addr learned my addr 172.21.15.89:0/41108803 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91af7fe640 1 -- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006d100 msgr2=0x7f91b01f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91aeffd640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006d100 0x7f91b01f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91a7fff640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b006db80 0x7f91b014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91af7fe640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006d100 0x7f91b01f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91af7fe640 1 -- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b006db80 msgr2=0x7f91b014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91af7fe640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b006db80 0x7f91b014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91af7fe640 1 -- 172.21.15.89:0/41108803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009a70 con 0x7f91b0152ce0 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91aeffd640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006d100 0x7f91b01f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91a7fff640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b006db80 0x7f91b014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91af7fe640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 0x7f91b014f6c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91a80b0040 tx=0x7f91a8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80ad950 con 0x7f91b0152ce0 2023-12-07T09:59:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80adab0 con 0x7f91b0152ce0 2023-12-07T09:59:09.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b01f18c0 con 0x7f91b0152ce0 2023-12-07T09:59:09.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80ade20 con 0x7f91b0152ce0 2023-12-07T09:59:09.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b01f1e80 con 0x7f91b0152ce0 2023-12-07T09:59:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b004e890 con 0x7f91b0152ce0 2023-12-07T09:59:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f91a80b9450 con 0x7f91b0152ce0 2023-12-07T09:59:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91acff9640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91900668d0 0x7f9190068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91a811f750 con 0x7f91b0152ce0 2023-12-07T09:59:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.352+0000 7f91aeffd640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91900668d0 0x7f9190068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.356+0000 7f91aeffd640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91900668d0 0x7f9190068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000f70 tx=0x7f91a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.356+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91a80ecc50 con 0x7f91b0152ce0 2023-12-07T09:59:09.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.508+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91b014de50 con 0x7f91b0152ce0 2023-12-07T09:59:09.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.508+0000 7f91acff9640 1 -- 172.21.15.89:0/41108803 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f91a80f0270 con 0x7f91b0152ce0 2023-12-07T09:59:09.514 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:09.514 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":16,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:03.194859+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:09.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.508+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91900668d0 msgr2=0x7f9190068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.508+0000 7f91b5980640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91900668d0 0x7f9190068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000f70 tx=0x7f91a0009040 comp rx=0 tx=0).stop 2023-12-07T09:59:09.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 msgr2=0x7f91b014f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 0x7f91b014f6c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91a80b0040 tx=0x7f91a8019660 comp rx=0 tx=0).stop 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 shutdown_connections 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0152ce0 0x7f91b014f6c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b006db80 0x7f91b014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91900668d0 0x7f9190068d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 --2- 172.21.15.89:0/41108803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91b006d100 0x7f91b01f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 >> 172.21.15.89:0/41108803 conn(0x7f91b00c2ad0 msgr2=0x7f91b0150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 shutdown_connections 2023-12-07T09:59:09.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.512+0000 7f91b5980640 1 -- 172.21.15.89:0/41108803 wait complete. 2023-12-07T09:59:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:09.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:09.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.667+0000 7fdc91aea640 1 Processor -- start 2023-12-07T09:59:09.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.667+0000 7fdc91aea640 1 -- start start 2023-12-07T09:59:09.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc91aea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc8c0c7f20 0x7fdc8c06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc91aea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c06cf70 con 0x7fdc8c0c8430 2023-12-07T09:59:09.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc91aea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c152160 con 0x7fdc8c151d80 2023-12-07T09:59:09.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc91aea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0c6a30 con 0x7fdc8c0c7f20 2023-12-07T09:59:09.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdc8c0c8430 0x7fdc8c06b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34536/0 (socket says 172.21.15.89:34536) 2023-12-07T09:59:09.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8affd640 1 -- 172.21.15.89:0/34664132 learned_addr learned my addr 172.21.15.89:0/34664132 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8bfff640 1 --2- 172.21.15.89:0/34664132 >> v2:172.21.15.97:3300/0 conn(0x7fdc8c0c7f20 0x7fdc8c06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645176218 0 0) 0x7fdc8c06cf70 con 0x7fdc8c0c8430 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc74003530 con 0x7fdc8c0c8430 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366102879 0 0) 0x7fdc74003530 con 0x7fdc8c0c8430 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 >> v2:172.21.15.97:3300/0 conn(0x7fdc8c0c7f20 msgr2=0x7fdc8c06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 --2- 172.21.15.89:0/34664132 >> v2:172.21.15.97:3300/0 conn(0x7fdc8c0c7f20 0x7fdc8c06be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 >> v1:172.21.15.97:6789/0 conn(0x7fdc8c151d80 legacy=0x7fdc8c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0c72d0 con 0x7fdc8c0c8430 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fdc800016a0 con 0x7fdc8c0c8430 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 >> v1:172.21.15.89:6789/0 conn(0x7fdc8c0c8430 legacy=0x7fdc8c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc74003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc740047d0 0x7fdc74004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc740051e0 0x7fdc7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0c6a30 con 0x7fdc740039d0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7400c130 con 0x7fdc740047d0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7400c2f0 con 0x7fdc740051e0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc74003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8affd640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc740047d0 0x7fdc74004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8bfff640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc740051e0 0x7fdc7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc740051e0 msgr2=0x7fdc7400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc740051e0 0x7fdc7400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc740047d0 msgr2=0x7fdc74004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc740047d0 0x7fdc74004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/34664132 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74003530 con 0x7fdc740039d0 2023-12-07T09:59:09.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.671+0000 7fdc8bfff640 1 -- 172.21.15.89:0/34664132 reap_dead start 2023-12-07T09:59:09.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc74003df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0015b0 tx=0x7fdc7c01c1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f047a3da1da25ed server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0050d0 con 0x7fdc740039d0 2023-12-07T09:59:09.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c0a7050 con 0x7fdc740039d0 2023-12-07T09:59:09.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc8a7fc640 1 -- 172.21.15.89:0/34664132 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c005490 con 0x7fdc740039d0 2023-12-07T09:59:09.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 -- 172.21.15.89:0/34664132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 msgr2=0x7fdc74003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc74003df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0015b0 tx=0x7fdc7c01c1f0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 -- 172.21.15.89:0/34664132 shutdown_connections 2023-12-07T09:59:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 --2- 172.21.15.89:0/34664132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc74003df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 -- 172.21.15.89:0/34664132 >> 172.21.15.89:0/34664132 conn(0x7fdc8c0abd00 msgr2=0x7fdc8c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 -- 172.21.15.89:0/34664132 shutdown_connections 2023-12-07T09:59:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 -- 172.21.15.89:0/34664132 wait complete. 2023-12-07T09:59:09.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.675+0000 7fdc91aea640 1 Processor -- start 2023-12-07T09:59:09.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- start start 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc8c1f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc8c0aa420 0x7fdc8c0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc8c150cd0 0x7fdc8c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c1e0530 con 0x7fdc740039d0 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c1e1a60 con 0x7fdc8c150cd0 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c1dff40 con 0x7fdc8c0aa420 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc8c1f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc8c1f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44906/0 (socket says 172.21.15.89:44906) 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/2399298697 learned_addr learned my addr 172.21.15.89:0/2399298697 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/2399298697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc8c0aa420 msgr2=0x7fdc8c0ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc8c0aa420 0x7fdc8c0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/2399298697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc8c150cd0 msgr2=0x7fdc8c151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc8c150cd0 0x7fdc8c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 -- 172.21.15.89:0/2399298697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c1f0e60 con 0x7fdc740039d0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc8b7fe640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc8c1f0920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c000c10 tx=0x7fdc74005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c007220 con 0x7fdc740039d0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c007380 con 0x7fdc740039d0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c1e14a0 con 0x7fdc740039d0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0067e0 con 0x7fdc740039d0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c1e0150 con 0x7fdc740039d0 2023-12-07T09:59:09.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.679+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c04e890 con 0x7fdc740039d0 2023-12-07T09:59:09.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.683+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc7c006940 con 0x7fdc740039d0 2023-12-07T09:59:09.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.683+0000 7fdc73fff640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc78066900 0x7fdc78068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:09.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.683+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc7c11dd30 con 0x7fdc740039d0 2023-12-07T09:59:09.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.683+0000 7fdc8affd640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc78066900 0x7fdc78068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:09.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.683+0000 7fdc8affd640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc78066900 0x7fdc78068dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c1ea7e0 tx=0x7fdc80000bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:09.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.687+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc7c0eb2b0 con 0x7fdc740039d0 2023-12-07T09:59:09.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.835+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc8c152160 con 0x7fdc740039d0 2023-12-07T09:59:09.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.835+0000 7fdc73fff640 1 -- 172.21.15.89:0/2399298697 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc8c152160 con 0x7fdc740039d0 2023-12-07T09:59:09.841 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:09.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc78066900 msgr2=0x7fdc78068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc78066900 0x7fdc78068dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c1ea7e0 tx=0x7fdc80000bd0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 msgr2=0x7fdc8c1f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:09.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc8c1f0920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c000c10 tx=0x7fdc74005800 comp rx=0 tx=0).stop 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 shutdown_connections 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc8c150cd0 0x7fdc8c151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc78066900 0x7fdc78068dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc8c0aa420 0x7fdc8c0ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 --2- 172.21.15.89:0/2399298697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc740039d0 0x7fdc8c1f0920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 >> 172.21.15.89:0/2399298697 conn(0x7fdc8c0abd00 msgr2=0x7fdc8c1535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 shutdown_connections 2023-12-07T09:59:09.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.839+0000 7fdc91aea640 1 -- 172.21.15.89:0/2399298697 wait complete. 2023-12-07T09:59:09.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T09:59:09.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 Processor -- start 2023-12-07T09:59:09.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 -- start start 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72440ca620 0x7f72440caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440c4890 0x7f72440c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72440bd5a0 0x7f72440c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724406b7d0 con 0x7f72440ca620 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7244155160 con 0x7f72440bd5a0 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724ac88640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724406b180 con 0x7f72440c4890 2023-12-07T09:59:10.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72440ca620 0x7f72440caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72440ca620 0x7f72440caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44912/0 (socket says 172.21.15.89:44912) 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 -- 172.21.15.89:0/3227040283 learned_addr learned my addr 172.21.15.89:0/3227040283 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f724a487640 1 --2- 172.21.15.89:0/3227040283 >> v2:172.21.15.97:3300/0 conn(0x7f72440bd5a0 0x7f72440c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249485640 1 --2- 172.21.15.89:0/3227040283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440c4890 0x7f72440c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 -- 172.21.15.89:0/3227040283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440c4890 msgr2=0x7f72440c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 --2- 172.21.15.89:0/3227040283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440c4890 0x7f72440c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 -- 172.21.15.89:0/3227040283 >> v2:172.21.15.97:3300/0 conn(0x7f72440bd5a0 msgr2=0x7f72440c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 --2- 172.21.15.89:0/3227040283 >> v2:172.21.15.97:3300/0 conn(0x7f72440bd5a0 0x7f72440c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.995+0000 7f7249c86640 1 -- 172.21.15.89:0/3227040283 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724406b460 con 0x7f72440ca620 2023-12-07T09:59:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f7249c86640 1 --2- 172.21.15.89:0/3227040283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f72440caa00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f72440c98b0 tx=0x7f724001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a0e3255cbf8def server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f7248c84640 1 -- 172.21.15.89:0/3227040283 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400ab600 con 0x7f72440ca620 2023-12-07T09:59:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f7248c84640 1 -- 172.21.15.89:0/3227040283 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400a7050 con 0x7f72440ca620 2023-12-07T09:59:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f7248c84640 1 -- 172.21.15.89:0/3227040283 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400ab980 con 0x7f72440ca620 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 -- 172.21.15.89:0/3227040283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 msgr2=0x7f72440caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 --2- 172.21.15.89:0/3227040283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f72440caa00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f72440c98b0 tx=0x7f724001c3e0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 -- 172.21.15.89:0/3227040283 shutdown_connections 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 --2- 172.21.15.89:0/3227040283 >> v2:172.21.15.97:3300/0 conn(0x7f72440bd5a0 0x7f72440c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 --2- 172.21.15.89:0/3227040283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440c4890 0x7f72440c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 --2- 172.21.15.89:0/3227040283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f72440caa00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 -- 172.21.15.89:0/3227040283 >> 172.21.15.89:0/3227040283 conn(0x7f72440ac0a0 msgr2=0x7f72440c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:10.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 -- 172.21.15.89:0/3227040283 shutdown_connections 2023-12-07T09:59:10.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 -- 172.21.15.89:0/3227040283 wait complete. 2023-12-07T09:59:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:09.999+0000 7f724ac88640 1 Processor -- start 2023-12-07T09:59:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- start start 2023-12-07T09:59:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440bd5a0 0x7f72440ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72440c4890 0x7f7244145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f7244146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441eda40 con 0x7f72440ca620 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441ede60 con 0x7f72440c4890 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7244154810 con 0x7f72440bd5a0 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f7244146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f7244146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44918/0 (socket says 172.21.15.89:44918) 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 -- 172.21.15.89:0/2660591102 learned_addr learned my addr 172.21.15.89:0/2660591102 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f7249485640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72440c4890 0x7f7244145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f7249c86640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440bd5a0 0x7f72440ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 -- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440bd5a0 msgr2=0x7f72440ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440bd5a0 0x7f72440ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 -- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72440c4890 msgr2=0x7f7244145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72440c4890 0x7f7244145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 -- 172.21.15.89:0/2660591102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400094d0 con 0x7f72440ca620 2023-12-07T09:59:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724a487640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f7244146500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f723c00ef30 tx=0x7f723c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c010040 con 0x7f72440ca620 2023-12-07T09:59:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c014400 con 0x7f72440ca620 2023-12-07T09:59:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c009ca0 con 0x7f72440ca620 2023-12-07T09:59:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72441ece50 con 0x7f72440ca620 2023-12-07T09:59:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72440c62e0 con 0x7f72440ca620 2023-12-07T09:59:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.003+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72441edb80 con 0x7f72440ca620 2023-12-07T09:59:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.007+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f723c0147b0 con 0x7f72440ca620 2023-12-07T09:59:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.007+0000 7f723a7fc640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7228066900 0x7f7228068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.007+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f723c084a00 con 0x7f72440ca620 2023-12-07T09:59:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.007+0000 7f7249c86640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7228066900 0x7f7228068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.007+0000 7f7249c86640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7228066900 0x7f7228068dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72400ad000 tx=0x7f72400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:10.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.011+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72441edb80 con 0x7f72440ca620 2023-12-07T09:59:10.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f72441edb80 con 0x7f72440ca620 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f723a7fc640 1 -- 172.21.15.89:0/2660591102 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f72441edb80 con 0x7f72440ca620 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:10.168 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T09:59:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7228066900 msgr2=0x7f7228068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7228066900 0x7f7228068dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72400ad000 tx=0x7f72400a6000 comp rx=0 tx=0).stop 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 msgr2=0x7f7244146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f7244146500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f723c00ef30 tx=0x7f723c00b480 comp rx=0 tx=0).stop 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 shutdown_connections 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72440ca620 0x7f7244146500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72440c4890 0x7f7244145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7228066900 0x7f7228068dc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 --2- 172.21.15.89:0/2660591102 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72440bd5a0 0x7f72440ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 >> 172.21.15.89:0/2660591102 conn(0x7f72440ac0a0 msgr2=0x7f7244151050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 shutdown_connections 2023-12-07T09:59:10.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.163+0000 7f724ac88640 1 -- 172.21.15.89:0/2660591102 wait complete. 2023-12-07T09:59:10.188 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-07T09:59:10.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-07T09:59:10.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 Processor -- start 2023-12-07T09:59:10.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 -- start start 2023-12-07T09:59:10.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e40151e10 0x7f6e400c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400bd720 0x7f6e4006c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e400c4f50 0x7f6e4006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e401521f0 con 0x7f6e400c4f50 2023-12-07T09:59:10.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4006bd20 con 0x7f6e40151e10 2023-12-07T09:59:10.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e4778d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e40155330 con 0x7f6e400bd720 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e400c4f50 0x7f6e4006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e400c4f50 0x7f6e4006c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44920/0 (socket says 172.21.15.89:44920) 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 -- 172.21.15.89:0/3718842653 learned_addr learned my addr 172.21.15.89:0/3718842653 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e44d28640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400bd720 0x7f6e4006c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 -- 172.21.15.89:0/3718842653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400bd720 msgr2=0x7f6e4006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45529640 1 --2- 172.21.15.89:0/3718842653 >> v2:172.21.15.97:3300/0 conn(0x7f6e40151e10 0x7f6e400c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400bd720 0x7f6e4006c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 -- 172.21.15.89:0/3718842653 >> v2:172.21.15.97:3300/0 conn(0x7f6e40151e10 msgr2=0x7f6e400c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 --2- 172.21.15.89:0/3718842653 >> v2:172.21.15.97:3300/0 conn(0x7f6e40151e10 0x7f6e400c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45d2a640 1 -- 172.21.15.89:0/3718842653 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40155610 con 0x7f6e400c4f50 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e44d28640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400bd720 0x7f6e4006c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.323+0000 7f6e45529640 1 --2- 172.21.15.89:0/3718842653 >> v2:172.21.15.97:3300/0 conn(0x7f6e40151e10 0x7f6e400c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e45d2a640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400c4f50 0x7f6e4006c6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6e400c7be0 tx=0x7f6e3801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3d67acd5cf46b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e37fff640 1 -- 172.21.15.89:0/3718842653 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380a5670 con 0x7f6e400c4f50 2023-12-07T09:59:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e37fff640 1 -- 172.21.15.89:0/3718842653 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e380a57d0 con 0x7f6e400c4f50 2023-12-07T09:59:10.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e37fff640 1 -- 172.21.15.89:0/3718842653 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380a5b60 con 0x7f6e400c4f50 2023-12-07T09:59:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 -- 172.21.15.89:0/3718842653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400c4f50 msgr2=0x7f6e4006c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400c4f50 0x7f6e4006c6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6e400c7be0 tx=0x7f6e3801c940 comp rx=0 tx=0).stop 2023-12-07T09:59:10.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 -- 172.21.15.89:0/3718842653 shutdown_connections 2023-12-07T09:59:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400c4f50 0x7f6e4006c6f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 --2- 172.21.15.89:0/3718842653 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400bd720 0x7f6e4006c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 --2- 172.21.15.89:0/3718842653 >> v2:172.21.15.97:3300/0 conn(0x7f6e40151e10 0x7f6e400c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 -- 172.21.15.89:0/3718842653 >> 172.21.15.89:0/3718842653 conn(0x7f6e400ca090 msgr2=0x7f6e400ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 -- 172.21.15.89:0/3718842653 shutdown_connections 2023-12-07T09:59:10.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.327+0000 7f6e4778d640 1 -- 172.21.15.89:0/3718842653 wait complete. 2023-12-07T09:59:10.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 Processor -- start 2023-12-07T09:59:10.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 -- start start 2023-12-07T09:59:10.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 0x7f6e401535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400c4f50 0x7f6e400bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e40151e10 0x7f6e400be440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401f15b0 con 0x7f6e400bd720 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400c33c0 con 0x7f6e40151e10 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401ed150 con 0x7f6e400c4f50 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 0x7f6e401535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 0x7f6e401535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44934/0 (socket says 172.21.15.89:44934) 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 -- 172.21.15.89:0/1505468945 learned_addr learned my addr 172.21.15.89:0/1505468945 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e44d28640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400c4f50 0x7f6e400bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45d2a640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e40151e10 0x7f6e400be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 -- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400c4f50 msgr2=0x7f6e400bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400c4f50 0x7f6e400bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 -- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e40151e10 msgr2=0x7f6e400be440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:10.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e40151e10 0x7f6e400be440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:10.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 -- 172.21.15.89:0/1505468945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38009b30 con 0x7f6e400bd720 2023-12-07T09:59:10.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e45529640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 0x7f6e401535f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c820 tx=0x7f6e3c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:10.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c007a30 con 0x7f6e400bd720 2023-12-07T09:59:10.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c007b90 con 0x7f6e400bd720 2023-12-07T09:59:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e401f0a30 con 0x7f6e400bd720 2023-12-07T09:59:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00ce10 con 0x7f6e400bd720 2023-12-07T09:59:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.331+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e401f0ff0 con 0x7f6e400bd720 2023-12-07T09:59:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.335+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4004e890 con 0x7f6e400bd720 2023-12-07T09:59:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.335+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e3c0113f0 con 0x7f6e400bd720 2023-12-07T09:59:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.335+0000 7f6e35ffb640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6e240668d0 0x7f6e24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.335+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e3c084100 con 0x7f6e400bd720 2023-12-07T09:59:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.335+0000 7f6e44d28640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6e240668d0 0x7f6e24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:10.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.335+0000 7f6e44d28640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6e240668d0 0x7f6e24068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e400bdb60 tx=0x7f6e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:10.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.339+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e3c0517d0 con 0x7f6e400bd720 2023-12-07T09:59:10.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:10.491+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6e4006d060 con 0x7f6e400bd720 2023-12-07T09:59:10.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:10.720 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.407+0000 7f6e35ffb640 1 -- 172.21.15.89:0/1505468945 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6e3c054df0 con 0x7f6e400bd720 2023-12-07T09:59:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6e240668d0 msgr2=0x7f6e24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6e240668d0 0x7f6e24068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e400bdb60 tx=0x7f6e30008040 comp rx=0 tx=0).stop 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 msgr2=0x7f6e401535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 0x7f6e401535f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c820 tx=0x7f6e3c00cce0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 shutdown_connections 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e40151e10 0x7f6e400be440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6e240668d0 0x7f6e24068d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6e400c4f50 0x7f6e400bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 --2- 172.21.15.89:0/1505468945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e400bd720 0x7f6e401535f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 >> 172.21.15.89:0/1505468945 conn(0x7f6e400ca090 msgr2=0x7f6e400aa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 shutdown_connections 2023-12-07T09:59:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.411+0000 7f6e4778d640 1 -- 172.21.15.89:0/1505468945 wait complete. 2023-12-07T09:59:11.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T09:59:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f839a8bb640 1 Processor -- start 2023-12-07T09:59:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f839a8bb640 1 -- start start 2023-12-07T09:59:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f839a8bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f839a8bb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8394152d90 con 0x7f8394156600 2023-12-07T09:59:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f839a8bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8394152480 con 0x7f839414fd00 2023-12-07T09:59:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f839a8bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940a9760 con 0x7f83940a86d0 2023-12-07T09:59:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f83937fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8394156600 0x7f839414f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34538/0 (socket says 172.21.15.89:34538) 2023-12-07T09:59:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f83937fe640 1 -- 172.21.15.89:0/1061070962 learned_addr learned my addr 172.21.15.89:0/1061070962 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8393fff640 1 --2- 172.21.15.89:0/1061070962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291285433 0 0) 0x7f8394152d90 con 0x7f8394156600 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f837c003530 con 0x7f8394156600 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736502194 0 0) 0x7f8394152480 con 0x7f839414fd00 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8394152d90 con 0x7f839414fd00 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8393fff640 1 -- 172.21.15.89:0/1061070962 >> v1:172.21.15.97:6789/0 conn(0x7f839414fd00 legacy=0x7f83940aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8393fff640 1 -- 172.21.15.89:0/1061070962 >> v1:172.21.15.89:6789/0 conn(0x7f8394156600 legacy=0x7f839414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.587+0000 7f8393fff640 1 -- 172.21.15.89:0/1061070962 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394152740 con 0x7f83940a86d0 2023-12-07T09:59:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.591+0000 7f8393fff640 1 --2- 172.21.15.89:0/1061070962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940a8f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83840097f0 tx=0x7f838401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf9ded3934467d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:11.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.591+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840a8050 con 0x7f83940a86d0 2023-12-07T09:59:11.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.591+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83840ac5f0 con 0x7f83940a86d0 2023-12-07T09:59:11.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.591+0000 7f8392ffd640 1 -- 172.21.15.89:0/1061070962 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840ac980 con 0x7f83940a86d0 2023-12-07T09:59:11.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- 172.21.15.89:0/1061070962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 msgr2=0x7f83940a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 --2- 172.21.15.89:0/1061070962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940a8f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83840097f0 tx=0x7f838401c4c0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- 172.21.15.89:0/1061070962 shutdown_connections 2023-12-07T09:59:11.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 --2- 172.21.15.89:0/1061070962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940a8f30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- 172.21.15.89:0/1061070962 >> 172.21.15.89:0/1061070962 conn(0x7f83940c2a60 msgr2=0x7f83940c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:11.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- 172.21.15.89:0/1061070962 shutdown_connections 2023-12-07T09:59:11.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- 172.21.15.89:0/1061070962 wait complete. 2023-12-07T09:59:11.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 Processor -- start 2023-12-07T09:59:11.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- start start 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839414fd00 0x7f8394147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 0x7f8394148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839414ab50 con 0x7f8394156600 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394070bb0 con 0x7f839414fd00 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f839a8bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83941489b0 con 0x7f83940a86d0 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 0x7f8394148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:11.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 0x7f8394148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44940/0 (socket says 172.21.15.89:44940) 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 -- 172.21.15.89:0/3345244025 learned_addr learned my addr 172.21.15.89:0/3345244025 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f83937fe640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839414fd00 0x7f8394147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8393fff640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 -- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 msgr2=0x7f83940c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 -- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839414fd00 msgr2=0x7f8394147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839414fd00 0x7f8394147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.595+0000 7f8398e58640 1 -- 172.21.15.89:0/3345244025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384009420 con 0x7f8394156600 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8398e58640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 0x7f8394148470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c790 tx=0x7f838c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:11.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00cea0 con 0x7f8394156600 2023-12-07T09:59:11.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c003b80 con 0x7f8394156600 2023-12-07T09:59:11.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00a850 con 0x7f8394156600 2023-12-07T09:59:11.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83940702c0 con 0x7f8394156600 2023-12-07T09:59:11.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8394071f30 con 0x7f8394156600 2023-12-07T09:59:11.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8394155c20 con 0x7f8394156600 2023-12-07T09:59:11.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f838c00a9b0 con 0x7f8394156600 2023-12-07T09:59:11.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8390ff9640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f83800668d0 0x7f8380068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:11.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f838c083fa0 con 0x7f8394156600 2023-12-07T09:59:11.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.599+0000 7f8393fff640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f83800668d0 0x7f8380068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:11.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.603+0000 7f8393fff640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f83800668d0 0x7f8380068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83840ae000 tx=0x7f8384008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:11.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.607+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f838c051460 con 0x7f8394156600 2023-12-07T09:59:11.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:11.755+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f839404e890 con 0x7f8394156600 2023-12-07T09:59:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f8390ff9640 1 -- 172.21.15.89:0/3345244025 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f838c054a80 con 0x7f8394156600 2023-12-07T09:59:12.420 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2023-12-07T09:59:12.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f83800668d0 msgr2=0x7f8380068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:12.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f83800668d0 0x7f8380068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83840ae000 tx=0x7f8384008040 comp rx=0 tx=0).stop 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 msgr2=0x7f8394148470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 0x7f8394148470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c790 tx=0x7f838c00cc50 comp rx=0 tx=0).stop 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 shutdown_connections 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8394156600 0x7f8394148470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839414fd00 0x7f8394147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f83800668d0 0x7f8380068d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 --2- 172.21.15.89:0/3345244025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83940a86d0 0x7f83940c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.415+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 >> 172.21.15.89:0/3345244025 conn(0x7f83940c2a60 msgr2=0x7f83940ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:12.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.419+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 shutdown_connections 2023-12-07T09:59:12.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.419+0000 7f839a8bb640 1 -- 172.21.15.89:0/3345244025 wait complete. 2023-12-07T09:59:12.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-07T09:59:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.599+0000 7f5b334e3640 1 Processor -- start 2023-12-07T09:59:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.599+0000 7f5b334e3640 1 -- start start 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b334e3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5b2c0c6220 0x7f5b2c158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b334e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c0c13a0 0x7f5b2c0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b334e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b2c151bf0 0x7f5b2c152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b334e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c158580 con 0x7f5b2c151bf0 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b334e3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c157f50 con 0x7f5b2c0c6220 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b334e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c1f60 con 0x7f5b2c0c13a0 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b2c151bf0 0x7f5b2c152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b2c151bf0 0x7f5b2c152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44942/0 (socket says 172.21.15.89:44942) 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b30a7e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c0c13a0 0x7f5b2c0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 -- 172.21.15.89:0/2953348734 learned_addr learned my addr 172.21.15.89:0/2953348734 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b3127f640 1 --2- 172.21.15.89:0/2953348734 >> v2:172.21.15.97:3300/0 conn(0x7f5b2c0c6220 0x7f5b2c158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 -- 172.21.15.89:0/2953348734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c0c13a0 msgr2=0x7f5b2c0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:12.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 --2- 172.21.15.89:0/2953348734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c0c13a0 0x7f5b2c0c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 -- 172.21.15.89:0/2953348734 >> v2:172.21.15.97:3300/0 conn(0x7f5b2c0c6220 msgr2=0x7f5b2c158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:12.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 --2- 172.21.15.89:0/2953348734 >> v2:172.21.15.97:3300/0 conn(0x7f5b2c0c6220 0x7f5b2c158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 -- 172.21.15.89:0/2953348734 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0c2240 con 0x7f5b2c151bf0 2023-12-07T09:59:12.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.603+0000 7f5b31a80640 1 --2- 172.21.15.89:0/2953348734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c151bf0 0x7f5b2c152060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06b500 tx=0x7f5b2401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8d0c2a9a014b62 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b23fff640 1 -- 172.21.15.89:0/2953348734 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240a57c0 con 0x7f5b2c151bf0 2023-12-07T09:59:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b23fff640 1 -- 172.21.15.89:0/2953348734 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b240a5920 con 0x7f5b2c151bf0 2023-12-07T09:59:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b23fff640 1 -- 172.21.15.89:0/2953348734 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240a5cb0 con 0x7f5b2c151bf0 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- 172.21.15.89:0/2953348734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c151bf0 msgr2=0x7f5b2c152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- 172.21.15.89:0/2953348734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c151bf0 0x7f5b2c152060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06b500 tx=0x7f5b2401c9a0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- 172.21.15.89:0/2953348734 shutdown_connections 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- 172.21.15.89:0/2953348734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c151bf0 0x7f5b2c152060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- 172.21.15.89:0/2953348734 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c0c13a0 0x7f5b2c0c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- 172.21.15.89:0/2953348734 >> v2:172.21.15.97:3300/0 conn(0x7f5b2c0c6220 0x7f5b2c158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- 172.21.15.89:0/2953348734 >> 172.21.15.89:0/2953348734 conn(0x7f5b2c06a5a0 msgr2=0x7f5b2c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- 172.21.15.89:0/2953348734 shutdown_connections 2023-12-07T09:59:12.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- 172.21.15.89:0/2953348734 wait complete. 2023-12-07T09:59:12.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 Processor -- start 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- start start 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b2c0c13a0 0x7f5b2c1f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 0x7f5b2c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c151bf0 0x7f5b2c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0aae30 con 0x7f5b2c0c6220 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c06d520 con 0x7f5b2c0c13a0 2023-12-07T09:59:12.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b334e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0ab010 con 0x7f5b2c151bf0 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b30a7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 0x7f5b2c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b30a7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 0x7f5b2c06ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44950/0 (socket says 172.21.15.89:44950) 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b30a7e640 1 -- 172.21.15.89:0/3003334786 learned_addr learned my addr 172.21.15.89:0/3003334786 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b31a80640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c151bf0 0x7f5b2c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.607+0000 7f5b3127f640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b2c0c13a0 0x7f5b2c1f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b30a7e640 1 -- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c151bf0 msgr2=0x7f5b2c1477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b30a7e640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c151bf0 0x7f5b2c1477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b30a7e640 1 -- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b2c0c13a0 msgr2=0x7f5b2c1f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b30a7e640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b2c0c13a0 0x7f5b2c1f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b30a7e640 1 -- 172.21.15.89:0/3003334786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24009b30 con 0x7f5b2c0c6220 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b3127f640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b2c0c13a0 0x7f5b2c1f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b30a7e640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 0x7f5b2c06ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e7f0 tx=0x7f5b1c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c009550 con 0x7f5b2c0c6220 2023-12-07T09:59:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0059a0 con 0x7f5b2c0c6220 2023-12-07T09:59:12.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c005d30 con 0x7f5b2c0c6220 2023-12-07T09:59:12.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0ab2f0 con 0x7f5b2c0c6220 2023-12-07T09:59:12.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c0ab8b0 con 0x7f5b2c0c6220 2023-12-07T09:59:12.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c04e890 con 0x7f5b2c0c6220 2023-12-07T09:59:12.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5b1c00c940 con 0x7f5b2c0c6220 2023-12-07T09:59:12.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.611+0000 7f5b21ffb640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5b10066900 0x7f5b10068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:12.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.615+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5b1c084610 con 0x7f5b2c0c6220 2023-12-07T09:59:12.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.615+0000 7f5b3127f640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5b10066900 0x7f5b10068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:12.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.615+0000 7f5b3127f640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5b10066900 0x7f5b10068dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009bb0 tx=0x7f5b28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:12.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.619+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b1c051950 con 0x7f5b2c0c6220 2023-12-07T09:59:12.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:12.799+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5b2c06f2e0 con 0x7f5b2c0c6220 2023-12-07T09:59:13.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.415+0000 7f5b21ffb640 1 -- 172.21.15.89:0/3003334786 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5b1c054f70 con 0x7f5b2c0c6220 2023-12-07T09:59:13.422 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 2 and data pool 3 2023-12-07T09:59:13.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5b10066900 msgr2=0x7f5b10068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5b10066900 0x7f5b10068dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009bb0 tx=0x7f5b28008040 comp rx=0 tx=0).stop 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 msgr2=0x7f5b2c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 0x7f5b2c06ca00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e7f0 tx=0x7f5b1c00ecb0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 shutdown_connections 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5b10066900 0x7f5b10068dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b2c151bf0 0x7f5b2c1477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b2c0c6220 0x7f5b2c06ca00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 --2- 172.21.15.89:0/3003334786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b2c0c13a0 0x7f5b2c1f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 >> 172.21.15.89:0/3003334786 conn(0x7f5b2c06a5a0 msgr2=0x7f5b2c0c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 shutdown_connections 2023-12-07T09:59:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.419+0000 7f5b334e3640 1 -- 172.21.15.89:0/3003334786 wait complete. 2023-12-07T09:59:13.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:13.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 Processor -- start 2023-12-07T09:59:13.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 -- start start 2023-12-07T09:59:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff0b40ca610 0x7ff0b40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b406cd90 0x7ff0b40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b4155790 con 0x7ff0b40bd720 2023-12-07T09:59:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b40c4b00 con 0x7ff0b40ca610 2023-12-07T09:59:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0ba3d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40c4de0 con 0x7ff0b406cd90 2023-12-07T09:59:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b37fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff0b40bd720 0x7ff0b4158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34552/0 (socket says 172.21.15.89:34552) 2023-12-07T09:59:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b37fe640 1 -- 172.21.15.89:0/839583721 learned_addr learned my addr 172.21.15.89:0/839583721 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b896e640 1 --2- 172.21.15.89:0/839583721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b406cd90 0x7ff0b40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b3fff640 1 --2- 172.21.15.89:0/839583721 >> v2:172.21.15.97:3300/0 conn(0x7ff0b40ca610 0x7ff0b40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b2ffd640 1 -- 172.21.15.89:0/839583721 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176022014 0 0) 0x7ff0b4155790 con 0x7ff0b40bd720 2023-12-07T09:59:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b2ffd640 1 -- 172.21.15.89:0/839583721 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff09c003530 con 0x7ff0b40bd720 2023-12-07T09:59:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b896e640 1 -- 172.21.15.89:0/839583721 >> v2:172.21.15.97:3300/0 conn(0x7ff0b40ca610 msgr2=0x7ff0b40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b896e640 1 --2- 172.21.15.89:0/839583721 >> v2:172.21.15.97:3300/0 conn(0x7ff0b40ca610 0x7ff0b40c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b896e640 1 -- 172.21.15.89:0/839583721 >> v1:172.21.15.89:6789/0 conn(0x7ff0b40bd720 legacy=0x7ff0b4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.583+0000 7ff0b896e640 1 -- 172.21.15.89:0/839583721 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4157e30 con 0x7ff0b406cd90 2023-12-07T09:59:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0b896e640 1 --2- 172.21.15.89:0/839583721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b406cd90 0x7ff0b40c9a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009d90 tx=0x7ff0ac01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0d53ed4dcce3d36 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0b2ffd640 1 -- 172.21.15.89:0/839583721 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40c52d0 con 0x7ff0b406cd90 2023-12-07T09:59:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0b2ffd640 1 -- 172.21.15.89:0/839583721 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0a4e60 con 0x7ff0b406cd90 2023-12-07T09:59:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0b2ffd640 1 -- 172.21.15.89:0/839583721 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0ac640 con 0x7ff0b406cd90 2023-12-07T09:59:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/839583721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b406cd90 msgr2=0x7ff0b40c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/839583721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b406cd90 0x7ff0b40c9a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009d90 tx=0x7ff0ac01c510 comp rx=0 tx=0).stop 2023-12-07T09:59:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/839583721 shutdown_connections 2023-12-07T09:59:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/839583721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b406cd90 0x7ff0b40c9a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/839583721 >> v2:172.21.15.97:3300/0 conn(0x7ff0b40ca610 0x7ff0b40c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/839583721 >> 172.21.15.89:0/839583721 conn(0x7ff0b4071ea0 msgr2=0x7ff0b40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:13.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/839583721 shutdown_connections 2023-12-07T09:59:13.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.587+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/839583721 wait complete. 2023-12-07T09:59:13.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 Processor -- start 2023-12-07T09:59:13.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 -- start start 2023-12-07T09:59:13.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0b406cd90 0x7ff0b40c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b40bd720 0x7ff0b40c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 0x7ff0b41ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40c23c0 con 0x7ff0b40ca610 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40a9f20 con 0x7ff0b406cd90 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40ac0e0 con 0x7ff0b40bd720 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 0x7ff0b41ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 0x7ff0b41ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44960/0 (socket says 172.21.15.89:44960) 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 -- 172.21.15.89:0/1083833367 learned_addr learned my addr 172.21.15.89:0/1083833367 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b37fe640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b40bd720 0x7ff0b40c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b3fff640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0b406cd90 0x7ff0b40c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 -- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b40bd720 msgr2=0x7ff0b40c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b40bd720 0x7ff0b40c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 -- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0b406cd90 msgr2=0x7ff0b40c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0b406cd90 0x7ff0b40c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 -- 172.21.15.89:0/1083833367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac009a70 con 0x7ff0b40ca610 2023-12-07T09:59:13.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b896e640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 0x7ff0b41ee4a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009d90 tx=0x7ff0ac0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:13.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac009450 con 0x7ff0b40ca610 2023-12-07T09:59:13.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0acd30 con 0x7ff0b40ca610 2023-12-07T09:59:13.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b40ac3c0 con 0x7ff0b40ca610 2023-12-07T09:59:13.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0acea0 con 0x7ff0b40ca610 2023-12-07T09:59:13.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.591+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b41edf80 con 0x7ff0b40ca610 2023-12-07T09:59:13.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.595+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b41ee170 con 0x7ff0b40ca610 2023-12-07T09:59:13.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.595+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0ac0b3050 con 0x7ff0b40ca610 2023-12-07T09:59:13.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.595+0000 7ff0b0ff9640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0a00668d0 0x7ff0a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.595+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0b40cac00 con 0x7ff0b40ca610 2023-12-07T09:59:13.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.595+0000 7ff0b3fff640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0a00668d0 0x7ff0a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.595+0000 7ff0b3fff640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0a00668d0 0x7ff0a0068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0b41ebcb0 tx=0x7ff0a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:13.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.599+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0ac0eb390 con 0x7ff0b40ca610 2023-12-07T09:59:13.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.751+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0b404e890 con 0x7ff0b40ca610 2023-12-07T09:59:13.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.751+0000 7ff0b0ff9640 1 -- 172.21.15.89:0/1083833367 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16458 (secure 0 0 0) 0x7ff0ac0ee9b0 con 0x7ff0b40ca610 2023-12-07T09:59:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:13.758 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:12.803066+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:13.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0a00668d0 msgr2=0x7ff0a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0a00668d0 0x7ff0a0068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0b41ebcb0 tx=0x7ff0a4009190 comp rx=0 tx=0).stop 2023-12-07T09:59:13.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 msgr2=0x7ff0b41ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 0x7ff0b41ee4a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009d90 tx=0x7ff0ac0195d0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 shutdown_connections 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0b40ca610 0x7ff0b41ee4a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0a00668d0 0x7ff0a0068d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0b40bd720 0x7ff0b40c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 --2- 172.21.15.89:0/1083833367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0b406cd90 0x7ff0b40c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 >> 172.21.15.89:0/1083833367 conn(0x7ff0b4071ea0 msgr2=0x7ff0b4072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 shutdown_connections 2023-12-07T09:59:13.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.755+0000 7ff0ba3d1640 1 -- 172.21.15.89:0/1083833367 wait complete. 2023-12-07T09:59:13.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:13.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.907+0000 7fe7e7ec9640 1 Processor -- start 2023-12-07T09:59:13.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.907+0000 7fe7e7ec9640 1 -- start start 2023-12-07T09:59:13.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e7ec9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe7e006a5a0 0x7fe7e00c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e7ec9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e01551d0 con 0x7fe7e00c0c20 2023-12-07T09:59:13.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e7ec9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e0072840 con 0x7fe7e00c1ae0 2023-12-07T09:59:13.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e7ec9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e006e9c0 con 0x7fe7e006a5a0 2023-12-07T09:59:13.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe7e00c0c20 0x7fe7e015f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34564/0 (socket says 172.21.15.89:34564) 2023-12-07T09:59:13.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 -- 172.21.15.89:0/3385302800 learned_addr learned my addr 172.21.15.89:0/3385302800 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493684337 0 0) 0x7fe7e01551d0 con 0x7fe7e00c0c20 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e5c65640 1 --2- 172.21.15.89:0/3385302800 >> v2:172.21.15.97:3300/0 conn(0x7fe7e006a5a0 0x7fe7e00c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7cc003530 con 0x7fe7e00c0c20 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588554417 0 0) 0x7fe7cc003530 con 0x7fe7e00c0c20 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 >> v2:172.21.15.97:3300/0 conn(0x7fe7e006a5a0 msgr2=0x7fe7e00c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 --2- 172.21.15.89:0/3385302800 >> v2:172.21.15.97:3300/0 conn(0x7fe7e006a5a0 0x7fe7e00c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 >> v1:172.21.15.97:6789/0 conn(0x7fe7e00c1ae0 legacy=0x7fe7e00c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0072560 con 0x7fe7e00c0c20 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fe7d8001a00 con 0x7fe7e00c0c20 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 >> v1:172.21.15.89:6789/0 conn(0x7fe7e00c0c20 legacy=0x7fe7e015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7cc0039d0 0x7fe7cc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc0047d0 0x7fe7cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc005190 0x7fe7cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e006e9c0 con 0x7fe7cc005190 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc00c090 con 0x7fe7cc0047d0 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc00c250 con 0x7fe7cc0039d0 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc005190 0x7fe7cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e5464640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc0047d0 0x7fe7cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e5c65640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7cc0039d0 0x7fe7cc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 -- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7cc0039d0 msgr2=0x7fe7cc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7cc0039d0 0x7fe7cc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 -- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc0047d0 msgr2=0x7fe7cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:13.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc0047d0 0x7fe7cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e6466640 1 -- 172.21.15.89:0/3385302800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc003530 con 0x7fe7cc005190 2023-12-07T09:59:13.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.911+0000 7fe7e5464640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc0047d0 0x7fe7cc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:13.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e6466640 1 -- 172.21.15.89:0/3385302800 reap_dead start 2023-12-07T09:59:13.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc005190 0x7fe7cc00b990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800a760 tx=0x7fe7d801d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7669532e203b797 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:13.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80ad630 con 0x7fe7cc005190 2023-12-07T09:59:13.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d80a8070 con 0x7fe7cc005190 2023-12-07T09:59:13.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e4c63640 1 -- 172.21.15.89:0/3385302800 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80ad9d0 con 0x7fe7cc005190 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3385302800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc005190 msgr2=0x7fe7cc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc005190 0x7fe7cc00b990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800a760 tx=0x7fe7d801d260 comp rx=0 tx=0).stop 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3385302800 shutdown_connections 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3385302800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc005190 0x7fe7cc00b990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3385302800 >> 172.21.15.89:0/3385302800 conn(0x7fe7e00c3be0 msgr2=0x7fe7e00c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3385302800 shutdown_connections 2023-12-07T09:59:13.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.915+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3385302800 wait complete. 2023-12-07T09:59:13.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 Processor -- start 2023-12-07T09:59:13.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- start start 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc005190 0x7fe7e01586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e00c6650 0x7fe7e00ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 0x7fe7e0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e01e9ac0 con 0x7fe7e0156670 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0147d80 con 0x7fe7cc005190 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00ace40 con 0x7fe7e00c6650 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 0x7fe7e0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 0x7fe7e0156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44978/0 (socket says 172.21.15.89:44978) 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 -- 172.21.15.89:0/3457641067 learned_addr learned my addr 172.21.15.89:0/3457641067 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e5464640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e00c6650 0x7fe7e00ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e5c65640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc005190 0x7fe7e01586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 -- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e00c6650 msgr2=0x7fe7e00ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e00c6650 0x7fe7e00ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 -- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc005190 msgr2=0x7fe7e01586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc005190 0x7fe7e01586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 -- 172.21.15.89:0/3457641067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00c6bc0 con 0x7fe7e0156670 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e5464640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e00c6650 0x7fe7e00ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:13.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e5c65640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc005190 0x7fe7e01586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e6466640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 0x7fe7e0156af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7d801db00 tx=0x7fe7cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80ad630 con 0x7fe7e0156670 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d80b3040 con 0x7fe7e0156670 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80ad9b0 con 0x7fe7e0156670 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e00c5770 con 0x7fe7e0156670 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00c5d30 con 0x7fe7e0156670 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.919+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e0067a40 con 0x7fe7e0156670 2023-12-07T09:59:13.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.923+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe7d80aa030 con 0x7fe7e0156670 2023-12-07T09:59:13.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.923+0000 7fe7d67fc640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7c40668d0 0x7fe7c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:13.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.923+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7d80a5e40 con 0x7fe7e0156670 2023-12-07T09:59:13.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.923+0000 7fe7e5c65640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7c40668d0 0x7fe7c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:13.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.923+0000 7fe7e5c65640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7c40668d0 0x7fe7c4068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009a60 tx=0x7fe7dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:13.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:13.927+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7d80eb240 con 0x7fe7e0156670 2023-12-07T09:59:14.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.075+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7e004e890 con 0x7fe7e0156670 2023-12-07T09:59:14.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.075+0000 7fe7d67fc640 1 -- 172.21.15.89:0/3457641067 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16458 (secure 0 0 0) 0x7fe7d80ee860 con 0x7fe7e0156670 2023-12-07T09:59:14.083 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:14.083 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:12.803066+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7c40668d0 msgr2=0x7fe7c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7c40668d0 0x7fe7c4068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009a60 tx=0x7fe7dc008040 comp rx=0 tx=0).stop 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 msgr2=0x7fe7e0156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 0x7fe7e0156af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7d801db00 tx=0x7fe7cc005800 comp rx=0 tx=0).stop 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 shutdown_connections 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e0156670 0x7fe7e0156af0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7c40668d0 0x7fe7c4068d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e00c6650 0x7fe7e00ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 --2- 172.21.15.89:0/3457641067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7cc005190 0x7fe7e01586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 >> 172.21.15.89:0/3457641067 conn(0x7fe7e00c3be0 msgr2=0x7fe7e006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:14.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 shutdown_connections 2023-12-07T09:59:14.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.079+0000 7fe7e7ec9640 1 -- 172.21.15.89:0/3457641067 wait complete. 2023-12-07T09:59:14.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-07T09:59:14.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 Processor -- start 2023-12-07T09:59:14.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 -- start start 2023-12-07T09:59:14.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a8c14b450 0x7f9a8c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9a8c0725e0 0x7f9a8c0c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c06d550 0x7f9a8c0c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8c0c1dc0 con 0x7f9a8c14b450 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8c06f3b0 con 0x7f9a8c0725e0 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.239+0000 7f9a9352a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0c3980 con 0x7f9a8c06d550 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a8c14b450 0x7f9a8c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a8c14b450 0x7f9a8c06d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44984/0 (socket says 172.21.15.89:44984) 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 -- 172.21.15.89:0/1154465821 learned_addr learned my addr 172.21.15.89:0/1154465821 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a90ac5640 1 --2- 172.21.15.89:0/1154465821 >> v2:172.21.15.97:3300/0 conn(0x7f9a8c0725e0 0x7f9a8c0c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a91ac7640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c06d550 0x7f9a8c0c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 -- 172.21.15.89:0/1154465821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c06d550 msgr2=0x7f9a8c0c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c06d550 0x7f9a8c0c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 -- 172.21.15.89:0/1154465821 >> v2:172.21.15.97:3300/0 conn(0x7f9a8c0725e0 msgr2=0x7f9a8c0c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 --2- 172.21.15.89:0/1154465821 >> v2:172.21.15.97:3300/0 conn(0x7f9a8c0725e0 0x7f9a8c0c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 -- 172.21.15.89:0/1154465821 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c151ea0 con 0x7f9a8c14b450 2023-12-07T09:59:14.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a91ac7640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c06d550 0x7f9a8c0c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:14.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a912c6640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c06d010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c14eec0 tx=0x7f9a8801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba0340716ef4f12 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:14.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a83fff640 1 -- 172.21.15.89:0/1154465821 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880ab600 con 0x7f9a8c14b450 2023-12-07T09:59:14.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a83fff640 1 -- 172.21.15.89:0/1154465821 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a880a7050 con 0x7f9a8c14b450 2023-12-07T09:59:14.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.243+0000 7f9a83fff640 1 -- 172.21.15.89:0/1154465821 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880ab980 con 0x7f9a8c14b450 2023-12-07T09:59:14.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- 172.21.15.89:0/1154465821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 msgr2=0x7f9a8c06d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:14.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c06d010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c14eec0 tx=0x7f9a8801c3e0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- 172.21.15.89:0/1154465821 shutdown_connections 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c06d550 0x7f9a8c0c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- 172.21.15.89:0/1154465821 >> v2:172.21.15.97:3300/0 conn(0x7f9a8c0725e0 0x7f9a8c0c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- 172.21.15.89:0/1154465821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c06d010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- 172.21.15.89:0/1154465821 >> 172.21.15.89:0/1154465821 conn(0x7f9a8c0c3b70 msgr2=0x7f9a8c0c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- 172.21.15.89:0/1154465821 shutdown_connections 2023-12-07T09:59:14.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- 172.21.15.89:0/1154465821 wait complete. 2023-12-07T09:59:14.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 Processor -- start 2023-12-07T09:59:14.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- start start 2023-12-07T09:59:14.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a8c06d550 0x7f9a8c144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c0725e0 0x7f9a8c145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c1eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c147c50 con 0x7f9a8c14b450 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c1477c0 con 0x7f9a8c06d550 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a9352a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c142280 con 0x7f9a8c0725e0 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c1eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c1eb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44986/0 (socket says 172.21.15.89:44986) 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 -- 172.21.15.89:0/276269302 learned_addr learned my addr 172.21.15.89:0/276269302 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a912c6640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a8c06d550 0x7f9a8c144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a90ac5640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c0725e0 0x7f9a8c145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 -- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c0725e0 msgr2=0x7f9a8c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c0725e0 0x7f9a8c145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 -- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a8c06d550 msgr2=0x7f9a8c144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a8c06d550 0x7f9a8c144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:14.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 -- 172.21.15.89:0/276269302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880094d0 con 0x7f9a8c14b450 2023-12-07T09:59:14.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.247+0000 7f9a91ac7640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c1eb5c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400cef0 tx=0x7f9a8400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:14.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400d840 con 0x7f9a8c14b450 2023-12-07T09:59:14.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8400d9a0 con 0x7f9a8c14b450 2023-12-07T09:59:14.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400dd50 con 0x7f9a8c14b450 2023-12-07T09:59:14.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c1eefa0 con 0x7f9a8c14b450 2023-12-07T09:59:14.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c147450 con 0x7f9a8c14b450 2023-12-07T09:59:14.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c1475e0 con 0x7f9a8c14b450 2023-12-07T09:59:14.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9a8401e3b0 con 0x7f9a8c14b450 2023-12-07T09:59:14.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a81ffb640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a700668d0 0x7f9a70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:14.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a84084dc0 con 0x7f9a8c14b450 2023-12-07T09:59:14.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.251+0000 7f9a912c6640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a700668d0 0x7f9a70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:14.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.255+0000 7f9a912c6640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a700668d0 0x7f9a70068d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a880ad000 tx=0x7f9a88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:14.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.255+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a840520b0 con 0x7f9a8c14b450 2023-12-07T09:59:14.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:14.439+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9a8c147930 con 0x7f9a8c14b450 2023-12-07T09:59:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.439+0000 7f9a81ffb640 1 -- 172.21.15.89:0/276269302 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9a8401a0b0 con 0x7f9a8c14b450 2023-12-07T09:59:15.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a700668d0 msgr2=0x7f9a70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:15.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a700668d0 0x7f9a70068d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a880ad000 tx=0x7f9a88008040 comp rx=0 tx=0).stop 2023-12-07T09:59:15.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 msgr2=0x7f9a8c1eb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:15.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c1eb5c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400cef0 tx=0x7f9a8400a710 comp rx=0 tx=0).stop 2023-12-07T09:59:15.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 shutdown_connections 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a8c14b450 0x7f9a8c1eb5c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a700668d0 0x7f9a70068d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a8c0725e0 0x7f9a8c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 --2- 172.21.15.89:0/276269302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a8c06d550 0x7f9a8c144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 >> 172.21.15.89:0/276269302 conn(0x7f9a8c0c3b70 msgr2=0x7f9a8c0c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 shutdown_connections 2023-12-07T09:59:15.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.443+0000 7f9a9352a640 1 -- 172.21.15.89:0/276269302 wait complete. 2023-12-07T09:59:15.472 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T09:59:15.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-07T09:59:15.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 Processor -- start 2023-12-07T09:59:15.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 -- start start 2023-12-07T09:59:15.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:15.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fceb40c7f20 0x7fceb406be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:15.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb406cf70 con 0x7fceb40c8430 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb4152160 con 0x7fceb40c7f20 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fcebb5e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40c6a30 con 0x7fceb4151d80 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fceb40c7f20 0x7fceb406be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fceb40c7f20 0x7fceb406be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44998/0 (socket says 172.21.15.89:44998) 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb8b81640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fceb40c8430 0x7fceb406b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34576/0 (socket says 172.21.15.89:34576) 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 -- 172.21.15.89:0/1750768745 learned_addr learned my addr 172.21.15.89:0/1750768745 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 -- 172.21.15.89:0/1750768745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 msgr2=0x7fceb40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9382640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceabfff640 1 -- 172.21.15.89:0/1750768745 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053215182 0 0) 0x7fceb406cf70 con 0x7fceb40c8430 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 -- 172.21.15.89:0/1750768745 >> v1:172.21.15.89:6789/0 conn(0x7fceb40c8430 legacy=0x7fceb406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9b83640 1 -- 172.21.15.89:0/1750768745 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40c72d0 con 0x7fceb40c7f20 2023-12-07T09:59:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.611+0000 7fceb9382640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fceb9b83640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb406be30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e50 tx=0x7fceac01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef23b8066795ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fceabfff640 1 -- 172.21.15.89:0/1750768745 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0a5810 con 0x7fceb40c7f20 2023-12-07T09:59:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fceabfff640 1 -- 172.21.15.89:0/1750768745 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0a5970 con 0x7fceb40c7f20 2023-12-07T09:59:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fceabfff640 1 -- 172.21.15.89:0/1750768745 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0a5d00 con 0x7fceb40c7f20 2023-12-07T09:59:15.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1750768745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 msgr2=0x7fceb406be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:15.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb406be30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e50 tx=0x7fceac01c950 comp rx=0 tx=0).stop 2023-12-07T09:59:15.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1750768745 shutdown_connections 2023-12-07T09:59:15.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb406be30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1750768745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1750768745 >> 172.21.15.89:0/1750768745 conn(0x7fceb40abd00 msgr2=0x7fceb40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:15.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1750768745 shutdown_connections 2023-12-07T09:59:15.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.615+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1750768745 wait complete. 2023-12-07T09:59:15.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 Processor -- start 2023-12-07T09:59:15.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 -- start start 2023-12-07T09:59:15.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb414a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:15.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fceb40c8430 0x7fceb414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb414c880 con 0x7fceb40c7f20 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb414c3f0 con 0x7fceb40c8430 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4153070 con 0x7fceb4151d80 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb414a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb414a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45002/0 (socket says 172.21.15.89:45002) 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 -- 172.21.15.89:0/1352296218 learned_addr learned my addr 172.21.15.89:0/1352296218 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9b83640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb8b81640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fceb40c8430 0x7fceb414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 -- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 msgr2=0x7fceb40aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 -- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fceb40c8430 msgr2=0x7fceb414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fceb40c8430 0x7fceb414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:15.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 -- 172.21.15.89:0/1352296218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009b30 con 0x7fceb40c7f20 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9b83640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fceb9382640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb414a990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c7c0 tx=0x7fceb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0007a30 con 0x7fceb40c7f20 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0007b90 con 0x7fceb40c7f20 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb414bda0 con 0x7fceb40c7f20 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000ce70 con 0x7fceb40c7f20 2023-12-07T09:59:15.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.619+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb414aed0 con 0x7fceb40c7f20 2023-12-07T09:59:15.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.623+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb414bc00 con 0x7fceb40c7f20 2023-12-07T09:59:15.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.623+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fceb00113f0 con 0x7fceb40c7f20 2023-12-07T09:59:15.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.623+0000 7fcea9ffb640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fce980668d0 0x7fce98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:15.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.623+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceb0084950 con 0x7fceb40c7f20 2023-12-07T09:59:15.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.623+0000 7fceb8b81640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fce980668d0 0x7fce98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:15.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.623+0000 7fceb8b81640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fce980668d0 0x7fce98068d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fceb40c10a0 tx=0x7fcea4007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:15.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.627+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fceb414bc00 con 0x7fceb40c7f20 2023-12-07T09:59:15.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:15.807+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fceb414bc00 con 0x7fceb40c7f20 2023-12-07T09:59:16.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.447+0000 7fcea9ffb640 1 -- 172.21.15.89:0/1352296218 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fceb414bc00 con 0x7fceb40c7f20 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fce980668d0 msgr2=0x7fce98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fce980668d0 0x7fce98068d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fceb40c10a0 tx=0x7fcea4007c10 comp rx=0 tx=0).stop 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 msgr2=0x7fceb414a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb414a990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c7c0 tx=0x7fceb000cc80 comp rx=0 tx=0).stop 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 shutdown_connections 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fce980668d0 0x7fce98068d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fceb4151d80 0x7fceb40aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fceb40c8430 0x7fceb414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 --2- 172.21.15.89:0/1352296218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fceb40c7f20 0x7fceb414a990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 >> 172.21.15.89:0/1352296218 conn(0x7fceb40abd00 msgr2=0x7fceb4150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:16.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 shutdown_connections 2023-12-07T09:59:16.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.451+0000 7fcebb5e6640 1 -- 172.21.15.89:0/1352296218 wait complete. 2023-12-07T09:59:16.477 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-07T09:59:16.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:16.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.607+0000 7f3c4845a640 1 Processor -- start 2023-12-07T09:59:16.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.607+0000 7f3c4845a640 1 -- start start 2023-12-07T09:59:16.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c4845a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 0x7f3c4006ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c4845a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4006e280 con 0x7f3c40155360 2023-12-07T09:59:16.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c4845a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c400c1bd0 con 0x7f3c4006e7c0 2023-12-07T09:59:16.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c4845a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c2150 con 0x7f3c401587c0 2023-12-07T09:59:16.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3c40155360 0x7f3c4006b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34584/0 (socket says 172.21.15.89:34584) 2023-12-07T09:59:16.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 -- 172.21.15.89:0/129793527 learned_addr learned my addr 172.21.15.89:0/129793527 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:16.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c469f7640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 0x7f3c4006ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920502701 0 0) 0x7f3c4006e280 con 0x7f3c40155360 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c003530 con 0x7f3c40155360 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847082949 0 0) 0x7f3c400c1bd0 con 0x7f3c4006e7c0 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4006e280 con 0x7f3c4006e7c0 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2216535397 0 0) 0x7f3c2c003530 con 0x7f3c40155360 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 msgr2=0x7f3c4006ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 0x7f3c4006ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 >> v1:172.21.15.97:6789/0 conn(0x7f3c4006e7c0 legacy=0x7f3c401580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400c4c40 con 0x7f3c40155360 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f3c3c001680 con 0x7f3c40155360 2023-12-07T09:59:16.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 >> v1:172.21.15.89:6789/0 conn(0x7f3c40155360 legacy=0x7f3c4006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c2c003b40 0x7f3c2c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c0047d0 0x7f3c2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 0x7f3c2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c2150 con 0x7f3c2c003b40 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c00ba40 con 0x7f3c2c0047d0 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c00bbd0 con 0x7f3c401587c0 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c2c003b40 0x7f3c2c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c459f5640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c0047d0 0x7f3c2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c469f7640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 0x7f3c2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 -- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 msgr2=0x7f3c2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c401587c0 0x7f3c2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 -- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c0047d0 msgr2=0x7f3c2c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c2c0047d0 0x7f3c2c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.611+0000 7f3c461f6640 1 -- 172.21.15.89:0/129793527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c003530 con 0x7f3c2c003b40 2023-12-07T09:59:16.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c461f6640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c2c003b40 0x7f3c2c003f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c160 tx=0x7f3c3c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5521ebacf8f57a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0058e0 con 0x7f3c2c003b40 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c005a60 con 0x7f3c2c003b40 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c451f4640 1 -- 172.21.15.89:0/129793527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c005e10 con 0x7f3c2c003b40 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c4845a640 1 -- 172.21.15.89:0/129793527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c2c003b40 msgr2=0x7f3c2c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c4845a640 1 --2- 172.21.15.89:0/129793527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c2c003b40 0x7f3c2c003f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c160 tx=0x7f3c3c01cb60 comp rx=0 tx=0).stop 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c469f7640 1 -- 172.21.15.89:0/129793527 reap_dead start 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c4845a640 1 -- 172.21.15.89:0/129793527 shutdown_connections 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c4845a640 1 -- 172.21.15.89:0/129793527 >> 172.21.15.89:0/129793527 conn(0x7f3c400c3240 msgr2=0x7f3c400c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c4845a640 1 -- 172.21.15.89:0/129793527 shutdown_connections 2023-12-07T09:59:16.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.615+0000 7f3c4845a640 1 -- 172.21.15.89:0/129793527 wait complete. 2023-12-07T09:59:16.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 Processor -- start 2023-12-07T09:59:16.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- start start 2023-12-07T09:59:16.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c003b40 0x7f3c401f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 0x7f3c40071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c40072320 0x7f3c400aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400a9e80 con 0x7f3c40155cc0 2023-12-07T09:59:16.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400a7490 con 0x7f3c40072320 2023-12-07T09:59:16.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c401f1390 con 0x7f3c2c003b40 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 0x7f3c40071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 0x7f3c40071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45014/0 (socket says 172.21.15.89:45014) 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 -- 172.21.15.89:0/2168181392 learned_addr learned my addr 172.21.15.89:0/2168181392 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c461f6640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c003b40 0x7f3c401f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c469f7640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c40072320 0x7f3c400aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 -- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c003b40 msgr2=0x7f3c401f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c003b40 0x7f3c401f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 -- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c40072320 msgr2=0x7f3c400aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c40072320 0x7f3c400aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 -- 172.21.15.89:0/2168181392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400727a0 con 0x7f3c40155cc0 2023-12-07T09:59:16.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c459f5640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 0x7f3c40071de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000e5a0 tx=0x7f3c3000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:16.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300052e0 con 0x7f3c40155cc0 2023-12-07T09:59:16.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30005460 con 0x7f3c40155cc0 2023-12-07T09:59:16.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30003840 con 0x7f3c40155cc0 2023-12-07T09:59:16.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c400a7730 con 0x7f3c40155cc0 2023-12-07T09:59:16.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c400aa7d0 con 0x7f3c40155cc0 2023-12-07T09:59:16.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.619+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4004e890 con 0x7f3c40155cc0 2023-12-07T09:59:16.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.623+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c300039a0 con 0x7f3c40155cc0 2023-12-07T09:59:16.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.623+0000 7f3c36ffd640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3c24066900 0x7f3c24068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.623+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c30083ec0 con 0x7f3c40155cc0 2023-12-07T09:59:16.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.623+0000 7f3c461f6640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3c24066900 0x7f3c24068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.623+0000 7f3c461f6640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3c24066900 0x7f3c24068dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0aa000 tx=0x7f3c3c001a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:16.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.627+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c30051110 con 0x7f3c40155cc0 2023-12-07T09:59:16.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.807+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c400c4780 con 0x7f3c40155cc0 2023-12-07T09:59:16.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.807+0000 7f3c36ffd640 1 -- 172.21.15.89:0/2168181392 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f3c30054730 con 0x7f3c40155cc0 2023-12-07T09:59:16.815 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:16.815 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:16.815 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3c24066900 msgr2=0x7f3c24068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3c24066900 0x7f3c24068dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0aa000 tx=0x7f3c3c001a00 comp rx=0 tx=0).stop 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 msgr2=0x7f3c40071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 0x7f3c40071de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000e5a0 tx=0x7f3c3000ea60 comp rx=0 tx=0).stop 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 shutdown_connections 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c40072320 0x7f3c400aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c40155cc0 0x7f3c40071de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3c24066900 0x7f3c24068dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 --2- 172.21.15.89:0/2168181392 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c2c003b40 0x7f3c401f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 >> 172.21.15.89:0/2168181392 conn(0x7f3c400c3240 msgr2=0x7f3c40151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:16.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 shutdown_connections 2023-12-07T09:59:16.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.811+0000 7f3c4845a640 1 -- 172.21.15.89:0/2168181392 wait complete. 2023-12-07T09:59:16.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:16.922 INFO:tasks.ceph.mds.b.smithi097.stderr:2023-12-07T09:59:16.917+0000 7f4dd67e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T09:59:16.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 Processor -- start 2023-12-07T09:59:16.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 -- start start 2023-12-07T09:59:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 0x7f47b80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 0x7f47b80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b8155790 con 0x7f47b806cd90 2023-12-07T09:59:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b80c4b00 con 0x7f47b80ca610 2023-12-07T09:59:16.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.967+0000 7f47bd380640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c4de0 con 0x7f47b80bd720 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 0x7f47b80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47b6ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 0x7f47b80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 0x7f47b80c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:35900/0 (socket says 172.21.15.89:35900) 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47b6ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 0x7f47b80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:59998/0 (socket says 172.21.15.89:59998) 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 -- 172.21.15.89:0/622610490 learned_addr learned my addr 172.21.15.89:0/622610490 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47b77fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f47b806cd90 0x7f47b8158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:39130/0 (socket says 172.21.15.89:39130) 2023-12-07T09:59:16.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 -- 172.21.15.89:0/622610490 >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 msgr2=0x7f47b80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 --2- 172.21.15.89:0/622610490 >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 0x7f47b80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 -- 172.21.15.89:0/622610490 >> v1:172.21.15.97:6789/0 conn(0x7f47b806cd90 legacy=0x7f47b8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 -- 172.21.15.89:0/622610490 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8157e30 con 0x7f47b80bd720 2023-12-07T09:59:16.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47b6ffd640 1 --2- 172.21.15.89:0/622610490 >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 0x7f47b80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:16.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.971+0000 7f47affff640 1 --2- 172.21.15.89:0/622610490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 0x7f47b80c9a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009870 tx=0x7f47a001c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719050212cb9c945 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47b67fc640 1 -- 172.21.15.89:0/622610490 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80c52d0 con 0x7f47b80bd720 2023-12-07T09:59:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47b67fc640 1 -- 172.21.15.89:0/622610490 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a00a4940 con 0x7f47b80bd720 2023-12-07T09:59:16.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47b67fc640 1 -- 172.21.15.89:0/622610490 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00a4cd0 con 0x7f47b80bd720 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- 172.21.15.89:0/622610490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 msgr2=0x7f47b80c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 --2- 172.21.15.89:0/622610490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 0x7f47b80c9a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009870 tx=0x7f47a001c100 comp rx=0 tx=0).stop 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- 172.21.15.89:0/622610490 shutdown_connections 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 --2- 172.21.15.89:0/622610490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b80bd720 0x7f47b80c9a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 --2- 172.21.15.89:0/622610490 >> v2:172.21.15.97:3300/0 conn(0x7f47b80ca610 0x7f47b80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- 172.21.15.89:0/622610490 >> 172.21.15.89:0/622610490 conn(0x7f47b8071ea0 msgr2=0x7f47b80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- 172.21.15.89:0/622610490 shutdown_connections 2023-12-07T09:59:16.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- 172.21.15.89:0/622610490 wait complete. 2023-12-07T09:59:16.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 Processor -- start 2023-12-07T09:59:16.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- start start 2023-12-07T09:59:16.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b806cd90 0x7f47b81f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80bd720 0x7f47b81f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 0x7f47b80c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8151680 con 0x7f47b80ca610 2023-12-07T09:59:16.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80be000 con 0x7f47b80bd720 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47bd380640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8151e20 con 0x7f47b806cd90 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 0x7f47b80c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 0x7f47b80c2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45018/0 (socket says 172.21.15.89:45018) 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.975+0000 7f47b77fe640 1 -- 172.21.15.89:0/2032017485 learned_addr learned my addr 172.21.15.89:0/2032017485 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b6ffd640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b806cd90 0x7f47b81f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47affff640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80bd720 0x7f47b81f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b77fe640 1 -- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b806cd90 msgr2=0x7f47b81f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b77fe640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b806cd90 0x7f47b81f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b77fe640 1 -- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80bd720 msgr2=0x7f47b81f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b77fe640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80bd720 0x7f47b81f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b77fe640 1 -- 172.21.15.89:0/2032017485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009420 con 0x7f47b80ca610 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47affff640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80bd720 0x7f47b81f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:16.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b77fe640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 0x7f47b80c2cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c7a0 tx=0x7f47b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:16.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000a640 con 0x7f47b80ca610 2023-12-07T09:59:16.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000a7a0 con 0x7f47b80ca610 2023-12-07T09:59:16.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a00094d0 con 0x7f47b80ca610 2023-12-07T09:59:16.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ab10 con 0x7f47b80ca610 2023-12-07T09:59:16.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b8151b40 con 0x7f47b80ca610 2023-12-07T09:59:16.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b804e890 con 0x7f47b80ca610 2023-12-07T09:59:16.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f47b000ac70 con 0x7f47b80ca610 2023-12-07T09:59:16.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47af7fe640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f47980668d0 0x7f4798068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:16.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47b0083ba0 con 0x7f47b80ca610 2023-12-07T09:59:16.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.979+0000 7f47b6ffd640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f47980668d0 0x7f4798068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:16.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.983+0000 7f47b6ffd640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f47980668d0 0x7f4798068d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009be0 tx=0x7f47a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:16.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:16.983+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47b0050e80 con 0x7f47b80ca610 2023-12-07T09:59:17.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.135+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b80be140 con 0x7f47b80ca610 2023-12-07T09:59:17.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47af7fe640 1 -- 172.21.15.89:0/2032017485 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f47b0017020 con 0x7f47b80ca610 2023-12-07T09:59:17.143 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:17.143 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:17.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f47980668d0 msgr2=0x7f4798068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f47980668d0 0x7f4798068d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009be0 tx=0x7f47a8008040 comp rx=0 tx=0).stop 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 msgr2=0x7f47b80c2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 0x7f47b80c2cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c7a0 tx=0x7f47b000cc60 comp rx=0 tx=0).stop 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 shutdown_connections 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b80ca610 0x7f47b80c2cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b80bd720 0x7f47b81f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f47980668d0 0x7f4798068d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 --2- 172.21.15.89:0/2032017485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47b806cd90 0x7f47b81f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 >> 172.21.15.89:0/2032017485 conn(0x7f47b8071ea0 msgr2=0x7f47b815f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 shutdown_connections 2023-12-07T09:59:17.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.139+0000 7f47bd380640 1 -- 172.21.15.89:0/2032017485 wait complete. 2023-12-07T09:59:17.164 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T09:59:17.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T09:59:17.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 Processor -- start 2023-12-07T09:59:17.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 -- start start 2023-12-07T09:59:17.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5080ca620 0x7fc5080caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50806b7d0 con 0x7fc5080c4890 2023-12-07T09:59:17.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508155160 con 0x7fc5080ca620 2023-12-07T09:59:17.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50e748640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50806b180 con 0x7fc5080bd5a0 2023-12-07T09:59:17.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5080ca620 0x7fc5080caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5080ca620 0x7fc5080caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45026/0 (socket says 172.21.15.89:45026) 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 -- 172.21.15.89:0/3051105489 learned_addr learned my addr 172.21.15.89:0/3051105489 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50cf45640 1 --1- 172.21.15.89:0/3051105489 >> v1:172.21.15.89:6789/0 conn(0x7fc5080c4890 0x7fc5080c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34586/0 (socket says 172.21.15.89:34586) 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50df47640 1 --2- 172.21.15.89:0/3051105489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 -- 172.21.15.89:0/3051105489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 msgr2=0x7fc5080c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 --2- 172.21.15.89:0/3051105489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 -- 172.21.15.89:0/3051105489 >> v1:172.21.15.89:6789/0 conn(0x7fc5080c4890 legacy=0x7fc5080c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc50d746640 1 -- 172.21.15.89:0/3051105489 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50806b460 con 0x7fc5080ca620 2023-12-07T09:59:17.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.295+0000 7fc4fffff640 1 -- 172.21.15.89:0/3051105489 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738103855 0 0) 0x7fc50806b7d0 con 0x7fc5080c4890 2023-12-07T09:59:17.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50d746640 1 --2- 172.21.15.89:0/3051105489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5080caa00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc504009870 tx=0x7fc50401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2c97ea0aa45dac server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:17.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc4fffff640 1 -- 172.21.15.89:0/3051105489 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040ab600 con 0x7fc5080ca620 2023-12-07T09:59:17.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc4fffff640 1 -- 172.21.15.89:0/3051105489 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5040ab760 con 0x7fc5080ca620 2023-12-07T09:59:17.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc4fffff640 1 -- 172.21.15.89:0/3051105489 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040abaf0 con 0x7fc5080ca620 2023-12-07T09:59:17.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 -- 172.21.15.89:0/3051105489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 msgr2=0x7fc5080caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 --2- 172.21.15.89:0/3051105489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5080caa00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc504009870 tx=0x7fc50401c4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 -- 172.21.15.89:0/3051105489 shutdown_connections 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 --2- 172.21.15.89:0/3051105489 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 --2- 172.21.15.89:0/3051105489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5080caa00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 -- 172.21.15.89:0/3051105489 >> 172.21.15.89:0/3051105489 conn(0x7fc5080ac0a0 msgr2=0x7fc5080c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 -- 172.21.15.89:0/3051105489 shutdown_connections 2023-12-07T09:59:17.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.299+0000 7fc50e748640 1 -- 172.21.15.89:0/3051105489 wait complete. 2023-12-07T09:59:17.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 Processor -- start 2023-12-07T09:59:17.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 -- start start 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5080c4890 0x7fc5081f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5081f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080c15a0 con 0x7fc5080ca620 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081f1170 con 0x7fc5080c4890 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081f1450 con 0x7fc5080bd5a0 2023-12-07T09:59:17.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5081f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5081f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45038/0 (socket says 172.21.15.89:45038) 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 -- 172.21.15.89:0/936575824 learned_addr learned my addr 172.21.15.89:0/936575824 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50cf45640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5080c4890 0x7fc5081f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50d746640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 -- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 msgr2=0x7fc5080c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 -- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5080c4890 msgr2=0x7fc5081f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5080c4890 0x7fc5081f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 -- 172.21.15.89:0/936575824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040094d0 con 0x7fc5080ca620 2023-12-07T09:59:17.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50df47640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5081f4910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc500009fd0 tx=0x7fc50000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:17.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500014420 con 0x7fc5080ca620 2023-12-07T09:59:17.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500014580 con 0x7fc5080ca620 2023-12-07T09:59:17.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500014930 con 0x7fc5080ca620 2023-12-07T09:59:17.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.303+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5081f1730 con 0x7fc5080ca620 2023-12-07T09:59:17.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5080c5e50 con 0x7fc5080ca620 2023-12-07T09:59:17.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5081f1920 con 0x7fc5080ca620 2023-12-07T09:59:17.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc500014a90 con 0x7fc5080ca620 2023-12-07T09:59:17.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc4fdffb640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4ec0668d0 0x7fc4ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc500084c40 con 0x7fc5080ca620 2023-12-07T09:59:17.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc50d746640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4ec0668d0 0x7fc4ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.307+0000 7fc50d746640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4ec0668d0 0x7fc4ec068d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc5040af000 tx=0x7fc5040b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:17.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.311+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc500051f20 con 0x7fc5080ca620 2023-12-07T09:59:17.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.463+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5081f12e0 con 0x7fc4ec0668d0 2023-12-07T09:59:17.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.471+0000 7fc4fdffb640 1 -- 172.21.15.89:0/936575824 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264637 (secure 0 0 0) 0x7fc5081f12e0 con 0x7fc4ec0668d0 2023-12-07T09:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:17.484 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4ec0668d0 msgr2=0x7fc4ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4ec0668d0 0x7fc4ec068d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc5040af000 tx=0x7fc5040b6040 comp rx=0 tx=0).stop 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 msgr2=0x7fc5081f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5081f4910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc500009fd0 tx=0x7fc50000e4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 shutdown_connections 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5080ca620 0x7fc5081f4910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5080c4890 0x7fc5081f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4ec0668d0 0x7fc4ec068d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 --2- 172.21.15.89:0/936575824 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5080bd5a0 0x7fc5080c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 >> 172.21.15.89:0/936575824 conn(0x7fc5080ac0a0 msgr2=0x7fc5080bcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:17.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 shutdown_connections 2023-12-07T09:59:17.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.475+0000 7fc50e748640 1 -- 172.21.15.89:0/936575824 wait complete. 2023-12-07T09:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-07T09:59:16.342581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2867200,"data_stored":1740236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929921"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209408+0000","last_change":"2023-12-07T09:59:13.243605+0000","last_active":"2023-12-07T09:59:14.209408+0000","last_peered":"2023-12-07T09:59:14.209408+0000","last_clean":"2023-12-07T09:59:14.209408+0000","last_became_active":"2023-12-07T09:59:13.243400+0000","last_became_peered":"2023-12-07T09:59:13.243400+0000","last_unstale":"2023-12-07T09:59:14.209408+0000","last_undegraded":"2023-12-07T09:59:14.209408+0000","last_fullsized":"2023-12-07T09:59:14.209408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:07.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.212830+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.212534+0000","last_became_peered":"2023-12-07T09:59:13.212534+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856465+0000","last_change":"2023-12-07T09:59:13.215703+0000","last_active":"2023-12-07T09:59:14.856465+0000","last_peered":"2023-12-07T09:59:14.856465+0000","last_clean":"2023-12-07T09:59:14.856465+0000","last_became_active":"2023-12-07T09:59:13.215423+0000","last_became_peered":"2023-12-07T09:59:13.215423+0000","last_unstale":"2023-12-07T09:59:14.856465+0000","last_undegraded":"2023-12-07T09:59:14.856465+0000","last_fullsized":"2023-12-07T09:59:14.856465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856651+0000","last_change":"2023-12-07T09:59:13.220582+0000","last_active":"2023-12-07T09:59:14.856651+0000","last_peered":"2023-12-07T09:59:14.856651+0000","last_clean":"2023-12-07T09:59:14.856651+0000","last_became_active":"2023-12-07T09:59:13.219984+0000","last_became_peered":"2023-12-07T09:59:13.219984+0000","last_unstale":"2023-12-07T09:59:14.856651+0000","last_undegraded":"2023-12-07T09:59:14.856651+0000","last_fullsized":"2023-12-07T09:59:14.856651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209013+0000","last_change":"2023-12-07T09:59:13.226763+0000","last_active":"2023-12-07T09:59:14.209013+0000","last_peered":"2023-12-07T09:59:14.209013+0000","last_clean":"2023-12-07T09:59:14.209013+0000","last_became_active":"2023-12-07T09:59:13.226473+0000","last_became_peered":"2023-12-07T09:59:13.226473+0000","last_unstale":"2023-12-07T09:59:14.209013+0000","last_undegraded":"2023-12-07T09:59:14.209013+0000","last_fullsized":"2023-12-07T09:59:14.209013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856311+0000","last_change":"2023-12-07T09:59:13.224914+0000","last_active":"2023-12-07T09:59:14.856311+0000","last_peered":"2023-12-07T09:59:14.856311+0000","last_clean":"2023-12-07T09:59:14.856311+0000","last_became_active":"2023-12-07T09:59:13.224520+0000","last_became_peered":"2023-12-07T09:59:13.224520+0000","last_unstale":"2023-12-07T09:59:14.856311+0000","last_undegraded":"2023-12-07T09:59:14.856311+0000","last_fullsized":"2023-12-07T09:59:14.856311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208595+0000","last_change":"2023-12-07T09:59:13.220721+0000","last_active":"2023-12-07T09:59:14.208595+0000","last_peered":"2023-12-07T09:59:14.208595+0000","last_clean":"2023-12-07T09:59:14.208595+0000","last_became_active":"2023-12-07T09:59:13.220444+0000","last_became_peered":"2023-12-07T09:59:13.220444+0000","last_unstale":"2023-12-07T09:59:14.208595+0000","last_undegraded":"2023-12-07T09:59:14.208595+0000","last_fullsized":"2023-12-07T09:59:14.208595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204871+0000","last_change":"2023-12-07T09:59:13.225842+0000","last_active":"2023-12-07T09:59:14.204871+0000","last_peered":"2023-12-07T09:59:14.204871+0000","last_clean":"2023-12-07T09:59:14.204871+0000","last_became_active":"2023-12-07T09:59:13.225534+0000","last_became_peered":"2023-12-07T09:59:13.225534+0000","last_unstale":"2023-12-07T09:59:14.204871+0000","last_undegraded":"2023-12-07T09:59:14.204871+0000","last_fullsized":"2023-12-07T09:59:14.204871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209416+0000","last_change":"2023-12-07T09:59:13.236754+0000","last_active":"2023-12-07T09:59:14.209416+0000","last_peered":"2023-12-07T09:59:14.209416+0000","last_clean":"2023-12-07T09:59:14.209416+0000","last_became_active":"2023-12-07T09:59:13.236474+0000","last_became_peered":"2023-12-07T09:59:13.236474+0000","last_unstale":"2023-12-07T09:59:14.209416+0000","last_undegraded":"2023-12-07T09:59:14.209416+0000","last_fullsized":"2023-12-07T09:59:14.209416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:02.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856024+0000","last_change":"2023-12-07T09:59:13.244846+0000","last_active":"2023-12-07T09:59:14.856024+0000","last_peered":"2023-12-07T09:59:14.856024+0000","last_clean":"2023-12-07T09:59:14.856024+0000","last_became_active":"2023-12-07T09:59:13.242324+0000","last_became_peered":"2023-12-07T09:59:13.242324+0000","last_unstale":"2023-12-07T09:59:14.856024+0000","last_undegraded":"2023-12-07T09:59:14.856024+0000","last_fullsized":"2023-12-07T09:59:14.856024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856304+0000","last_change":"2023-12-07T09:59:13.240209+0000","last_active":"2023-12-07T09:59:14.856304+0000","last_peered":"2023-12-07T09:59:14.856304+0000","last_clean":"2023-12-07T09:59:14.856304+0000","last_became_active":"2023-12-07T09:59:13.239803+0000","last_became_peered":"2023-12-07T09:59:13.239803+0000","last_unstale":"2023-12-07T09:59:14.856304+0000","last_undegraded":"2023-12-07T09:59:14.856304+0000","last_fullsized":"2023-12-07T09:59:14.856304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209848+0000","last_change":"2023-12-07T09:59:13.243615+0000","last_active":"2023-12-07T09:59:14.209848+0000","last_peered":"2023-12-07T09:59:14.209848+0000","last_clean":"2023-12-07T09:59:14.209848+0000","last_became_active":"2023-12-07T09:59:13.242637+0000","last_became_peered":"2023-12-07T09:59:13.242637+0000","last_unstale":"2023-12-07T09:59:14.209848+0000","last_undegraded":"2023-12-07T09:59:14.209848+0000","last_fullsized":"2023-12-07T09:59:14.209848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205211+0000","last_change":"2023-12-07T09:59:13.236803+0000","last_active":"2023-12-07T09:59:14.205211+0000","last_peered":"2023-12-07T09:59:14.205211+0000","last_clean":"2023-12-07T09:59:14.205211+0000","last_became_active":"2023-12-07T09:59:13.236552+0000","last_became_peered":"2023-12-07T09:59:13.236552+0000","last_unstale":"2023-12-07T09:59:14.205211+0000","last_undegraded":"2023-12-07T09:59:14.205211+0000","last_fullsized":"2023-12-07T09:59:14.205211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856315+0000","last_change":"2023-12-07T09:59:13.214434+0000","last_active":"2023-12-07T09:59:14.856315+0000","last_peered":"2023-12-07T09:59:14.856315+0000","last_clean":"2023-12-07T09:59:14.856315+0000","last_became_active":"2023-12-07T09:59:13.214166+0000","last_became_peered":"2023-12-07T09:59:13.214166+0000","last_unstale":"2023-12-07T09:59:14.856315+0000","last_undegraded":"2023-12-07T09:59:14.856315+0000","last_fullsized":"2023-12-07T09:59:14.856315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:12.020167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855595+0000","last_change":"2023-12-07T09:59:13.229160+0000","last_active":"2023-12-07T09:59:14.855595+0000","last_peered":"2023-12-07T09:59:14.855595+0000","last_clean":"2023-12-07T09:59:14.855595+0000","last_became_active":"2023-12-07T09:59:13.228864+0000","last_became_peered":"2023-12-07T09:59:13.228864+0000","last_unstale":"2023-12-07T09:59:14.855595+0000","last_undegraded":"2023-12-07T09:59:14.855595+0000","last_fullsized":"2023-12-07T09:59:14.855595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855752+0000","last_change":"2023-12-07T09:59:13.227080+0000","last_active":"2023-12-07T09:59:14.855752+0000","last_peered":"2023-12-07T09:59:14.855752+0000","last_clean":"2023-12-07T09:59:14.855752+0000","last_became_active":"2023-12-07T09:59:13.226779+0000","last_became_peered":"2023-12-07T09:59:13.226779+0000","last_unstale":"2023-12-07T09:59:14.855752+0000","last_undegraded":"2023-12-07T09:59:14.855752+0000","last_fullsized":"2023-12-07T09:59:14.855752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.857170+0000","last_change":"2023-12-07T09:59:13.231346+0000","last_active":"2023-12-07T09:59:14.857170+0000","last_peered":"2023-12-07T09:59:14.857170+0000","last_clean":"2023-12-07T09:59:14.857170+0000","last_became_active":"2023-12-07T09:59:13.230979+0000","last_became_peered":"2023-12-07T09:59:13.230979+0000","last_unstale":"2023-12-07T09:59:14.857170+0000","last_undegraded":"2023-12-07T09:59:14.857170+0000","last_fullsized":"2023-12-07T09:59:14.857170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855462+0000","last_change":"2023-12-07T09:59:13.237675+0000","last_active":"2023-12-07T09:59:14.855462+0000","last_peered":"2023-12-07T09:59:14.855462+0000","last_clean":"2023-12-07T09:59:14.855462+0000","last_became_active":"2023-12-07T09:59:13.237296+0000","last_became_peered":"2023-12-07T09:59:13.237296+0000","last_unstale":"2023-12-07T09:59:14.855462+0000","last_undegraded":"2023-12-07T09:59:14.855462+0000","last_fullsized":"2023-12-07T09:59:14.855462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209370+0000","last_change":"2023-12-07T09:59:13.226161+0000","last_active":"2023-12-07T09:59:14.209370+0000","last_peered":"2023-12-07T09:59:14.209370+0000","last_clean":"2023-12-07T09:59:14.209370+0000","last_became_active":"2023-12-07T09:59:13.225859+0000","last_became_peered":"2023-12-07T09:59:13.225859+0000","last_unstale":"2023-12-07T09:59:14.209370+0000","last_undegraded":"2023-12-07T09:59:14.209370+0000","last_fullsized":"2023-12-07T09:59:14.209370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:32:17.070492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856173+0000","last_change":"2023-12-07T09:59:13.243132+0000","last_active":"2023-12-07T09:59:14.856173+0000","last_peered":"2023-12-07T09:59:14.856173+0000","last_clean":"2023-12-07T09:59:14.856173+0000","last_became_active":"2023-12-07T09:59:13.242916+0000","last_became_peered":"2023-12-07T09:59:13.242916+0000","last_unstale":"2023-12-07T09:59:14.856173+0000","last_undegraded":"2023-12-07T09:59:14.856173+0000","last_fullsized":"2023-12-07T09:59:14.856173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856497+0000","last_change":"2023-12-07T09:59:13.215353+0000","last_active":"2023-12-07T09:59:14.856497+0000","last_peered":"2023-12-07T09:59:14.856497+0000","last_clean":"2023-12-07T09:59:14.856497+0000","last_became_active":"2023-12-07T09:59:13.215031+0000","last_became_peered":"2023-12-07T09:59:13.215031+0000","last_unstale":"2023-12-07T09:59:14.856497+0000","last_undegraded":"2023-12-07T09:59:14.856497+0000","last_fullsized":"2023-12-07T09:59:14.856497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856448+0000","last_change":"2023-12-07T09:59:13.229476+0000","last_active":"2023-12-07T09:59:14.856448+0000","last_peered":"2023-12-07T09:59:14.856448+0000","last_clean":"2023-12-07T09:59:14.856448+0000","last_became_active":"2023-12-07T09:59:13.229204+0000","last_became_peered":"2023-12-07T09:59:13.229204+0000","last_unstale":"2023-12-07T09:59:14.856448+0000","last_undegraded":"2023-12-07T09:59:14.856448+0000","last_fullsized":"2023-12-07T09:59:14.856448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204948+0000","last_change":"2023-12-07T09:59:13.229199+0000","last_active":"2023-12-07T09:59:14.204948+0000","last_peered":"2023-12-07T09:59:14.204948+0000","last_clean":"2023-12-07T09:59:14.204948+0000","last_became_active":"2023-12-07T09:59:13.227858+0000","last_became_peered":"2023-12-07T09:59:13.227858+0000","last_unstale":"2023-12-07T09:59:14.204948+0000","last_undegraded":"2023-12-07T09:59:14.204948+0000","last_fullsized":"2023-12-07T09:59:14.204948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856087+0000","last_change":"2023-12-07T09:59:13.219925+0000","last_active":"2023-12-07T09:59:14.856087+0000","last_peered":"2023-12-07T09:59:14.856087+0000","last_clean":"2023-12-07T09:59:14.856087+0000","last_became_active":"2023-12-07T09:59:13.219578+0000","last_became_peered":"2023-12-07T09:59:13.219578+0000","last_unstale":"2023-12-07T09:59:14.856087+0000","last_undegraded":"2023-12-07T09:59:14.856087+0000","last_fullsized":"2023-12-07T09:59:14.856087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205159+0000","last_change":"2023-12-07T09:59:13.223429+0000","last_active":"2023-12-07T09:59:14.205159+0000","last_peered":"2023-12-07T09:59:14.205159+0000","last_clean":"2023-12-07T09:59:14.205159+0000","last_became_active":"2023-12-07T09:59:13.223049+0000","last_became_peered":"2023-12-07T09:59:13.223049+0000","last_unstale":"2023-12-07T09:59:14.205159+0000","last_undegraded":"2023-12-07T09:59:14.205159+0000","last_fullsized":"2023-12-07T09:59:14.205159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856062+0000","last_change":"2023-12-07T09:59:13.236777+0000","last_active":"2023-12-07T09:59:14.856062+0000","last_peered":"2023-12-07T09:59:14.856062+0000","last_clean":"2023-12-07T09:59:14.856062+0000","last_became_active":"2023-12-07T09:59:13.236213+0000","last_became_peered":"2023-12-07T09:59:13.236213+0000","last_unstale":"2023-12-07T09:59:14.856062+0000","last_undegraded":"2023-12-07T09:59:14.856062+0000","last_fullsized":"2023-12-07T09:59:14.856062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855812+0000","last_change":"2023-12-07T09:59:13.225469+0000","last_active":"2023-12-07T09:59:14.855812+0000","last_peered":"2023-12-07T09:59:14.855812+0000","last_clean":"2023-12-07T09:59:14.855812+0000","last_became_active":"2023-12-07T09:59:13.224304+0000","last_became_peered":"2023-12-07T09:59:13.224304+0000","last_unstale":"2023-12-07T09:59:14.855812+0000","last_undegraded":"2023-12-07T09:59:14.855812+0000","last_fullsized":"2023-12-07T09:59:14.855812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205265+0000","last_change":"2023-12-07T09:59:13.228379+0000","last_active":"2023-12-07T09:59:14.205265+0000","last_peered":"2023-12-07T09:59:14.205265+0000","last_clean":"2023-12-07T09:59:14.205265+0000","last_became_active":"2023-12-07T09:59:13.227897+0000","last_became_peered":"2023-12-07T09:59:13.227897+0000","last_unstale":"2023-12-07T09:59:14.205265+0000","last_undegraded":"2023-12-07T09:59:14.205265+0000","last_fullsized":"2023-12-07T09:59:14.205265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856333+0000","last_change":"2023-12-07T09:59:13.222608+0000","last_active":"2023-12-07T09:59:14.856333+0000","last_peered":"2023-12-07T09:59:14.856333+0000","last_clean":"2023-12-07T09:59:14.856333+0000","last_became_active":"2023-12-07T09:59:13.219912+0000","last_became_peered":"2023-12-07T09:59:13.219912+0000","last_unstale":"2023-12-07T09:59:14.856333+0000","last_undegraded":"2023-12-07T09:59:14.856333+0000","last_fullsized":"2023-12-07T09:59:14.856333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856650+0000","last_change":"2023-12-07T09:59:13.237134+0000","last_active":"2023-12-07T09:59:14.856650+0000","last_peered":"2023-12-07T09:59:14.856650+0000","last_clean":"2023-12-07T09:59:14.856650+0000","last_became_active":"2023-12-07T09:59:13.235178+0000","last_became_peered":"2023-12-07T09:59:13.235178+0000","last_unstale":"2023-12-07T09:59:14.856650+0000","last_undegraded":"2023-12-07T09:59:14.856650+0000","last_fullsized":"2023-12-07T09:59:14.856650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855309+0000","last_change":"2023-12-07T09:59:13.215170+0000","last_active":"2023-12-07T09:59:14.855309+0000","last_peered":"2023-12-07T09:59:14.855309+0000","last_clean":"2023-12-07T09:59:14.855309+0000","last_became_active":"2023-12-07T09:59:13.214893+0000","last_became_peered":"2023-12-07T09:59:13.214893+0000","last_unstale":"2023-12-07T09:59:14.855309+0000","last_undegraded":"2023-12-07T09:59:14.855309+0000","last_fullsized":"2023-12-07T09:59:14.855309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855956+0000","last_change":"2023-12-07T09:59:13.238320+0000","last_active":"2023-12-07T09:59:14.855956+0000","last_peered":"2023-12-07T09:59:14.855956+0000","last_clean":"2023-12-07T09:59:14.855956+0000","last_became_active":"2023-12-07T09:59:13.236975+0000","last_became_peered":"2023-12-07T09:59:13.236975+0000","last_unstale":"2023-12-07T09:59:14.855956+0000","last_undegraded":"2023-12-07T09:59:14.855956+0000","last_fullsized":"2023-12-07T09:59:14.855956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209622+0000","last_change":"2023-12-07T09:59:13.223573+0000","last_active":"2023-12-07T09:59:14.209622+0000","last_peered":"2023-12-07T09:59:14.209622+0000","last_clean":"2023-12-07T09:59:14.209622+0000","last_became_active":"2023-12-07T09:59:13.223311+0000","last_became_peered":"2023-12-07T09:59:13.223311+0000","last_unstale":"2023-12-07T09:59:14.209622+0000","last_undegraded":"2023-12-07T09:59:14.209622+0000","last_fullsized":"2023-12-07T09:59:14.209622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:53.489945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205303+0000","last_change":"2023-12-07T09:59:12.445561+0000","last_active":"2023-12-07T09:59:14.205303+0000","last_peered":"2023-12-07T09:59:14.205303+0000","last_clean":"2023-12-07T09:59:14.205303+0000","last_became_active":"2023-12-07T09:59:12.445157+0000","last_became_peered":"2023-12-07T09:59:12.445157+0000","last_unstale":"2023-12-07T09:59:14.205303+0000","last_undegraded":"2023-12-07T09:59:14.205303+0000","last_fullsized":"2023-12-07T09:59:14.205303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856519+0000","last_change":"2023-12-07T09:59:13.223869+0000","last_active":"2023-12-07T09:59:14.856519+0000","last_peered":"2023-12-07T09:59:14.856519+0000","last_clean":"2023-12-07T09:59:14.856519+0000","last_became_active":"2023-12-07T09:59:13.223599+0000","last_became_peered":"2023-12-07T09:59:13.223599+0000","last_unstale":"2023-12-07T09:59:14.856519+0000","last_undegraded":"2023-12-07T09:59:14.856519+0000","last_fullsized":"2023-12-07T09:59:14.856519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855929+0000","last_change":"2023-12-07T09:59:12.447360+0000","last_active":"2023-12-07T09:59:14.855929+0000","last_peered":"2023-12-07T09:59:14.855929+0000","last_clean":"2023-12-07T09:59:14.855929+0000","last_became_active":"2023-12-07T09:59:12.445342+0000","last_became_peered":"2023-12-07T09:59:12.445342+0000","last_unstale":"2023-12-07T09:59:14.855929+0000","last_undegraded":"2023-12-07T09:59:14.855929+0000","last_fullsized":"2023-12-07T09:59:14.855929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205055+0000","last_change":"2023-12-07T09:59:12.445519+0000","last_active":"2023-12-07T09:59:14.205055+0000","last_peered":"2023-12-07T09:59:14.205055+0000","last_clean":"2023-12-07T09:59:14.205055+0000","last_became_active":"2023-12-07T09:59:12.445216+0000","last_became_peered":"2023-12-07T09:59:12.445216+0000","last_unstale":"2023-12-07T09:59:14.205055+0000","last_undegraded":"2023-12-07T09:59:14.205055+0000","last_fullsized":"2023-12-07T09:59:14.205055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204981+0000","last_change":"2023-12-07T09:59:13.222784+0000","last_active":"2023-12-07T09:59:14.204981+0000","last_peered":"2023-12-07T09:59:14.204981+0000","last_clean":"2023-12-07T09:59:14.204981+0000","last_became_active":"2023-12-07T09:59:13.221094+0000","last_became_peered":"2023-12-07T09:59:13.221094+0000","last_unstale":"2023-12-07T09:59:14.204981+0000","last_undegraded":"2023-12-07T09:59:14.204981+0000","last_fullsized":"2023-12-07T09:59:14.204981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856191+0000","last_change":"2023-12-07T09:59:12.444592+0000","last_active":"2023-12-07T09:59:14.856191+0000","last_peered":"2023-12-07T09:59:14.856191+0000","last_clean":"2023-12-07T09:59:14.856191+0000","last_became_active":"2023-12-07T09:59:12.444319+0000","last_became_peered":"2023-12-07T09:59:12.444319+0000","last_unstale":"2023-12-07T09:59:14.856191+0000","last_undegraded":"2023-12-07T09:59:14.856191+0000","last_fullsized":"2023-12-07T09:59:14.856191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:17.193358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855494+0000","last_change":"2023-12-07T09:59:13.217769+0000","last_active":"2023-12-07T09:59:14.855494+0000","last_peered":"2023-12-07T09:59:14.855494+0000","last_clean":"2023-12-07T09:59:14.855494+0000","last_became_active":"2023-12-07T09:59:13.217483+0000","last_became_peered":"2023-12-07T09:59:13.217483+0000","last_unstale":"2023-12-07T09:59:14.855494+0000","last_undegraded":"2023-12-07T09:59:14.855494+0000","last_fullsized":"2023-12-07T09:59:14.855494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856282+0000","last_change":"2023-12-07T09:59:12.446477+0000","last_active":"2023-12-07T09:59:14.856282+0000","last_peered":"2023-12-07T09:59:14.856282+0000","last_clean":"2023-12-07T09:59:14.856282+0000","last_became_active":"2023-12-07T09:59:12.446203+0000","last_became_peered":"2023-12-07T09:59:12.446203+0000","last_unstale":"2023-12-07T09:59:14.856282+0000","last_undegraded":"2023-12-07T09:59:14.856282+0000","last_fullsized":"2023-12-07T09:59:14.856282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856664+0000","last_change":"2023-12-07T09:59:13.228184+0000","last_active":"2023-12-07T09:59:14.856664+0000","last_peered":"2023-12-07T09:59:14.856664+0000","last_clean":"2023-12-07T09:59:14.856664+0000","last_became_active":"2023-12-07T09:59:13.227834+0000","last_became_peered":"2023-12-07T09:59:13.227834+0000","last_unstale":"2023-12-07T09:59:14.856664+0000","last_undegraded":"2023-12-07T09:59:14.856664+0000","last_fullsized":"2023-12-07T09:59:14.856664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856790+0000","last_change":"2023-12-07T09:59:12.445865+0000","last_active":"2023-12-07T09:59:14.856790+0000","last_peered":"2023-12-07T09:59:14.856790+0000","last_clean":"2023-12-07T09:59:14.856790+0000","last_became_active":"2023-12-07T09:59:12.445572+0000","last_became_peered":"2023-12-07T09:59:12.445572+0000","last_unstale":"2023-12-07T09:59:14.856790+0000","last_undegraded":"2023-12-07T09:59:14.856790+0000","last_fullsized":"2023-12-07T09:59:14.856790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856567+0000","last_change":"2023-12-07T09:59:13.223916+0000","last_active":"2023-12-07T09:59:14.856567+0000","last_peered":"2023-12-07T09:59:14.856567+0000","last_clean":"2023-12-07T09:59:14.856567+0000","last_became_active":"2023-12-07T09:59:13.221626+0000","last_became_peered":"2023-12-07T09:59:13.221626+0000","last_unstale":"2023-12-07T09:59:14.856567+0000","last_undegraded":"2023-12-07T09:59:14.856567+0000","last_fullsized":"2023-12-07T09:59:14.856567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855897+0000","last_change":"2023-12-07T09:59:12.444220+0000","last_active":"2023-12-07T09:59:14.855897+0000","last_peered":"2023-12-07T09:59:14.855897+0000","last_clean":"2023-12-07T09:59:14.855897+0000","last_became_active":"2023-12-07T09:59:12.443588+0000","last_became_peered":"2023-12-07T09:59:12.443588+0000","last_unstale":"2023-12-07T09:59:14.855897+0000","last_undegraded":"2023-12-07T09:59:14.855897+0000","last_fullsized":"2023-12-07T09:59:14.855897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209944+0000","last_change":"2023-12-07T09:59:13.232678+0000","last_active":"2023-12-07T09:59:14.209944+0000","last_peered":"2023-12-07T09:59:14.209944+0000","last_clean":"2023-12-07T09:59:14.209944+0000","last_became_active":"2023-12-07T09:59:13.232421+0000","last_became_peered":"2023-12-07T09:59:13.232421+0000","last_unstale":"2023-12-07T09:59:14.209944+0000","last_undegraded":"2023-12-07T09:59:14.209944+0000","last_fullsized":"2023-12-07T09:59:14.209944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856093+0000","last_change":"2023-12-07T09:59:12.442066+0000","last_active":"2023-12-07T09:59:14.856093+0000","last_peered":"2023-12-07T09:59:14.856093+0000","last_clean":"2023-12-07T09:59:14.856093+0000","last_became_active":"2023-12-07T09:59:12.441817+0000","last_became_peered":"2023-12-07T09:59:12.441817+0000","last_unstale":"2023-12-07T09:59:14.856093+0000","last_undegraded":"2023-12-07T09:59:14.856093+0000","last_fullsized":"2023-12-07T09:59:14.856093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208914+0000","last_change":"2023-12-07T09:59:13.227653+0000","last_active":"2023-12-07T09:59:14.208914+0000","last_peered":"2023-12-07T09:59:14.208914+0000","last_clean":"2023-12-07T09:59:14.208914+0000","last_became_active":"2023-12-07T09:59:13.227307+0000","last_became_peered":"2023-12-07T09:59:13.227307+0000","last_unstale":"2023-12-07T09:59:14.208914+0000","last_undegraded":"2023-12-07T09:59:14.208914+0000","last_fullsized":"2023-12-07T09:59:14.208914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856577+0000","last_change":"2023-12-07T09:59:12.447857+0000","last_active":"2023-12-07T09:59:14.856577+0000","last_peered":"2023-12-07T09:59:14.856577+0000","last_clean":"2023-12-07T09:59:14.856577+0000","last_became_active":"2023-12-07T09:59:12.447625+0000","last_became_peered":"2023-12-07T09:59:12.447625+0000","last_unstale":"2023-12-07T09:59:14.856577+0000","last_undegraded":"2023-12-07T09:59:14.856577+0000","last_fullsized":"2023-12-07T09:59:14.856577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856290+0000","last_change":"2023-12-07T09:59:13.221295+0000","last_active":"2023-12-07T09:59:14.856290+0000","last_peered":"2023-12-07T09:59:14.856290+0000","last_clean":"2023-12-07T09:59:14.856290+0000","last_became_active":"2023-12-07T09:59:13.220976+0000","last_became_peered":"2023-12-07T09:59:13.220976+0000","last_unstale":"2023-12-07T09:59:14.856290+0000","last_undegraded":"2023-12-07T09:59:14.856290+0000","last_fullsized":"2023-12-07T09:59:14.856290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:47.462027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856560+0000","last_change":"2023-12-07T09:59:12.441312+0000","last_active":"2023-12-07T09:59:14.856560+0000","last_peered":"2023-12-07T09:59:14.856560+0000","last_clean":"2023-12-07T09:59:14.856560+0000","last_became_active":"2023-12-07T09:59:12.441028+0000","last_became_peered":"2023-12-07T09:59:12.441028+0000","last_unstale":"2023-12-07T09:59:14.856560+0000","last_undegraded":"2023-12-07T09:59:14.856560+0000","last_fullsized":"2023-12-07T09:59:14.856560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:26.967332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209168+0000","last_change":"2023-12-07T09:59:13.232850+0000","last_active":"2023-12-07T09:59:14.209168+0000","last_peered":"2023-12-07T09:59:14.209168+0000","last_clean":"2023-12-07T09:59:14.209168+0000","last_became_active":"2023-12-07T09:59:13.232332+0000","last_became_peered":"2023-12-07T09:59:13.232332+0000","last_unstale":"2023-12-07T09:59:14.209168+0000","last_undegraded":"2023-12-07T09:59:14.209168+0000","last_fullsized":"2023-12-07T09:59:14.209168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855793+0000","last_change":"2023-12-07T09:59:12.445929+0000","last_active":"2023-12-07T09:59:14.855793+0000","last_peered":"2023-12-07T09:59:14.855793+0000","last_clean":"2023-12-07T09:59:14.855793+0000","last_became_active":"2023-12-07T09:59:12.445461+0000","last_became_peered":"2023-12-07T09:59:12.445461+0000","last_unstale":"2023-12-07T09:59:14.855793+0000","last_undegraded":"2023-12-07T09:59:14.855793+0000","last_fullsized":"2023-12-07T09:59:14.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.235497+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.231385+0000","last_became_peered":"2023-12-07T09:59:13.231385+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855650+0000","last_change":"2023-12-07T09:59:12.439722+0000","last_active":"2023-12-07T09:59:14.855650+0000","last_peered":"2023-12-07T09:59:14.855650+0000","last_clean":"2023-12-07T09:59:14.855650+0000","last_became_active":"2023-12-07T09:59:12.438240+0000","last_became_peered":"2023-12-07T09:59:12.438240+0000","last_unstale":"2023-12-07T09:59:14.855650+0000","last_undegraded":"2023-12-07T09:59:14.855650+0000","last_fullsized":"2023-12-07T09:59:14.855650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208754+0000","last_change":"2023-12-07T09:59:13.234272+0000","last_active":"2023-12-07T09:59:14.208754+0000","last_peered":"2023-12-07T09:59:14.208754+0000","last_clean":"2023-12-07T09:59:14.208754+0000","last_became_active":"2023-12-07T09:59:13.231957+0000","last_became_peered":"2023-12-07T09:59:13.231957+0000","last_unstale":"2023-12-07T09:59:14.208754+0000","last_undegraded":"2023-12-07T09:59:14.208754+0000","last_fullsized":"2023-12-07T09:59:14.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.210004+0000","last_change":"2023-12-07T09:59:12.439194+0000","last_active":"2023-12-07T09:59:14.210004+0000","last_peered":"2023-12-07T09:59:14.210004+0000","last_clean":"2023-12-07T09:59:14.210004+0000","last_became_active":"2023-12-07T09:59:12.438884+0000","last_became_peered":"2023-12-07T09:59:12.438884+0000","last_unstale":"2023-12-07T09:59:14.210004+0000","last_undegraded":"2023-12-07T09:59:14.210004+0000","last_fullsized":"2023-12-07T09:59:14.210004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208903+0000","last_change":"2023-12-07T09:59:13.230666+0000","last_active":"2023-12-07T09:59:14.208903+0000","last_peered":"2023-12-07T09:59:14.208903+0000","last_clean":"2023-12-07T09:59:14.208903+0000","last_became_active":"2023-12-07T09:59:13.230390+0000","last_became_peered":"2023-12-07T09:59:13.230390+0000","last_unstale":"2023-12-07T09:59:14.208903+0000","last_undegraded":"2023-12-07T09:59:14.208903+0000","last_fullsized":"2023-12-07T09:59:14.208903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855548+0000","last_change":"2023-12-07T09:59:12.444548+0000","last_active":"2023-12-07T09:59:14.855548+0000","last_peered":"2023-12-07T09:59:14.855548+0000","last_clean":"2023-12-07T09:59:14.855548+0000","last_became_active":"2023-12-07T09:59:12.444265+0000","last_became_peered":"2023-12-07T09:59:12.444265+0000","last_unstale":"2023-12-07T09:59:14.855548+0000","last_undegraded":"2023-12-07T09:59:14.855548+0000","last_fullsized":"2023-12-07T09:59:14.855548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209558+0000","last_change":"2023-12-07T09:59:13.232945+0000","last_active":"2023-12-07T09:59:14.209558+0000","last_peered":"2023-12-07T09:59:14.209558+0000","last_clean":"2023-12-07T09:59:14.209558+0000","last_became_active":"2023-12-07T09:59:13.232656+0000","last_became_peered":"2023-12-07T09:59:13.232656+0000","last_unstale":"2023-12-07T09:59:14.209558+0000","last_undegraded":"2023-12-07T09:59:14.209558+0000","last_fullsized":"2023-12-07T09:59:14.209558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:31.593646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855993+0000","last_change":"2023-12-07T09:59:12.439997+0000","last_active":"2023-12-07T09:59:14.855993+0000","last_peered":"2023-12-07T09:59:14.855993+0000","last_clean":"2023-12-07T09:59:14.855993+0000","last_became_active":"2023-12-07T09:59:12.439732+0000","last_became_peered":"2023-12-07T09:59:12.439732+0000","last_unstale":"2023-12-07T09:59:14.855993+0000","last_undegraded":"2023-12-07T09:59:14.855993+0000","last_fullsized":"2023-12-07T09:59:14.855993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856858+0000","last_change":"2023-12-07T09:59:13.222198+0000","last_active":"2023-12-07T09:59:14.856858+0000","last_peered":"2023-12-07T09:59:14.856858+0000","last_clean":"2023-12-07T09:59:14.856858+0000","last_became_active":"2023-12-07T09:59:13.219609+0000","last_became_peered":"2023-12-07T09:59:13.219609+0000","last_unstale":"2023-12-07T09:59:14.856858+0000","last_undegraded":"2023-12-07T09:59:14.856858+0000","last_fullsized":"2023-12-07T09:59:14.856858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855424+0000","last_change":"2023-12-07T09:59:12.442621+0000","last_active":"2023-12-07T09:59:14.855424+0000","last_peered":"2023-12-07T09:59:14.855424+0000","last_clean":"2023-12-07T09:59:14.855424+0000","last_became_active":"2023-12-07T09:59:12.442335+0000","last_became_peered":"2023-12-07T09:59:12.442335+0000","last_unstale":"2023-12-07T09:59:14.855424+0000","last_undegraded":"2023-12-07T09:59:14.855424+0000","last_fullsized":"2023-12-07T09:59:14.855424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:52.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209055+0000","last_change":"2023-12-07T09:59:13.236569+0000","last_active":"2023-12-07T09:59:14.209055+0000","last_peered":"2023-12-07T09:59:14.209055+0000","last_clean":"2023-12-07T09:59:14.209055+0000","last_became_active":"2023-12-07T09:59:13.236202+0000","last_became_peered":"2023-12-07T09:59:13.236202+0000","last_unstale":"2023-12-07T09:59:14.209055+0000","last_undegraded":"2023-12-07T09:59:14.209055+0000","last_fullsized":"2023-12-07T09:59:14.209055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-07T09:59:13.208674+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:13.208674+0000","last_peered":"2023-12-07T09:59:13.208674+0000","last_clean":"2023-12-07T09:59:13.208674+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:13.208674+0000","last_undegraded":"2023-12-07T09:59:13.208674+0000","last_fullsized":"2023-12-07T09:59:13.208674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856471+0000","last_change":"2023-12-07T09:59:12.448949+0000","last_active":"2023-12-07T09:59:14.856471+0000","last_peered":"2023-12-07T09:59:14.856471+0000","last_clean":"2023-12-07T09:59:14.856471+0000","last_became_active":"2023-12-07T09:59:12.448415+0000","last_became_peered":"2023-12-07T09:59:12.448415+0000","last_unstale":"2023-12-07T09:59:14.856471+0000","last_undegraded":"2023-12-07T09:59:14.856471+0000","last_fullsized":"2023-12-07T09:59:14.856471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205136+0000","last_change":"2023-12-07T09:59:13.236914+0000","last_active":"2023-12-07T09:59:14.205136+0000","last_peered":"2023-12-07T09:59:14.205136+0000","last_clean":"2023-12-07T09:59:14.205136+0000","last_became_active":"2023-12-07T09:59:13.236582+0000","last_became_peered":"2023-12-07T09:59:13.236582+0000","last_unstale":"2023-12-07T09:59:14.205136+0000","last_undegraded":"2023-12-07T09:59:14.205136+0000","last_fullsized":"2023-12-07T09:59:14.205136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208617+0000","last_change":"2023-12-07T09:59:12.453760+0000","last_active":"2023-12-07T09:59:14.208617+0000","last_peered":"2023-12-07T09:59:14.208617+0000","last_clean":"2023-12-07T09:59:14.208617+0000","last_became_active":"2023-12-07T09:59:12.451737+0000","last_became_peered":"2023-12-07T09:59:12.451737+0000","last_unstale":"2023-12-07T09:59:14.208617+0000","last_undegraded":"2023-12-07T09:59:14.208617+0000","last_fullsized":"2023-12-07T09:59:14.208617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:16.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856296+0000","last_change":"2023-12-07T09:59:13.229329+0000","last_active":"2023-12-07T09:59:14.856296+0000","last_peered":"2023-12-07T09:59:14.856296+0000","last_clean":"2023-12-07T09:59:14.856296+0000","last_became_active":"2023-12-07T09:59:13.229012+0000","last_became_peered":"2023-12-07T09:59:13.229012+0000","last_unstale":"2023-12-07T09:59:14.856296+0000","last_undegraded":"2023-12-07T09:59:14.856296+0000","last_fullsized":"2023-12-07T09:59:14.856296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:16.553666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855396+0000","last_change":"2023-12-07T09:59:12.443723+0000","last_active":"2023-12-07T09:59:14.855396+0000","last_peered":"2023-12-07T09:59:14.855396+0000","last_clean":"2023-12-07T09:59:14.855396+0000","last_became_active":"2023-12-07T09:59:12.443456+0000","last_became_peered":"2023-12-07T09:59:12.443456+0000","last_unstale":"2023-12-07T09:59:14.855396+0000","last_undegraded":"2023-12-07T09:59:14.855396+0000","last_fullsized":"2023-12-07T09:59:14.855396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:29.302595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855830+0000","last_change":"2023-12-07T09:59:13.216025+0000","last_active":"2023-12-07T09:59:14.855830+0000","last_peered":"2023-12-07T09:59:14.855830+0000","last_clean":"2023-12-07T09:59:14.855830+0000","last_became_active":"2023-12-07T09:59:13.215772+0000","last_became_peered":"2023-12-07T09:59:13.215772+0000","last_unstale":"2023-12-07T09:59:14.855830+0000","last_undegraded":"2023-12-07T09:59:14.855830+0000","last_fullsized":"2023-12-07T09:59:14.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856711+0000","last_change":"2023-12-07T09:59:12.442740+0000","last_active":"2023-12-07T09:59:14.856711+0000","last_peered":"2023-12-07T09:59:14.856711+0000","last_clean":"2023-12-07T09:59:14.856711+0000","last_became_active":"2023-12-07T09:59:12.442434+0000","last_became_peered":"2023-12-07T09:59:12.442434+0000","last_unstale":"2023-12-07T09:59:14.856711+0000","last_undegraded":"2023-12-07T09:59:14.856711+0000","last_fullsized":"2023-12-07T09:59:14.856711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209730+0000","last_change":"2023-12-07T09:59:13.229519+0000","last_active":"2023-12-07T09:59:14.209730+0000","last_peered":"2023-12-07T09:59:14.209730+0000","last_clean":"2023-12-07T09:59:14.209730+0000","last_became_active":"2023-12-07T09:59:13.229213+0000","last_became_peered":"2023-12-07T09:59:13.229213+0000","last_unstale":"2023-12-07T09:59:14.209730+0000","last_undegraded":"2023-12-07T09:59:14.209730+0000","last_fullsized":"2023-12-07T09:59:14.209730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:11.313416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855747+0000","last_change":"2023-12-07T09:59:12.444649+0000","last_active":"2023-12-07T09:59:14.855747+0000","last_peered":"2023-12-07T09:59:14.855747+0000","last_clean":"2023-12-07T09:59:14.855747+0000","last_became_active":"2023-12-07T09:59:12.444396+0000","last_became_peered":"2023-12-07T09:59:12.444396+0000","last_unstale":"2023-12-07T09:59:14.855747+0000","last_undegraded":"2023-12-07T09:59:14.855747+0000","last_fullsized":"2023-12-07T09:59:14.855747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856950+0000","last_change":"2023-12-07T09:59:13.235666+0000","last_active":"2023-12-07T09:59:14.856950+0000","last_peered":"2023-12-07T09:59:14.856950+0000","last_clean":"2023-12-07T09:59:14.856950+0000","last_became_active":"2023-12-07T09:59:13.235387+0000","last_became_peered":"2023-12-07T09:59:13.235387+0000","last_unstale":"2023-12-07T09:59:14.856950+0000","last_undegraded":"2023-12-07T09:59:14.856950+0000","last_fullsized":"2023-12-07T09:59:14.856950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209610+0000","last_change":"2023-12-07T09:59:12.453170+0000","last_active":"2023-12-07T09:59:14.209610+0000","last_peered":"2023-12-07T09:59:14.209610+0000","last_clean":"2023-12-07T09:59:14.209610+0000","last_became_active":"2023-12-07T09:59:12.452722+0000","last_became_peered":"2023-12-07T09:59:12.452722+0000","last_unstale":"2023-12-07T09:59:14.209610+0000","last_undegraded":"2023-12-07T09:59:14.209610+0000","last_fullsized":"2023-12-07T09:59:14.209610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:11.940444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855656+0000","last_change":"2023-12-07T09:59:13.218149+0000","last_active":"2023-12-07T09:59:14.855656+0000","last_peered":"2023-12-07T09:59:14.855656+0000","last_clean":"2023-12-07T09:59:14.855656+0000","last_became_active":"2023-12-07T09:59:13.217830+0000","last_became_peered":"2023-12-07T09:59:13.217830+0000","last_unstale":"2023-12-07T09:59:14.855656+0000","last_undegraded":"2023-12-07T09:59:14.855656+0000","last_fullsized":"2023-12-07T09:59:14.855656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855883+0000","last_change":"2023-12-07T09:59:12.449220+0000","last_active":"2023-12-07T09:59:14.855883+0000","last_peered":"2023-12-07T09:59:14.855883+0000","last_clean":"2023-12-07T09:59:14.855883+0000","last_became_active":"2023-12-07T09:59:12.448837+0000","last_became_peered":"2023-12-07T09:59:12.448837+0000","last_unstale":"2023-12-07T09:59:14.855883+0000","last_undegraded":"2023-12-07T09:59:14.855883+0000","last_fullsized":"2023-12-07T09:59:14.855883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205360+0000","last_change":"2023-12-07T09:59:13.229085+0000","last_active":"2023-12-07T09:59:14.205360+0000","last_peered":"2023-12-07T09:59:14.205360+0000","last_clean":"2023-12-07T09:59:14.205360+0000","last_became_active":"2023-12-07T09:59:13.227932+0000","last_became_peered":"2023-12-07T09:59:13.227932+0000","last_unstale":"2023-12-07T09:59:14.205360+0000","last_undegraded":"2023-12-07T09:59:14.205360+0000","last_fullsized":"2023-12-07T09:59:14.205360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856299+0000","last_change":"2023-12-07T09:59:12.453221+0000","last_active":"2023-12-07T09:59:14.856299+0000","last_peered":"2023-12-07T09:59:14.856299+0000","last_clean":"2023-12-07T09:59:14.856299+0000","last_became_active":"2023-12-07T09:59:12.452946+0000","last_became_peered":"2023-12-07T09:59:12.452946+0000","last_unstale":"2023-12-07T09:59:14.856299+0000","last_undegraded":"2023-12-07T09:59:14.856299+0000","last_fullsized":"2023-12-07T09:59:14.856299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856524+0000","last_change":"2023-12-07T09:59:13.214345+0000","last_active":"2023-12-07T09:59:14.856524+0000","last_peered":"2023-12-07T09:59:14.856524+0000","last_clean":"2023-12-07T09:59:14.856524+0000","last_became_active":"2023-12-07T09:59:13.214065+0000","last_became_peered":"2023-12-07T09:59:13.214065+0000","last_unstale":"2023-12-07T09:59:14.856524+0000","last_undegraded":"2023-12-07T09:59:14.856524+0000","last_fullsized":"2023-12-07T09:59:14.856524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208601+0000","last_change":"2023-12-07T09:59:12.454383+0000","last_active":"2023-12-07T09:59:14.208601+0000","last_peered":"2023-12-07T09:59:14.208601+0000","last_clean":"2023-12-07T09:59:14.208601+0000","last_became_active":"2023-12-07T09:59:12.454061+0000","last_became_peered":"2023-12-07T09:59:12.454061+0000","last_unstale":"2023-12-07T09:59:14.208601+0000","last_undegraded":"2023-12-07T09:59:14.208601+0000","last_fullsized":"2023-12-07T09:59:14.208601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209349+0000","last_change":"2023-12-07T09:59:13.222718+0000","last_active":"2023-12-07T09:59:14.209349+0000","last_peered":"2023-12-07T09:59:14.209349+0000","last_clean":"2023-12-07T09:59:14.209349+0000","last_became_active":"2023-12-07T09:59:13.222405+0000","last_became_peered":"2023-12-07T09:59:13.222405+0000","last_unstale":"2023-12-07T09:59:14.209349+0000","last_undegraded":"2023-12-07T09:59:14.209349+0000","last_fullsized":"2023-12-07T09:59:14.209349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:30.311283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855995+0000","last_change":"2023-12-07T09:59:12.439274+0000","last_active":"2023-12-07T09:59:14.855995+0000","last_peered":"2023-12-07T09:59:14.855995+0000","last_clean":"2023-12-07T09:59:14.855995+0000","last_became_active":"2023-12-07T09:59:12.438973+0000","last_became_peered":"2023-12-07T09:59:12.438973+0000","last_unstale":"2023-12-07T09:59:14.855995+0000","last_undegraded":"2023-12-07T09:59:14.855995+0000","last_fullsized":"2023-12-07T09:59:14.855995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205003+0000","last_change":"2023-12-07T09:59:13.225445+0000","last_active":"2023-12-07T09:59:14.205003+0000","last_peered":"2023-12-07T09:59:14.205003+0000","last_clean":"2023-12-07T09:59:14.205003+0000","last_became_active":"2023-12-07T09:59:13.225149+0000","last_became_peered":"2023-12-07T09:59:13.225149+0000","last_unstale":"2023-12-07T09:59:14.205003+0000","last_undegraded":"2023-12-07T09:59:14.205003+0000","last_fullsized":"2023-12-07T09:59:14.205003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855648+0000","last_change":"2023-12-07T09:59:12.442112+0000","last_active":"2023-12-07T09:59:14.855648+0000","last_peered":"2023-12-07T09:59:14.855648+0000","last_clean":"2023-12-07T09:59:14.855648+0000","last_became_active":"2023-12-07T09:59:12.441793+0000","last_became_peered":"2023-12-07T09:59:12.441793+0000","last_unstale":"2023-12-07T09:59:14.855648+0000","last_undegraded":"2023-12-07T09:59:14.855648+0000","last_fullsized":"2023-12-07T09:59:14.855648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205346+0000","last_change":"2023-12-07T09:59:13.221842+0000","last_active":"2023-12-07T09:59:14.205346+0000","last_peered":"2023-12-07T09:59:14.205346+0000","last_clean":"2023-12-07T09:59:14.205346+0000","last_became_active":"2023-12-07T09:59:13.221454+0000","last_became_peered":"2023-12-07T09:59:13.221454+0000","last_unstale":"2023-12-07T09:59:14.205346+0000","last_undegraded":"2023-12-07T09:59:14.205346+0000","last_fullsized":"2023-12-07T09:59:14.205346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209325+0000","last_change":"2023-12-07T09:59:12.453238+0000","last_active":"2023-12-07T09:59:14.209325+0000","last_peered":"2023-12-07T09:59:14.209325+0000","last_clean":"2023-12-07T09:59:14.209325+0000","last_became_active":"2023-12-07T09:59:12.452285+0000","last_became_peered":"2023-12-07T09:59:12.452285+0000","last_unstale":"2023-12-07T09:59:14.209325+0000","last_undegraded":"2023-12-07T09:59:14.209325+0000","last_fullsized":"2023-12-07T09:59:14.209325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:05.804533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855821+0000","last_change":"2023-12-07T09:59:13.243271+0000","last_active":"2023-12-07T09:59:14.855821+0000","last_peered":"2023-12-07T09:59:14.855821+0000","last_clean":"2023-12-07T09:59:14.855821+0000","last_became_active":"2023-12-07T09:59:13.242931+0000","last_became_peered":"2023-12-07T09:59:13.242931+0000","last_unstale":"2023-12-07T09:59:14.855821+0000","last_undegraded":"2023-12-07T09:59:14.855821+0000","last_fullsized":"2023-12-07T09:59:14.855821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856927+0000","last_change":"2023-12-07T09:59:13.232574+0000","last_active":"2023-12-07T09:59:14.856927+0000","last_peered":"2023-12-07T09:59:14.856927+0000","last_clean":"2023-12-07T09:59:14.856927+0000","last_became_active":"2023-12-07T09:59:13.232262+0000","last_became_peered":"2023-12-07T09:59:13.232262+0000","last_unstale":"2023-12-07T09:59:14.856927+0000","last_undegraded":"2023-12-07T09:59:14.856927+0000","last_fullsized":"2023-12-07T09:59:14.856927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208855+0000","last_change":"2023-12-07T09:59:12.454304+0000","last_active":"2023-12-07T09:59:14.208855+0000","last_peered":"2023-12-07T09:59:14.208855+0000","last_clean":"2023-12-07T09:59:14.208855+0000","last_became_active":"2023-12-07T09:59:12.454038+0000","last_became_peered":"2023-12-07T09:59:12.454038+0000","last_unstale":"2023-12-07T09:59:14.208855+0000","last_undegraded":"2023-12-07T09:59:14.208855+0000","last_fullsized":"2023-12-07T09:59:14.208855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856881+0000","last_change":"2023-12-07T09:59:13.232029+0000","last_active":"2023-12-07T09:59:14.856881+0000","last_peered":"2023-12-07T09:59:14.856881+0000","last_clean":"2023-12-07T09:59:14.856881+0000","last_became_active":"2023-12-07T09:59:13.231273+0000","last_became_peered":"2023-12-07T09:59:13.231273+0000","last_unstale":"2023-12-07T09:59:14.856881+0000","last_undegraded":"2023-12-07T09:59:14.856881+0000","last_fullsized":"2023-12-07T09:59:14.856881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209153+0000","last_change":"2023-12-07T09:59:12.452964+0000","last_active":"2023-12-07T09:59:14.209153+0000","last_peered":"2023-12-07T09:59:14.209153+0000","last_clean":"2023-12-07T09:59:14.209153+0000","last_became_active":"2023-12-07T09:59:12.452651+0000","last_became_peered":"2023-12-07T09:59:12.452651+0000","last_unstale":"2023-12-07T09:59:14.209153+0000","last_undegraded":"2023-12-07T09:59:14.209153+0000","last_fullsized":"2023-12-07T09:59:14.209153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856607+0000","last_change":"2023-12-07T09:59:13.224204+0000","last_active":"2023-12-07T09:59:14.856607+0000","last_peered":"2023-12-07T09:59:14.856607+0000","last_clean":"2023-12-07T09:59:14.856607+0000","last_became_active":"2023-12-07T09:59:13.222519+0000","last_became_peered":"2023-12-07T09:59:13.222519+0000","last_unstale":"2023-12-07T09:59:14.856607+0000","last_undegraded":"2023-12-07T09:59:14.856607+0000","last_fullsized":"2023-12-07T09:59:14.856607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205381+0000","last_change":"2023-12-07T09:59:12.440360+0000","last_active":"2023-12-07T09:59:14.205381+0000","last_peered":"2023-12-07T09:59:14.205381+0000","last_clean":"2023-12-07T09:59:14.205381+0000","last_became_active":"2023-12-07T09:59:12.440087+0000","last_became_peered":"2023-12-07T09:59:12.440087+0000","last_unstale":"2023-12-07T09:59:14.205381+0000","last_undegraded":"2023-12-07T09:59:14.205381+0000","last_fullsized":"2023-12-07T09:59:14.205381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:25.030548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205333+0000","last_change":"2023-12-07T09:59:13.237795+0000","last_active":"2023-12-07T09:59:14.205333+0000","last_peered":"2023-12-07T09:59:14.205333+0000","last_clean":"2023-12-07T09:59:14.205333+0000","last_became_active":"2023-12-07T09:59:13.237488+0000","last_became_peered":"2023-12-07T09:59:13.237488+0000","last_unstale":"2023-12-07T09:59:14.205333+0000","last_undegraded":"2023-12-07T09:59:14.205333+0000","last_fullsized":"2023-12-07T09:59:14.205333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856662+0000","last_change":"2023-12-07T09:59:12.453157+0000","last_active":"2023-12-07T09:59:14.856662+0000","last_peered":"2023-12-07T09:59:14.856662+0000","last_clean":"2023-12-07T09:59:14.856662+0000","last_became_active":"2023-12-07T09:59:12.452900+0000","last_became_peered":"2023-12-07T09:59:12.452900+0000","last_unstale":"2023-12-07T09:59:14.856662+0000","last_undegraded":"2023-12-07T09:59:14.856662+0000","last_fullsized":"2023-12-07T09:59:14.856662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T09:59:17.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T09:59:17.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 Processor -- start 2023-12-07T09:59:17.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 -- start start 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8b240ca620 0x7f8b240caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b240bd5a0 0x7f8b240c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2406b7d0 con 0x7f8b240c4890 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b24155160 con 0x7f8b240bd5a0 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b292c8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2406b180 con 0x7f8b240ca620 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b28ac7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b240bd5a0 0x7f8b240c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b237fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8b240c4890 0x7f8b240c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34588/0 (socket says 172.21.15.89:34588) 2023-12-07T09:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b237fe640 1 -- 172.21.15.89:0/3047815551 learned_addr learned my addr 172.21.15.89:0/3047815551 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b28ac7640 1 -- 172.21.15.89:0/3047815551 >> v2:172.21.15.97:3300/0 conn(0x7f8b240ca620 msgr2=0x7f8b240caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b23fff640 1 --2- 172.21.15.89:0/3047815551 >> v2:172.21.15.97:3300/0 conn(0x7f8b240ca620 0x7f8b240caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b28ac7640 1 --2- 172.21.15.89:0/3047815551 >> v2:172.21.15.97:3300/0 conn(0x7f8b240ca620 0x7f8b240caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b28ac7640 1 -- 172.21.15.89:0/3047815551 >> v1:172.21.15.89:6789/0 conn(0x7f8b240c4890 legacy=0x7f8b240c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b28ac7640 1 -- 172.21.15.89:0/3047815551 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2406b460 con 0x7f8b240bd5a0 2023-12-07T09:59:17.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b22ffd640 1 -- 172.21.15.89:0/3047815551 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671709116 0 0) 0x7f8b2406b7d0 con 0x7f8b240c4890 2023-12-07T09:59:17.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.675+0000 7f8b23fff640 1 --2- 172.21.15.89:0/3047815551 >> v2:172.21.15.97:3300/0 conn(0x7f8b240ca620 0x7f8b240caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:17.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b28ac7640 1 --2- 172.21.15.89:0/3047815551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240bd5a0 0x7f8b240c8620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b240ac950 tx=0x7f8b1c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cb28433055356d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:17.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b22ffd640 1 -- 172.21.15.89:0/3047815551 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0a58d0 con 0x7f8b240bd5a0 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b22ffd640 1 -- 172.21.15.89:0/3047815551 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0a5a30 con 0x7f8b240bd5a0 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b22ffd640 1 -- 172.21.15.89:0/3047815551 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0a5dc0 con 0x7f8b240bd5a0 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 -- 172.21.15.89:0/3047815551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240bd5a0 msgr2=0x7f8b240c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 --2- 172.21.15.89:0/3047815551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240bd5a0 0x7f8b240c8620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b240ac950 tx=0x7f8b1c01c880 comp rx=0 tx=0).stop 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 -- 172.21.15.89:0/3047815551 shutdown_connections 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 --2- 172.21.15.89:0/3047815551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240bd5a0 0x7f8b240c8620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 --2- 172.21.15.89:0/3047815551 >> v2:172.21.15.97:3300/0 conn(0x7f8b240ca620 0x7f8b240caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 -- 172.21.15.89:0/3047815551 >> 172.21.15.89:0/3047815551 conn(0x7f8b240ac0a0 msgr2=0x7f8b240c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:17.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 -- 172.21.15.89:0/3047815551 shutdown_connections 2023-12-07T09:59:17.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 -- 172.21.15.89:0/3047815551 wait complete. 2023-12-07T09:59:17.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 Processor -- start 2023-12-07T09:59:17.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.679+0000 7f8b292c8640 1 -- start start 2023-12-07T09:59:17.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b240bd5a0 0x7f8b240bda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b240c4890 0x7f8b241f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 0x7f8b2414f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241f0d90 con 0x7f8b240ca620 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241f0ab0 con 0x7f8b240c4890 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241ede80 con 0x7f8b240bd5a0 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 0x7f8b2414f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 0x7f8b2414f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45052/0 (socket says 172.21.15.89:45052) 2023-12-07T09:59:17.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 -- 172.21.15.89:0/2967750336 learned_addr learned my addr 172.21.15.89:0/2967750336 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:17.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b23fff640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b240bd5a0 0x7f8b240bda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b237fe640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b240c4890 0x7f8b241f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 -- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b240bd5a0 msgr2=0x7f8b240bda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b240bd5a0 0x7f8b240bda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 -- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b240c4890 msgr2=0x7f8b241f0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b240c4890 0x7f8b241f0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 -- 172.21.15.89:0/2967750336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009a70 con 0x7f8b240ca620 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b237fe640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b240c4890 0x7f8b241f0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b28ac7640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 0x7f8b2414f170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c01a4b0 tx=0x7f8b1c019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0b9860 con 0x7f8b240ca620 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0b99c0 con 0x7f8b240ca620 2023-12-07T09:59:17.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b241ee160 con 0x7f8b240ca620 2023-12-07T09:59:17.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0b9d70 con 0x7f8b240ca620 2023-12-07T09:59:17.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b241578a0 con 0x7f8b240ca620 2023-12-07T09:59:17.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.683+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2404e890 con 0x7f8b240ca620 2023-12-07T09:59:17.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.687+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8b1c0ad440 con 0x7f8b240ca620 2023-12-07T09:59:17.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.687+0000 7f8b20ff9640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b100668d0 0x7f8b10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:17.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.687+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b1c11f950 con 0x7f8b240ca620 2023-12-07T09:59:17.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.687+0000 7f8b23fff640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b100668d0 0x7f8b10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:17.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.687+0000 7f8b23fff640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b100668d0 0x7f8b10068d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400a9a0 tx=0x7f8b14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:17.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.691+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b1c0ecca0 con 0x7f8b240ca620 2023-12-07T09:59:17.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.835+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b241616e0 con 0x7f8b100668d0 2023-12-07T09:59:17.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.843+0000 7f8b20ff9640 1 -- 172.21.15.89:0/2967750336 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264637 (secure 0 0 0) 0x7f8b1400a720 con 0x7f8b100668d0 2023-12-07T09:59:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:17.854 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T09:59:17.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b100668d0 msgr2=0x7f8b10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b100668d0 0x7f8b10068d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400a9a0 tx=0x7f8b14008040 comp rx=0 tx=0).stop 2023-12-07T09:59:17.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 msgr2=0x7f8b2414f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 0x7f8b2414f170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c01a4b0 tx=0x7f8b1c019620 comp rx=0 tx=0).stop 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 shutdown_connections 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b240ca620 0x7f8b2414f170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b240c4890 0x7f8b241f0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b100668d0 0x7f8b10068d90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 --2- 172.21.15.89:0/2967750336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b240bd5a0 0x7f8b240bda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 >> 172.21.15.89:0/2967750336 conn(0x7f8b240ac0a0 msgr2=0x7f8b24152240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 shutdown_connections 2023-12-07T09:59:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:17.847+0000 7f8b292c8640 1 -- 172.21.15.89:0/2967750336 wait complete. 2023-12-07T09:59:17.872 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-07T09:59:16.342581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218980,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755740,"statfs":{"total":773094113280,"available":772869877760,"internally_reserved":0,"allocated":2867200,"data_stored":1740236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929921"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209408+0000","last_change":"2023-12-07T09:59:13.243605+0000","last_active":"2023-12-07T09:59:14.209408+0000","last_peered":"2023-12-07T09:59:14.209408+0000","last_clean":"2023-12-07T09:59:14.209408+0000","last_became_active":"2023-12-07T09:59:13.243400+0000","last_became_peered":"2023-12-07T09:59:13.243400+0000","last_unstale":"2023-12-07T09:59:14.209408+0000","last_undegraded":"2023-12-07T09:59:14.209408+0000","last_fullsized":"2023-12-07T09:59:14.209408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:07.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.212830+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.212534+0000","last_became_peered":"2023-12-07T09:59:13.212534+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856465+0000","last_change":"2023-12-07T09:59:13.215703+0000","last_active":"2023-12-07T09:59:14.856465+0000","last_peered":"2023-12-07T09:59:14.856465+0000","last_clean":"2023-12-07T09:59:14.856465+0000","last_became_active":"2023-12-07T09:59:13.215423+0000","last_became_peered":"2023-12-07T09:59:13.215423+0000","last_unstale":"2023-12-07T09:59:14.856465+0000","last_undegraded":"2023-12-07T09:59:14.856465+0000","last_fullsized":"2023-12-07T09:59:14.856465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856651+0000","last_change":"2023-12-07T09:59:13.220582+0000","last_active":"2023-12-07T09:59:14.856651+0000","last_peered":"2023-12-07T09:59:14.856651+0000","last_clean":"2023-12-07T09:59:14.856651+0000","last_became_active":"2023-12-07T09:59:13.219984+0000","last_became_peered":"2023-12-07T09:59:13.219984+0000","last_unstale":"2023-12-07T09:59:14.856651+0000","last_undegraded":"2023-12-07T09:59:14.856651+0000","last_fullsized":"2023-12-07T09:59:14.856651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209013+0000","last_change":"2023-12-07T09:59:13.226763+0000","last_active":"2023-12-07T09:59:14.209013+0000","last_peered":"2023-12-07T09:59:14.209013+0000","last_clean":"2023-12-07T09:59:14.209013+0000","last_became_active":"2023-12-07T09:59:13.226473+0000","last_became_peered":"2023-12-07T09:59:13.226473+0000","last_unstale":"2023-12-07T09:59:14.209013+0000","last_undegraded":"2023-12-07T09:59:14.209013+0000","last_fullsized":"2023-12-07T09:59:14.209013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856311+0000","last_change":"2023-12-07T09:59:13.224914+0000","last_active":"2023-12-07T09:59:14.856311+0000","last_peered":"2023-12-07T09:59:14.856311+0000","last_clean":"2023-12-07T09:59:14.856311+0000","last_became_active":"2023-12-07T09:59:13.224520+0000","last_became_peered":"2023-12-07T09:59:13.224520+0000","last_unstale":"2023-12-07T09:59:14.856311+0000","last_undegraded":"2023-12-07T09:59:14.856311+0000","last_fullsized":"2023-12-07T09:59:14.856311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208595+0000","last_change":"2023-12-07T09:59:13.220721+0000","last_active":"2023-12-07T09:59:14.208595+0000","last_peered":"2023-12-07T09:59:14.208595+0000","last_clean":"2023-12-07T09:59:14.208595+0000","last_became_active":"2023-12-07T09:59:13.220444+0000","last_became_peered":"2023-12-07T09:59:13.220444+0000","last_unstale":"2023-12-07T09:59:14.208595+0000","last_undegraded":"2023-12-07T09:59:14.208595+0000","last_fullsized":"2023-12-07T09:59:14.208595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204871+0000","last_change":"2023-12-07T09:59:13.225842+0000","last_active":"2023-12-07T09:59:14.204871+0000","last_peered":"2023-12-07T09:59:14.204871+0000","last_clean":"2023-12-07T09:59:14.204871+0000","last_became_active":"2023-12-07T09:59:13.225534+0000","last_became_peered":"2023-12-07T09:59:13.225534+0000","last_unstale":"2023-12-07T09:59:14.204871+0000","last_undegraded":"2023-12-07T09:59:14.204871+0000","last_fullsized":"2023-12-07T09:59:14.204871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209416+0000","last_change":"2023-12-07T09:59:13.236754+0000","last_active":"2023-12-07T09:59:14.209416+0000","last_peered":"2023-12-07T09:59:14.209416+0000","last_clean":"2023-12-07T09:59:14.209416+0000","last_became_active":"2023-12-07T09:59:13.236474+0000","last_became_peered":"2023-12-07T09:59:13.236474+0000","last_unstale":"2023-12-07T09:59:14.209416+0000","last_undegraded":"2023-12-07T09:59:14.209416+0000","last_fullsized":"2023-12-07T09:59:14.209416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:02.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856024+0000","last_change":"2023-12-07T09:59:13.244846+0000","last_active":"2023-12-07T09:59:14.856024+0000","last_peered":"2023-12-07T09:59:14.856024+0000","last_clean":"2023-12-07T09:59:14.856024+0000","last_became_active":"2023-12-07T09:59:13.242324+0000","last_became_peered":"2023-12-07T09:59:13.242324+0000","last_unstale":"2023-12-07T09:59:14.856024+0000","last_undegraded":"2023-12-07T09:59:14.856024+0000","last_fullsized":"2023-12-07T09:59:14.856024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856304+0000","last_change":"2023-12-07T09:59:13.240209+0000","last_active":"2023-12-07T09:59:14.856304+0000","last_peered":"2023-12-07T09:59:14.856304+0000","last_clean":"2023-12-07T09:59:14.856304+0000","last_became_active":"2023-12-07T09:59:13.239803+0000","last_became_peered":"2023-12-07T09:59:13.239803+0000","last_unstale":"2023-12-07T09:59:14.856304+0000","last_undegraded":"2023-12-07T09:59:14.856304+0000","last_fullsized":"2023-12-07T09:59:14.856304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209848+0000","last_change":"2023-12-07T09:59:13.243615+0000","last_active":"2023-12-07T09:59:14.209848+0000","last_peered":"2023-12-07T09:59:14.209848+0000","last_clean":"2023-12-07T09:59:14.209848+0000","last_became_active":"2023-12-07T09:59:13.242637+0000","last_became_peered":"2023-12-07T09:59:13.242637+0000","last_unstale":"2023-12-07T09:59:14.209848+0000","last_undegraded":"2023-12-07T09:59:14.209848+0000","last_fullsized":"2023-12-07T09:59:14.209848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205211+0000","last_change":"2023-12-07T09:59:13.236803+0000","last_active":"2023-12-07T09:59:14.205211+0000","last_peered":"2023-12-07T09:59:14.205211+0000","last_clean":"2023-12-07T09:59:14.205211+0000","last_became_active":"2023-12-07T09:59:13.236552+0000","last_became_peered":"2023-12-07T09:59:13.236552+0000","last_unstale":"2023-12-07T09:59:14.205211+0000","last_undegraded":"2023-12-07T09:59:14.205211+0000","last_fullsized":"2023-12-07T09:59:14.205211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856315+0000","last_change":"2023-12-07T09:59:13.214434+0000","last_active":"2023-12-07T09:59:14.856315+0000","last_peered":"2023-12-07T09:59:14.856315+0000","last_clean":"2023-12-07T09:59:14.856315+0000","last_became_active":"2023-12-07T09:59:13.214166+0000","last_became_peered":"2023-12-07T09:59:13.214166+0000","last_unstale":"2023-12-07T09:59:14.856315+0000","last_undegraded":"2023-12-07T09:59:14.856315+0000","last_fullsized":"2023-12-07T09:59:14.856315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:12.020167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855595+0000","last_change":"2023-12-07T09:59:13.229160+0000","last_active":"2023-12-07T09:59:14.855595+0000","last_peered":"2023-12-07T09:59:14.855595+0000","last_clean":"2023-12-07T09:59:14.855595+0000","last_became_active":"2023-12-07T09:59:13.228864+0000","last_became_peered":"2023-12-07T09:59:13.228864+0000","last_unstale":"2023-12-07T09:59:14.855595+0000","last_undegraded":"2023-12-07T09:59:14.855595+0000","last_fullsized":"2023-12-07T09:59:14.855595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855752+0000","last_change":"2023-12-07T09:59:13.227080+0000","last_active":"2023-12-07T09:59:14.855752+0000","last_peered":"2023-12-07T09:59:14.855752+0000","last_clean":"2023-12-07T09:59:14.855752+0000","last_became_active":"2023-12-07T09:59:13.226779+0000","last_became_peered":"2023-12-07T09:59:13.226779+0000","last_unstale":"2023-12-07T09:59:14.855752+0000","last_undegraded":"2023-12-07T09:59:14.855752+0000","last_fullsized":"2023-12-07T09:59:14.855752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.857170+0000","last_change":"2023-12-07T09:59:13.231346+0000","last_active":"2023-12-07T09:59:14.857170+0000","last_peered":"2023-12-07T09:59:14.857170+0000","last_clean":"2023-12-07T09:59:14.857170+0000","last_became_active":"2023-12-07T09:59:13.230979+0000","last_became_peered":"2023-12-07T09:59:13.230979+0000","last_unstale":"2023-12-07T09:59:14.857170+0000","last_undegraded":"2023-12-07T09:59:14.857170+0000","last_fullsized":"2023-12-07T09:59:14.857170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855462+0000","last_change":"2023-12-07T09:59:13.237675+0000","last_active":"2023-12-07T09:59:14.855462+0000","last_peered":"2023-12-07T09:59:14.855462+0000","last_clean":"2023-12-07T09:59:14.855462+0000","last_became_active":"2023-12-07T09:59:13.237296+0000","last_became_peered":"2023-12-07T09:59:13.237296+0000","last_unstale":"2023-12-07T09:59:14.855462+0000","last_undegraded":"2023-12-07T09:59:14.855462+0000","last_fullsized":"2023-12-07T09:59:14.855462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209370+0000","last_change":"2023-12-07T09:59:13.226161+0000","last_active":"2023-12-07T09:59:14.209370+0000","last_peered":"2023-12-07T09:59:14.209370+0000","last_clean":"2023-12-07T09:59:14.209370+0000","last_became_active":"2023-12-07T09:59:13.225859+0000","last_became_peered":"2023-12-07T09:59:13.225859+0000","last_unstale":"2023-12-07T09:59:14.209370+0000","last_undegraded":"2023-12-07T09:59:14.209370+0000","last_fullsized":"2023-12-07T09:59:14.209370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:32:17.070492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856173+0000","last_change":"2023-12-07T09:59:13.243132+0000","last_active":"2023-12-07T09:59:14.856173+0000","last_peered":"2023-12-07T09:59:14.856173+0000","last_clean":"2023-12-07T09:59:14.856173+0000","last_became_active":"2023-12-07T09:59:13.242916+0000","last_became_peered":"2023-12-07T09:59:13.242916+0000","last_unstale":"2023-12-07T09:59:14.856173+0000","last_undegraded":"2023-12-07T09:59:14.856173+0000","last_fullsized":"2023-12-07T09:59:14.856173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856497+0000","last_change":"2023-12-07T09:59:13.215353+0000","last_active":"2023-12-07T09:59:14.856497+0000","last_peered":"2023-12-07T09:59:14.856497+0000","last_clean":"2023-12-07T09:59:14.856497+0000","last_became_active":"2023-12-07T09:59:13.215031+0000","last_became_peered":"2023-12-07T09:59:13.215031+0000","last_unstale":"2023-12-07T09:59:14.856497+0000","last_undegraded":"2023-12-07T09:59:14.856497+0000","last_fullsized":"2023-12-07T09:59:14.856497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856448+0000","last_change":"2023-12-07T09:59:13.229476+0000","last_active":"2023-12-07T09:59:14.856448+0000","last_peered":"2023-12-07T09:59:14.856448+0000","last_clean":"2023-12-07T09:59:14.856448+0000","last_became_active":"2023-12-07T09:59:13.229204+0000","last_became_peered":"2023-12-07T09:59:13.229204+0000","last_unstale":"2023-12-07T09:59:14.856448+0000","last_undegraded":"2023-12-07T09:59:14.856448+0000","last_fullsized":"2023-12-07T09:59:14.856448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204948+0000","last_change":"2023-12-07T09:59:13.229199+0000","last_active":"2023-12-07T09:59:14.204948+0000","last_peered":"2023-12-07T09:59:14.204948+0000","last_clean":"2023-12-07T09:59:14.204948+0000","last_became_active":"2023-12-07T09:59:13.227858+0000","last_became_peered":"2023-12-07T09:59:13.227858+0000","last_unstale":"2023-12-07T09:59:14.204948+0000","last_undegraded":"2023-12-07T09:59:14.204948+0000","last_fullsized":"2023-12-07T09:59:14.204948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856087+0000","last_change":"2023-12-07T09:59:13.219925+0000","last_active":"2023-12-07T09:59:14.856087+0000","last_peered":"2023-12-07T09:59:14.856087+0000","last_clean":"2023-12-07T09:59:14.856087+0000","last_became_active":"2023-12-07T09:59:13.219578+0000","last_became_peered":"2023-12-07T09:59:13.219578+0000","last_unstale":"2023-12-07T09:59:14.856087+0000","last_undegraded":"2023-12-07T09:59:14.856087+0000","last_fullsized":"2023-12-07T09:59:14.856087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205159+0000","last_change":"2023-12-07T09:59:13.223429+0000","last_active":"2023-12-07T09:59:14.205159+0000","last_peered":"2023-12-07T09:59:14.205159+0000","last_clean":"2023-12-07T09:59:14.205159+0000","last_became_active":"2023-12-07T09:59:13.223049+0000","last_became_peered":"2023-12-07T09:59:13.223049+0000","last_unstale":"2023-12-07T09:59:14.205159+0000","last_undegraded":"2023-12-07T09:59:14.205159+0000","last_fullsized":"2023-12-07T09:59:14.205159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856062+0000","last_change":"2023-12-07T09:59:13.236777+0000","last_active":"2023-12-07T09:59:14.856062+0000","last_peered":"2023-12-07T09:59:14.856062+0000","last_clean":"2023-12-07T09:59:14.856062+0000","last_became_active":"2023-12-07T09:59:13.236213+0000","last_became_peered":"2023-12-07T09:59:13.236213+0000","last_unstale":"2023-12-07T09:59:14.856062+0000","last_undegraded":"2023-12-07T09:59:14.856062+0000","last_fullsized":"2023-12-07T09:59:14.856062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855812+0000","last_change":"2023-12-07T09:59:13.225469+0000","last_active":"2023-12-07T09:59:14.855812+0000","last_peered":"2023-12-07T09:59:14.855812+0000","last_clean":"2023-12-07T09:59:14.855812+0000","last_became_active":"2023-12-07T09:59:13.224304+0000","last_became_peered":"2023-12-07T09:59:13.224304+0000","last_unstale":"2023-12-07T09:59:14.855812+0000","last_undegraded":"2023-12-07T09:59:14.855812+0000","last_fullsized":"2023-12-07T09:59:14.855812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205265+0000","last_change":"2023-12-07T09:59:13.228379+0000","last_active":"2023-12-07T09:59:14.205265+0000","last_peered":"2023-12-07T09:59:14.205265+0000","last_clean":"2023-12-07T09:59:14.205265+0000","last_became_active":"2023-12-07T09:59:13.227897+0000","last_became_peered":"2023-12-07T09:59:13.227897+0000","last_unstale":"2023-12-07T09:59:14.205265+0000","last_undegraded":"2023-12-07T09:59:14.205265+0000","last_fullsized":"2023-12-07T09:59:14.205265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856333+0000","last_change":"2023-12-07T09:59:13.222608+0000","last_active":"2023-12-07T09:59:14.856333+0000","last_peered":"2023-12-07T09:59:14.856333+0000","last_clean":"2023-12-07T09:59:14.856333+0000","last_became_active":"2023-12-07T09:59:13.219912+0000","last_became_peered":"2023-12-07T09:59:13.219912+0000","last_unstale":"2023-12-07T09:59:14.856333+0000","last_undegraded":"2023-12-07T09:59:14.856333+0000","last_fullsized":"2023-12-07T09:59:14.856333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856650+0000","last_change":"2023-12-07T09:59:13.237134+0000","last_active":"2023-12-07T09:59:14.856650+0000","last_peered":"2023-12-07T09:59:14.856650+0000","last_clean":"2023-12-07T09:59:14.856650+0000","last_became_active":"2023-12-07T09:59:13.235178+0000","last_became_peered":"2023-12-07T09:59:13.235178+0000","last_unstale":"2023-12-07T09:59:14.856650+0000","last_undegraded":"2023-12-07T09:59:14.856650+0000","last_fullsized":"2023-12-07T09:59:14.856650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855309+0000","last_change":"2023-12-07T09:59:13.215170+0000","last_active":"2023-12-07T09:59:14.855309+0000","last_peered":"2023-12-07T09:59:14.855309+0000","last_clean":"2023-12-07T09:59:14.855309+0000","last_became_active":"2023-12-07T09:59:13.214893+0000","last_became_peered":"2023-12-07T09:59:13.214893+0000","last_unstale":"2023-12-07T09:59:14.855309+0000","last_undegraded":"2023-12-07T09:59:14.855309+0000","last_fullsized":"2023-12-07T09:59:14.855309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855956+0000","last_change":"2023-12-07T09:59:13.238320+0000","last_active":"2023-12-07T09:59:14.855956+0000","last_peered":"2023-12-07T09:59:14.855956+0000","last_clean":"2023-12-07T09:59:14.855956+0000","last_became_active":"2023-12-07T09:59:13.236975+0000","last_became_peered":"2023-12-07T09:59:13.236975+0000","last_unstale":"2023-12-07T09:59:14.855956+0000","last_undegraded":"2023-12-07T09:59:14.855956+0000","last_fullsized":"2023-12-07T09:59:14.855956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209622+0000","last_change":"2023-12-07T09:59:13.223573+0000","last_active":"2023-12-07T09:59:14.209622+0000","last_peered":"2023-12-07T09:59:14.209622+0000","last_clean":"2023-12-07T09:59:14.209622+0000","last_became_active":"2023-12-07T09:59:13.223311+0000","last_became_peered":"2023-12-07T09:59:13.223311+0000","last_unstale":"2023-12-07T09:59:14.209622+0000","last_undegraded":"2023-12-07T09:59:14.209622+0000","last_fullsized":"2023-12-07T09:59:14.209622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:53.489945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205303+0000","last_change":"2023-12-07T09:59:12.445561+0000","last_active":"2023-12-07T09:59:14.205303+0000","last_peered":"2023-12-07T09:59:14.205303+0000","last_clean":"2023-12-07T09:59:14.205303+0000","last_became_active":"2023-12-07T09:59:12.445157+0000","last_became_peered":"2023-12-07T09:59:12.445157+0000","last_unstale":"2023-12-07T09:59:14.205303+0000","last_undegraded":"2023-12-07T09:59:14.205303+0000","last_fullsized":"2023-12-07T09:59:14.205303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856519+0000","last_change":"2023-12-07T09:59:13.223869+0000","last_active":"2023-12-07T09:59:14.856519+0000","last_peered":"2023-12-07T09:59:14.856519+0000","last_clean":"2023-12-07T09:59:14.856519+0000","last_became_active":"2023-12-07T09:59:13.223599+0000","last_became_peered":"2023-12-07T09:59:13.223599+0000","last_unstale":"2023-12-07T09:59:14.856519+0000","last_undegraded":"2023-12-07T09:59:14.856519+0000","last_fullsized":"2023-12-07T09:59:14.856519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855929+0000","last_change":"2023-12-07T09:59:12.447360+0000","last_active":"2023-12-07T09:59:14.855929+0000","last_peered":"2023-12-07T09:59:14.855929+0000","last_clean":"2023-12-07T09:59:14.855929+0000","last_became_active":"2023-12-07T09:59:12.445342+0000","last_became_peered":"2023-12-07T09:59:12.445342+0000","last_unstale":"2023-12-07T09:59:14.855929+0000","last_undegraded":"2023-12-07T09:59:14.855929+0000","last_fullsized":"2023-12-07T09:59:14.855929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205055+0000","last_change":"2023-12-07T09:59:12.445519+0000","last_active":"2023-12-07T09:59:14.205055+0000","last_peered":"2023-12-07T09:59:14.205055+0000","last_clean":"2023-12-07T09:59:14.205055+0000","last_became_active":"2023-12-07T09:59:12.445216+0000","last_became_peered":"2023-12-07T09:59:12.445216+0000","last_unstale":"2023-12-07T09:59:14.205055+0000","last_undegraded":"2023-12-07T09:59:14.205055+0000","last_fullsized":"2023-12-07T09:59:14.205055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204981+0000","last_change":"2023-12-07T09:59:13.222784+0000","last_active":"2023-12-07T09:59:14.204981+0000","last_peered":"2023-12-07T09:59:14.204981+0000","last_clean":"2023-12-07T09:59:14.204981+0000","last_became_active":"2023-12-07T09:59:13.221094+0000","last_became_peered":"2023-12-07T09:59:13.221094+0000","last_unstale":"2023-12-07T09:59:14.204981+0000","last_undegraded":"2023-12-07T09:59:14.204981+0000","last_fullsized":"2023-12-07T09:59:14.204981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856191+0000","last_change":"2023-12-07T09:59:12.444592+0000","last_active":"2023-12-07T09:59:14.856191+0000","last_peered":"2023-12-07T09:59:14.856191+0000","last_clean":"2023-12-07T09:59:14.856191+0000","last_became_active":"2023-12-07T09:59:12.444319+0000","last_became_peered":"2023-12-07T09:59:12.444319+0000","last_unstale":"2023-12-07T09:59:14.856191+0000","last_undegraded":"2023-12-07T09:59:14.856191+0000","last_fullsized":"2023-12-07T09:59:14.856191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:17.193358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855494+0000","last_change":"2023-12-07T09:59:13.217769+0000","last_active":"2023-12-07T09:59:14.855494+0000","last_peered":"2023-12-07T09:59:14.855494+0000","last_clean":"2023-12-07T09:59:14.855494+0000","last_became_active":"2023-12-07T09:59:13.217483+0000","last_became_peered":"2023-12-07T09:59:13.217483+0000","last_unstale":"2023-12-07T09:59:14.855494+0000","last_undegraded":"2023-12-07T09:59:14.855494+0000","last_fullsized":"2023-12-07T09:59:14.855494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856282+0000","last_change":"2023-12-07T09:59:12.446477+0000","last_active":"2023-12-07T09:59:14.856282+0000","last_peered":"2023-12-07T09:59:14.856282+0000","last_clean":"2023-12-07T09:59:14.856282+0000","last_became_active":"2023-12-07T09:59:12.446203+0000","last_became_peered":"2023-12-07T09:59:12.446203+0000","last_unstale":"2023-12-07T09:59:14.856282+0000","last_undegraded":"2023-12-07T09:59:14.856282+0000","last_fullsized":"2023-12-07T09:59:14.856282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856664+0000","last_change":"2023-12-07T09:59:13.228184+0000","last_active":"2023-12-07T09:59:14.856664+0000","last_peered":"2023-12-07T09:59:14.856664+0000","last_clean":"2023-12-07T09:59:14.856664+0000","last_became_active":"2023-12-07T09:59:13.227834+0000","last_became_peered":"2023-12-07T09:59:13.227834+0000","last_unstale":"2023-12-07T09:59:14.856664+0000","last_undegraded":"2023-12-07T09:59:14.856664+0000","last_fullsized":"2023-12-07T09:59:14.856664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856790+0000","last_change":"2023-12-07T09:59:12.445865+0000","last_active":"2023-12-07T09:59:14.856790+0000","last_peered":"2023-12-07T09:59:14.856790+0000","last_clean":"2023-12-07T09:59:14.856790+0000","last_became_active":"2023-12-07T09:59:12.445572+0000","last_became_peered":"2023-12-07T09:59:12.445572+0000","last_unstale":"2023-12-07T09:59:14.856790+0000","last_undegraded":"2023-12-07T09:59:14.856790+0000","last_fullsized":"2023-12-07T09:59:14.856790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856567+0000","last_change":"2023-12-07T09:59:13.223916+0000","last_active":"2023-12-07T09:59:14.856567+0000","last_peered":"2023-12-07T09:59:14.856567+0000","last_clean":"2023-12-07T09:59:14.856567+0000","last_became_active":"2023-12-07T09:59:13.221626+0000","last_became_peered":"2023-12-07T09:59:13.221626+0000","last_unstale":"2023-12-07T09:59:14.856567+0000","last_undegraded":"2023-12-07T09:59:14.856567+0000","last_fullsized":"2023-12-07T09:59:14.856567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855897+0000","last_change":"2023-12-07T09:59:12.444220+0000","last_active":"2023-12-07T09:59:14.855897+0000","last_peered":"2023-12-07T09:59:14.855897+0000","last_clean":"2023-12-07T09:59:14.855897+0000","last_became_active":"2023-12-07T09:59:12.443588+0000","last_became_peered":"2023-12-07T09:59:12.443588+0000","last_unstale":"2023-12-07T09:59:14.855897+0000","last_undegraded":"2023-12-07T09:59:14.855897+0000","last_fullsized":"2023-12-07T09:59:14.855897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209944+0000","last_change":"2023-12-07T09:59:13.232678+0000","last_active":"2023-12-07T09:59:14.209944+0000","last_peered":"2023-12-07T09:59:14.209944+0000","last_clean":"2023-12-07T09:59:14.209944+0000","last_became_active":"2023-12-07T09:59:13.232421+0000","last_became_peered":"2023-12-07T09:59:13.232421+0000","last_unstale":"2023-12-07T09:59:14.209944+0000","last_undegraded":"2023-12-07T09:59:14.209944+0000","last_fullsized":"2023-12-07T09:59:14.209944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856093+0000","last_change":"2023-12-07T09:59:12.442066+0000","last_active":"2023-12-07T09:59:14.856093+0000","last_peered":"2023-12-07T09:59:14.856093+0000","last_clean":"2023-12-07T09:59:14.856093+0000","last_became_active":"2023-12-07T09:59:12.441817+0000","last_became_peered":"2023-12-07T09:59:12.441817+0000","last_unstale":"2023-12-07T09:59:14.856093+0000","last_undegraded":"2023-12-07T09:59:14.856093+0000","last_fullsized":"2023-12-07T09:59:14.856093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208914+0000","last_change":"2023-12-07T09:59:13.227653+0000","last_active":"2023-12-07T09:59:14.208914+0000","last_peered":"2023-12-07T09:59:14.208914+0000","last_clean":"2023-12-07T09:59:14.208914+0000","last_became_active":"2023-12-07T09:59:13.227307+0000","last_became_peered":"2023-12-07T09:59:13.227307+0000","last_unstale":"2023-12-07T09:59:14.208914+0000","last_undegraded":"2023-12-07T09:59:14.208914+0000","last_fullsized":"2023-12-07T09:59:14.208914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856577+0000","last_change":"2023-12-07T09:59:12.447857+0000","last_active":"2023-12-07T09:59:14.856577+0000","last_peered":"2023-12-07T09:59:14.856577+0000","last_clean":"2023-12-07T09:59:14.856577+0000","last_became_active":"2023-12-07T09:59:12.447625+0000","last_became_peered":"2023-12-07T09:59:12.447625+0000","last_unstale":"2023-12-07T09:59:14.856577+0000","last_undegraded":"2023-12-07T09:59:14.856577+0000","last_fullsized":"2023-12-07T09:59:14.856577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856290+0000","last_change":"2023-12-07T09:59:13.221295+0000","last_active":"2023-12-07T09:59:14.856290+0000","last_peered":"2023-12-07T09:59:14.856290+0000","last_clean":"2023-12-07T09:59:14.856290+0000","last_became_active":"2023-12-07T09:59:13.220976+0000","last_became_peered":"2023-12-07T09:59:13.220976+0000","last_unstale":"2023-12-07T09:59:14.856290+0000","last_undegraded":"2023-12-07T09:59:14.856290+0000","last_fullsized":"2023-12-07T09:59:14.856290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:47.462027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856560+0000","last_change":"2023-12-07T09:59:12.441312+0000","last_active":"2023-12-07T09:59:14.856560+0000","last_peered":"2023-12-07T09:59:14.856560+0000","last_clean":"2023-12-07T09:59:14.856560+0000","last_became_active":"2023-12-07T09:59:12.441028+0000","last_became_peered":"2023-12-07T09:59:12.441028+0000","last_unstale":"2023-12-07T09:59:14.856560+0000","last_undegraded":"2023-12-07T09:59:14.856560+0000","last_fullsized":"2023-12-07T09:59:14.856560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:26.967332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209168+0000","last_change":"2023-12-07T09:59:13.232850+0000","last_active":"2023-12-07T09:59:14.209168+0000","last_peered":"2023-12-07T09:59:14.209168+0000","last_clean":"2023-12-07T09:59:14.209168+0000","last_became_active":"2023-12-07T09:59:13.232332+0000","last_became_peered":"2023-12-07T09:59:13.232332+0000","last_unstale":"2023-12-07T09:59:14.209168+0000","last_undegraded":"2023-12-07T09:59:14.209168+0000","last_fullsized":"2023-12-07T09:59:14.209168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855793+0000","last_change":"2023-12-07T09:59:12.445929+0000","last_active":"2023-12-07T09:59:14.855793+0000","last_peered":"2023-12-07T09:59:14.855793+0000","last_clean":"2023-12-07T09:59:14.855793+0000","last_became_active":"2023-12-07T09:59:12.445461+0000","last_became_peered":"2023-12-07T09:59:12.445461+0000","last_unstale":"2023-12-07T09:59:14.855793+0000","last_undegraded":"2023-12-07T09:59:14.855793+0000","last_fullsized":"2023-12-07T09:59:14.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.235497+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.231385+0000","last_became_peered":"2023-12-07T09:59:13.231385+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855650+0000","last_change":"2023-12-07T09:59:12.439722+0000","last_active":"2023-12-07T09:59:14.855650+0000","last_peered":"2023-12-07T09:59:14.855650+0000","last_clean":"2023-12-07T09:59:14.855650+0000","last_became_active":"2023-12-07T09:59:12.438240+0000","last_became_peered":"2023-12-07T09:59:12.438240+0000","last_unstale":"2023-12-07T09:59:14.855650+0000","last_undegraded":"2023-12-07T09:59:14.855650+0000","last_fullsized":"2023-12-07T09:59:14.855650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208754+0000","last_change":"2023-12-07T09:59:13.234272+0000","last_active":"2023-12-07T09:59:14.208754+0000","last_peered":"2023-12-07T09:59:14.208754+0000","last_clean":"2023-12-07T09:59:14.208754+0000","last_became_active":"2023-12-07T09:59:13.231957+0000","last_became_peered":"2023-12-07T09:59:13.231957+0000","last_unstale":"2023-12-07T09:59:14.208754+0000","last_undegraded":"2023-12-07T09:59:14.208754+0000","last_fullsized":"2023-12-07T09:59:14.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.210004+0000","last_change":"2023-12-07T09:59:12.439194+0000","last_active":"2023-12-07T09:59:14.210004+0000","last_peered":"2023-12-07T09:59:14.210004+0000","last_clean":"2023-12-07T09:59:14.210004+0000","last_became_active":"2023-12-07T09:59:12.438884+0000","last_became_peered":"2023-12-07T09:59:12.438884+0000","last_unstale":"2023-12-07T09:59:14.210004+0000","last_undegraded":"2023-12-07T09:59:14.210004+0000","last_fullsized":"2023-12-07T09:59:14.210004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208903+0000","last_change":"2023-12-07T09:59:13.230666+0000","last_active":"2023-12-07T09:59:14.208903+0000","last_peered":"2023-12-07T09:59:14.208903+0000","last_clean":"2023-12-07T09:59:14.208903+0000","last_became_active":"2023-12-07T09:59:13.230390+0000","last_became_peered":"2023-12-07T09:59:13.230390+0000","last_unstale":"2023-12-07T09:59:14.208903+0000","last_undegraded":"2023-12-07T09:59:14.208903+0000","last_fullsized":"2023-12-07T09:59:14.208903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855548+0000","last_change":"2023-12-07T09:59:12.444548+0000","last_active":"2023-12-07T09:59:14.855548+0000","last_peered":"2023-12-07T09:59:14.855548+0000","last_clean":"2023-12-07T09:59:14.855548+0000","last_became_active":"2023-12-07T09:59:12.444265+0000","last_became_peered":"2023-12-07T09:59:12.444265+0000","last_unstale":"2023-12-07T09:59:14.855548+0000","last_undegraded":"2023-12-07T09:59:14.855548+0000","last_fullsized":"2023-12-07T09:59:14.855548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209558+0000","last_change":"2023-12-07T09:59:13.232945+0000","last_active":"2023-12-07T09:59:14.209558+0000","last_peered":"2023-12-07T09:59:14.209558+0000","last_clean":"2023-12-07T09:59:14.209558+0000","last_became_active":"2023-12-07T09:59:13.232656+0000","last_became_peered":"2023-12-07T09:59:13.232656+0000","last_unstale":"2023-12-07T09:59:14.209558+0000","last_undegraded":"2023-12-07T09:59:14.209558+0000","last_fullsized":"2023-12-07T09:59:14.209558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:31.593646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855993+0000","last_change":"2023-12-07T09:59:12.439997+0000","last_active":"2023-12-07T09:59:14.855993+0000","last_peered":"2023-12-07T09:59:14.855993+0000","last_clean":"2023-12-07T09:59:14.855993+0000","last_became_active":"2023-12-07T09:59:12.439732+0000","last_became_peered":"2023-12-07T09:59:12.439732+0000","last_unstale":"2023-12-07T09:59:14.855993+0000","last_undegraded":"2023-12-07T09:59:14.855993+0000","last_fullsized":"2023-12-07T09:59:14.855993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856858+0000","last_change":"2023-12-07T09:59:13.222198+0000","last_active":"2023-12-07T09:59:14.856858+0000","last_peered":"2023-12-07T09:59:14.856858+0000","last_clean":"2023-12-07T09:59:14.856858+0000","last_became_active":"2023-12-07T09:59:13.219609+0000","last_became_peered":"2023-12-07T09:59:13.219609+0000","last_unstale":"2023-12-07T09:59:14.856858+0000","last_undegraded":"2023-12-07T09:59:14.856858+0000","last_fullsized":"2023-12-07T09:59:14.856858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855424+0000","last_change":"2023-12-07T09:59:12.442621+0000","last_active":"2023-12-07T09:59:14.855424+0000","last_peered":"2023-12-07T09:59:14.855424+0000","last_clean":"2023-12-07T09:59:14.855424+0000","last_became_active":"2023-12-07T09:59:12.442335+0000","last_became_peered":"2023-12-07T09:59:12.442335+0000","last_unstale":"2023-12-07T09:59:14.855424+0000","last_undegraded":"2023-12-07T09:59:14.855424+0000","last_fullsized":"2023-12-07T09:59:14.855424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:52.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209055+0000","last_change":"2023-12-07T09:59:13.236569+0000","last_active":"2023-12-07T09:59:14.209055+0000","last_peered":"2023-12-07T09:59:14.209055+0000","last_clean":"2023-12-07T09:59:14.209055+0000","last_became_active":"2023-12-07T09:59:13.236202+0000","last_became_peered":"2023-12-07T09:59:13.236202+0000","last_unstale":"2023-12-07T09:59:14.209055+0000","last_undegraded":"2023-12-07T09:59:14.209055+0000","last_fullsized":"2023-12-07T09:59:14.209055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-07T09:59:13.208674+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:13.208674+0000","last_peered":"2023-12-07T09:59:13.208674+0000","last_clean":"2023-12-07T09:59:13.208674+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:13.208674+0000","last_undegraded":"2023-12-07T09:59:13.208674+0000","last_fullsized":"2023-12-07T09:59:13.208674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856471+0000","last_change":"2023-12-07T09:59:12.448949+0000","last_active":"2023-12-07T09:59:14.856471+0000","last_peered":"2023-12-07T09:59:14.856471+0000","last_clean":"2023-12-07T09:59:14.856471+0000","last_became_active":"2023-12-07T09:59:12.448415+0000","last_became_peered":"2023-12-07T09:59:12.448415+0000","last_unstale":"2023-12-07T09:59:14.856471+0000","last_undegraded":"2023-12-07T09:59:14.856471+0000","last_fullsized":"2023-12-07T09:59:14.856471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205136+0000","last_change":"2023-12-07T09:59:13.236914+0000","last_active":"2023-12-07T09:59:14.205136+0000","last_peered":"2023-12-07T09:59:14.205136+0000","last_clean":"2023-12-07T09:59:14.205136+0000","last_became_active":"2023-12-07T09:59:13.236582+0000","last_became_peered":"2023-12-07T09:59:13.236582+0000","last_unstale":"2023-12-07T09:59:14.205136+0000","last_undegraded":"2023-12-07T09:59:14.205136+0000","last_fullsized":"2023-12-07T09:59:14.205136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208617+0000","last_change":"2023-12-07T09:59:12.453760+0000","last_active":"2023-12-07T09:59:14.208617+0000","last_peered":"2023-12-07T09:59:14.208617+0000","last_clean":"2023-12-07T09:59:14.208617+0000","last_became_active":"2023-12-07T09:59:12.451737+0000","last_became_peered":"2023-12-07T09:59:12.451737+0000","last_unstale":"2023-12-07T09:59:14.208617+0000","last_undegraded":"2023-12-07T09:59:14.208617+0000","last_fullsized":"2023-12-07T09:59:14.208617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:16.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856296+0000","last_change":"2023-12-07T09:59:13.229329+0000","last_active":"2023-12-07T09:59:14.856296+0000","last_peered":"2023-12-07T09:59:14.856296+0000","last_clean":"2023-12-07T09:59:14.856296+0000","last_became_active":"2023-12-07T09:59:13.229012+0000","last_became_peered":"2023-12-07T09:59:13.229012+0000","last_unstale":"2023-12-07T09:59:14.856296+0000","last_undegraded":"2023-12-07T09:59:14.856296+0000","last_fullsized":"2023-12-07T09:59:14.856296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:16.553666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855396+0000","last_change":"2023-12-07T09:59:12.443723+0000","last_active":"2023-12-07T09:59:14.855396+0000","last_peered":"2023-12-07T09:59:14.855396+0000","last_clean":"2023-12-07T09:59:14.855396+0000","last_became_active":"2023-12-07T09:59:12.443456+0000","last_became_peered":"2023-12-07T09:59:12.443456+0000","last_unstale":"2023-12-07T09:59:14.855396+0000","last_undegraded":"2023-12-07T09:59:14.855396+0000","last_fullsized":"2023-12-07T09:59:14.855396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:29.302595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855830+0000","last_change":"2023-12-07T09:59:13.216025+0000","last_active":"2023-12-07T09:59:14.855830+0000","last_peered":"2023-12-07T09:59:14.855830+0000","last_clean":"2023-12-07T09:59:14.855830+0000","last_became_active":"2023-12-07T09:59:13.215772+0000","last_became_peered":"2023-12-07T09:59:13.215772+0000","last_unstale":"2023-12-07T09:59:14.855830+0000","last_undegraded":"2023-12-07T09:59:14.855830+0000","last_fullsized":"2023-12-07T09:59:14.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856711+0000","last_change":"2023-12-07T09:59:12.442740+0000","last_active":"2023-12-07T09:59:14.856711+0000","last_peered":"2023-12-07T09:59:14.856711+0000","last_clean":"2023-12-07T09:59:14.856711+0000","last_became_active":"2023-12-07T09:59:12.442434+0000","last_became_peered":"2023-12-07T09:59:12.442434+0000","last_unstale":"2023-12-07T09:59:14.856711+0000","last_undegraded":"2023-12-07T09:59:14.856711+0000","last_fullsized":"2023-12-07T09:59:14.856711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209730+0000","last_change":"2023-12-07T09:59:13.229519+0000","last_active":"2023-12-07T09:59:14.209730+0000","last_peered":"2023-12-07T09:59:14.209730+0000","last_clean":"2023-12-07T09:59:14.209730+0000","last_became_active":"2023-12-07T09:59:13.229213+0000","last_became_peered":"2023-12-07T09:59:13.229213+0000","last_unstale":"2023-12-07T09:59:14.209730+0000","last_undegraded":"2023-12-07T09:59:14.209730+0000","last_fullsized":"2023-12-07T09:59:14.209730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:11.313416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855747+0000","last_change":"2023-12-07T09:59:12.444649+0000","last_active":"2023-12-07T09:59:14.855747+0000","last_peered":"2023-12-07T09:59:14.855747+0000","last_clean":"2023-12-07T09:59:14.855747+0000","last_became_active":"2023-12-07T09:59:12.444396+0000","last_became_peered":"2023-12-07T09:59:12.444396+0000","last_unstale":"2023-12-07T09:59:14.855747+0000","last_undegraded":"2023-12-07T09:59:14.855747+0000","last_fullsized":"2023-12-07T09:59:14.855747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856950+0000","last_change":"2023-12-07T09:59:13.235666+0000","last_active":"2023-12-07T09:59:14.856950+0000","last_peered":"2023-12-07T09:59:14.856950+0000","last_clean":"2023-12-07T09:59:14.856950+0000","last_became_active":"2023-12-07T09:59:13.235387+0000","last_became_peered":"2023-12-07T09:59:13.235387+0000","last_unstale":"2023-12-07T09:59:14.856950+0000","last_undegraded":"2023-12-07T09:59:14.856950+0000","last_fullsized":"2023-12-07T09:59:14.856950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209610+0000","last_change":"2023-12-07T09:59:12.453170+0000","last_active":"2023-12-07T09:59:14.209610+0000","last_peered":"2023-12-07T09:59:14.209610+0000","last_clean":"2023-12-07T09:59:14.209610+0000","last_became_active":"2023-12-07T09:59:12.452722+0000","last_became_peered":"2023-12-07T09:59:12.452722+0000","last_unstale":"2023-12-07T09:59:14.209610+0000","last_undegraded":"2023-12-07T09:59:14.209610+0000","last_fullsized":"2023-12-07T09:59:14.209610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:11.940444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855656+0000","last_change":"2023-12-07T09:59:13.218149+0000","last_active":"2023-12-07T09:59:14.855656+0000","last_peered":"2023-12-07T09:59:14.855656+0000","last_clean":"2023-12-07T09:59:14.855656+0000","last_became_active":"2023-12-07T09:59:13.217830+0000","last_became_peered":"2023-12-07T09:59:13.217830+0000","last_unstale":"2023-12-07T09:59:14.855656+0000","last_undegraded":"2023-12-07T09:59:14.855656+0000","last_fullsized":"2023-12-07T09:59:14.855656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855883+0000","last_change":"2023-12-07T09:59:12.449220+0000","last_active":"2023-12-07T09:59:14.855883+0000","last_peered":"2023-12-07T09:59:14.855883+0000","last_clean":"2023-12-07T09:59:14.855883+0000","last_became_active":"2023-12-07T09:59:12.448837+0000","last_became_peered":"2023-12-07T09:59:12.448837+0000","last_unstale":"2023-12-07T09:59:14.855883+0000","last_undegraded":"2023-12-07T09:59:14.855883+0000","last_fullsized":"2023-12-07T09:59:14.855883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205360+0000","last_change":"2023-12-07T09:59:13.229085+0000","last_active":"2023-12-07T09:59:14.205360+0000","last_peered":"2023-12-07T09:59:14.205360+0000","last_clean":"2023-12-07T09:59:14.205360+0000","last_became_active":"2023-12-07T09:59:13.227932+0000","last_became_peered":"2023-12-07T09:59:13.227932+0000","last_unstale":"2023-12-07T09:59:14.205360+0000","last_undegraded":"2023-12-07T09:59:14.205360+0000","last_fullsized":"2023-12-07T09:59:14.205360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856299+0000","last_change":"2023-12-07T09:59:12.453221+0000","last_active":"2023-12-07T09:59:14.856299+0000","last_peered":"2023-12-07T09:59:14.856299+0000","last_clean":"2023-12-07T09:59:14.856299+0000","last_became_active":"2023-12-07T09:59:12.452946+0000","last_became_peered":"2023-12-07T09:59:12.452946+0000","last_unstale":"2023-12-07T09:59:14.856299+0000","last_undegraded":"2023-12-07T09:59:14.856299+0000","last_fullsized":"2023-12-07T09:59:14.856299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856524+0000","last_change":"2023-12-07T09:59:13.214345+0000","last_active":"2023-12-07T09:59:14.856524+0000","last_peered":"2023-12-07T09:59:14.856524+0000","last_clean":"2023-12-07T09:59:14.856524+0000","last_became_active":"2023-12-07T09:59:13.214065+0000","last_became_peered":"2023-12-07T09:59:13.214065+0000","last_unstale":"2023-12-07T09:59:14.856524+0000","last_undegraded":"2023-12-07T09:59:14.856524+0000","last_fullsized":"2023-12-07T09:59:14.856524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208601+0000","last_change":"2023-12-07T09:59:12.454383+0000","last_active":"2023-12-07T09:59:14.208601+0000","last_peered":"2023-12-07T09:59:14.208601+0000","last_clean":"2023-12-07T09:59:14.208601+0000","last_became_active":"2023-12-07T09:59:12.454061+0000","last_became_peered":"2023-12-07T09:59:12.454061+0000","last_unstale":"2023-12-07T09:59:14.208601+0000","last_undegraded":"2023-12-07T09:59:14.208601+0000","last_fullsized":"2023-12-07T09:59:14.208601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209349+0000","last_change":"2023-12-07T09:59:13.222718+0000","last_active":"2023-12-07T09:59:14.209349+0000","last_peered":"2023-12-07T09:59:14.209349+0000","last_clean":"2023-12-07T09:59:14.209349+0000","last_became_active":"2023-12-07T09:59:13.222405+0000","last_became_peered":"2023-12-07T09:59:13.222405+0000","last_unstale":"2023-12-07T09:59:14.209349+0000","last_undegraded":"2023-12-07T09:59:14.209349+0000","last_fullsized":"2023-12-07T09:59:14.209349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:30.311283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855995+0000","last_change":"2023-12-07T09:59:12.439274+0000","last_active":"2023-12-07T09:59:14.855995+0000","last_peered":"2023-12-07T09:59:14.855995+0000","last_clean":"2023-12-07T09:59:14.855995+0000","last_became_active":"2023-12-07T09:59:12.438973+0000","last_became_peered":"2023-12-07T09:59:12.438973+0000","last_unstale":"2023-12-07T09:59:14.855995+0000","last_undegraded":"2023-12-07T09:59:14.855995+0000","last_fullsized":"2023-12-07T09:59:14.855995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205003+0000","last_change":"2023-12-07T09:59:13.225445+0000","last_active":"2023-12-07T09:59:14.205003+0000","last_peered":"2023-12-07T09:59:14.205003+0000","last_clean":"2023-12-07T09:59:14.205003+0000","last_became_active":"2023-12-07T09:59:13.225149+0000","last_became_peered":"2023-12-07T09:59:13.225149+0000","last_unstale":"2023-12-07T09:59:14.205003+0000","last_undegraded":"2023-12-07T09:59:14.205003+0000","last_fullsized":"2023-12-07T09:59:14.205003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855648+0000","last_change":"2023-12-07T09:59:12.442112+0000","last_active":"2023-12-07T09:59:14.855648+0000","last_peered":"2023-12-07T09:59:14.855648+0000","last_clean":"2023-12-07T09:59:14.855648+0000","last_became_active":"2023-12-07T09:59:12.441793+0000","last_became_peered":"2023-12-07T09:59:12.441793+0000","last_unstale":"2023-12-07T09:59:14.855648+0000","last_undegraded":"2023-12-07T09:59:14.855648+0000","last_fullsized":"2023-12-07T09:59:14.855648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205346+0000","last_change":"2023-12-07T09:59:13.221842+0000","last_active":"2023-12-07T09:59:14.205346+0000","last_peered":"2023-12-07T09:59:14.205346+0000","last_clean":"2023-12-07T09:59:14.205346+0000","last_became_active":"2023-12-07T09:59:13.221454+0000","last_became_peered":"2023-12-07T09:59:13.221454+0000","last_unstale":"2023-12-07T09:59:14.205346+0000","last_undegraded":"2023-12-07T09:59:14.205346+0000","last_fullsized":"2023-12-07T09:59:14.205346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209325+0000","last_change":"2023-12-07T09:59:12.453238+0000","last_active":"2023-12-07T09:59:14.209325+0000","last_peered":"2023-12-07T09:59:14.209325+0000","last_clean":"2023-12-07T09:59:14.209325+0000","last_became_active":"2023-12-07T09:59:12.452285+0000","last_became_peered":"2023-12-07T09:59:12.452285+0000","last_unstale":"2023-12-07T09:59:14.209325+0000","last_undegraded":"2023-12-07T09:59:14.209325+0000","last_fullsized":"2023-12-07T09:59:14.209325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:05.804533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855821+0000","last_change":"2023-12-07T09:59:13.243271+0000","last_active":"2023-12-07T09:59:14.855821+0000","last_peered":"2023-12-07T09:59:14.855821+0000","last_clean":"2023-12-07T09:59:14.855821+0000","last_became_active":"2023-12-07T09:59:13.242931+0000","last_became_peered":"2023-12-07T09:59:13.242931+0000","last_unstale":"2023-12-07T09:59:14.855821+0000","last_undegraded":"2023-12-07T09:59:14.855821+0000","last_fullsized":"2023-12-07T09:59:14.855821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856927+0000","last_change":"2023-12-07T09:59:13.232574+0000","last_active":"2023-12-07T09:59:14.856927+0000","last_peered":"2023-12-07T09:59:14.856927+0000","last_clean":"2023-12-07T09:59:14.856927+0000","last_became_active":"2023-12-07T09:59:13.232262+0000","last_became_peered":"2023-12-07T09:59:13.232262+0000","last_unstale":"2023-12-07T09:59:14.856927+0000","last_undegraded":"2023-12-07T09:59:14.856927+0000","last_fullsized":"2023-12-07T09:59:14.856927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208855+0000","last_change":"2023-12-07T09:59:12.454304+0000","last_active":"2023-12-07T09:59:14.208855+0000","last_peered":"2023-12-07T09:59:14.208855+0000","last_clean":"2023-12-07T09:59:14.208855+0000","last_became_active":"2023-12-07T09:59:12.454038+0000","last_became_peered":"2023-12-07T09:59:12.454038+0000","last_unstale":"2023-12-07T09:59:14.208855+0000","last_undegraded":"2023-12-07T09:59:14.208855+0000","last_fullsized":"2023-12-07T09:59:14.208855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856881+0000","last_change":"2023-12-07T09:59:13.232029+0000","last_active":"2023-12-07T09:59:14.856881+0000","last_peered":"2023-12-07T09:59:14.856881+0000","last_clean":"2023-12-07T09:59:14.856881+0000","last_became_active":"2023-12-07T09:59:13.231273+0000","last_became_peered":"2023-12-07T09:59:13.231273+0000","last_unstale":"2023-12-07T09:59:14.856881+0000","last_undegraded":"2023-12-07T09:59:14.856881+0000","last_fullsized":"2023-12-07T09:59:14.856881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209153+0000","last_change":"2023-12-07T09:59:12.452964+0000","last_active":"2023-12-07T09:59:14.209153+0000","last_peered":"2023-12-07T09:59:14.209153+0000","last_clean":"2023-12-07T09:59:14.209153+0000","last_became_active":"2023-12-07T09:59:12.452651+0000","last_became_peered":"2023-12-07T09:59:12.452651+0000","last_unstale":"2023-12-07T09:59:14.209153+0000","last_undegraded":"2023-12-07T09:59:14.209153+0000","last_fullsized":"2023-12-07T09:59:14.209153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856607+0000","last_change":"2023-12-07T09:59:13.224204+0000","last_active":"2023-12-07T09:59:14.856607+0000","last_peered":"2023-12-07T09:59:14.856607+0000","last_clean":"2023-12-07T09:59:14.856607+0000","last_became_active":"2023-12-07T09:59:13.222519+0000","last_became_peered":"2023-12-07T09:59:13.222519+0000","last_unstale":"2023-12-07T09:59:14.856607+0000","last_undegraded":"2023-12-07T09:59:14.856607+0000","last_fullsized":"2023-12-07T09:59:14.856607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205381+0000","last_change":"2023-12-07T09:59:12.440360+0000","last_active":"2023-12-07T09:59:14.205381+0000","last_peered":"2023-12-07T09:59:14.205381+0000","last_clean":"2023-12-07T09:59:14.205381+0000","last_became_active":"2023-12-07T09:59:12.440087+0000","last_became_peered":"2023-12-07T09:59:12.440087+0000","last_unstale":"2023-12-07T09:59:14.205381+0000","last_undegraded":"2023-12-07T09:59:14.205381+0000","last_fullsized":"2023-12-07T09:59:14.205381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:25.030548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205333+0000","last_change":"2023-12-07T09:59:13.237795+0000","last_active":"2023-12-07T09:59:14.205333+0000","last_peered":"2023-12-07T09:59:14.205333+0000","last_clean":"2023-12-07T09:59:14.205333+0000","last_became_active":"2023-12-07T09:59:13.237488+0000","last_became_peered":"2023-12-07T09:59:13.237488+0000","last_unstale":"2023-12-07T09:59:14.205333+0000","last_undegraded":"2023-12-07T09:59:14.205333+0000","last_fullsized":"2023-12-07T09:59:14.205333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856662+0000","last_change":"2023-12-07T09:59:12.453157+0000","last_active":"2023-12-07T09:59:14.856662+0000","last_peered":"2023-12-07T09:59:14.856662+0000","last_clean":"2023-12-07T09:59:14.856662+0000","last_became_active":"2023-12-07T09:59:12.452900+0000","last_became_peered":"2023-12-07T09:59:12.452900+0000","last_unstale":"2023-12-07T09:59:14.856662+0000","last_undegraded":"2023-12-07T09:59:14.856662+0000","last_fullsized":"2023-12-07T09:59:14.856662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T09:59:17.878 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T09:59:17.879 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-07T09:59:17.879 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-07T09:59:17.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-07T09:59:17.880 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-07T09:59:18.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799c8c8640 1 Processor -- start 2023-12-07T09:59:18.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799c8c8640 1 -- start start 2023-12-07T09:59:18.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799c8c8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f79980c4890 0x7f79980caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799c8c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799806b7d0 con 0x7f79980bd5a0 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799c8c8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7998155160 con 0x7f79980ca620 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799c8c8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799806b180 con 0x7f79980c4890 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799659c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f79980c4890 0x7f79980caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799759e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f79980bd5a0 0x7f79980c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34604/0 (socket says 172.21.15.89:34604) 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799759e640 1 -- 172.21.15.89:0/45217875 learned_addr learned my addr 172.21.15.89:0/45217875 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799659c640 1 -- 172.21.15.89:0/45217875 >> v1:172.21.15.97:6789/0 conn(0x7f79980ca620 legacy=0x7f79980c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:18.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799659c640 1 -- 172.21.15.89:0/45217875 >> v1:172.21.15.89:6789/0 conn(0x7f79980bd5a0 legacy=0x7f79980c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f7995d9b640 1 -- 172.21.15.89:0/45217875 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037952751 0 0) 0x7f799806b7d0 con 0x7f79980bd5a0 2023-12-07T09:59:18.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.047+0000 7f799659c640 1 -- 172.21.15.89:0/45217875 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799806b460 con 0x7f79980c4890 2023-12-07T09:59:18.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799659c640 1 --2- 172.21.15.89:0/45217875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980caa00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097c0 tx=0x7f798c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffae4c2a995fddd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f7995d9b640 1 -- 172.21.15.89:0/45217875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0a47b0 con 0x7f79980c4890 2023-12-07T09:59:18.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f7995d9b640 1 -- 172.21.15.89:0/45217875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980c9da0 con 0x7f79980c4890 2023-12-07T09:59:18.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f7995d9b640 1 -- 172.21.15.89:0/45217875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0a4b30 con 0x7f79980c4890 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 -- 172.21.15.89:0/45217875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 msgr2=0x7f79980caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 --2- 172.21.15.89:0/45217875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980caa00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097c0 tx=0x7f798c01c000 comp rx=0 tx=0).stop 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 -- 172.21.15.89:0/45217875 shutdown_connections 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 --2- 172.21.15.89:0/45217875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980caa00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 -- 172.21.15.89:0/45217875 >> 172.21.15.89:0/45217875 conn(0x7f79980ac0a0 msgr2=0x7f79980c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 -- 172.21.15.89:0/45217875 shutdown_connections 2023-12-07T09:59:18.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 -- 172.21.15.89:0/45217875 wait complete. 2023-12-07T09:59:18.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 Processor -- start 2023-12-07T09:59:18.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.051+0000 7f799c8c8640 1 -- start start 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79980bd5a0 0x7f79981488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79980ca620 0x7f79980aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799814fce0 con 0x7f79980c4890 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7998151220 con 0x7f79980ca620 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7998151640 con 0x7f79980bd5a0 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45080/0 (socket says 172.21.15.89:45080) 2023-12-07T09:59:18.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 -- 172.21.15.89:0/2642098811 learned_addr learned my addr 172.21.15.89:0/2642098811 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 -- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79980bd5a0 msgr2=0x7f79981488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79980bd5a0 0x7f79981488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 -- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79980ca620 msgr2=0x7f79980aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799759e640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79980ca620 0x7f79980aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79980ca620 0x7f79980aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 -- 172.21.15.89:0/2642098811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c009420 con 0x7f79980c4890 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799759e640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79980ca620 0x7f79980aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799659c640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980c3a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f798c0af040 tx=0x7f798c0190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0ac850 con 0x7f79980c4890 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0ac9d0 con 0x7f79980c4890 2023-12-07T09:59:18.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79980c3f40 con 0x7f79980c4890 2023-12-07T09:59:18.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0acd80 con 0x7f79980c4890 2023-12-07T09:59:18.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7998149d70 con 0x7f79980c4890 2023-12-07T09:59:18.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.055+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7998151860 con 0x7f79980c4890 2023-12-07T09:59:18.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.059+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f798c0b3040 con 0x7f79980c4890 2023-12-07T09:59:18.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.059+0000 7f797f7fe640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79840668d0 0x7f7984068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.059+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f798c11de40 con 0x7f79980c4890 2023-12-07T09:59:18.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.059+0000 7f7996d9d640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79840668d0 0x7f7984068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.059+0000 7f7996d9d640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79840668d0 0x7f7984068d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7988003cf0 tx=0x7f79880079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.063+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7998151860 con 0x7f79980c4890 2023-12-07T09:59:18.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.247+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7998151860 con 0x7f79980c4890 2023-12-07T09:59:18.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f797f7fe640 1 -- 172.21.15.89:0/2642098811 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164969 (secure 0 0 0) 0x7f7998151860 con 0x7f79980c4890 2023-12-07T09:59:18.258 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:18.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79840668d0 msgr2=0x7f7984068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f799c8c8640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79840668d0 0x7f7984068d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7988003cf0 tx=0x7f79880079c0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 msgr2=0x7f79980c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f799c8c8640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980c3a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f798c0af040 tx=0x7f798c0190c0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 shutdown_connections 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.251+0000 7f799c8c8640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79980ca620 0x7f79980aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.255+0000 7f799c8c8640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79980c4890 0x7f79980c3a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.255+0000 7f799c8c8640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79840668d0 0x7f7984068d90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.255+0000 7f799c8c8640 1 --2- 172.21.15.89:0/2642098811 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79980bd5a0 0x7f79981488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.255+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 >> 172.21.15.89:0/2642098811 conn(0x7f79980ac0a0 msgr2=0x7f799814df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.255+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 shutdown_connections 2023-12-07T09:59:18.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.255+0000 7f799c8c8640 1 -- 172.21.15.89:0/2642098811 wait complete. 2023-12-07T09:59:18.277 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2483427308},{"type":"v1","addr":"172.21.15.89:6833","nonce":2483427308}]},"active_addr":"172.21.15.89:6833/2483427308","active_change":"2023-12-07T09:58:52.328641+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2825669071}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2164152984}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":123690080}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3942217400}]}]} 2023-12-07T09:59:18.281 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-07T09:59:18.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-07T09:59:18.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:18.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b9ba53640 1 Processor -- start 2023-12-07T09:59:18.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b9ba53640 1 -- start start 2023-12-07T09:59:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b9ba53640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4b940c1290 0x7f4b940c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b9ba53640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b94158b20 con 0x7f4b940c5f20 2023-12-07T09:59:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b9ba53640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b94157f10 con 0x7f4b940c2ac0 2023-12-07T09:59:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b9ba53640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b941581f0 con 0x7f4b940c1290 2023-12-07T09:59:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b99ff0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4b940c1290 0x7f4b940c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b98fee640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4b940c5f20 0x7f4b94151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34612/0 (socket says 172.21.15.89:34612) 2023-12-07T09:59:18.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b98fee640 1 -- 172.21.15.89:0/1026073714 learned_addr learned my addr 172.21.15.89:0/1026073714 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:18.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b99ff0640 1 -- 172.21.15.89:0/1026073714 >> v1:172.21.15.97:6789/0 conn(0x7f4b940c2ac0 legacy=0x7f4b94070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:18.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b8bfff640 1 -- 172.21.15.89:0/1026073714 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809227297 0 0) 0x7f4b94158b20 con 0x7f4b940c5f20 2023-12-07T09:59:18.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b99ff0640 1 -- 172.21.15.89:0/1026073714 >> v1:172.21.15.89:6789/0 conn(0x7f4b940c5f20 legacy=0x7f4b94151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.419+0000 7f4b99ff0640 1 -- 172.21.15.89:0/1026073714 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b941584d0 con 0x7f4b940c1290 2023-12-07T09:59:18.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b99ff0640 1 --2- 172.21.15.89:0/1026073714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c1290 0x7f4b940c16e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009d90 tx=0x7f4b8c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30e2c2c22b6a149 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b8bfff640 1 -- 172.21.15.89:0/1026073714 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0a5860 con 0x7f4b940c1290 2023-12-07T09:59:18.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b8bfff640 1 -- 172.21.15.89:0/1026073714 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0a59c0 con 0x7f4b940c1290 2023-12-07T09:59:18.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b8bfff640 1 -- 172.21.15.89:0/1026073714 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0a5d50 con 0x7f4b940c1290 2023-12-07T09:59:18.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1026073714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c1290 msgr2=0x7f4b940c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1026073714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c1290 0x7f4b940c16e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009d90 tx=0x7f4b8c01c890 comp rx=0 tx=0).stop 2023-12-07T09:59:18.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1026073714 shutdown_connections 2023-12-07T09:59:18.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1026073714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c1290 0x7f4b940c16e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1026073714 >> 172.21.15.89:0/1026073714 conn(0x7f4b940a9c10 msgr2=0x7f4b940aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:18.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1026073714 shutdown_connections 2023-12-07T09:59:18.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.423+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1026073714 wait complete. 2023-12-07T09:59:18.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 Processor -- start 2023-12-07T09:59:18.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 -- start start 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b940c1290 0x7f4b940ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 0x7f4b941ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b940c5f20 0x7f4b941ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941edde0 con 0x7f4b940c2ac0 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94154b50 con 0x7f4b940c1290 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941f1200 con 0x7f4b940c5f20 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 0x7f4b941ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 0x7f4b941ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45110/0 (socket says 172.21.15.89:45110) 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 -- 172.21.15.89:0/1614078212 learned_addr learned my addr 172.21.15.89:0/1614078212 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b997ef640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b940c1290 0x7f4b940ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b99ff0640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b940c5f20 0x7f4b941ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 -- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b940c5f20 msgr2=0x7f4b941ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b940c5f20 0x7f4b941ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 -- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b940c1290 msgr2=0x7f4b940ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b940c1290 0x7f4b940ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 -- 172.21.15.89:0/1614078212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c009a70 con 0x7f4b940c2ac0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b98fee640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 0x7f4b941ed360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c410 tx=0x7f4b8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b840074e0 con 0x7f4b940c2ac0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b84007640 con 0x7f4b940c2ac0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84004a30 con 0x7f4b940c2ac0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94150bb0 con 0x7f4b940c2ac0 2023-12-07T09:59:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.427+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b941f08d0 con 0x7f4b940c2ac0 2023-12-07T09:59:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.431+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9404e890 con 0x7f4b940c2ac0 2023-12-07T09:59:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.431+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4b84004b90 con 0x7f4b940c2ac0 2023-12-07T09:59:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.431+0000 7f4b89ffb640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b780668d0 0x7f4b78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.431+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b84084160 con 0x7f4b940c2ac0 2023-12-07T09:59:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.431+0000 7f4b997ef640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b780668d0 0x7f4b78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.431+0000 7f4b997ef640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b780668d0 0x7f4b78068d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b9414db10 tx=0x7f4b90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.435+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b84051440 con 0x7f4b940c2ac0 2023-12-07T09:59:18.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.591+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b940c8a90 con 0x7f4b940c2ac0 2023-12-07T09:59:18.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.591+0000 7f4b89ffb640 1 -- 172.21.15.89:0/1614078212 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4b84054a60 con 0x7f4b940c2ac0 2023-12-07T09:59:18.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:18.598 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b780668d0 msgr2=0x7f4b78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b780668d0 0x7f4b78068d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b9414db10 tx=0x7f4b90009040 comp rx=0 tx=0).stop 2023-12-07T09:59:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 msgr2=0x7f4b941ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 0x7f4b941ed360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c410 tx=0x7f4b8400c8d0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 shutdown_connections 2023-12-07T09:59:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b780668d0 0x7f4b78068d90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b940c5f20 0x7f4b941ed8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b940c2ac0 0x7f4b941ed360 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 --2- 172.21.15.89:0/1614078212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b940c1290 0x7f4b940ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 >> 172.21.15.89:0/1614078212 conn(0x7f4b940a9c10 msgr2=0x7f4b940c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 shutdown_connections 2023-12-07T09:59:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.595+0000 7f4b9ba53640 1 -- 172.21.15.89:0/1614078212 wait complete. 2023-12-07T09:59:18.619 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-07T09:59:18.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:18.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.747+0000 7fa34ecbb640 1 Processor -- start 2023-12-07T09:59:18.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 -- start start 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3480ca620 0x7fa3480caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480c4890 0x7fa3480c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3480bd5a0 0x7fa3480c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34806b7d0 con 0x7fa3480bd5a0 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa348155160 con 0x7fa3480ca620 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34ecbb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34806b180 con 0x7fa3480c4890 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3480bd5a0 0x7fa3480c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3480bd5a0 0x7fa3480c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45122/0 (socket says 172.21.15.89:45122) 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 -- 172.21.15.89:0/1832728271 learned_addr learned my addr 172.21.15.89:0/1832728271 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34dcb9640 1 --2- 172.21.15.89:0/1832728271 >> v2:172.21.15.97:3300/0 conn(0x7fa3480ca620 0x7fa3480caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34d4b8640 1 --2- 172.21.15.89:0/1832728271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480c4890 0x7fa3480c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 -- 172.21.15.89:0/1832728271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480c4890 msgr2=0x7fa3480c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 --2- 172.21.15.89:0/1832728271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480c4890 0x7fa3480c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 -- 172.21.15.89:0/1832728271 >> v2:172.21.15.97:3300/0 conn(0x7fa3480ca620 msgr2=0x7fa3480caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 --2- 172.21.15.89:0/1832728271 >> v2:172.21.15.97:3300/0 conn(0x7fa3480ca620 0x7fa3480caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.751+0000 7fa34e4ba640 1 -- 172.21.15.89:0/1832728271 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34806b460 con 0x7fa3480bd5a0 2023-12-07T09:59:18.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34e4ba640 1 --2- 172.21.15.89:0/1832728271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480bd5a0 0x7fa3480c8450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa3480ac950 tx=0x7fa34001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e310fb23576ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ccb7640 1 -- 172.21.15.89:0/1832728271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400a56c0 con 0x7fa3480bd5a0 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ccb7640 1 -- 172.21.15.89:0/1832728271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3400a5820 con 0x7fa3480bd5a0 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ccb7640 1 -- 172.21.15.89:0/1832728271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400a5bb0 con 0x7fa3480bd5a0 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 -- 172.21.15.89:0/1832728271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480bd5a0 msgr2=0x7fa3480c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/1832728271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480bd5a0 0x7fa3480c8450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa3480ac950 tx=0x7fa34001c8b0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 -- 172.21.15.89:0/1832728271 shutdown_connections 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/1832728271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480bd5a0 0x7fa3480c8450 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/1832728271 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480c4890 0x7fa3480c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/1832728271 >> v2:172.21.15.97:3300/0 conn(0x7fa3480ca620 0x7fa3480caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 -- 172.21.15.89:0/1832728271 >> 172.21.15.89:0/1832728271 conn(0x7fa3480ac0a0 msgr2=0x7fa3480c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 -- 172.21.15.89:0/1832728271 shutdown_connections 2023-12-07T09:59:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 -- 172.21.15.89:0/1832728271 wait complete. 2023-12-07T09:59:18.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 Processor -- start 2023-12-07T09:59:18.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.755+0000 7fa34ecbb640 1 -- start start 2023-12-07T09:59:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3480bd5a0 0x7fa34814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 0x7fa348146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480ca620 0x7fa3481467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481f08d0 con 0x7fa3480c4890 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480a9bf0 con 0x7fa3480bd5a0 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480a9910 con 0x7fa3480ca620 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 0x7fa348146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 0x7fa348146280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45138/0 (socket says 172.21.15.89:45138) 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 -- 172.21.15.89:0/415947245 learned_addr learned my addr 172.21.15.89:0/415947245 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34e4ba640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480ca620 0x7fa3481467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34dcb9640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3480bd5a0 0x7fa34814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 -- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480ca620 msgr2=0x7fa3481467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480ca620 0x7fa3481467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 -- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3480bd5a0 msgr2=0x7fa34814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3480bd5a0 0x7fa34814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 -- 172.21.15.89:0/415947245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340009b30 con 0x7fa3480c4890 2023-12-07T09:59:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34d4b8640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 0x7fa348146280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa33800d7d0 tx=0x7fa33800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3380096a0 con 0x7fa3480c4890 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa338009800 con 0x7fa3480c4890 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338009bb0 con 0x7fa3480c4890 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3481effa0 con 0x7fa3480c4890 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3481f0560 con 0x7fa3480c4890 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3481f0720 con 0x7fa3480c4890 2023-12-07T09:59:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.759+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa338009d10 con 0x7fa3480c4890 2023-12-07T09:59:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.763+0000 7fa33e7fc640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa32c0668d0 0x7fa32c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.763+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3380847c0 con 0x7fa3480c4890 2023-12-07T09:59:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.763+0000 7fa34dcb9640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa32c0668d0 0x7fa32c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.763+0000 7fa34dcb9640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa32c0668d0 0x7fa32c068d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa348157590 tx=0x7fa344008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:18.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.767+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa338051aa0 con 0x7fa3480c4890 2023-12-07T09:59:18.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.915+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa34804e890 con 0x7fa3480c4890 2023-12-07T09:59:18.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.915+0000 7fa33e7fc640 1 -- 172.21.15.89:0/415947245 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa3380550c0 con 0x7fa3480c4890 2023-12-07T09:59:18.923 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:18.923 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:18.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa32c0668d0 msgr2=0x7fa32c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa32c0668d0 0x7fa32c068d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa348157590 tx=0x7fa344008040 comp rx=0 tx=0).stop 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 msgr2=0x7fa348146280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 0x7fa348146280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa33800d7d0 tx=0x7fa33800dc90 comp rx=0 tx=0).stop 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 shutdown_connections 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa32c0668d0 0x7fa32c068d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa3480ca620 0x7fa3481467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3480c4890 0x7fa348146280 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 --2- 172.21.15.89:0/415947245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3480bd5a0 0x7fa34814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 >> 172.21.15.89:0/415947245 conn(0x7fa3480ac0a0 msgr2=0x7fa3480c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 shutdown_connections 2023-12-07T09:59:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:18.919+0000 7fa34ecbb640 1 -- 172.21.15.89:0/415947245 wait complete. 2023-12-07T09:59:18.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-07T09:59:18.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-07T09:59:18.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-07T09:59:18.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-07T09:59:18.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-07T09:59:18.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-07T09:59:18.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-07T09:59:18.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-07T09:59:19.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.179+0000 7fc6397f5640 1 Processor -- start 2023-12-07T09:59:19.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.179+0000 7fc6397f5640 1 -- start start 2023-12-07T09:59:19.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6397f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6340c1440 0x7fc63406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6397f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634071440 con 0x7fc63406c400 2023-12-07T09:59:19.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6397f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634151100 con 0x7fc63414dc50 2023-12-07T09:59:19.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6397f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc634071f90 con 0x7fc6340c1440 2023-12-07T09:59:19.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6337fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc63406c400 0x7fc63406ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34616/0 (socket says 172.21.15.89:34616) 2023-12-07T09:59:19.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6337fe640 1 -- 172.21.15.89:0/1495514777 learned_addr learned my addr 172.21.15.89:0/1495514777 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc631ffb640 1 -- 172.21.15.89:0/1495514777 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786582209 0 0) 0x7fc62c0014a0 con 0x7fc63406c400 2023-12-07T09:59:19.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc631ffb640 1 -- 172.21.15.89:0/1495514777 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c003530 con 0x7fc63406c400 2023-12-07T09:59:19.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6327fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6340c1440 0x7fc63406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc508580640 1 Processor -- start 2023-12-07T09:59:19.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc508580640 1 -- start start 2023-12-07T09:59:19.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc508580640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4f80dbcd0 0x7fc4f80de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc508580640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f80e2120 con 0x7fc4f804a940 2023-12-07T09:59:19.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc508580640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f80e2cc0 con 0x7fc4f8047f10 2023-12-07T09:59:19.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6327fc640 1 -- 172.21.15.89:0/1495514777 >> v1:172.21.15.97:6789/0 conn(0x7fc63414dc50 legacy=0x7fc6340c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6327fc640 1 -- 172.21.15.89:0/1495514777 >> v1:172.21.15.89:6789/0 conn(0x7fc63406c400 legacy=0x7fc63406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.183+0000 7fc6327fc640 1 -- 172.21.15.89:0/1495514777 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634151630 con 0x7fc6340c1440 2023-12-07T09:59:19.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc508580640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80e1df0 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7f7892b80640 1 Processor -- start 2023-12-07T09:59:19.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc505b1b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4f80dbcd0 0x7fc4f80de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc50531a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc4f8047f10 0x7fc4f80e25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:39162/0 (socket says 172.21.15.89:39162) 2023-12-07T09:59:19.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc50531a640 1 -- 172.21.15.89:0/2461042449 learned_addr learned my addr 172.21.15.89:0/2461042449 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116920663 0 0) 0x7fc4f80e2cc0 con 0x7fc4f8047f10 2023-12-07T09:59:19.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7f7892b80640 1 -- start start 2023-12-07T09:59:19.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ec003530 con 0x7fc4f8047f10 2023-12-07T09:59:19.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483618603 0 0) 0x7fc4f80e2120 con 0x7fc4f804a940 2023-12-07T09:59:19.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f80e2cc0 con 0x7fc4f804a940 2023-12-07T09:59:19.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc505b1b640 1 -- 172.21.15.89:0/2461042449 >> v1:172.21.15.97:6789/0 conn(0x7fc4f8047f10 legacy=0x7fc4f80e25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6327fc640 1 --2- 172.21.15.89:0/1495514777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6340c1440 0x7fc63406c950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc62400ba50 tx=0x7fc62401e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f70988f349ef07a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc505b1b640 1 -- 172.21.15.89:0/2461042449 >> v1:172.21.15.89:6789/0 conn(0x7fc4f804a940 legacy=0x7fc4f80070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.187+0000 7fc505b1b640 1 -- 172.21.15.89:0/2461042449 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f804aeb0 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f7892b80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f788c14dd70 0x7f788c0c0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc631ffb640 1 -- 172.21.15.89:0/1495514777 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240a7940 con 0x7fc6340c1440 2023-12-07T09:59:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc631ffb640 1 -- 172.21.15.89:0/1495514777 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6240ab070 con 0x7fc6340c1440 2023-12-07T09:59:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc631ffb640 1 -- 172.21.15.89:0/1495514777 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240a7cc0 con 0x7fc6340c1440 2023-12-07T09:59:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f7892b80640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c06dca0 con 0x7f788c0700d0 2023-12-07T09:59:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f7892b80640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c06e1d0 con 0x7f788c06c810 2023-12-07T09:59:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f789111d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f788c06c810 0x7f788c15aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:39172/0 (socket says 172.21.15.89:39172) 2023-12-07T09:59:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f789111d640 1 -- 172.21.15.89:0/4100551066 learned_addr learned my addr 172.21.15.89:0/4100551066 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f789091c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f788c14dd70 0x7f788c0c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 -- 172.21.15.89:0/1495514777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6340c1440 msgr2=0x7fc63406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 --2- 172.21.15.89:0/1495514777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6340c1440 0x7fc63406c950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc62400ba50 tx=0x7fc62401e890 comp rx=0 tx=0).stop 2023-12-07T09:59:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 -- 172.21.15.89:0/1495514777 shutdown_connections 2023-12-07T09:59:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 --2- 172.21.15.89:0/1495514777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6340c1440 0x7fc63406c950 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc62400ba50 tx=0x7fc62401e890 comp rx=0 tx=0).stop 2023-12-07T09:59:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 -- 172.21.15.89:0/1495514777 >> 172.21.15.89:0/1495514777 conn(0x7fc6340c5e10 msgr2=0x7fc6340c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f7892b80640 1 -- 172.21.15.89:0/4100551066 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c14e150 con 0x7f788c14dd70 2023-12-07T09:59:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f788b7fe640 1 -- 172.21.15.89:0/4100551066 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508767152 0 0) 0x7f788c06e1d0 con 0x7f788c06c810 2023-12-07T09:59:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f788b7fe640 1 -- 172.21.15.89:0/4100551066 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7874003530 con 0x7f788c06c810 2023-12-07T09:59:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f789091c640 1 -- 172.21.15.89:0/4100551066 >> v1:172.21.15.97:6789/0 conn(0x7f788c06c810 legacy=0x7f788c15aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f789091c640 1 -- 172.21.15.89:0/4100551066 >> v1:172.21.15.89:6789/0 conn(0x7f788c0700d0 legacy=0x7f788c153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7f789091c640 1 -- 172.21.15.89:0/4100551066 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c070ba0 con 0x7f788c14dd70 2023-12-07T09:59:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 -- 172.21.15.89:0/1495514777 shutdown_connections 2023-12-07T09:59:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fc6397f5640 1 -- 172.21.15.89:0/1495514777 wait complete. 2023-12-07T09:59:19.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.191+0000 7fe2d011d640 1 Processor -- start 2023-12-07T09:59:19.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2d011d640 1 -- start start 2023-12-07T09:59:19.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc505b1b640 1 --2- 172.21.15.89:0/2461042449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f80dbcd0 0x7fc4f80de760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0097c0 tx=0x7fc4fc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e6005bf4ad3cb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc6397f5640 1 Processor -- start 2023-12-07T09:59:19.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0ab610 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0ab770 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc50731e640 1 -- 172.21.15.89:0/2461042449 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0abb00 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc6397f5640 1 -- start start 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 -- 172.21.15.89:0/2461042449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f80dbcd0 msgr2=0x7fc4f80de760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 --2- 172.21.15.89:0/2461042449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f80dbcd0 0x7fc4f80de760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0097c0 tx=0x7fc4fc01c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 -- 172.21.15.89:0/2461042449 shutdown_connections 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 --2- 172.21.15.89:0/2461042449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f80dbcd0 0x7fc4f80de760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 -- 172.21.15.89:0/2461042449 >> 172.21.15.89:0/2461042449 conn(0x7fc4f8048400 msgr2=0x7fc4f8048810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2d011d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 0x7fe2c00dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2d011d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2c00e2d20 0x7fe2c00e5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2d011d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c000bad0 con 0x7fe2c00d7b30 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2d011d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c0046f00 con 0x7fe2c00e2d20 2023-12-07T09:59:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2d011d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00073e0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2cd6b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 0x7fe2c00dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2cd6b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 0x7fe2c00dbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:35966/0 (socket says 172.21.15.89:35966) 2023-12-07T09:59:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/932549343 learned_addr learned my addr 172.21.15.89:0/932549343 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 -- 172.21.15.89:0/2461042449 shutdown_connections 2023-12-07T09:59:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc6397f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc63406c400 0x7fc634141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fe2ce6ba640 1 --2- 172.21.15.89:0/932549343 >> v2:172.21.15.89:3300/0 conn(0x7fe2c00e2d20 0x7fe2c00e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fb02ffff640 1 Processor -- start 2023-12-07T09:59:19.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 -- start start 2023-12-07T09:59:19.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6397f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc63414dc50 0x7fc6340c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6397f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6341f4e80 0x7fc6340c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc63406c400 0x7fc634141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc63406c400 0x7fc634141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:35978/0 (socket says 172.21.15.89:35978) 2023-12-07T09:59:19.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.195+0000 7fc508580640 1 -- 172.21.15.89:0/2461042449 wait complete. 2023-12-07T09:59:19.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 -- 172.21.15.89:0/1408109978 learned_addr learned my addr 172.21.15.89:0/1408109978 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63414a340 con 0x7fc63414dc50 2023-12-07T09:59:19.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6337fe640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6341f4e80 0x7fc6340c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63414aef0 con 0x7fc6341f4e80 2023-12-07T09:59:19.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7f789091c640 1 --2- 172.21.15.89:0/4100551066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c14dd70 0x7f788c0c0810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a8c0 tx=0x7f787c01d480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=645ef8599c8d52d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6327fc640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc63414dc50 0x7fc6340c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341496c0 con 0x7fc63406c400 2023-12-07T09:59:19.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0300bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7f788b7fe640 1 -- 172.21.15.89:0/4100551066 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0ac670 con 0x7f788c14dd70 2023-12-07T09:59:19.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7f788b7fe640 1 -- 172.21.15.89:0/4100551066 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c0ac7d0 con 0x7f788c14dd70 2023-12-07T09:59:19.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7f788b7fe640 1 -- 172.21.15.89:0/4100551066 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0acb60 con 0x7f788c14dd70 2023-12-07T09:59:19.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb030072350 0x7fb030151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb030158690 0x7fb03006c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb030158bc0 con 0x7fb030072350 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb030071590 con 0x7fb030158690 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02ffff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb030071870 con 0x7fb03006dac0 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb030072350 0x7fb030151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0300bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0300bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:35994/0 (socket says 172.21.15.89:35994) 2023-12-07T09:59:19.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fb02effd640 1 -- 172.21.15.89:0/2901387021 learned_addr learned my addr 172.21.15.89:0/2901387021 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 -- 172.21.15.89:0/1408109978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6341f4e80 msgr2=0x7fc6340c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6341f4e80 0x7fc6340c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 -- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc63414dc50 msgr2=0x7fc6340c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc63414dc50 0x7fc6340c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62400b6b0 con 0x7fc63406c400 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc632ffd640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc63406c400 0x7fc634141890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc62800c3f0 tx=0x7fc62800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc508580640 1 Processor -- start 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280052d0 con 0x7fc63406c400 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc628005430 con 0x7fc63406c400 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628003840 con 0x7fc63406c400 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7f7892b80640 1 -- 172.21.15.89:0/4100551066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c14dd70 msgr2=0x7f788c0c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7f7892b80640 1 --2- 172.21.15.89:0/4100551066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c14dd70 0x7f788c0c0810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a8c0 tx=0x7f787c01d480 comp rx=0 tx=0).stop 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/932549343 >> v2:172.21.15.89:3300/0 conn(0x7fe2c00e2d20 msgr2=0x7fe2c00e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fe2cd6b8640 1 --2- 172.21.15.89:0/932549343 >> v2:172.21.15.89:3300/0 conn(0x7fe2c00e2d20 0x7fe2c00e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/932549343 >> v1:172.21.15.89:6789/0 conn(0x7fe2c00d7b30 legacy=0x7fe2c0046130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/932549343 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0007100 con 0x7fe2c00db8a0 2023-12-07T09:59:19.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.199+0000 7fc508580640 1 -- start start 2023-12-07T09:59:19.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6341499a0 con 0x7fc63406c400 2023-12-07T09:59:19.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fb02e7fc640 1 -- 172.21.15.89:0/2901387021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 msgr2=0x7fb0300bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fb02e7fc640 1 --2- 172.21.15.89:0/2901387021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0300bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fb02e7fc640 1 -- 172.21.15.89:0/2901387021 >> v2:172.21.15.97:3300/0 conn(0x7fb030158690 msgr2=0x7fb03006c410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T09:59:19.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fb02e7fc640 1 --2- 172.21.15.89:0/2901387021 >> v2:172.21.15.97:3300/0 conn(0x7fb030158690 0x7fb03006c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fb02e7fc640 1 -- 172.21.15.89:0/2901387021 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030071b50 con 0x7fb030072350 2023-12-07T09:59:19.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc634149f60 con 0x7fc63406c400 2023-12-07T09:59:19.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc508580640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f8047f10 0x7fc4f80e1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc508580640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f804a940 0x7fc4f8177480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc508580640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4f80dbcd0 0x7fc4f81779c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc508580640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8043030 con 0x7fc4f804a940 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc508580640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80d4f30 con 0x7fc4f8047f10 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc508580640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80de800 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f7892b80640 1 -- 172.21.15.89:0/4100551066 shutdown_connections 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f7892b80640 1 --2- 172.21.15.89:0/4100551066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c14dd70 0x7f788c0c0810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f7892b80640 1 -- 172.21.15.89:0/4100551066 >> 172.21.15.89:0/4100551066 conn(0x7f788c06af50 msgr2=0x7f788c0c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f7892b80640 1 -- 172.21.15.89:0/4100551066 shutdown_connections 2023-12-07T09:59:19.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc63406e2a0 con 0x7fc63406c400 2023-12-07T09:59:19.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4f80dbcd0 0x7fc4f81779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4f80dbcd0 0x7fc4f81779c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:36004/0 (socket says 172.21.15.89:36004) 2023-12-07T09:59:19.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 -- 172.21.15.89:0/2316419101 learned_addr learned my addr 172.21.15.89:0/2316419101 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50531a640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f804a940 0x7fc4f8177480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 -- 172.21.15.89:0/2316419101 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f8047f10 msgr2=0x7fc4f80e1490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T09:59:19.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f7892b80640 1 -- 172.21.15.89:0/4100551066 wait complete. 2023-12-07T09:59:19.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fe2cd6b8640 1 --2- 172.21.15.89:0/932549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 0x7fe2c00dbd00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009870 tx=0x7fe2b801c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b81ea10365421f90 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f9e4325a640 1 Processor -- start 2023-12-07T09:59:19.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f8047f10 0x7fc4f80e1490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 -- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f804a940 msgr2=0x7fc4f8177480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f804a940 0x7fc4f8177480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50631c640 1 -- 172.21.15.89:0/2316419101 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc009420 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc50531a640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f804a940 0x7fc4f8177480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:19.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fe2cceb7640 1 -- 172.21.15.89:0/932549343 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a5710 con 0x7fe2c00db8a0 2023-12-07T09:59:19.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7f9e4325a640 1 -- start start 2023-12-07T09:59:19.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 Processor -- start 2023-12-07T09:59:19.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2cceb7640 1 -- 172.21.15.89:0/932549343 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b80a5870 con 0x7fe2c00db8a0 2023-12-07T09:59:19.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2cceb7640 1 -- 172.21.15.89:0/932549343 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a5710 con 0x7fe2c00db8a0 2023-12-07T09:59:19.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.203+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc6280039a0 con 0x7fc63406c400 2023-12-07T09:59:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc50631c640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4f80dbcd0 0x7fc4f81779c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc500062190 tx=0x7fc500068000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500092400 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500092580 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500092970 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 -- start start 2023-12-07T09:59:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc508580640 1 -- 172.21.15.89:0/2316419101 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f80d5460 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc61b7fe640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc6200669a0 0x7fc620068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 -- 172.21.15.89:0/932549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 msgr2=0x7fe2c00dbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 --2- 172.21.15.89:0/932549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 0x7fe2c00dbd00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009870 tx=0x7fe2b801c040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc6327fc640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc6200669a0 0x7fc620068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc628083a40 con 0x7fc63406c400 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc61b7fe640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7fc62006ebc0 0x7fc620070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc620071690 con 0x7fc62006ebc0 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6280882a0 con 0x7fc63406c400 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc6327fc640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc6200669a0 0x7fc620068e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6240b2000 tx=0x7fc6240a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc6337fe640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7fc62006ebc0 0x7fc620070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc508580640 1 -- 172.21.15.89:0/2316419101 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f80d5180 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4f800bb00 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c06c810 0x7f788c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f788c0700d0 0x7f788c1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14dd70 0x7f788c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f789091c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c06c810 0x7f788c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f788c0700d0 0x7f788c1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f789091c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c06c810 0x7f788c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:60120/0 (socket says 172.21.15.89:60120) 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f789091c640 1 -- 172.21.15.89:0/194257982 learned_addr learned my addr 172.21.15.89:0/194257982 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c1f3490 con 0x7f788c14dd70 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c1f2e80 con 0x7f788c06c810 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c143e20 con 0x7f788c0700d0 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f789111d640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14dd70 0x7f788c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 -- 172.21.15.89:0/194257982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c06c810 msgr2=0x7f788c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f788c06c810 0x7f788c152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 -- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14dd70 msgr2=0x7f788c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14dd70 0x7f788c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c00a520 con 0x7f788c0700d0 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f789111d640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14dd70 0x7f788c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f788bfff640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f788c0700d0 0x7f788c1435d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f788400c730 tx=0x7f788400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 -- 172.21.15.89:0/932549343 shutdown_connections 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 --2- 172.21.15.89:0/932549343 >> v2:172.21.15.89:3300/0 conn(0x7fe2c00e2d20 0x7fe2c00e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 --2- 172.21.15.89:0/932549343 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00db8a0 0x7fe2c00dbd00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 -- 172.21.15.89:0/932549343 >> 172.21.15.89:0/932549343 conn(0x7fe2c0005ec0 msgr2=0x7fe2c00062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 -- 172.21.15.89:0/932549343 shutdown_connections 2023-12-07T09:59:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fe2d011d640 1 -- 172.21.15.89:0/932549343 wait complete. 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fb02e7fc640 1 --2- 172.21.15.89:0/2901387021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 0x7fb030151ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb03006e300 tx=0x7fb02401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0514a29f07bc76 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e4325a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e3c06db80 0x7f9e3c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e4325a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e3c06d100 0x7f9e3c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e3c06db80 0x7f9e3c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e3c06db80 0x7f9e3c06c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:60112/0 (socket says 172.21.15.89:60112) 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 -- 172.21.15.89:0/1119922254 learned_addr learned my addr 172.21.15.89:0/1119922254 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e417f7640 1 --2- 172.21.15.89:0/1119922254 >> v2:172.21.15.89:3300/0 conn(0x7f9e3c06d100 0x7f9e3c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c06bea0 con 0x7f9e3c152ce0 2023-12-07T09:59:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c159b10 con 0x7f9e3c06d100 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c159550 con 0x7f9e3c06db80 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 -- 172.21.15.89:0/1119922254 >> v2:172.21.15.89:3300/0 conn(0x7f9e3c06d100 msgr2=0x7f9e3c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 --2- 172.21.15.89:0/1119922254 >> v2:172.21.15.89:3300/0 conn(0x7f9e3c06d100 0x7f9e3c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 -- 172.21.15.89:0/1119922254 >> v1:172.21.15.89:6789/0 conn(0x7f9e3c152ce0 legacy=0x7f9e3c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7f9e33fff640 1 -- 172.21.15.89:0/1119922254 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c159830 con 0x7f9e3c06db80 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc6337fe640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7fc62006ebc0 0x7fc620070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fb02dffb640 1 -- 172.21.15.89:0/2901387021 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240ac640 con 0x7fb030072350 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fb02dffb640 1 -- 172.21.15.89:0/2901387021 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0240ac7a0 con 0x7fb030072350 2023-12-07T09:59:19.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.207+0000 7fb02dffb640 1 -- 172.21.15.89:0/2901387021 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240acb30 con 0x7fb030072350 2023-12-07T09:59:19.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884006d60 con 0x7f788c0700d0 2023-12-07T09:59:19.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 -- 172.21.15.89:0/2901387021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 msgr2=0x7fb030151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2901387021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 0x7fb030151ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb03006e300 tx=0x7fb02401c330 comp rx=0 tx=0).stop 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400ce40 con 0x7f788c0700d0 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884003bc0 con 0x7f788c0700d0 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c1f3120 con 0x7f788c0700d0 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c1534e0 con 0x7f788c0700d0 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f788c0c0d50 con 0x7f788c0700d0 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== osd.0 v2:172.21.15.89:6800/1485321757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc620071690 con 0x7fc62006ebc0 2023-12-07T09:59:19.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc500092ad0 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fe2d011d640 1 Processor -- start 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 -- 172.21.15.89:0/2901387021 shutdown_connections 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2901387021 >> v2:172.21.15.97:3300/0 conn(0x7fb030158690 0x7fb03006c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2901387021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 0x7fb030151ba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2901387021 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0300bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 -- 172.21.15.89:0/2901387021 >> 172.21.15.89:0/2901387021 conn(0x7fb0300c5ef0 msgr2=0x7fb0300c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 -- 172.21.15.89:0/2901387021 shutdown_connections 2023-12-07T09:59:19.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f3777172640 1 Processor -- start 2023-12-07T09:59:19.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc4f6ffd640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4e40669a0 0x7fc4e4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fb02ffff640 1 -- 172.21.15.89:0/2901387021 wait complete. 2023-12-07T09:59:19.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fe2d011d640 1 -- start start 2023-12-07T09:59:19.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5000fe0a0 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc4f6ffd640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7fc4e406ebc0 0x7fc4e4070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc505b1b640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4e40669a0 0x7fc4e4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 --> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4e4071690 con 0x7fc4e406ebc0 2023-12-07T09:59:19.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5001006c0 con 0x7fc4f80dbcd0 2023-12-07T09:59:19.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f8a8f679640 1 Processor -- start 2023-12-07T09:59:19.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.211+0000 7f3777172640 1 -- start start 2023-12-07T09:59:19.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8f679640 1 -- start start 2023-12-07T09:59:19.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7884003d20 con 0x7f788c0700d0 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fc50531a640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7fc4e406ebc0 0x7fc4e4070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fc505b1b640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4e40669a0 0x7fc4e4068e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0af000 tx=0x7fc4fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fc50531a640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7fc4e406ebc0 0x7fc4e4070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f9e33fff640 1 --2- 172.21.15.89:0/1119922254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c06db80 0x7f9e3c06c940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0c7090 tx=0x7f9e2c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4663971fcf201c67 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8f679640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a880ca610 0x7f8a880c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8f679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 0x7f8a880c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8f679640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a88155790 con 0x7f8a8806cd90 2023-12-07T09:59:19.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8f679640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a880c4b00 con 0x7f8a880ca610 2023-12-07T09:59:19.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8f679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a880c4de0 con 0x7f8a880bd720 2023-12-07T09:59:19.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fb02ffff640 1 Processor -- start 2023-12-07T09:59:19.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f3777172640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37700ca610 0x7f37700c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fb02ffff640 1 -- start start 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f3777172640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37700bd720 0x7f37700c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f78897fa640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f78780669d0 0x7f7878068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7884083ea0 con 0x7f788c0700d0 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2d011d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c00d7b30 0x7fe2c00dd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2d011d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2c00db8a0 0x7fe2c00cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2d011d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00e2d20 0x7fe2c00cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2d011d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00de150 con 0x7fe2c00d7b30 2023-12-07T09:59:19.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2d011d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00d5360 con 0x7fe2c00db8a0 2023-12-07T09:59:19.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2d011d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00e3e10 con 0x7fe2c00e2d20 2023-12-07T09:59:19.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8d415640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a880ca610 0x7f8a880c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8cc14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 0x7f8a880c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f78897fa640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f787806ebf0 0x7f7878071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78780716c0 con 0x7f787806ebf0 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7884089490 con 0x7f788c0700d0 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2cd6b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2c00db8a0 0x7fe2c00cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2cd6b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2c00db8a0 0x7fe2c00cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:60164/0 (socket says 172.21.15.89:60164) 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/433377326 learned_addr learned my addr 172.21.15.89:0/433377326 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8cc14640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 0x7f8a880c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:36024/0 (socket says 172.21.15.89:36024) 2023-12-07T09:59:19.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f8a8cc14640 1 -- 172.21.15.89:0/4285116305 learned_addr learned my addr 172.21.15.89:0/4285116305 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f3777172640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3770155790 con 0x7f377006cd90 2023-12-07T09:59:19.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f3777172640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700c4b00 con 0x7f37700ca610 2023-12-07T09:59:19.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f3777172640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700c4de0 con 0x7f37700bd720 2023-12-07T09:59:19.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f376ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37700bd720 0x7f37700c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.215+0000 7f789091c640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f78780669d0 0x7f7878068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0301fb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e337fe640 1 -- 172.21.15.89:0/1119922254 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0a7070 con 0x7f9e3c06db80 2023-12-07T09:59:19.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e337fe640 1 -- 172.21.15.89:0/1119922254 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0ab430 con 0x7f9e3c06db80 2023-12-07T09:59:19.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e337fe640 1 -- 172.21.15.89:0/1119922254 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0ab7c0 con 0x7f9e3c06db80 2023-12-07T09:59:19.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== osd.1 v2:172.21.15.89:6822/1573279697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc4e4071690 con 0x7fc4e406ebc0 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f376ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37700bd720 0x7f37700c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:60152/0 (socket says 172.21.15.89:60152) 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f376ffff640 1 -- 172.21.15.89:0/975364447 learned_addr learned my addr 172.21.15.89:0/975364447 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/433377326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00e2d20 msgr2=0x7fe2c00cdf20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2cd6b8640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2c00e2d20 0x7fe2c00cdf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c00d7b30 msgr2=0x7fe2c00dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2cd6b8640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c00d7b30 0x7fe2c00dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2cd6b8640 1 -- 172.21.15.89:0/433377326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80094d0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2cd6b8640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2c00db8a0 0x7fe2c00cd9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80af040 tx=0x7fe2b8019150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f789111d640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f787806ebf0 0x7f7878071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f8a8cc14640 1 -- 172.21.15.89:0/4285116305 >> v2:172.21.15.97:3300/0 conn(0x7f8a880ca610 msgr2=0x7f8a880c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8004240 con 0x7fe2c00db8a0 2023-12-07T09:59:19.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b80043e0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8003860 con 0x7fe2c00db8a0 2023-12-07T09:59:19.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00ce460 con 0x7fe2c00db8a0 2023-12-07T09:59:19.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c01742d0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c06db80 msgr2=0x7f9e3c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 --2- 172.21.15.89:0/1119922254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c06db80 0x7f9e3c06c940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0c7090 tx=0x7f9e2c01c430 comp rx=0 tx=0).stop 2023-12-07T09:59:19.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f8a8cc14640 1 --2- 172.21.15.89:0/4285116305 >> v2:172.21.15.97:3300/0 conn(0x7f8a880ca610 0x7f8a880c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f3774f0e640 1 --2- 172.21.15.89:0/975364447 >> v2:172.21.15.89:3300/0 conn(0x7f37700ca610 0x7f37700c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 0x7fb030157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb030158690 0x7fb0300a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f789111d640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f787806ebf0 0x7f7878071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0301fb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0301fb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:36048/0 (socket says 172.21.15.89:36048) 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 -- 172.21.15.89:0/2752130655 learned_addr learned my addr 172.21.15.89:0/2752130655 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300aa8f0 con 0x7fb030072350 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300aab90 con 0x7fb030158690 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300a9560 con 0x7fb03006dac0 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2c0045ac0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02f7fe640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb030158690 0x7fb0300a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 -- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb030158690 msgr2=0x7fb0300a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb030158690 0x7fb0300a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 -- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 msgr2=0x7fb030157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb030072350 0x7fb030157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb024009420 con 0x7fb03006dac0 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02f7fe640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb030158690 0x7fb0300a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f3774f0e640 1 -- 172.21.15.89:0/975364447 >> v2:172.21.15.97:3300/0 conn(0x7f37700bd720 msgr2=0x7f37700c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f3774f0e640 1 --2- 172.21.15.89:0/975364447 >> v2:172.21.15.97:3300/0 conn(0x7f37700bd720 0x7f37700c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f3774f0e640 1 -- 172.21.15.89:0/975364447 >> v1:172.21.15.89:6789/0 conn(0x7f377006cd90 legacy=0x7f3770158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f3774f0e640 1 -- 172.21.15.89:0/975364447 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770157e30 con 0x7f37700ca610 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 shutdown_connections 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 --2- 172.21.15.89:0/1119922254 >> v2:172.21.15.89:3300/0 conn(0x7f9e3c06d100 0x7f9e3c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 --2- 172.21.15.89:0/1119922254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c06db80 0x7f9e3c06c940 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 >> 172.21.15.89:0/1119922254 conn(0x7f9e3c0c2ad0 msgr2=0x7f9e3c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7fb02effd640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0301fb0d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb02000e7e0 tx=0x7fb02000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 shutdown_connections 2023-12-07T09:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f9e4325a640 1 -- 172.21.15.89:0/1119922254 wait complete. 2023-12-07T09:59:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== osd.2 v2:172.21.15.89:6816/746240021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f78780716c0 con 0x7f787806ebf0 2023-12-07T09:59:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000c8d0 con 0x7fb03006dac0 2023-12-07T09:59:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f8a8cc14640 1 -- 172.21.15.89:0/4285116305 >> v1:172.21.15.89:6789/0 conn(0x7f8a8806cd90 legacy=0x7f8a88158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.219+0000 7f8a8cc14640 1 -- 172.21.15.89:0/4285116305 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a88157e30 con 0x7f8a880bd720 2023-12-07T09:59:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7f8a8d415640 1 --2- 172.21.15.89:0/4285116305 >> v2:172.21.15.97:3300/0 conn(0x7f8a880ca610 0x7f8a880c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7f789091c640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f78780669d0 0x7f7878068e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a8c0 tx=0x7f787c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2b80039c0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000ee90 con 0x7fb03006dac0 2023-12-07T09:59:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300a9840 con 0x7fb03006dac0 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2be7fc640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ac0668d0 0x7fe2ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2b80a9070 con 0x7fe2c00db8a0 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2be7fc640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7fe2ac06eaf0 0x7fe2ac070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 --> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2ac0715c0 con 0x7fe2ac06eaf0 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b81206e0 con 0x7fe2c00db8a0 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2cdeb9640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ac0668d0 0x7fe2ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fe2ce6ba640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7fe2ac06eaf0 0x7fe2ac070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb030157970 con 0x7fb03006dac0 2023-12-07T09:59:19.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000cc70 con 0x7fb03006dac0 2023-12-07T09:59:19.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb010000fd0 con 0x7fb03006dac0 2023-12-07T09:59:19.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.223+0000 7f9e4325a640 1 Processor -- start 2023-12-07T09:59:19.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f9e4325a640 1 -- start start 2023-12-07T09:59:19.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3774f0e640 1 --2- 172.21.15.89:0/975364447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 0x7f37700c94c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37700ca380 tx=0x7f376401bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8a0d6b24c9b8c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fe2cdeb9640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ac0668d0 0x7fe2ac068d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8050230 tx=0x7fe2c80690f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f376f7fe640 1 -- 172.21.15.89:0/975364447 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700c52d0 con 0x7f37700ca610 2023-12-07T09:59:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f376f7fe640 1 -- 172.21.15.89:0/975364447 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37640a4820 con 0x7f37700ca610 2023-12-07T09:59:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f376f7fe640 1 -- 172.21.15.89:0/975364447 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640a4bb0 con 0x7f37700ca610 2023-12-07T09:59:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb020026480 con 0x7fb03006dac0 2023-12-07T09:59:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 -- 172.21.15.89:0/975364447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 msgr2=0x7f37700c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 --2- 172.21.15.89:0/975364447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 0x7f37700c94c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37700ca380 tx=0x7f376401bfe0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb0177fe640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb01c0669d0 0x7fb01c068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb020084590 con 0x7fb03006dac0 2023-12-07T09:59:19.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fe2ce6ba640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7fe2ac06eaf0 0x7fe2ac070f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb0177fe640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fb01c06ebf0 0x7fb01c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb02e7fc640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb01c0669d0 0x7fb01c068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb01c0716c0 con 0x7fb01c06ebf0 2023-12-07T09:59:19.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb020084940 con 0x7fb03006dac0 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 -- 172.21.15.89:0/975364447 shutdown_connections 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 --2- 172.21.15.89:0/975364447 >> v2:172.21.15.97:3300/0 conn(0x7f37700bd720 0x7f37700c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 --2- 172.21.15.89:0/975364447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 0x7f37700c94c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 -- 172.21.15.89:0/975364447 >> 172.21.15.89:0/975364447 conn(0x7f3770071ea0 msgr2=0x7f37700722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7fb02e7fc640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb01c0669d0 0x7fb01c068e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0240ae000 tx=0x7fb0240046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f9e4325a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e3c06d100 0x7f9e3c1f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f9e4325a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e3c06db80 0x7f9e3c14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c152ce0 0x7f9e3c145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c146e60 con 0x7f9e3c06db80 2023-12-07T09:59:19.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0c3d80 con 0x7f9e3c152ce0 2023-12-07T09:59:19.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1f22d0 con 0x7f9e3c06d100 2023-12-07T09:59:19.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8cc14640 1 --2- 172.21.15.89:0/4285116305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 0x7f8a880c9a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009870 tx=0x7f8a7801c120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c18c988ee4d13ba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e40ff6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e3c06d100 0x7f9e3c1f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 -- 172.21.15.89:0/975364447 shutdown_connections 2023-12-07T09:59:19.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.227+0000 7f3777172640 1 -- 172.21.15.89:0/975364447 wait complete. 2023-12-07T09:59:19.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e40ff6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e3c06d100 0x7f9e3c1f1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:36060/0 (socket says 172.21.15.89:36060) 2023-12-07T09:59:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e40ff6640 1 -- 172.21.15.89:0/2171115890 learned_addr learned my addr 172.21.15.89:0/2171115890 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c152ce0 0x7f9e3c145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a7ffff640 1 -- 172.21.15.89:0/4285116305 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a880c52d0 con 0x7f8a880bd720 2023-12-07T09:59:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a7ffff640 1 -- 172.21.15.89:0/4285116305 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a780a4940 con 0x7f8a880bd720 2023-12-07T09:59:19.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a7ffff640 1 -- 172.21.15.89:0/4285116305 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a780a4cd0 con 0x7f8a880bd720 2023-12-07T09:59:19.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7fb02f7fe640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fb01c06ebf0 0x7fb01c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e33fff640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e3c06db80 0x7f9e3c14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 -- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e3c06d100 msgr2=0x7f9e3c1f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e3c06d100 0x7f9e3c1f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 -- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e3c06db80 msgr2=0x7f9e3c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e3c06db80 0x7f9e3c14b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 -- 172.21.15.89:0/2171115890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0094d0 con 0x7f9e3c152ce0 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e417f7640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c152ce0 0x7f9e3c145b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400efc0 tx=0x7f9e3400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== osd.3 v2:172.21.15.89:6808/2109259736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe2ac0715c0 con 0x7fe2ac06eaf0 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 -- 172.21.15.89:0/4285116305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 msgr2=0x7f8a880c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 --2- 172.21.15.89:0/4285116305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 0x7f8a880c9a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009870 tx=0x7f8a7801c120 comp rx=0 tx=0).stop 2023-12-07T09:59:19.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f3777172640 1 Processor -- start 2023-12-07T09:59:19.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34009e60 con 0x7f9e3c152ce0 2023-12-07T09:59:19.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400f040 con 0x7f9e3c152ce0 2023-12-07T09:59:19.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340146a0 con 0x7f9e3c152ce0 2023-12-07T09:59:19.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c146900 con 0x7f9e3c152ce0 2023-12-07T09:59:19.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c1f1d10 con 0x7f9e3c152ce0 2023-12-07T09:59:19.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 -- 172.21.15.89:0/4285116305 shutdown_connections 2023-12-07T09:59:19.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 --2- 172.21.15.89:0/4285116305 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a880bd720 0x7f8a880c9a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 --2- 172.21.15.89:0/4285116305 >> v2:172.21.15.97:3300/0 conn(0x7f8a880ca610 0x7f8a880c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 -- 172.21.15.89:0/4285116305 >> 172.21.15.89:0/4285116305 conn(0x7f8a88071ea0 msgr2=0x7f8a880722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 -- 172.21.15.89:0/4285116305 shutdown_connections 2023-12-07T09:59:19.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e3c04e890 con 0x7f9e3c152ce0 2023-12-07T09:59:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f3777172640 1 -- start start 2023-12-07T09:59:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7fb02f7fe640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fb01c06ebf0 0x7fb01c071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.231+0000 7f8a8f679640 1 -- 172.21.15.89:0/4285116305 wait complete. 2023-12-07T09:59:19.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== osd.4 v2:172.21.15.97:6816/811237390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb01c0716c0 con 0x7fb01c06ebf0 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e34014800 con 0x7f9e3c152ce0 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f377006cd90 0x7f37700ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37700bd720 0x7f37700ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 0x7f3770155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37701f2a40 con 0x7f37700ca610 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37701ee550 con 0x7f377006cd90 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37701ef520 con 0x7f37700bd720 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f377006cd90 0x7f37700ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f377006cd90 0x7f37700ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:60180/0 (socket says 172.21.15.89:60180) 2023-12-07T09:59:19.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 -- 172.21.15.89:0/1405615878 learned_addr learned my addr 172.21.15.89:0/1405615878 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f377570f640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 0x7f3770155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f376ffff640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37700bd720 0x7f37700ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 -- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37700bd720 msgr2=0x7f37700ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37700bd720 0x7f37700ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 -- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 msgr2=0x7f3770155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37700ca610 0x7f3770155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 -- 172.21.15.89:0/1405615878 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009420 con 0x7f377006cd90 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3774f0e640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f377006cd90 0x7f37700ac0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37640af040 tx=0x7f37640190a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 --> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc63415e830 con 0x7fc62006ebc0 2023-12-07T09:59:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640ac850 con 0x7f377006cd90 2023-12-07T09:59:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37640ac9d0 con 0x7f377006cd90 2023-12-07T09:59:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640acd80 con 0x7f377006cd90 2023-12-07T09:59:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37701ef090 con 0x7f377006cd90 2023-12-07T09:59:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37701eea40 con 0x7f377006cd90 2023-12-07T09:59:19.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc61b7fe640 1 -- 172.21.15.89:0/1408109978 <== osd.0 v2:172.21.15.89:6800/1485321757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc62c0018f0 con 0x7fc62006ebc0 2023-12-07T09:59:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f9e317fa640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e280669a0 0x7f9e28068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.235+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e34085220 con 0x7f9e3c152ce0 2023-12-07T09:59:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e317fa640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7f9e2806ebc0 0x7f9e28070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 --> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e28071690 con 0x7f9e2806ebc0 2023-12-07T09:59:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e34087840 con 0x7f9e3c152ce0 2023-12-07T09:59:19.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7fc62006ebc0 msgr2=0x7fc620070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7fc62006ebc0 0x7fc620070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e40ff6640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e280669a0 0x7f9e28068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e33fff640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7f9e2806ebc0 0x7f9e28070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f8a8f679640 1 Processor -- start 2023-12-07T09:59:19.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc6200669a0 msgr2=0x7fc620068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e40ff6640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e280669a0 0x7f9e28068e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e380099b0 tx=0x7f9e38009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37640b3040 con 0x7f377006cd90 2023-12-07T09:59:19.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc6200669a0 0x7fc620068e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6240b2000 tx=0x7fc6240a9070 comp rx=0 tx=0).stop 2023-12-07T09:59:19.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc63406c400 msgr2=0x7fc634141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 --2- 172.21.15.89:0/1408109978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc63406c400 0x7fc634141890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc62800c3f0 tx=0x7fc62800c8b0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6337fe640 1 -- 172.21.15.89:0/1408109978 reap_dead start 2023-12-07T09:59:19.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f9e33fff640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7f9e2806ebc0 0x7f9e28070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3750000fd0 con 0x7f377006cd90 2023-12-07T09:59:19.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 shutdown_connections 2023-12-07T09:59:19.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 >> 172.21.15.89:0/1408109978 conn(0x7fc6340c5e10 msgr2=0x7fc63406c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.239+0000 7f8a8f679640 1 -- start start 2023-12-07T09:59:19.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 shutdown_connections 2023-12-07T09:59:19.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7fc6397f5640 1 -- 172.21.15.89:0/1408109978 wait complete. 2023-12-07T09:59:19.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== osd.5 v2:172.21.15.97:6802/3253961744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9e28071690 con 0x7f9e2806ebc0 2023-12-07T09:59:19.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376d7fa640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3754066950 0x7f3754068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37700cac00 con 0x7f377006cd90 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8f679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a8806cd90 0x7f8a8814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8f679640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a880bd720 0x7f8a88151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8f679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a880ca610 0x7f8a8814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8f679640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a880aac30 con 0x7f8a880bd720 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8f679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a880aaf10 con 0x7f8a880ca610 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8f679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8814a250 con 0x7f8a8806cd90 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a880ca610 0x7f8a8814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8d415640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a8806cd90 0x7f8a8814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8d415640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a8806cd90 0x7f8a8814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:36066/0 (socket says 172.21.15.89:36066) 2023-12-07T09:59:19.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a880ca610 0x7f8a8814c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:60194/0 (socket says 172.21.15.89:60194) 2023-12-07T09:59:19.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8d415640 1 -- 172.21.15.89:0/2037179103 learned_addr learned my addr 172.21.15.89:0/2037179103 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376ffff640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3754066950 0x7f3754068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376d7fa640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f375406eb70 0x7f3754070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 --> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3754071640 con 0x7f375406eb70 2023-12-07T09:59:19.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37641222c0 con 0x7f377006cd90 2023-12-07T09:59:19.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8cc14640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a880bd720 0x7f8a88151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 -- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a8806cd90 msgr2=0x7f8a8814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a8806cd90 0x7f8a8814aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 -- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a880bd720 msgr2=0x7f8a88151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a880bd720 0x7f8a88151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f8a8dc16640 1 -- 172.21.15.89:0/2037179103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84009420 con 0x7f8a880ca610 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f377570f640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f375406eb70 0x7f3754070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f376ffff640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3754066950 0x7f3754068e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3770155e70 tx=0x7f375c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.243+0000 7f377570f640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f375406eb70 0x7f3754070f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f8a8dc16640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a880ca610 0x7f8a8814c410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8a880c5d50 tx=0x7f8a8000cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80003b80 con 0x7f8a880ca610 2023-12-07T09:59:19.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a780094d0 con 0x7f8a880ca610 2023-12-07T09:59:19.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a80003ce0 con 0x7f8a880ca610 2023-12-07T09:59:19.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 --> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f788c1f3600 con 0x7f787806ebf0 2023-12-07T09:59:19.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a88151f50 con 0x7f8a880ca610 2023-12-07T09:59:19.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80005310 con 0x7f8a880ca610 2023-12-07T09:59:19.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f78897fa640 1 -- 172.21.15.89:0/194257982 <== osd.2 v2:172.21.15.89:6816/746240021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f788c1f3600 con 0x7f787806ebf0 2023-12-07T09:59:19.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f787806ebf0 msgr2=0x7f7878071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f787806ebf0 0x7f7878071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f78780669d0 msgr2=0x7f7878068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f78780669d0 0x7f7878068e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a8c0 tx=0x7f787c009040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f788c0700d0 msgr2=0x7f788c1435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f7892b80640 1 --2- 172.21.15.89:0/194257982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f788c0700d0 0x7f788c1435d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f788400c730 tx=0x7f788400cbf0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f789111d640 1 -- 172.21.15.89:0/194257982 reap_dead start 2023-12-07T09:59:19.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 shutdown_connections 2023-12-07T09:59:19.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 >> 172.21.15.89:0/194257982 conn(0x7f788c06af50 msgr2=0x7f788c0c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.247+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== osd.7 v2:172.21.15.97:6800/1479824909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3754071640 con 0x7f375406eb70 2023-12-07T09:59:19.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 shutdown_connections 2023-12-07T09:59:19.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f7892b80640 1 -- 172.21.15.89:0/194257982 wait complete. 2023-12-07T09:59:19.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a880c9c00 con 0x7f8a880ca610 2023-12-07T09:59:19.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a8000a5e0 con 0x7f8a880ca610 2023-12-07T09:59:19.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 --> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4f8005470 con 0x7fc4e406ebc0 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a7dffb640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a6c0669a0 0x7f8a6c068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a8d415640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a6c0669a0 0x7f8a6c068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a80084380 con 0x7f8a880ca610 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a7dffb640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f8a6c06ebc0 0x7f8a6c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 --> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a6c071690 con 0x7f8a6c06ebc0 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.251+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a800869a0 con 0x7f8a880ca610 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7f8a8cc14640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f8a6c06ebc0 0x7f8a6c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f6ffd640 1 -- 172.21.15.89:0/2316419101 <== osd.1 v2:172.21.15.89:6822/1573279697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc4f8005470 con 0x7fc4e406ebc0 2023-12-07T09:59:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7f8a8cc14640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f8a6c06ebc0 0x7f8a6c070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7f8a8d415640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a6c0669a0 0x7f8a6c068e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009d50 tx=0x7f8a84009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7fc4e406ebc0 msgr2=0x7fc4e4070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7fc4e406ebc0 0x7fc4e4070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4e40669a0 msgr2=0x7fc4e4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4e40669a0 0x7fc4e4068e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0af000 tx=0x7fc4fc008040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4f80dbcd0 msgr2=0x7fc4f81779c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 --2- 172.21.15.89:0/2316419101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4f80dbcd0 0x7fc4f81779c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc500062190 tx=0x7fc500068000 comp rx=0 tx=0).stop 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc50631c640 1 -- 172.21.15.89:0/2316419101 reap_dead start 2023-12-07T09:59:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== osd.6 v2:172.21.15.97:6824/2141814588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8a6c071690 con 0x7f8a6c06ebc0 2023-12-07T09:59:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 shutdown_connections 2023-12-07T09:59:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.255+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 >> 172.21.15.89:0/2316419101 conn(0x7fc4f8048400 msgr2=0x7fc4f80487e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.259+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 shutdown_connections 2023-12-07T09:59:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.259+0000 7fc4f4ff9640 1 -- 172.21.15.89:0/2316419101 wait complete. 2023-12-07T09:59:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.263+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 --> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2c00db280 con 0x7fe2ac06eaf0 2023-12-07T09:59:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.263+0000 7fe2be7fc640 1 -- 172.21.15.89:0/433377326 <== osd.3 v2:172.21.15.89:6808/2109259736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2c40095a0 con 0x7fe2ac06eaf0 2023-12-07T09:59:19.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.263+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7fe2ac06eaf0 msgr2=0x7fe2ac070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.263+0000 7fe2d011d640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7fe2ac06eaf0 0x7fe2ac070f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 --> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb010002cc0 con 0x7fb01c06ebf0 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ac0668d0 msgr2=0x7fe2ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ac0668d0 0x7fe2ac068d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8050230 tx=0x7fe2c80690f0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2c00db8a0 msgr2=0x7fe2c00cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 --2- 172.21.15.89:0/433377326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2c00db8a0 0x7fe2c00cd9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80af040 tx=0x7fe2b8019150 comp rx=0 tx=0).stop 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2ce6ba640 1 -- 172.21.15.89:0/433377326 reap_dead start 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 shutdown_connections 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 >> 172.21.15.89:0/433377326 conn(0x7fe2c0005ec0 msgr2=0x7fe2c0046030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb0177fe640 1 -- 172.21.15.89:0/2752130655 <== osd.4 v2:172.21.15.97:6816/811237390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb010002cc0 con 0x7fb01c06ebf0 2023-12-07T09:59:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 shutdown_connections 2023-12-07T09:59:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fb01c06ebf0 msgr2=0x7fb01c071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fb01c06ebf0 0x7fb01c071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fe2d011d640 1 -- 172.21.15.89:0/433377326 wait complete. 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb01c0669d0 msgr2=0x7fb01c068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb01c0669d0 0x7fb01c068e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0240ae000 tx=0x7fb0240046d0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 msgr2=0x7fb0301fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 --2- 172.21.15.89:0/2752130655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb03006dac0 0x7fb0301fb0d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb02000e7e0 tx=0x7fb02000eca0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02f7fe640 1 -- 172.21.15.89:0/2752130655 reap_dead start 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 shutdown_connections 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 >> 172.21.15.89:0/2752130655 conn(0x7fb0300c5ef0 msgr2=0x7fb03006cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 shutdown_connections 2023-12-07T09:59:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7fb02ffff640 1 -- 172.21.15.89:0/2752130655 wait complete. 2023-12-07T09:59:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 --> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e3c0c3ec0 con 0x7f9e2806ebc0 2023-12-07T09:59:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.271+0000 7f9e317fa640 1 -- 172.21.15.89:0/2171115890 <== osd.5 v2:172.21.15.97:6802/3253961744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e3c0c3ec0 con 0x7f9e2806ebc0 2023-12-07T09:59:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7f9e2806ebc0 msgr2=0x7f9e28070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7f9e2806ebc0 0x7f9e28070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e280669a0 msgr2=0x7f9e28068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e280669a0 0x7f9e28068e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e380099b0 tx=0x7f9e38009110 comp rx=0 tx=0).stop 2023-12-07T09:59:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c152ce0 msgr2=0x7f9e3c145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 --2- 172.21.15.89:0/2171115890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c152ce0 0x7f9e3c145b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400efc0 tx=0x7f9e3400c490 comp rx=0 tx=0).stop 2023-12-07T09:59:19.301 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e417f7640 1 -- 172.21.15.89:0/2171115890 reap_dead start 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 shutdown_connections 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 >> 172.21.15.89:0/2171115890 conn(0x7f9e3c0c2ad0 msgr2=0x7f9e3c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 shutdown_connections 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.275+0000 7f9e4325a640 1 -- 172.21.15.89:0/2171115890 wait complete. 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 --> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3750002cc0 con 0x7f375406eb70 2023-12-07T09:59:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f376d7fa640 1 -- 172.21.15.89:0/1405615878 <== osd.7 v2:172.21.15.97:6800/1479824909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3750002cc0 con 0x7f375406eb70 2023-12-07T09:59:19.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f375406eb70 msgr2=0x7f3754070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f375406eb70 0x7f3754070f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3754066950 msgr2=0x7f3754068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3754066950 0x7f3754068e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3770155e70 tx=0x7f375c008040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f377006cd90 msgr2=0x7f37700ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f3777172640 1 --2- 172.21.15.89:0/1405615878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f377006cd90 0x7f37700ac0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37640af040 tx=0x7f37640190a0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.279+0000 7f377570f640 1 -- 172.21.15.89:0/1405615878 reap_dead start 2023-12-07T09:59:19.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.283+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 --> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a8804e890 con 0x7f8a6c06ebc0 2023-12-07T09:59:19.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.283+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 shutdown_connections 2023-12-07T09:59:19.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.283+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 >> 172.21.15.89:0/1405615878 conn(0x7f3770071ea0 msgr2=0x7f377014f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.283+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 shutdown_connections 2023-12-07T09:59:19.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.283+0000 7f3777172640 1 -- 172.21.15.89:0/1405615878 wait complete. 2023-12-07T09:59:19.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.283+0000 7f8a7dffb640 1 -- 172.21.15.89:0/2037179103 <== osd.6 v2:172.21.15.97:6824/2141814588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a8804e890 con 0x7f8a6c06ebc0 2023-12-07T09:59:19.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f8a6c06ebc0 msgr2=0x7f8a6c070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f8a6c06ebc0 0x7f8a6c070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a6c0669a0 msgr2=0x7f8a6c068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a6c0669a0 0x7f8a6c068e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009d50 tx=0x7f8a84009190 comp rx=0 tx=0).stop 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a880ca610 msgr2=0x7f8a8814c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 --2- 172.21.15.89:0/2037179103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a880ca610 0x7f8a8814c410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8a880c5d50 tx=0x7f8a8000cb90 comp rx=0 tx=0).stop 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8dc16640 1 -- 172.21.15.89:0/2037179103 reap_dead start 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 shutdown_connections 2023-12-07T09:59:19.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 >> 172.21.15.89:0/2037179103 conn(0x7f8a88071ea0 msgr2=0x7f8a880ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.308 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-12-07T09:59:19.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-07T09:59:19.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 shutdown_connections 2023-12-07T09:59:19.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.287+0000 7f8a8f679640 1 -- 172.21.15.89:0/2037179103 wait complete. 2023-12-07T09:59:19.309 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-12-07T09:59:19.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-07T09:59:19.315 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-12-07T09:59:19.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-07T09:59:19.318 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-07T09:59:19.324 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.324 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-07T09:59:19.325 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-07T09:59:19.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-07T09:59:19.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.507+0000 7f35491e6640 1 Processor -- start 2023-12-07T09:59:19.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.507+0000 7f35491e6640 1 -- start start 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.507+0000 7f35491e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414dc50 0x7f35440c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.507+0000 7f35491e6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3544071440 con 0x7f354406bee0 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.507+0000 7f35491e6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3544151100 con 0x7f354406c400 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.507+0000 7f35491e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3544071f90 con 0x7f354414dc50 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f354359e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f354406bee0 0x7f354415b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57774/0 (socket says 172.21.15.89:57774) 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f354359e640 1 -- 172.21.15.89:0/2987119560 learned_addr learned my addr 172.21.15.89:0/2987119560 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3542d9d640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414dc50 0x7f35440c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079371649 0 0) 0x7f3538001120 con 0x7f354406bee0 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c003530 con 0x7f354406bee0 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776212880 0 0) 0x7f3544151100 con 0x7f354406c400 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c0048b0 con 0x7f354406c400 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 <== mon.1 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464153915 0 0) 0x7f352c0048b0 con 0x7f354406c400 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414dc50 msgr2=0x7f35440c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414dc50 0x7f35440c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 >> v1:172.21.15.89:6789/0 conn(0x7f354406bee0 legacy=0x7f354415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544151630 con 0x7f354406c400 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 <== mon.1 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f353c001a00 con 0x7f354406c400 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 >> v1:172.21.15.97:6789/0 conn(0x7f354406c400 legacy=0x7f354406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f352c004d00 0x7f352c005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f352c005960 0x7f352c005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352c006400 0x7f352c00c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544071f90 con 0x7f352c006400 2023-12-07T09:59:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c00d1b0 con 0x7f352c004d00 2023-12-07T09:59:19.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c00d370 con 0x7f352c005960 2023-12-07T09:59:19.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f354259c640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f352c005960 0x7f352c005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.511+0000 7f3542d9d640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f352c004d00 0x7f352c005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.515+0000 7f354359e640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352c006400 0x7f352c00c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.515+0000 7f354359e640 1 -- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f352c005960 msgr2=0x7f352c005de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.515+0000 7f354359e640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f352c005960 0x7f352c005de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.515+0000 7f354359e640 1 -- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f352c004d00 msgr2=0x7f352c005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.515+0000 7f354359e640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f352c004d00 0x7f352c005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.515+0000 7f354359e640 1 -- 172.21.15.89:0/2987119560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544151630 con 0x7f352c006400 2023-12-07T09:59:19.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.519+0000 7f354359e640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352c006400 0x7f352c00c9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3538001920 tx=0x7f353801c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870ea51388b78b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.519+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538005ae0 con 0x7f352c006400 2023-12-07T09:59:19.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f3541d9b640 1 -- 172.21.15.89:0/2987119560 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538005c60 con 0x7f352c006400 2023-12-07T09:59:19.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f35491e6640 1 -- 172.21.15.89:0/2987119560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352c006400 msgr2=0x7f352c00c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f35491e6640 1 --2- 172.21.15.89:0/2987119560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352c006400 0x7f352c00c9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3538001920 tx=0x7f353801c5e0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f354359e640 1 -- 172.21.15.89:0/2987119560 reap_dead start 2023-12-07T09:59:19.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f35491e6640 1 -- 172.21.15.89:0/2987119560 shutdown_connections 2023-12-07T09:59:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f35491e6640 1 -- 172.21.15.89:0/2987119560 >> 172.21.15.89:0/2987119560 conn(0x7f35440c5e10 msgr2=0x7f35440c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f35491e6640 1 -- 172.21.15.89:0/2987119560 shutdown_connections 2023-12-07T09:59:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7f35491e6640 1 -- 172.21.15.89:0/2987119560 wait complete. 2023-12-07T09:59:19.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7ff3f5232640 1 Processor -- start 2023-12-07T09:59:19.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.523+0000 7ff3f5232640 1 -- start start 2023-12-07T09:59:19.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f35491e6640 1 Processor -- start 2023-12-07T09:59:19.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f35491e6640 1 -- start start 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3f5232640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff3f014dd10 0x7ff3f0150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3f5232640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f006d020 0x7ff3f00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3f5232640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 0x7ff3f0070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3f5232640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00a8b00 con 0x7ff3f00c1f20 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3f5232640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f006c070 con 0x7ff3f014dd10 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3f5232640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f006c350 con 0x7ff3f006d020 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3ef59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 0x7ff3f0070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3ef59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 0x7ff3f0070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39778/0 (socket says 172.21.15.89:39778) 2023-12-07T09:59:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3ef59e640 1 -- 172.21.15.89:0/2143184469 learned_addr learned my addr 172.21.15.89:0/2143184469 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3eed9d640 1 --2- 172.21.15.89:0/2143184469 >> v2:172.21.15.97:3300/0 conn(0x7ff3f014dd10 0x7ff3f0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3eed9d640 1 -- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f006d020 msgr2=0x7ff3f00c19e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T09:59:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3eed9d640 1 --2- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f006d020 0x7ff3f00c19e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3eed9d640 1 -- 172.21.15.89:0/2143184469 >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 msgr2=0x7ff3f0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3eed9d640 1 --2- 172.21.15.89:0/2143184469 >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 0x7ff3f0070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3eed9d640 1 -- 172.21.15.89:0/2143184469 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f006c630 con 0x7ff3f014dd10 2023-12-07T09:59:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7ff3ef59e640 1 --2- 172.21.15.89:0/2143184469 >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 0x7ff3f0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f35491e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 0x7f354414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f35491e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 0x7f35441e9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f35491e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 0x7f35441e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f354259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 0x7f35441e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.527+0000 7f354259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 0x7f35441e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55020/0 (socket says 172.21.15.89:55020) 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 0x7f35441e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 0x7f35441e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:32788/0 (socket says 172.21.15.89:32788) 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f3542d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 0x7f354414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f3542d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 0x7f354414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39780/0 (socket says 172.21.15.89:39780) 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 -- 172.21.15.89:0/3272858093 learned_addr learned my addr 172.21.15.89:0/3272858093 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35441e92e0 con 0x7f35440a8f10 2023-12-07T09:59:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544140330 con 0x7f35440a97d0 2023-12-07T09:59:19.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440a9d40 con 0x7f354414f360 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 -- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 msgr2=0x7f35441e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 0x7f35441e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 -- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 msgr2=0x7f354414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 0x7f354414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440aa000 con 0x7f354414f360 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f3542d9d640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 0x7f354414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:19.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354359e640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 0x7f35441e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f2483a79640 1 Processor -- start 2023-12-07T09:59:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f2483a79640 1 -- start start 2023-12-07T09:59:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f354259c640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 0x7f35441e9700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f353c005350 tx=0x7f353c005810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7ff3eed9d640 1 --2- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f0150840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00c3b30 tx=0x7ff3d80206d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3123e0eb933fdb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.531+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c010810 con 0x7f354414f360 2023-12-07T09:59:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3edd9b640 1 -- 172.21.15.89:0/2143184469 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00710d0 con 0x7ff3f014dd10 2023-12-07T09:59:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c010970 con 0x7f354414f360 2023-12-07T09:59:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c010d20 con 0x7f354414f360 2023-12-07T09:59:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3edd9b640 1 -- 172.21.15.89:0/2143184469 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d800d2d0 con 0x7ff3f014dd10 2023-12-07T09:59:19.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3edd9b640 1 -- 172.21.15.89:0/2143184469 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80a97a0 con 0x7ff3f014dd10 2023-12-07T09:59:19.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7fa508e94640 1 Processor -- start 2023-12-07T09:59:19.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 -- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 msgr2=0x7ff3f0150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 --2- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f0150840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00c3b30 tx=0x7ff3d80206d0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35440aa2e0 con 0x7f354414f360 2023-12-07T09:59:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35440aa8a0 con 0x7f354414f360 2023-12-07T09:59:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2483a79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f247c152a90 0x7f247c06c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7fa508e94640 1 -- start start 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 -- 172.21.15.89:0/2143184469 shutdown_connections 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 --2- 172.21.15.89:0/2143184469 >> v2:172.21.15.89:3300/0 conn(0x7ff3f00c1f20 0x7ff3f0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 --2- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f006d020 0x7ff3f00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 --2- 172.21.15.89:0/2143184469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f0150840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 -- 172.21.15.89:0/2143184469 >> 172.21.15.89:0/2143184469 conn(0x7ff3f00c2ad0 msgr2=0x7ff3f00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 -- 172.21.15.89:0/2143184469 shutdown_connections 2023-12-07T09:59:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7ff3f5232640 1 -- 172.21.15.89:0/2143184469 wait complete. 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2483a79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c06cba0 0x7f247c1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2483a79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c06c120 con 0x7f247c0722e0 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2483a79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c070ff0 con 0x7f247c152a90 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2483a79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c071240 con 0x7f247c06cba0 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2481014640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f247c0722e0 0x7f247c0c0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57788/0 (socket says 172.21.15.89:57788) 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2482016640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c06cba0 0x7f247c1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2482016640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c06cba0 0x7f247c1633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55028/0 (socket says 172.21.15.89:55028) 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2482016640 1 -- 172.21.15.89:0/1429667704 learned_addr learned my addr 172.21.15.89:0/1429667704 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524005260 con 0x7f354414f360 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7f2481815640 1 --2- 172.21.15.89:0/1429667704 >> v2:172.21.15.97:3300/0 conn(0x7f247c152a90 0x7f247c06c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7fa508e94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa50406d020 0x7fa504150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7fa508e94640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50406c070 con 0x7fa5040c35f0 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7fa508e94640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50406c350 con 0x7fa50414dd10 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.535+0000 7fa508e94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040a8b00 con 0x7fa50406d020 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa5040c35f0 0x7fa5040c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57804/0 (socket says 172.21.15.89:57804) 2023-12-07T09:59:19.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50259c640 1 -- 172.21.15.89:0/3712827019 learned_addr learned my addr 172.21.15.89:0/3712827019 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7f2481815640 1 -- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c06cba0 msgr2=0x7f247c1633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7f2481815640 1 --2- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c06cba0 0x7f247c1633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7f2481815640 1 -- 172.21.15.89:0/1429667704 >> v1:172.21.15.89:6789/0 conn(0x7f247c0722e0 legacy=0x7f247c0c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7f2481815640 1 -- 172.21.15.89:0/1429667704 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c071520 con 0x7f247c152a90 2023-12-07T09:59:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa50406d020 0x7fa504150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294668408 0 0) 0x7fa50406c070 con 0x7fa5040c35f0 2023-12-07T09:59:19.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ec003530 con 0x7fa5040c35f0 2023-12-07T09:59:19.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f353c015430 con 0x7f354414f360 2023-12-07T09:59:19.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7ff3f5232640 1 Processor -- start 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010401134 0 0) 0x7fa4ec003530 con 0x7fa5040c35f0 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa50406d020 msgr2=0x7fa504150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa50406d020 0x7fa504150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 >> v1:172.21.15.97:6789/0 conn(0x7fa50414dd10 legacy=0x7fa504070380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50406c630 con 0x7fa5040c35f0 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fa4f4001680 con 0x7fa5040c35f0 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 >> v1:172.21.15.89:6789/0 conn(0x7fa5040c35f0 legacy=0x7fa5040c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec0047d0 0x7fa4ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec005200 0x7fa4ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040a8b00 con 0x7fa4ec0039b0 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0148f0 con 0x7fa4ec0047d0 2023-12-07T09:59:19.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec014ab0 con 0x7fa4ec005200 2023-12-07T09:59:19.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7ff3f5232640 1 -- start start 2023-12-07T09:59:19.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7f352b7fe640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35300669a0 0x7f3530068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.539+0000 7fa50259c640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f3542d9d640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35300669a0 0x7f3530068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa502d9d640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec005200 0x7fa4ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa50259c640 1 -- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec005200 msgr2=0x7fa4ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa50259c640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec005200 0x7fa4ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa50259c640 1 -- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec0047d0 msgr2=0x7fa4ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec0047d0 0x7fa4ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa50259c640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec0047d0 0x7fa4ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa50259c640 1 -- 172.21.15.89:0/3712827019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50406c630 con 0x7fa4ec0039b0 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f353c086d70 con 0x7f354414f360 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa502d9d640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4ec005200 0x7fa4ec00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:19.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4ec0047d0 0x7fa4ec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:19.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3f5232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f006d020 0x7ff3f0147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2481815640 1 --2- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c152a90 0x7f247c06c660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2474009d90 tx=0x7f247401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcb10c66a48a201c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f3542d9d640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35300669a0 0x7f3530068e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35440c5d50 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3f5232640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f00c1f20 0x7ff3f00aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3f5232640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f00ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3f5232640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01454b0 con 0x7ff3f006d020 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3f5232640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01e9210 con 0x7ff3f014dd10 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3f5232640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01e94f0 con 0x7ff3f00c1f20 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3eed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f006d020 0x7ff3f0147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3eed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f006d020 0x7ff3f0147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39792/0 (socket says 172.21.15.89:39792) 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3eed9d640 1 -- 172.21.15.89:0/1382252968 learned_addr learned my addr 172.21.15.89:0/1382252968 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2480813640 1 -- 172.21.15.89:0/1429667704 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740a5950 con 0x7f247c152a90 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2480813640 1 -- 172.21.15.89:0/1429667704 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740a5ab0 con 0x7f247c152a90 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2480813640 1 -- 172.21.15.89:0/1429667704 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740a5950 con 0x7f247c152a90 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f00ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ee59c640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f00c1f20 0x7ff3f00aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 -- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f00c1f20 msgr2=0x7ff3f00aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f00c1f20 0x7ff3f00aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 -- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f006d020 msgr2=0x7ff3f0147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f006d020 0x7ff3f0147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 -- 172.21.15.89:0/1382252968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00077f0 con 0x7ff3f014dd10 2023-12-07T09:59:19.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2483a79640 1 -- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c152a90 msgr2=0x7f247c06c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2483a79640 1 --2- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c152a90 0x7f247c06c660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2474009d90 tx=0x7f247401c8b0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7ff3ef59e640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f00ab210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0008a30 tx=0x7ff3e000e4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2483a79640 1 -- 172.21.15.89:0/1429667704 shutdown_connections 2023-12-07T09:59:19.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2483a79640 1 --2- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c06cba0 0x7f247c1633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2483a79640 1 --2- 172.21.15.89:0/1429667704 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c152a90 0x7f247c06c660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.543+0000 7f2483a79640 1 -- 172.21.15.89:0/1429667704 >> 172.21.15.89:0/1429667704 conn(0x7f247c06af50 msgr2=0x7f247c0c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0003ba0 con 0x7ff3f014dd10 2023-12-07T09:59:19.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7f2483a79640 1 -- 172.21.15.89:0/1429667704 shutdown_connections 2023-12-07T09:59:19.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7ff3f5232640 1 -- 172.21.15.89:0/1382252968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d800d8c0 con 0x7ff3f014dd10 2023-12-07T09:59:19.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7ff3f5232640 1 -- 172.21.15.89:0/1382252968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f0147200 con 0x7ff3f014dd10 2023-12-07T09:59:19.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f353c08b070 con 0x7f354414f360 2023-12-07T09:59:19.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e000be90 con 0x7ff3f014dd10 2023-12-07T09:59:19.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0003ba0 con 0x7ff3f014dd10 2023-12-07T09:59:19.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7f2483a79640 1 -- 172.21.15.89:0/1429667704 wait complete. 2023-12-07T09:59:19.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7f2483a79640 1 Processor -- start 2023-12-07T09:59:19.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7f2483a79640 1 -- start start 2023-12-07T09:59:19.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7fa50259c640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c290 tx=0x7fa4f401cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d817d9caab5b43d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4005ae0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4005c40 con 0x7fa4ec0039b0 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.547+0000 7fa50159a640 1 -- 172.21.15.89:0/3712827019 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4005ae0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7fa508e94640 1 -- 172.21.15.89:0/3712827019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 msgr2=0x7fa4ec003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7fa508e94640 1 --2- 172.21.15.89:0/3712827019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c290 tx=0x7fa4f401cb10 comp rx=0 tx=0).stop 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7fa502d9d640 1 -- 172.21.15.89:0/3712827019 reap_dead start 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7fa508e94640 1 -- 172.21.15.89:0/3712827019 shutdown_connections 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2483a79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 0x7f247c1fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f0145620 con 0x7ff3f014dd10 2023-12-07T09:59:19.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7fa508e94640 1 -- 172.21.15.89:0/3712827019 >> 172.21.15.89:0/3712827019 conn(0x7fa5040c2ad0 msgr2=0x7fa5040c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2483a79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 0x7f247c14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff3e0003d00 con 0x7ff3f014dd10 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2483a79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f247c152a90 0x7f247c0a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 0x7f247c1fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 0x7f247c1fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:32846/0 (socket says 172.21.15.89:32846) 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481014640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 0x7f247c14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481014640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 0x7f247c14efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55056/0 (socket says 172.21.15.89:55056) 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 -- 172.21.15.89:0/3757680845 learned_addr learned my addr 172.21.15.89:0/3757680845 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c15a340 con 0x7f247c152a90 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2482016640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f247c152a90 0x7f247c0a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c14d610 con 0x7f247c06cba0 2023-12-07T09:59:19.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c159c80 con 0x7f247c0722e0 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 -- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 msgr2=0x7f247c14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 0x7f247c14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 -- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f247c152a90 msgr2=0x7f247c0a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f247c152a90 0x7f247c0a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481815640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474009a70 con 0x7f247c06cba0 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7f2481014640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 0x7f247c14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7fa508e94640 1 -- 172.21.15.89:0/3712827019 shutdown_connections 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7fa508e94640 1 -- 172.21.15.89:0/3712827019 wait complete. 2023-12-07T09:59:19.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.551+0000 7ff3e77fe640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff3d0066960 0x7ff3d0068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7f2481815640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 0x7f247c1fa1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f247401a4e0 tx=0x7f2474019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3e0010040 con 0x7ff3f014dd10 2023-12-07T09:59:19.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7ff3eed9d640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff3d0066960 0x7ff3d0068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7ff3eed9d640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff3d0066960 0x7ff3d0068e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8020f70 tx=0x7ff3d80ab070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7fa508e94640 1 Processor -- start 2023-12-07T09:59:19.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.555+0000 7fa508e94640 1 -- start start 2023-12-07T09:59:19.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3f0145620 con 0x7ff3f014dd10 2023-12-07T09:59:19.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474004040 con 0x7f247c06cba0 2023-12-07T09:59:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740041c0 con 0x7f247c06cba0 2023-12-07T09:59:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474004570 con 0x7f247c06cba0 2023-12-07T09:59:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa508e94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa5041e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c0c10a0 con 0x7f247c06cba0 2023-12-07T09:59:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c1fabd0 con 0x7f247c06cba0 2023-12-07T09:59:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa508e94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa504148b30 0x7fa5041453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa5041e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa5041e8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39810/0 (socket says 172.21.15.89:39810) 2023-12-07T09:59:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 -- 172.21.15.89:0/3662074023 learned_addr learned my addr 172.21.15.89:0/3662074023 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5041ec900 0x7fa5040c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c04e890 con 0x7f247c06cba0 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040a93e0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041ec420 con 0x7fa5041ec900 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040aa140 con 0x7fa504148b30 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 -- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa504148b30 msgr2=0x7fa5041453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa504148b30 0x7fa5041453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa504148b30 0x7fa5041453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 -- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5041ec900 msgr2=0x7fa5040c4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5041ec900 0x7fa5040c4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.559+0000 7fa50259c640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040a9b80 con 0x7fa4ec0039b0 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa504148b30 0x7fa5041453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa50259c640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa5041e8d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c290 tx=0x7fa4ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40b4070 con 0x7fa4ec0039b0 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5040a9e60 con 0x7fa4ec0039b0 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5041458f0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4005a40 con 0x7fa4ec0039b0 2023-12-07T09:59:19.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4007240 con 0x7fa4ec0039b0 2023-12-07T09:59:19.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.563+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f24740046d0 con 0x7f247c06cba0 2023-12-07T09:59:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7f24727fc640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f24600669a0 0x7f2460068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f247411f940 con 0x7f247c06cba0 2023-12-07T09:59:19.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e8005260 con 0x7fa4ec0039b0 2023-12-07T09:59:19.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7f2481014640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f24600669a0 0x7f2460068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa4f40073a0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7fa4f2ffd640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4e40668d0 0x7fa4e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.567+0000 7f2481014640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f24600669a0 0x7f2460068e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f247c0c61b0 tx=0x7f246c007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.571+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24740ecd40 con 0x7f247c06cba0 2023-12-07T09:59:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.571+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4f411eaf0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.571+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4e40668d0 0x7fa4e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.571+0000 7fa501d9b640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4e40668d0 0x7fa4e4068d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5040721c0 tx=0x7fa4f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.579+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4f40eb1a0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.615+0000 7fbf93ee4640 1 Processor -- start 2023-12-07T09:59:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.615+0000 7fbf93ee4640 1 -- start start 2023-12-07T09:59:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf93ee4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbf840dbcb0 0x7fbf840e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf93ee4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf840decf0 0x7fbf840df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf93ee4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840e2c20 con 0x7fbf8400b090 2023-12-07T09:59:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf93ee4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf840de840 con 0x7fbf840dbcb0 2023-12-07T09:59:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf93ee4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf840df6e0 con 0x7fbf840decf0 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf9147f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbf8400b090 0x7fbf84006ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57806/0 (socket says 172.21.15.89:57806) 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf9147f640 1 -- 172.21.15.89:0/904152158 learned_addr learned my addr 172.21.15.89:0/904152158 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf92481640 1 --2- 172.21.15.89:0/904152158 >> v2:172.21.15.97:3300/0 conn(0x7fbf840decf0 0x7fbf840df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf91c80640 1 --2- 172.21.15.89:0/904152158 >> v2:172.21.15.89:3300/0 conn(0x7fbf840dbcb0 0x7fbf840e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf92481640 1 -- 172.21.15.89:0/904152158 >> v2:172.21.15.89:3300/0 conn(0x7fbf840dbcb0 msgr2=0x7fbf840e26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf90c7e640 1 -- 172.21.15.89:0/904152158 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139732357 0 0) 0x7fbf840e2c20 con 0x7fbf8400b090 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf92481640 1 --2- 172.21.15.89:0/904152158 >> v2:172.21.15.89:3300/0 conn(0x7fbf840dbcb0 0x7fbf840e26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf92481640 1 -- 172.21.15.89:0/904152158 >> v1:172.21.15.89:6789/0 conn(0x7fbf8400b090 legacy=0x7fbf84006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.619+0000 7fbf92481640 1 -- 172.21.15.89:0/904152158 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840475f0 con 0x7fbf840decf0 2023-12-07T09:59:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fbf91c80640 1 --2- 172.21.15.89:0/904152158 >> v2:172.21.15.89:3300/0 conn(0x7fbf840dbcb0 0x7fbf840e26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 Processor -- start 2023-12-07T09:59:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 -- start start 2023-12-07T09:59:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fc1ddf8d640 1 Processor -- start 2023-12-07T09:59:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fc1ddf8d640 1 -- start start 2023-12-07T09:59:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fbf92481640 1 --2- 172.21.15.89:0/904152158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf840decf0 0x7fbf840df1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c064410 tx=0x7fbf8c096bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6721849bf68ea02 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f16780c19e0 0x7f16780c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1678071530 0x7f167806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1678161fa0 con 0x7f1678164870 2023-12-07T09:59:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678071c30 con 0x7f1678071530 2023-12-07T09:59:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7f16801e6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16781613d0 con 0x7f16780c19e0 2023-12-07T09:59:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fbf90c7e640 1 -- 172.21.15.89:0/904152158 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c11f9c0 con 0x7fbf840decf0 2023-12-07T09:59:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fbf90c7e640 1 -- 172.21.15.89:0/904152158 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c11fb20 con 0x7fbf840decf0 2023-12-07T09:59:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.623+0000 7fbf90c7e640 1 -- 172.21.15.89:0/904152158 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c127440 con 0x7fbf840decf0 2023-12-07T09:59:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167df82640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f16780c19e0 0x7f16780c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167e783640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1678164870 0x7f1678164cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57816/0 (socket says 172.21.15.89:57816) 2023-12-07T09:59:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167e783640 1 -- 172.21.15.89:0/1394212092 learned_addr learned my addr 172.21.15.89:0/1394212092 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167d781640 1 --2- 172.21.15.89:0/1394212092 >> v2:172.21.15.89:3300/0 conn(0x7f1678071530 0x7f167806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fc1d77fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc1d8152ce0 0x7fc1d80700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57828/0 (socket says 172.21.15.89:57828) 2023-12-07T09:59:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fbf93ee4640 1 -- 172.21.15.89:0/904152158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf840decf0 msgr2=0x7fbf840df1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/904152158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf840decf0 0x7fbf840df1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c064410 tx=0x7fbf8c096bb0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fbf93ee4640 1 -- 172.21.15.89:0/904152158 shutdown_connections 2023-12-07T09:59:19.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/904152158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf840decf0 0x7fbf840df1a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/904152158 >> v2:172.21.15.89:3300/0 conn(0x7fbf840dbcb0 0x7fbf840e26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fbf93ee4640 1 -- 172.21.15.89:0/904152158 >> 172.21.15.89:0/904152158 conn(0x7fbf84048230 msgr2=0x7fbf84048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7fc1d77fe640 1 -- 172.21.15.89:0/2947716761 learned_addr learned my addr 172.21.15.89:0/2947716761 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1d806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/2947716761 >> v2:172.21.15.97:3300/0 conn(0x7fc1d806d100 0x7fc1d80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fbf93ee4640 1 -- 172.21.15.89:0/904152158 shutdown_connections 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1d806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d806bea0 con 0x7fc1d8152ce0 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/2947716761 >> v2:172.21.15.97:3300/0 conn(0x7fc1d806d100 0x7fc1d80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d8159b10 con 0x7fc1d806d100 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8159550 con 0x7fc1d806db80 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207201374 0 0) 0x7fc1d806bea0 con 0x7fc1d8152ce0 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c0003530 con 0x7fc1d8152ce0 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3181064976 0 0) 0x7fc1c0003530 con 0x7fc1d8152ce0 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 msgr2=0x7fc1d806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1d806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 >> v2:172.21.15.97:3300/0 conn(0x7fc1d806d100 msgr2=0x7fc1d80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 --2- 172.21.15.89:0/2947716761 >> v2:172.21.15.97:3300/0 conn(0x7fc1d806d100 0x7fc1d80c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8159830 con 0x7fc1d8152ce0 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fc1c8001680 con 0x7fc1d8152ce0 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/2947716761 >> v2:172.21.15.97:3300/0 conn(0x7fc1d806d100 0x7fc1d80c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 >> v1:172.21.15.89:6789/0 conn(0x7fc1d8152ce0 legacy=0x7fc1d80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c0003980 0x7fc1c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1c0004d10 0x7fc1c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8159b10 con 0x7fc1c0004d10 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8159550 con 0x7fc1c0003980 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c000ba70 con 0x7fc1d806db80 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1c0004d10 0x7fc1c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167cf80640 1 -- 172.21.15.89:0/1394212092 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478494351 0 0) 0x7f1678161fa0 con 0x7f1678164870 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167cf80640 1 -- 172.21.15.89:0/1394212092 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1664003530 con 0x7f1678164870 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167df82640 1 -- 172.21.15.89:0/1394212092 >> v2:172.21.15.89:3300/0 conn(0x7f1678071530 msgr2=0x7f167806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167df82640 1 --2- 172.21.15.89:0/1394212092 >> v2:172.21.15.89:3300/0 conn(0x7f1678071530 0x7f167806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167df82640 1 -- 172.21.15.89:0/1394212092 >> v1:172.21.15.89:6789/0 conn(0x7f1678164870 legacy=0x7f1678164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.627+0000 7f167df82640 1 -- 172.21.15.89:0/1394212092 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678161670 con 0x7f16780c19e0 2023-12-07T09:59:19.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fbf93ee4640 1 -- 172.21.15.89:0/904152158 wait complete. 2023-12-07T09:59:19.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fbf93ee4640 1 Processor -- start 2023-12-07T09:59:19.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d77fe640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c0003980 0x7fc1c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7f167d781640 1 --2- 172.21.15.89:0/1394212092 >> v2:172.21.15.89:3300/0 conn(0x7f1678071530 0x7f167806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:19.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fbf93ee4640 1 -- start start 2023-12-07T09:59:19.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 -- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c0003980 msgr2=0x7fc1c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c0003980 0x7fc1c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 -- 172.21.15.89:0/2947716761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1c0004d10 msgr2=0x7fc1c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1c0004d10 0x7fc1c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fc1d6ffd640 1 -- 172.21.15.89:0/2947716761 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0003530 con 0x7fc1d806db80 2023-12-07T09:59:19.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7f167df82640 1 --2- 172.21.15.89:0/1394212092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16780c19e0 0x7f16780c1dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1678066cb0 tx=0x7f167401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53971a32fc170815 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.631+0000 7fdfb3fff640 1 Processor -- start 2023-12-07T09:59:19.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f167cf80640 1 -- 172.21.15.89:0/1394212092 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740ad680 con 0x7f16780c19e0 2023-12-07T09:59:19.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb3fff640 1 -- start start 2023-12-07T09:59:19.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f167cf80640 1 -- 172.21.15.89:0/1394212092 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16740ad7e0 con 0x7f16780c19e0 2023-12-07T09:59:19.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f167cf80640 1 -- 172.21.15.89:0/1394212092 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740adb70 con 0x7f16780c19e0 2023-12-07T09:59:19.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 0x7fbf8403faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf840dbcb0 0x7fbf84030380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 0x7fbf8403faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 0x7fbf8403faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:32916/0 (socket says 172.21.15.89:32916) 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 -- 172.21.15.89:0/193786272 learned_addr learned my addr 172.21.15.89:0/193786272 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb40c4890 0x7fdfb40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb3fff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb406b7d0 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f16801e6640 1 -- 172.21.15.89:0/1394212092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16780c19e0 msgr2=0x7f16780c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb3fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb4155160 con 0x7fdfb40c4890 2023-12-07T09:59:19.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb3fff640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb406b180 con 0x7fdfb40ca620 2023-12-07T09:59:19.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f16801e6640 1 --2- 172.21.15.89:0/1394212092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16780c19e0 0x7f16780c1dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1678066cb0 tx=0x7f167401c380 comp rx=0 tx=0).stop 2023-12-07T09:59:19.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf840decf0 0x7fbf84041490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55082/0 (socket says 172.21.15.89:55082) 2023-12-07T09:59:19.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb40c4890 0x7fdfb40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/149454065 learned_addr learned my addr 172.21.15.89:0/149454065 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8403ffe0 con 0x7fbf840decf0 2023-12-07T09:59:19.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8404b4d0 con 0x7fbf8400b090 2023-12-07T09:59:19.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f16801e6640 1 -- 172.21.15.89:0/1394212092 shutdown_connections 2023-12-07T09:59:19.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/149454065 >> v2:172.21.15.89:3300/0 conn(0x7fdfb40c4890 msgr2=0x7fdfb40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/149454065 >> v2:172.21.15.89:3300/0 conn(0x7fdfb40c4890 0x7fdfb40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/149454065 >> v1:172.21.15.97:6789/0 conn(0x7fdfb40bd5a0 legacy=0x7fdfb40c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:19.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/149454065 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb406b460 con 0x7fdfb40ca620 2023-12-07T09:59:19.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8403f2e0 con 0x7fbf840dbcb0 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf9147f640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf840dbcb0 0x7fbf84030380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 -- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf840dbcb0 msgr2=0x7fbf84030380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf840dbcb0 0x7fbf84030380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 -- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf840decf0 msgr2=0x7fbf84041490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf840decf0 0x7fbf84041490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0687b0 con 0x7fbf8400b090 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf91c80640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 0x7fbf8403faa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c7f0 tx=0x7fbf8800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800cea0 con 0x7fbf8400b090 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf880079b0 con 0x7fbf8400b090 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88007d60 con 0x7fbf8400b090 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf840453b0 con 0x7fbf8400b090 2023-12-07T09:59:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8403f580 con 0x7fbf8400b090 2023-12-07T09:59:19.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1d6ffd640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1c00047d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009ab0 tx=0x7fc1cc01ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb7e3551a7def62 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.635+0000 7f16801e6640 1 --2- 172.21.15.89:0/1394212092 >> v2:172.21.15.89:3300/0 conn(0x7f1678071530 0x7f167806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7f16801e6640 1 --2- 172.21.15.89:0/1394212092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16780c19e0 0x7f16780c1dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7f16801e6640 1 -- 172.21.15.89:0/1394212092 >> 172.21.15.89:0/1394212092 conn(0x7f16780c2ad0 msgr2=0x7f16780c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0a5660 con 0x7fc1d806db80 2023-12-07T09:59:19.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1d67fc640 1 -- 172.21.15.89:0/2947716761 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0a57c0 con 0x7fc1d806db80 2023-12-07T09:59:19.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7f16801e6640 1 -- 172.21.15.89:0/1394212092 shutdown_connections 2023-12-07T09:59:19.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7f16801e6640 1 -- 172.21.15.89:0/1394212092 wait complete. 2023-12-07T09:59:19.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 msgr2=0x7fc1c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/2947716761 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1c00047d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009ab0 tx=0x7fc1cc01ca70 comp rx=0 tx=0).stop 2023-12-07T09:59:19.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1d7fff640 1 -- 172.21.15.89:0/2947716761 reap_dead start 2023-12-07T09:59:19.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 shutdown_connections 2023-12-07T09:59:19.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 >> 172.21.15.89:0/2947716761 conn(0x7fc1d80c2ad0 msgr2=0x7fc1d80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf840052a0 con 0x7fbf8400b090 2023-12-07T09:59:19.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.639+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbf880113f0 con 0x7fbf8400b090 2023-12-07T09:59:19.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 shutdown_connections 2023-12-07T09:59:19.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/2947716761 wait complete. 2023-12-07T09:59:19.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/149454065 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40caa00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009870 tx=0x7fdf9c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c7e22c5c87e84d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 Processor -- start 2023-12-07T09:59:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fdfb1ffb640 1 -- 172.21.15.89:0/149454065 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0ad680 con 0x7fdfb40ca620 2023-12-07T09:59:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fdfb1ffb640 1 -- 172.21.15.89:0/149454065 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c0ad7e0 con 0x7fdfb40ca620 2023-12-07T09:59:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fdfb1ffb640 1 -- 172.21.15.89:0/149454065 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0adb70 con 0x7fdfb40ca620 2023-12-07T09:59:19.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 -- start start 2023-12-07T09:59:19.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fbf827fc640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbf700669a0 0x7fbf70068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fbf9147f640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbf700669a0 0x7fbf70068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf88084480 con 0x7fbf8400b090 2023-12-07T09:59:19.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 0x7f16781fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16780c19e0 0x7f1678153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fc1ddf8d640 1 Processor -- start 2023-12-07T09:59:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f167df82640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 0x7f16781fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f167d781640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16780c19e0 0x7f1678153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f167df82640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 0x7f16781fed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55098/0 (socket says 172.21.15.89:55098) 2023-12-07T09:59:19.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f167d781640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16780c19e0 0x7f1678153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39866/0 (socket says 172.21.15.89:39866) 2023-12-07T09:59:19.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fdfb3fff640 1 -- 172.21.15.89:0/149454065 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 msgr2=0x7fdfb40caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/149454065 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40caa00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009870 tx=0x7fdf9c01c470 comp rx=0 tx=0).stop 2023-12-07T09:59:19.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fbf9147f640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbf700669a0 0x7fbf70068e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf840e1690 tx=0x7fbf7c007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7fc1ddf8d640 1 -- start start 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1678164870 0x7f167815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16780aa0f0 con 0x7f16780c19e0 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678154490 con 0x7f1678164870 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f16801e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16780aada0 con 0x7f1678071530 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.643+0000 7f167d781640 1 -- 172.21.15.89:0/3542900225 learned_addr learned my addr 172.21.15.89:0/3542900225 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f167df82640 1 -- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1678164870 msgr2=0x7f167815d160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f167df82640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1678164870 0x7f167815d160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f167df82640 1 -- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16780c19e0 msgr2=0x7f1678153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f167df82640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16780c19e0 0x7f1678153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f167df82640 1 -- 172.21.15.89:0/3542900225 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674009420 con 0x7f1678071530 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1d80a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1d80a8da0 0x7fc1d813bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1d80a8da0 0x7fc1d813bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1d80a8da0 0x7fc1d813bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39882/0 (socket says 172.21.15.89:39882) 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1d8154930 0x7fc1d813c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d813c7c0 con 0x7fc1d80a8da0 2023-12-07T09:59:19.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81564e0 con 0x7fc1d8154930 2023-12-07T09:59:19.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f167df82640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 0x7f16781fed60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f16740ac000 tx=0x7f1674019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81544a0 con 0x7fc1d806db80 2023-12-07T09:59:19.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d6ffd640 1 -- 172.21.15.89:0/1338840552 learned_addr learned my addr 172.21.15.89:0/1338840552 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1d8154930 0x7fc1d813c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf880516a0 con 0x7fbf8400b090 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 -- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 msgr2=0x7fc1d80a9980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1d80a9980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 -- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1d80a8da0 msgr2=0x7fc1d813bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1d80a8da0 0x7fc1d813bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8155f20 con 0x7fc1d8154930 2023-12-07T09:59:19.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740add60 con 0x7f1678071530 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16740b6620 con 0x7f1678071530 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740b69d0 con 0x7f1678071530 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16780aaa70 con 0x7f1678071530 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16780a8d70 con 0x7f1678071530 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1d7fff640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1d8154930 0x7fc1d813c280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1d806b4e0 tx=0x7fc1d0010530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d001b070 con 0x7fc1d8154930 2023-12-07T09:59:19.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0010d80 con 0x7fc1d8154930 2023-12-07T09:59:19.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00039a0 con 0x7fc1d8154930 2023-12-07T09:59:19.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d8156200 con 0x7fc1d8154930 2023-12-07T09:59:19.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8154130 con 0x7fc1d8154930 2023-12-07T09:59:19.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.647+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167804e890 con 0x7f1678071530 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 -- 172.21.15.89:0/149454065 shutdown_connections 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/149454065 >> v2:172.21.15.89:3300/0 conn(0x7fdfb40c4890 0x7fdfb40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/149454065 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40caa00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 -- 172.21.15.89:0/149454065 >> 172.21.15.89:0/149454065 conn(0x7fdfb40ac0a0 msgr2=0x7fdfb40c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 -- 172.21.15.89:0/149454065 shutdown_connections 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 -- 172.21.15.89:0/149454065 wait complete. 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc1d0003b00 con 0x7fc1d8154930 2023-12-07T09:59:19.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f16740b6b30 con 0x7f1678071530 2023-12-07T09:59:19.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fdfb3fff640 1 Processor -- start 2023-12-07T09:59:19.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.651+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b8005260 con 0x7fc1d8154930 2023-12-07T09:59:19.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7fc1bffff640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c40669a0 0x7fc1c4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d0084880 con 0x7fc1d8154930 2023-12-07T09:59:19.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7fc1d77fe640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c40669a0 0x7fc1c4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7fc1d77fe640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c40669a0 0x7fc1c4068e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000c10 tx=0x7fc1c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7f166e7fc640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f165c0669d0 0x7f165c068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16741224d0 con 0x7f1678071530 2023-12-07T09:59:19.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7f167d781640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f165c0669d0 0x7f165c068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7fdfb3fff640 1 -- start start 2023-12-07T09:59:19.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.655+0000 7f167d781640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f165c0669d0 0x7f165c068e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1678155fb0 tx=0x7f166800c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 0x7fdfb41f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb40c4890 0x7fdfb41f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 0x7fdfb41f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 0x7fdfb41f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:32942/0 (socket says 172.21.15.89:32942) 2023-12-07T09:59:19.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb40c4890 0x7fdfb41f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16740ef780 con 0x7f1678071530 2023-12-07T09:59:19.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1d0051b30 con 0x7fc1d8154930 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/3015175503 learned_addr learned my addr 172.21.15.89:0/3015175503 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4155ac0 con 0x7fdfb40c4890 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40bc960 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb41f7320 con 0x7fdfb40ca620 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb37fe640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 msgr2=0x7fdfb40c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb40c4890 msgr2=0x7fdfb41f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb40c4890 0x7fdfb41f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.659+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0094d0 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 0x7fdfb41f68a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c01c2a0 tx=0x7fdf9c01acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0adde0 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c0b8420 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0b87d0 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40bc3e0 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb40bc680 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdf9c0b4040 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.663+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98005260 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.667+0000 7fdfab7fe640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdf940668d0 0x7fdf94068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:19.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.667+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf9c11e910 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.667+0000 7fdfb27fc640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdf940668d0 0x7fdf94068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:19.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.667+0000 7fdfb27fc640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdf940668d0 0x7fdf94068d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40af0a0 tx=0x7fdfa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:19.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.671+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf9c0ebb40 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.867+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3524005510 con 0x7f354414f360 2023-12-07T09:59:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f352b7fe640 1 -- 172.21.15.89:0/3272858093 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f353c0540d0 con 0x7f354414f360 2023-12-07T09:59:19.875 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-12-07T09:59:19.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35300669a0 msgr2=0x7f3530068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35300669a0 0x7f3530068e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35440c5d50 tx=0x7f3534008040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 msgr2=0x7f35441e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 0x7f35441e9700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f353c005350 tx=0x7f353c005810 comp rx=0 tx=0).stop 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 shutdown_connections 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35440a97d0 0x7f35441e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35300669a0 0x7f3530068e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f354414f360 0x7f35441e9700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 --2- 172.21.15.89:0/3272858093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35440a8f10 0x7f354414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.871+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 >> 172.21.15.89:0/3272858093 conn(0x7f35440c5e10 msgr2=0x7f35440c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.875+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 shutdown_connections 2023-12-07T09:59:19.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.875+0000 7f35491e6640 1 -- 172.21.15.89:0/3272858093 wait complete. 2023-12-07T09:59:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.891+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3f0145620 con 0x7ff3f014dd10 2023-12-07T09:59:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e77fe640 1 -- 172.21.15.89:0/1382252968 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3f0145620 con 0x7ff3f014dd10 2023-12-07T09:59:19.899 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff3d0066960 msgr2=0x7ff3d0068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff3d0066960 0x7ff3d0068e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8020f70 tx=0x7ff3d80ab070 comp rx=0 tx=0).stop 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 msgr2=0x7ff3f00ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f00ab210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0008a30 tx=0x7ff3e000e4f0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 shutdown_connections 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f014dd10 0x7ff3f00ab210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff3d0066960 0x7ff3d0068e20 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8020f70 tx=0x7ff3d80ab070 comp rx=0 tx=0).stop 2023-12-07T09:59:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff3f00c1f20 0x7ff3f00aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 --2- 172.21.15.89:0/1382252968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f006d020 0x7ff3f0147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.895+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 >> 172.21.15.89:0/1382252968 conn(0x7ff3f00c2ad0 msgr2=0x7ff3f0153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.899+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f247c159dc0 con 0x7f247c06cba0 2023-12-07T09:59:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.899+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 shutdown_connections 2023-12-07T09:59:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.899+0000 7ff3e57fa640 1 -- 172.21.15.89:0/1382252968 wait complete. 2023-12-07T09:59:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.899+0000 7f24727fc640 1 -- 172.21.15.89:0/3757680845 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f247c159dc0 con 0x7f247c06cba0 2023-12-07T09:59:19.909 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-12-07T09:59:19.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f24600669a0 msgr2=0x7f2460068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f24600669a0 0x7f2460068e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f247c0c61b0 tx=0x7f246c007e50 comp rx=0 tx=0).stop 2023-12-07T09:59:19.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 msgr2=0x7f247c1fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 0x7f247c1fa1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f247401a4e0 tx=0x7f2474019650 comp rx=0 tx=0).stop 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 shutdown_connections 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f247c152a90 0x7f247c0a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f24600669a0 0x7f2460068e60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f247c0722e0 0x7f247c14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 --2- 172.21.15.89:0/3757680845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f247c06cba0 0x7f247c1fa1d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 >> 172.21.15.89:0/3757680845 conn(0x7f247c06af50 msgr2=0x7f247c0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 shutdown_connections 2023-12-07T09:59:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.907+0000 7f2483a79640 1 -- 172.21.15.89:0/3757680845 wait complete. 2023-12-07T09:59:19.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.911+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4e80057e0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.919+0000 7fa4f2ffd640 1 -- 172.21.15.89:0/3662074023 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4f40ee7c0 con 0x7fa4ec0039b0 2023-12-07T09:59:19.923 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.919+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4e40668d0 msgr2=0x7fa4e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.919+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4e40668d0 0x7fa4e4068d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5040721c0 tx=0x7fa4f8008040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.919+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 msgr2=0x7fa5041e8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.919+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa5041e8d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c290 tx=0x7fa4ec005800 comp rx=0 tx=0).stop 2023-12-07T09:59:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 shutdown_connections 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5041ec900 0x7fa5040c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4e40668d0 0x7fa4e4068d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa504148b30 0x7fa5041453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 --2- 172.21.15.89:0/3662074023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4ec0039b0 0x7fa5041e8d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 >> 172.21.15.89:0/3662074023 conn(0x7fa5040c2ad0 msgr2=0x7fa504066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 shutdown_connections 2023-12-07T09:59:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.923+0000 7fa508e94640 1 -- 172.21.15.89:0/3662074023 wait complete. 2023-12-07T09:59:19.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-12-07T09:59:19.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-12-07T09:59:19.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-07T09:59:19.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.947+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1678155ab0 con 0x7f1678071530 2023-12-07T09:59:19.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.947+0000 7f166e7fc640 1 -- 172.21.15.89:0/3542900225 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16740b2030 con 0x7f1678071530 2023-12-07T09:59:19.955 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f165c0669d0 msgr2=0x7f165c068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f165c0669d0 0x7f165c068e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1678155fb0 tx=0x7f166800c040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 msgr2=0x7f16781fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 0x7f16781fed60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f16740ac000 tx=0x7f1674019120 comp rx=0 tx=0).stop 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 shutdown_connections 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1678164870 0x7f167815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16780c19e0 0x7f1678153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f165c0669d0 0x7f165c068e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 --2- 172.21.15.89:0/3542900225 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1678071530 0x7f16781fed60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 >> 172.21.15.89:0/3542900225 conn(0x7f16780c2ad0 msgr2=0x7f16780c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 shutdown_connections 2023-12-07T09:59:19.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.951+0000 7f16801e6640 1 -- 172.21.15.89:0/3542900225 wait complete. 2023-12-07T09:59:19.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.963+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdf98005510 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.963+0000 7fdfab7fe640 1 -- 172.21.15.89:0/3015175503 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf9c0ef160 con 0x7fdfb40bd5a0 2023-12-07T09:59:19.969 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-12-07T09:59:19.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdf940668d0 msgr2=0x7fdf94068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdf940668d0 0x7fdf94068d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40af0a0 tx=0x7fdfa4008040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 msgr2=0x7fdfb41f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 0x7fdfb41f68a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c01c2a0 tx=0x7fdf9c01acb0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 shutdown_connections 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdf940668d0 0x7fdf94068d90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdfb40ca620 0x7fdfb40c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb40c4890 0x7fdfb41f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 --2- 172.21.15.89:0/3015175503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfb40bd5a0 0x7fdfb41f68a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 >> 172.21.15.89:0/3015175503 conn(0x7fdfb40ac0a0 msgr2=0x7fdfb41545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 shutdown_connections 2023-12-07T09:59:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fdfb3fff640 1 -- 172.21.15.89:0/3015175503 wait complete. 2023-12-07T09:59:19.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbf8403ef60 con 0x7fbf8400b090 2023-12-07T09:59:19.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.967+0000 7fbf827fc640 1 -- 172.21.15.89:0/193786272 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf88054cc0 con 0x7fbf8400b090 2023-12-07T09:59:19.974 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbf700669a0 msgr2=0x7fbf70068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbf700669a0 0x7fbf70068e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf840e1690 tx=0x7fbf7c007c10 comp rx=0 tx=0).stop 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 msgr2=0x7fbf8403faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 0x7fbf8403faa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c7f0 tx=0x7fbf8800ccb0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 shutdown_connections 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf840decf0 0x7fbf84041490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbf700669a0 0x7fbf70068e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbf840dbcb0 0x7fbf84030380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 --2- 172.21.15.89:0/193786272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf8400b090 0x7fbf8403faa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 >> 172.21.15.89:0/193786272 conn(0x7fbf84048230 msgr2=0x7fbf840dfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-07T09:59:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 shutdown_connections 2023-12-07T09:59:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.971+0000 7fbf93ee4640 1 -- 172.21.15.89:0/193786272 wait complete. 2023-12-07T09:59:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.975+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc1b80050d0 con 0x7fc1d8154930 2023-12-07T09:59:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1bffff640 1 -- 172.21.15.89:0/1338840552 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1d0055150 con 0x7fc1d8154930 2023-12-07T09:59:19.984 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c40669a0 msgr2=0x7fc1c4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c40669a0 0x7fc1c4068e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000c10 tx=0x7fc1c8009040 comp rx=0 tx=0).stop 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1d8154930 msgr2=0x7fc1d813c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1d8154930 0x7fc1d813c280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1d806b4e0 tx=0x7fc1d0010530 comp rx=0 tx=0).stop 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 shutdown_connections 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1d8154930 0x7fc1d813c280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1d80a8da0 0x7fc1d813bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c40669a0 0x7fc1c4068e60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 --2- 172.21.15.89:0/1338840552 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1d806db80 0x7fc1d80a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 >> 172.21.15.89:0/1338840552 conn(0x7fc1d80c2ad0 msgr2=0x7fc1d8151130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 shutdown_connections 2023-12-07T09:59:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:19.979+0000 7fc1ddf8d640 1 -- 172.21.15.89:0/1338840552 wait complete. 2023-12-07T09:59:19.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-12-07T09:59:20.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-12-07T09:59:20.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-07T09:59:20.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-07T09:59:20.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-07T09:59:20.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-07T09:59:20.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-07T09:59:20.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-07T09:59:20.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-07T09:59:21.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-07T09:59:21.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-07T09:59:21.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 Processor -- start 2023-12-07T09:59:21.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 -- start start 2023-12-07T09:59:21.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc38014dc50 0x7fc3800c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc37e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc38014dc50 0x7fc3800c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc37dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc37e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc38014dc50 0x7fc3800c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:32950/0 (socket says 172.21.15.89:32950) 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc37e59c640 1 -- 172.21.15.89:0/1255534689 learned_addr learned my addr 172.21.15.89:0/1255534689 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc380071440 con 0x7fc38006bee0 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc380151100 con 0x7fc38014dc50 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.099+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc380071f90 con 0x7fc38006c400 2023-12-07T09:59:21.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37d59a640 1 -- 172.21.15.89:0/1255534689 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437319188 0 0) 0x7fc3780014a0 con 0x7fc38006bee0 2023-12-07T09:59:21.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37d59a640 1 -- 172.21.15.89:0/1255534689 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc368003530 con 0x7fc38006bee0 2023-12-07T09:59:21.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37d59a640 1 -- 172.21.15.89:0/1255534689 <== mon.1 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3587543754 0 0) 0x7fc368003530 con 0x7fc38006bee0 2023-12-07T09:59:21.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37e59c640 1 -- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 msgr2=0x7fc3800c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37e59c640 1 --2- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37e59c640 1 -- 172.21.15.89:0/1255534689 >> v1:172.21.15.97:6789/0 conn(0x7fc38006bee0 legacy=0x7fc38006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.103+0000 7fc37e59c640 1 -- 172.21.15.89:0/1255534689 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc380151630 con 0x7fc38014dc50 2023-12-07T09:59:21.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.107+0000 7fc37e59c640 1 --2- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38014dc50 0x7fc3800c0d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc374009870 tx=0x7fc37401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7cdd617f610f4aa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.107+0000 7fc37d59a640 1 -- 172.21.15.89:0/1255534689 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378001b90 con 0x7fc38014dc50 2023-12-07T09:59:21.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.107+0000 7fc37d59a640 1 -- 172.21.15.89:0/1255534689 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3740aa480 con 0x7fc38014dc50 2023-12-07T09:59:21.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.107+0000 7fc37d59a640 1 -- 172.21.15.89:0/1255534689 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740aa7f0 con 0x7fc38014dc50 2023-12-07T09:59:21.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.107+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38014dc50 msgr2=0x7fc3800c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.107+0000 7fc384854640 1 --2- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38014dc50 0x7fc3800c0d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc374009870 tx=0x7fc37401c4f0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.111+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 shutdown_connections 2023-12-07T09:59:21.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.111+0000 7fc384854640 1 --2- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.111+0000 7fc384854640 1 --2- 172.21.15.89:0/1255534689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38014dc50 0x7fc3800c0d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.111+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 >> 172.21.15.89:0/1255534689 conn(0x7fc3800c5e10 msgr2=0x7fc3800c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.111+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 shutdown_connections 2023-12-07T09:59:21.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.111+0000 7fc384854640 1 -- 172.21.15.89:0/1255534689 wait complete. 2023-12-07T09:59:21.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 Processor -- start 2023-12-07T09:59:21.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 -- start start 2023-12-07T09:59:21.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38006bee0 0x7fc3801f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38014dc50 0x7fc3801ee260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc380154590 con 0x7fc38014dc50 2023-12-07T09:59:21.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc380150c90 con 0x7fc38006bee0 2023-12-07T09:59:21.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc384854640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3801edb30 con 0x7fc38006c400 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55130/0 (socket says 172.21.15.89:55130) 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 -- 172.21.15.89:0/2156731549 learned_addr learned my addr 172.21.15.89:0/2156731549 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 -- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38006bee0 msgr2=0x7fc3801f1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38006bee0 0x7fc3801f1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 -- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38014dc50 msgr2=0x7fc3801ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38014dc50 0x7fc3801ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 -- 172.21.15.89:0/2156731549 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3740094d0 con 0x7fc38006c400 2023-12-07T09:59:21.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.115+0000 7fc37dd9b640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c4520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc37000f9e0 tx=0x7fc37000fea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000c070 con 0x7fc38006c400 2023-12-07T09:59:21.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37000db20 con 0x7fc38006c400 2023-12-07T09:59:21.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000de90 con 0x7fc38006c400 2023-12-07T09:59:21.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3801eddd0 con 0x7fc38006c400 2023-12-07T09:59:21.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3801503f0 con 0x7fc38006c400 2023-12-07T09:59:21.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38004e890 con 0x7fc38006c400 2023-12-07T09:59:21.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.119+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc370011450 con 0x7fc38006c400 2023-12-07T09:59:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.123+0000 7fc36effd640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc3600668d0 0x7fc360068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.123+0000 7fc37e59c640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc3600668d0 0x7fc360068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.123+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc370015070 con 0x7fc38006c400 2023-12-07T09:59:21.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.127+0000 7fc37e59c640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc3600668d0 0x7fc360068d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3740ae000 tx=0x7fc374008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.131+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc370052480 con 0x7fc38006c400 2023-12-07T09:59:21.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.163+0000 7fa806d1d640 1 Processor -- start 2023-12-07T09:59:21.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.163+0000 7fa806d1d640 1 -- start start 2023-12-07T09:59:21.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa806d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 0x7fa7f80df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa806d1d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7f803ebe0 0x7fa7f800ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa806d1d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f800a1d0 con 0x7fa7f803e780 2023-12-07T09:59:21.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa806d1d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f803f050 con 0x7fa7f803ebe0 2023-12-07T09:59:21.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa806d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f800b2b0 con 0x7fa7f80dbb90 2023-12-07T09:59:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa804ab9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 0x7fa7f80df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa804ab9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 0x7fa7f80df0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55132/0 (socket says 172.21.15.89:55132) 2023-12-07T09:59:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa804ab9640 1 -- 172.21.15.89:0/3052576752 learned_addr learned my addr 172.21.15.89:0/3052576752 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa8052ba640 1 --2- 172.21.15.89:0/3052576752 >> v2:172.21.15.89:3300/0 conn(0x7fa7f803ebe0 0x7fa7f800ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa804ab9640 1 -- 172.21.15.89:0/3052576752 >> v2:172.21.15.89:3300/0 conn(0x7fa7f803ebe0 msgr2=0x7fa7f800ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa804ab9640 1 --2- 172.21.15.89:0/3052576752 >> v2:172.21.15.89:3300/0 conn(0x7fa7f803ebe0 0x7fa7f800ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.167+0000 7fa804ab9640 1 -- 172.21.15.89:0/3052576752 >> v1:172.21.15.89:6789/0 conn(0x7fa7f803e780 legacy=0x7fa7f800a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.171+0000 7fa804ab9640 1 -- 172.21.15.89:0/3052576752 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80df600 con 0x7fa7f80dbb90 2023-12-07T09:59:21.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.171+0000 7f34bdda1640 1 Processor -- start 2023-12-07T09:59:21.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.171+0000 7f34bdda1640 1 -- start start 2023-12-07T09:59:21.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34bdda1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34b8156500 0x7f34b806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34bdda1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b806dec0 con 0x7f34b814fcc0 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34bdda1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b8156980 con 0x7f34b80c19e0 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34bdda1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b80aa340 con 0x7f34b8156500 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b7fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f34b80c19e0 0x7f34b80c1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:41448/0 (socket says 172.21.15.89:41448) 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b7fff640 1 -- 172.21.15.89:0/4256968629 learned_addr learned my addr 172.21.15.89:0/4256968629 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa804ab9640 1 --2- 172.21.15.89:0/3052576752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 0x7fa7f80df0c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2230f72ff0a56899 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b6ffd640 1 --2- 172.21.15.89:0/4256968629 >> v2:172.21.15.97:3300/0 conn(0x7f34b8156500 0x7f34b806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa7ff7fe640 1 -- 172.21.15.89:0/3052576752 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab600 con 0x7fa7f80dbb90 2023-12-07T09:59:21.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013575357 0 0) 0x7f34ac001120 con 0x7f34b80c19e0 2023-12-07T09:59:21.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a0003530 con 0x7f34b80c19e0 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa7ff7fe640 1 -- 172.21.15.89:0/3052576752 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0a7050 con 0x7fa7f80dbb90 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa7ff7fe640 1 -- 172.21.15.89:0/3052576752 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab600 con 0x7fa7f80dbb90 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859567860 0 0) 0x7f34b806dec0 con 0x7f34b814fcc0 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34ac001120 con 0x7f34b814fcc0 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.1 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116386344 0 0) 0x7f34a0003530 con 0x7f34b80c19e0 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 >> v2:172.21.15.97:3300/0 conn(0x7f34b8156500 msgr2=0x7f34b806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 --2- 172.21.15.89:0/4256968629 >> v2:172.21.15.97:3300/0 conn(0x7f34b8156500 0x7f34b806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 >> v1:172.21.15.89:6789/0 conn(0x7f34b814fcc0 legacy=0x7f34b80aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80720c0 con 0x7f34b80c19e0 2023-12-07T09:59:21.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.1 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f34ac001810 con 0x7f34b80c19e0 2023-12-07T09:59:21.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa806d1d640 1 -- 172.21.15.89:0/3052576752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 msgr2=0x7fa7f80df0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa806d1d640 1 --2- 172.21.15.89:0/3052576752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 0x7fa7f80df0c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec01c3d0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 >> v1:172.21.15.97:6789/0 conn(0x7f34b80c19e0 legacy=0x7f34b80c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a0003b10 0x7f34a0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa806d1d640 1 -- 172.21.15.89:0/3052576752 shutdown_connections 2023-12-07T09:59:21.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa806d1d640 1 --2- 172.21.15.89:0/3052576752 >> v2:172.21.15.89:3300/0 conn(0x7fa7f803ebe0 0x7fa7f800ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa806d1d640 1 --2- 172.21.15.89:0/3052576752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f80dbb90 0x7fa7f80df0c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7fa806d1d640 1 -- 172.21.15.89:0/3052576752 >> 172.21.15.89:0/3052576752 conn(0x7fa7f8048230 msgr2=0x7fa7f8048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00047d0 0x7f34a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a000c180 con 0x7f34a0003b10 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a000c2f0 con 0x7f34a00052b0 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a000c4b0 con 0x7f34a00047d0 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b7fff640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f34b6ffd640 1 --2- 172.21.15.89:0/4256968629 >> v2:172.21.15.97:3300/0 conn(0x7f34b8156500 0x7f34b806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:21.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f34b6ffd640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00047d0 0x7f34a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f34b7fff640 1 -- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00047d0 msgr2=0x7f34a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f34b7fff640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00047d0 0x7f34a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f34b7fff640 1 -- 172.21.15.89:0/4256968629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a0003b10 msgr2=0x7f34a0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f34b7fff640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a0003b10 0x7f34a0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f34b7fff640 1 -- 172.21.15.89:0/4256968629 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80720c0 con 0x7f34a00052b0 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7fa806d1d640 1 -- 172.21.15.89:0/3052576752 shutdown_connections 2023-12-07T09:59:21.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7fa806d1d640 1 -- 172.21.15.89:0/3052576752 wait complete. 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.175+0000 7f81693f8640 1 Processor -- start 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 -- start start 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8164071340 0x7f8164158a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f816406db10 0x7f816415c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816415cb80 0x7f8164152530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816415d010 con 0x7f816406db10 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640c2580 con 0x7f8164071340 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81693f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8164159a10 con 0x7f816415cb80 2023-12-07T09:59:21.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f8162ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8164071340 0x7f8164158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f8162ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8164071340 0x7f8164158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:32990/0 (socket says 172.21.15.89:32990) 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f8162ffd640 1 -- 172.21.15.89:0/1661719800 learned_addr learned my addr 172.21.15.89:0/1661719800 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81627fc640 1 --2- 172.21.15.89:0/1661719800 >> v2:172.21.15.89:3300/0 conn(0x7f816406db10 0x7f816415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.179+0000 7f81627fc640 1 -- 172.21.15.89:0/1661719800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816415cb80 msgr2=0x7f8164152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f81627fc640 1 --2- 172.21.15.89:0/1661719800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816415cb80 0x7f8164152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f81627fc640 1 -- 172.21.15.89:0/1661719800 >> v2:172.21.15.97:3300/0 conn(0x7f8164071340 msgr2=0x7f8164158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34b7fff640 1 -- 172.21.15.89:0/4256968629 reap_dead start 2023-12-07T09:59:21.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34b7fff640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34a000b990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34ac013a20 tx=0x7f34ac025860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7133b40aae1526e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f81627fc640 1 --2- 172.21.15.89:0/1661719800 >> v2:172.21.15.97:3300/0 conn(0x7f8164071340 0x7f8164158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac0ae830 con 0x7f34a00052b0 2023-12-07T09:59:21.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac0ae9b0 con 0x7f34a00052b0 2023-12-07T09:59:21.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7fa806d1d640 1 Processor -- start 2023-12-07T09:59:21.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34b67fc640 1 -- 172.21.15.89:0/4256968629 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac0aed60 con 0x7f34a00052b0 2023-12-07T09:59:21.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7fa806d1d640 1 -- start start 2023-12-07T09:59:21.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f81627fc640 1 -- 172.21.15.89:0/1661719800 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164159170 con 0x7f816406db10 2023-12-07T09:59:21.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34bdda1640 1 -- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 msgr2=0x7f34a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.183+0000 7f34bdda1640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34a000b990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34ac013a20 tx=0x7f34ac025860 comp rx=0 tx=0).stop 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 0x7fa7f8182b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f803ebe0 0x7fa7f80309a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7f80dbb90 0x7fa7f8030ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f802f350 con 0x7fa7f803ebe0 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f802ed70 con 0x7fa7f80dbb90 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f8183380 con 0x7fa7f803e780 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 0x7fa7f8182b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 0x7fa7f8182b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55154/0 (socket says 172.21.15.89:55154) 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 -- 172.21.15.89:0/4098192299 learned_addr learned my addr 172.21.15.89:0/4098192299 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa8052ba640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7f80dbb90 0x7fa7f8030ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa7fffff640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f803ebe0 0x7fa7f80309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f34bdda1640 1 -- 172.21.15.89:0/4256968629 shutdown_connections 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f34bdda1640 1 --2- 172.21.15.89:0/4256968629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34a000b990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f34bdda1640 1 -- 172.21.15.89:0/4256968629 >> 172.21.15.89:0/4256968629 conn(0x7f34b80c2ad0 msgr2=0x7f34b80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f34bdda1640 1 -- 172.21.15.89:0/4256968629 shutdown_connections 2023-12-07T09:59:21.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f34bdda1640 1 -- 172.21.15.89:0/4256968629 wait complete. 2023-12-07T09:59:21.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 -- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7f80dbb90 msgr2=0x7fa7f8030ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7f80dbb90 0x7fa7f8030ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 -- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f803ebe0 msgr2=0x7fa7f80309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f803ebe0 0x7fa7f80309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 -- 172.21.15.89:0/4098192299 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0094d0 con 0x7fa7f803e780 2023-12-07T09:59:21.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa804ab9640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 0x7fa7f8182b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0ae040 tx=0x7fa7ec019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec003c30 con 0x7fa7f803e780 2023-12-07T09:59:21.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec003d90 con 0x7fa7f803e780 2023-12-07T09:59:21.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f81627fc640 1 --2- 172.21.15.89:0/1661719800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f816406db10 0x7f816415c640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f81640710b0 tx=0x7f815401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdf00cef3e2ea6d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 -- 172.21.15.89:0/4098192299 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f80dc0f0 con 0x7fa7f803e780 2023-12-07T09:59:21.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f8161ffb640 1 -- 172.21.15.89:0/1661719800 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540ad660 con 0x7f816406db10 2023-12-07T09:59:21.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f8161ffb640 1 -- 172.21.15.89:0/1661719800 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81540ad7c0 con 0x7f816406db10 2023-12-07T09:59:21.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7f8161ffb640 1 -- 172.21.15.89:0/1661719800 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540adb50 con 0x7f816406db10 2023-12-07T09:59:21.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa806d1d640 1 -- 172.21.15.89:0/4098192299 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f8183620 con 0x7fa7f803e780 2023-12-07T09:59:21.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.187+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab640 con 0x7fa7f803e780 2023-12-07T09:59:21.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f34bdda1640 1 Processor -- start 2023-12-07T09:59:21.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f34bdda1640 1 -- start start 2023-12-07T09:59:21.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 -- 172.21.15.89:0/1661719800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f816406db10 msgr2=0x7f816415c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 --2- 172.21.15.89:0/1661719800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f816406db10 0x7f816415c640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f81640710b0 tx=0x7f815401c3a0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d8005260 con 0x7fa7f803e780 2023-12-07T09:59:21.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 -- 172.21.15.89:0/1661719800 shutdown_connections 2023-12-07T09:59:21.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 --2- 172.21.15.89:0/1661719800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816415cb80 0x7f8164152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 --2- 172.21.15.89:0/1661719800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f816406db10 0x7f816415c640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 --2- 172.21.15.89:0/1661719800 >> v2:172.21.15.97:3300/0 conn(0x7f8164071340 0x7f8164158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 -- 172.21.15.89:0/1661719800 >> 172.21.15.89:0/1661719800 conn(0x7f81640c2ad0 msgr2=0x7f81640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 -- 172.21.15.89:0/1661719800 shutdown_connections 2023-12-07T09:59:21.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f81693f8640 1 -- 172.21.15.89:0/1661719800 wait complete. 2023-12-07T09:59:21.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f34bdda1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34b81ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa7ec0b2040 con 0x7fa7f803e780 2023-12-07T09:59:21.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.191+0000 7f34bdda1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 0x7f34b80bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34bdda1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b81572b0 0x7f34b80bf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 0x7f34b80bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 0x7f34b80bf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55162/0 (socket says 172.21.15.89:55162) 2023-12-07T09:59:21.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7fa7fd7fa640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa7e4066950 0x7fa7e4068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b81572b0 0x7f34b80bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b81572b0 0x7f34b80bf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39940/0 (socket says 172.21.15.89:39940) 2023-12-07T09:59:21.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 -- 172.21.15.89:0/478626658 learned_addr learned my addr 172.21.15.89:0/478626658 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80bedb0 con 0x7f34b81572b0 2023-12-07T09:59:21.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80c0300 con 0x7f34a00052b0 2023-12-07T09:59:21.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7fa7fffff640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa7e4066950 0x7fa7e4068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81ec810 con 0x7f34b81ec2c0 2023-12-07T09:59:21.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7fa7fffff640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa7e4066950 0x7fa7e4068e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa800064270 tx=0x7fa80006d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7ec0ef7a0 con 0x7fa7f803e780 2023-12-07T09:59:21.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f81693f8640 1 Processor -- start 2023-12-07T09:59:21.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 -- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 msgr2=0x7f34b81ebd80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:21.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34b81ebd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 -- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b81572b0 msgr2=0x7f34b80bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b81572b0 0x7f34b80bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f34b6ffd640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80c05c0 con 0x7f34b81ec2c0 2023-12-07T09:59:21.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.195+0000 7f81693f8640 1 -- start start 2023-12-07T09:59:21.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f34b6ffd640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 0x7f34b80bf1d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34b000ef40 tx=0x7f34b000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816406db10 0x7f816414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071340 0x7f816414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f816415cb80 0x7f816414c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816414e320 con 0x7f8164071340 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164154140 con 0x7f816415cb80 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816414e040 con 0x7f816406db10 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f8162ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816406db10 0x7f816414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81627fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071340 0x7f816414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f816415cb80 0x7f816414c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f8162ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816406db10 0x7f816414d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55170/0 (socket says 172.21.15.89:55170) 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f8162ffd640 1 -- 172.21.15.89:0/2359739998 learned_addr learned my addr 172.21.15.89:0/2359739998 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 -- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816406db10 msgr2=0x7f816414d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816406db10 0x7f816414d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 -- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071340 msgr2=0x7f816414c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071340 0x7f816414c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 -- 172.21.15.89:0/2359739998 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154009420 con 0x7f816415cb80 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7ec0ec270 con 0x7fa7f803e780 2023-12-07T09:59:21.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000a890 con 0x7f34b81ec2c0 2023-12-07T09:59:21.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81637fe640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f816415cb80 0x7f816414c950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f815c00be20 tx=0x7f815c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b8155560 con 0x7f34b81ec2c0 2023-12-07T09:59:21.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b80bc210 con 0x7f34b81ec2c0 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00ce70 con 0x7f816415cb80 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c014440 con 0x7f816415cb80 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c014810 con 0x7f816415cb80 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.199+0000 7f81693f8640 1 -- 172.21.15.89:0/2359739998 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81641543e0 con 0x7f816415cb80 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.203+0000 7f81693f8640 1 -- 172.21.15.89:0/2359739998 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816414e9f0 con 0x7f816415cb80 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.203+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b000a9f0 con 0x7f34b81ec2c0 2023-12-07T09:59:21.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.203+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000ad80 con 0x7f34b81ec2c0 2023-12-07T09:59:21.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.203+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3498005260 con 0x7f34b81ec2c0 2023-12-07T09:59:21.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.203+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144005260 con 0x7f816415cb80 2023-12-07T09:59:21.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.203+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f34b00183f0 con 0x7f34b81ec2c0 2023-12-07T09:59:21.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f815c01c360 con 0x7f816415cb80 2023-12-07T09:59:21.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f349ffff640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34a40668d0 0x7f34a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34b0084fe0 con 0x7f34b81ec2c0 2023-12-07T09:59:21.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f814b7fe640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f81500669a0 0x7f8150068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f815c084510 con 0x7f816415cb80 2023-12-07T09:59:21.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f8162ffd640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f81500669a0 0x7f8150068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.207+0000 7f34b77fe640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34a40668d0 0x7f34a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.211+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34b00522e0 con 0x7f34b81ec2c0 2023-12-07T09:59:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.211+0000 7f8162ffd640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f81500669a0 0x7f8150068e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8158006aa0 tx=0x7f8158008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.211+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f815c0517e0 con 0x7f816415cb80 2023-12-07T09:59:21.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.215+0000 7f34b77fe640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34a40668d0 0x7f34a4068d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34a8007fd0 tx=0x7f34a8007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 Processor -- start 2023-12-07T09:59:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 -- start start 2023-12-07T09:59:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825014de50 0x7f82500708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f825006cdc0 0x7f8250070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8250071410 con 0x7f8250070380 2023-12-07T09:59:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825006da50 con 0x7f825006cdc0 2023-12-07T09:59:21.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.255+0000 7f824f59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82501511d0 con 0x7f825014de50 2023-12-07T09:59:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 Processor -- start 2023-12-07T09:59:21.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 -- start start 2023-12-07T09:59:21.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f825006cdc0 0x7f8250070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f825006cdc0 0x7f8250070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39962/0 (socket says 172.21.15.89:39962) 2023-12-07T09:59:21.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 -- 172.21.15.89:0/3047824733 learned_addr learned my addr 172.21.15.89:0/3047824733 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 -- 172.21.15.89:0/3047824733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825014de50 msgr2=0x7f82500708d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T09:59:21.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 --2- 172.21.15.89:0/3047824733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825014de50 0x7f82500708d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 -- 172.21.15.89:0/3047824733 >> v1:172.21.15.97:6789/0 conn(0x7f8250070380 legacy=0x7f82500c08f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T09:59:21.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f824dd9b640 1 -- 172.21.15.89:0/3047824733 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82501514b0 con 0x7f825006cdc0 2023-12-07T09:59:21.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19680d46b0 0x7f19680d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f196804a410 0x7f1968007340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19680d7f30 con 0x7f1968006ed0 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196804b500 con 0x7f19680d46b0 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.259+0000 7f1975baa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680d4a90 con 0x7f196804a410 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1968006ed0 0x7f1968049d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57852/0 (socket says 172.21.15.89:57852) 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196effd640 1 -- 172.21.15.89:0/1876782154 learned_addr learned my addr 172.21.15.89:0/1876782154 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:21.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196ffff640 1 --2- 172.21.15.89:0/1876782154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f196804a410 0x7f1968007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196f7fe640 1 --2- 172.21.15.89:0/1876782154 >> v2:172.21.15.89:3300/0 conn(0x7f19680d46b0 0x7f19680d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196f7fe640 1 -- 172.21.15.89:0/1876782154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f196804a410 msgr2=0x7f1968007340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196f7fe640 1 --2- 172.21.15.89:0/1876782154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f196804a410 0x7f1968007340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196f7fe640 1 -- 172.21.15.89:0/1876782154 >> v1:172.21.15.89:6789/0 conn(0x7f1968006ed0 legacy=0x7f1968049d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.263+0000 7f196f7fe640 1 -- 172.21.15.89:0/1876782154 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196804ac60 con 0x7f19680d46b0 2023-12-07T09:59:21.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 Processor -- start 2023-12-07T09:59:21.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7f824dd9b640 1 --2- 172.21.15.89:0/3047824733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825006cdc0 0x7f8250070e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8240008870 tx=0x7f824001e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505d4d79799eeaa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7f824d59a640 1 -- 172.21.15.89:0/3047824733 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82400a6df0 con 0x7f825006cdc0 2023-12-07T09:59:21.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7f824d59a640 1 -- 172.21.15.89:0/3047824733 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82400aa070 con 0x7f825006cdc0 2023-12-07T09:59:21.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7f824d59a640 1 -- 172.21.15.89:0/3047824733 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82400b0620 con 0x7f825006cdc0 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 -- start start 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef580ca610 0x7fef580c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef580bd720 0x7fef580c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef5806cd90 0x7fef58158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef58155790 con 0x7fef580ca610 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580c4b00 con 0x7fef580bd720 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef5e6fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c4de0 con 0x7fef5806cd90 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef57fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef580ca610 0x7fef580c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef57fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef580ca610 0x7fef580c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39990/0 (socket says 172.21.15.89:39990) 2023-12-07T09:59:21.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef57fff640 1 -- 172.21.15.89:0/3271551913 learned_addr learned my addr 172.21.15.89:0/3271551913 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7fef577fe640 1 --2- 172.21.15.89:0/3271551913 >> v2:172.21.15.97:3300/0 conn(0x7fef580bd720 0x7fef580c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7fef5cc9b640 1 --2- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef5806cd90 0x7fef58158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 Processor -- start 2023-12-07T09:59:21.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 -- 172.21.15.89:0/3047824733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825006cdc0 msgr2=0x7f8250070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 --2- 172.21.15.89:0/3047824733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825006cdc0 0x7f8250070e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8240008870 tx=0x7f824001e5f0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.267+0000 7f196f7fe640 1 --2- 172.21.15.89:0/1876782154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19680d46b0 0x7f19680d79f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1970064410 tx=0x7f1970096b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0ec9680b5819d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 -- 172.21.15.89:0/3047824733 shutdown_connections 2023-12-07T09:59:21.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 --2- 172.21.15.89:0/3047824733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825006cdc0 0x7f8250070e10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 --2- 172.21.15.89:0/3047824733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825014de50 0x7f82500708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 -- 172.21.15.89:0/3047824733 >> 172.21.15.89:0/3047824733 conn(0x7f82500c60c0 msgr2=0x7f82500c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7fef577fe640 1 -- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef5806cd90 msgr2=0x7fef58158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 -- 172.21.15.89:0/3047824733 shutdown_connections 2023-12-07T09:59:21.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7fef577fe640 1 --2- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef5806cd90 0x7fef58158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7fef577fe640 1 -- 172.21.15.89:0/3271551913 >> v2:172.21.15.89:3300/0 conn(0x7fef580ca610 msgr2=0x7fef580c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7fef577fe640 1 --2- 172.21.15.89:0/3271551913 >> v2:172.21.15.89:3300/0 conn(0x7fef580ca610 0x7fef580c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7fef577fe640 1 -- 172.21.15.89:0/3271551913 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58157e30 con 0x7fef580bd720 2023-12-07T09:59:21.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 -- start start 2023-12-07T09:59:21.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f196e7fc640 1 -- 172.21.15.89:0/1876782154 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197011f8b0 con 0x7f19680d46b0 2023-12-07T09:59:21.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f196e7fc640 1 -- 172.21.15.89:0/1876782154 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197011fa10 con 0x7f19680d46b0 2023-12-07T09:59:21.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f196e7fc640 1 -- 172.21.15.89:0/1876782154 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197011fe40 con 0x7f19680d46b0 2023-12-07T09:59:21.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bf80c01e0 0x7f5bf815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf806d120 con 0x7f5bf806dfb0 2023-12-07T09:59:21.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf8070cd0 con 0x7f5bf80c01e0 2023-12-07T09:59:21.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfeb8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8070170 con 0x7f5bf80c1b90 2023-12-07T09:59:21.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f824f59e640 1 -- 172.21.15.89:0/3047824733 wait complete. 2023-12-07T09:59:21.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55222/0 (socket says 172.21.15.89:55222) 2023-12-07T09:59:21.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 -- 172.21.15.89:0/4204598927 learned_addr learned my addr 172.21.15.89:0/4204598927 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bf7fff640 1 --2- 172.21.15.89:0/4204598927 >> v2:172.21.15.89:3300/0 conn(0x7f5bf80c01e0 0x7f5bf815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 -- 172.21.15.89:0/4204598927 >> v2:172.21.15.89:3300/0 conn(0x7f5bf80c01e0 msgr2=0x7f5bf815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 --2- 172.21.15.89:0/4204598927 >> v2:172.21.15.89:3300/0 conn(0x7f5bf80c01e0 0x7f5bf815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 -- 172.21.15.89:0/4204598927 >> v1:172.21.15.97:6789/0 conn(0x7f5bf806dfb0 legacy=0x7f5bf80705c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T09:59:21.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.271+0000 7f5bfc929640 1 -- 172.21.15.89:0/4204598927 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf806d400 con 0x7f5bf80c1b90 2023-12-07T09:59:21.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 -- 172.21.15.89:0/1876782154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19680d46b0 msgr2=0x7f19680d79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 --2- 172.21.15.89:0/1876782154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19680d46b0 0x7f19680d79f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1970064410 tx=0x7f1970096b20 comp rx=0 tx=0).stop 2023-12-07T09:59:21.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 -- 172.21.15.89:0/1876782154 shutdown_connections 2023-12-07T09:59:21.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 --2- 172.21.15.89:0/1876782154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f196804a410 0x7f1968007340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 --2- 172.21.15.89:0/1876782154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19680d46b0 0x7f19680d79f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 -- 172.21.15.89:0/1876782154 >> 172.21.15.89:0/1876782154 conn(0x7f1968048230 msgr2=0x7f1968048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 -- 172.21.15.89:0/1876782154 shutdown_connections 2023-12-07T09:59:21.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f824f59e640 1 Processor -- start 2023-12-07T09:59:21.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f824f59e640 1 -- start start 2023-12-07T09:59:21.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f1975baa640 1 -- 172.21.15.89:0/1876782154 wait complete. 2023-12-07T09:59:21.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7fef577fe640 1 --2- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 0x7fef580c9a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef580ca380 tx=0x7fef4801c020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54a23e497cfb8d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f824f59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 0x7f82501f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f824f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8250070380 0x7f8250142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f824e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 0x7f82501f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 0x7f82501f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55228/0 (socket says 172.21.15.89:55228) 2023-12-07T09:59:21.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7fef56ffd640 1 -- 172.21.15.89:0/3271551913 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef580c52d0 con 0x7fef580bd720 2023-12-07T09:59:21.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.275+0000 7f824f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f825014de50 0x7f8250145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 -- 172.21.15.89:0/3853536969 learned_addr learned my addr 172.21.15.89:0/3853536969 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82501efd80 con 0x7f8250070380 2023-12-07T09:59:21.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825014ba20 con 0x7f825014de50 2023-12-07T09:59:21.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82500a8ff0 con 0x7f825006cdc0 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824dd9b640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8250070380 0x7f8250142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f1975baa640 1 Processor -- start 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f1975baa640 1 -- start start 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824ed9d640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f825014de50 0x7f8250145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 -- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f825014de50 msgr2=0x7f8250145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f825014de50 0x7f8250145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 -- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8250070380 msgr2=0x7f8250142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8250070380 0x7f8250142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240008550 con 0x7f825006cdc0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824dd9b640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8250070380 0x7f8250142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824ed9d640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f825014de50 0x7f8250145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824e59c640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 0x7f82501f5fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f824800ba50 tx=0x7f824800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800cc10 con 0x7f825006cdc0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824800cd70 con 0x7f825006cdc0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248014680 con 0x7f825006cdc0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82500a8a30 con 0x7f825006cdc0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825014bcc0 con 0x7f825006cdc0 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7fef56ffd640 1 -- 172.21.15.89:0/3271551913 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480a47e0 con 0x7fef580bd720 2023-12-07T09:59:21.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7fef56ffd640 1 -- 172.21.15.89:0/3271551913 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480a4b70 con 0x7fef580bd720 2023-12-07T09:59:21.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7fef5e6fe640 1 -- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 msgr2=0x7fef580c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 0x7fef580c9a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef580ca380 tx=0x7fef4801c020 comp rx=0 tx=0).stop 2023-12-07T09:59:21.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f5bfc929640 1 --2- 172.21.15.89:0/4204598927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80c1f70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009870 tx=0x7f5be401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ba2f1557ed0976 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f1975baa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1968006ed0 0x7f19680cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f1975baa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 0x7f19680ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f196f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1968006ed0 0x7f19680cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f196f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1968006ed0 0x7f19680cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:33030/0 (socket says 172.21.15.89:33030) 2023-12-07T09:59:21.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f196effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 0x7f19680ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f5bf77fe640 1 -- 172.21.15.89:0/4204598927 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40ac630 con 0x7f5bf80c1b90 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f196effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 0x7f19680ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40020/0 (socket says 172.21.15.89:40020) 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f196f7fe640 1 -- 172.21.15.89:0/1828367425 learned_addr learned my addr 172.21.15.89:0/1828367425 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 -- 172.21.15.89:0/3271551913 shutdown_connections 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef5806cd90 0x7fef58158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/3271551913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 0x7fef580c9a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/3271551913 >> v2:172.21.15.89:3300/0 conn(0x7fef580ca610 0x7fef580c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 -- 172.21.15.89:0/3271551913 >> 172.21.15.89:0/3271551913 conn(0x7fef58071ea0 msgr2=0x7fef580722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f5bf77fe640 1 -- 172.21.15.89:0/4204598927 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be40ac790 con 0x7f5bf80c1b90 2023-12-07T09:59:21.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f5bf77fe640 1 -- 172.21.15.89:0/4204598927 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40acb20 con 0x7f5bf80c1b90 2023-12-07T09:59:21.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.279+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825014bee0 con 0x7f825006cdc0 2023-12-07T09:59:21.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19680d46b0 0x7f19680cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19680d0fc0 con 0x7f196804a410 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1968045750 con 0x7f1968006ed0 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680d0440 con 0x7f19680d46b0 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196ffff640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19680d46b0 0x7f19680cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196effd640 1 -- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19680d46b0 msgr2=0x7f19680cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196effd640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19680d46b0 0x7f19680cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196effd640 1 -- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1968006ed0 msgr2=0x7f19680cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196effd640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1968006ed0 0x7f19680cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196effd640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700687b0 con 0x7f196804a410 2023-12-07T09:59:21.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/4204598927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 msgr2=0x7f5bf80c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/4204598927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80c1f70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009870 tx=0x7f5be401c500 comp rx=0 tx=0).stop 2023-12-07T09:59:21.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f196effd640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 0x7f19680ccad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c390 tx=0x7f195c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c005cf0 con 0x7f196804a410 2023-12-07T09:59:21.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c005e50 con 0x7f196804a410 2023-12-07T09:59:21.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c0072d0 con 0x7f196804a410 2023-12-07T09:59:21.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19680d0720 con 0x7f196804a410 2023-12-07T09:59:21.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19680d0ce0 con 0x7f196804a410 2023-12-07T09:59:21.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 -- 172.21.15.89:0/3271551913 shutdown_connections 2023-12-07T09:59:21.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 -- 172.21.15.89:0/3271551913 wait complete. 2023-12-07T09:59:21.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 Processor -- start 2023-12-07T09:59:21.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7fef5e6fe640 1 -- start start 2023-12-07T09:59:21.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1950005260 con 0x7f196804a410 2023-12-07T09:59:21.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8248007370 con 0x7f825006cdc0 2023-12-07T09:59:21.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f823effd640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8230066900 0x7f8230068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.283+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8248083f90 con 0x7f825006cdc0 2023-12-07T09:59:21.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/4204598927 shutdown_connections 2023-12-07T09:59:21.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/4204598927 >> v2:172.21.15.89:3300/0 conn(0x7f5bf80c01e0 0x7f5bf815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/4204598927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80c1f70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/4204598927 >> 172.21.15.89:0/4204598927 conn(0x7f5bf80c5f60 msgr2=0x7f5bf80c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/4204598927 shutdown_connections 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5e6fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef5806cd90 0x7fef5814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5e6fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 0x7fef581ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5e6fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 0x7fef581eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5e6fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5814ef00 con 0x7fef5806cd90 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5e6fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5814f1e0 con 0x7fef580bd720 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 0x7fef581eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 0x7fef581eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55240/0 (socket says 172.21.15.89:55240) 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 -- 172.21.15.89:0/2170902091 learned_addr learned my addr 172.21.15.89:0/2170902091 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5814f4c0 con 0x7fef580ca610 2023-12-07T09:59:21.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/4204598927 wait complete. 2023-12-07T09:59:21.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f5bfeb8d640 1 Processor -- start 2023-12-07T09:59:21.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7f824dd9b640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8230066900 0x7f8230068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 -- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 msgr2=0x7fef581ee850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T09:59:21.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 0x7fef581ee850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 -- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef5806cd90 msgr2=0x7fef5814d4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T09:59:21.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef5806cd90 0x7fef5814d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 -- 172.21.15.89:0/2170902091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009420 con 0x7fef580ca610 2023-12-07T09:59:21.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.287+0000 7fef5cc9b640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 0x7fef581eed90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef50007e60 tx=0x7fef5000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50014620 con 0x7fef580ca610 2023-12-07T09:59:21.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7f824dd9b640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8230066900 0x7f8230068dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82400b1000 tx=0x7f824000a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82480511c0 con 0x7f825006cdc0 2023-12-07T09:59:21.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000ee90 con 0x7fef580ca610 2023-12-07T09:59:21.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500149a0 con 0x7fef580ca610 2023-12-07T09:59:21.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef581f28a0 con 0x7fef580ca610 2023-12-07T09:59:21.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5814da10 con 0x7fef580ca610 2023-12-07T09:59:21.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.291+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f195c007430 con 0x7f196804a410 2023-12-07T09:59:21.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f195bfff640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19540669a0 0x7f1954068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5804e890 con 0x7fef580ca610 2023-12-07T09:59:21.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fef50014b00 con 0x7fef580ca610 2023-12-07T09:59:21.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f195c083db0 con 0x7f196804a410 2023-12-07T09:59:21.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f196f7fe640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19540669a0 0x7f1954068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 -- start start 2023-12-07T09:59:21.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf806dfb0 0x7f5bf81524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf80c01e0 0x7f5bf81f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81f1ef0 con 0x7f5bf806dfb0 2023-12-07T09:59:21.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81f4e80 con 0x7f5bf80c01e0 2023-12-07T09:59:21.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfeb8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf814e130 con 0x7f5bf80c1b90 2023-12-07T09:59:21.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7fef54ff9640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef44066920 0x7fef44068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfd12a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfd12a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80aa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:55242/0 (socket says 172.21.15.89:55242) 2023-12-07T09:59:21.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bfd12a640 1 -- 172.21.15.89:0/1940297327 learned_addr learned my addr 172.21.15.89:0/1940297327 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f5bf7fff640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf80c01e0 0x7f5bf81f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.295+0000 7f196f7fe640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19540669a0 0x7f1954068e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19700642e0 tx=0x7f1970129040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfc929640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf806dfb0 0x7f5bf81524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7fef57fff640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef44066920 0x7fef44068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfd12a640 1 -- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf80c01e0 msgr2=0x7f5bf81f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfd12a640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf80c01e0 0x7f5bf81f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfd12a640 1 -- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf806dfb0 msgr2=0x7f5bf81524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f195c051080 con 0x7f196804a410 2023-12-07T09:59:21.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfd12a640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf806dfb0 0x7f5bf81524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfd12a640 1 -- 172.21.15.89:0/1940297327 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40094d0 con 0x7f5bf80c1b90 2023-12-07T09:59:21.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfc929640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf806dfb0 0x7f5bf81524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:21.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bfd12a640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80aa5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b990 tx=0x7f5bf000be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef50084dd0 con 0x7fef580ca610 2023-12-07T09:59:21.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7fef57fff640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef44066920 0x7fef44068de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009940 tx=0x7fef4c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000cb40 con 0x7f5bf80c1b90 2023-12-07T09:59:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000cca0 con 0x7f5bf80c1b90 2023-12-07T09:59:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.299+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0014680 con 0x7f5bf80c1b90 2023-12-07T09:59:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.303+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf8155f70 con 0x7f5bf80c1b90 2023-12-07T09:59:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.303+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf814e3d0 con 0x7f5bf80c1b90 2023-12-07T09:59:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.303+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef50051fe0 con 0x7fef580ca610 2023-12-07T09:59:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.303+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf81f4ff0 con 0x7f5bf80c1b90 2023-12-07T09:59:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.311+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5bf0007370 con 0x7f5bf80c1b90 2023-12-07T09:59:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.311+0000 7f5bf57fa640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5bdc0668d0 0x7f5bdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.311+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bf0084370 con 0x7f5bf80c1b90 2023-12-07T09:59:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.311+0000 7f5bfc929640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5bdc0668d0 0x7f5bdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.315+0000 7f5bfc929640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5bdc0668d0 0x7f5bdc068d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5be40ae000 tx=0x7f5be40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.315+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bf81f4ff0 con 0x7f5bf80c1b90 2023-12-07T09:59:21.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.467+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc3801edf60 con 0x7fc38006c400 2023-12-07T09:59:21.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.467+0000 7fc36effd640 1 -- 172.21.15.89:0/2156731549 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc370052480 con 0x7fc38006c400 2023-12-07T09:59:21.472 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:21.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc3600668d0 msgr2=0x7fc360068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc3600668d0 0x7fc360068d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3740ae000 tx=0x7fc374008040 comp rx=0 tx=0).stop 2023-12-07T09:59:21.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 msgr2=0x7fc3800c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c4520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc37000f9e0 tx=0x7fc37000fea0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 shutdown_connections 2023-12-07T09:59:21.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38014dc50 0x7fc3801ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc3600668d0 0x7fc360068d90 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3740ae000 tx=0x7fc374008040 comp rx=0 tx=0).stop 2023-12-07T09:59:21.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc38006c400 0x7fc3800c4520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 --2- 172.21.15.89:0/2156731549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc38006bee0 0x7fc3801f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 >> 172.21.15.89:0/2156731549 conn(0x7fc3800c5e10 msgr2=0x7fc3801452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 shutdown_connections 2023-12-07T09:59:21.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.471+0000 7fc384854640 1 -- 172.21.15.89:0/2156731549 wait complete. 2023-12-07T09:59:21.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-12-07T09:59:21.508 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.535+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7d80057e0 con 0x7fa7f803e780 2023-12-07T09:59:21.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.535+0000 7fa7fd7fa640 1 -- 172.21.15.89:0/4098192299 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7ec0c2020 con 0x7fa7f803e780 2023-12-07T09:59:21.541 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-12-07T09:59:21.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa7e4066950 msgr2=0x7fa7e4068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa7e4066950 0x7fa7e4068e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa800064270 tx=0x7fa80006d040 comp rx=0 tx=0).stop 2023-12-07T09:59:21.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 msgr2=0x7fa7f8182b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 0x7fa7f8182b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0ae040 tx=0x7fa7ec019170 comp rx=0 tx=0).stop 2023-12-07T09:59:21.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 shutdown_connections 2023-12-07T09:59:21.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7f80dbb90 0x7fa7f8030ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7f803ebe0 0x7fa7f80309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa7e4066950 0x7fa7e4068e10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 --2- 172.21.15.89:0/4098192299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa7f803e780 0x7fa7f8182b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 >> 172.21.15.89:0/4098192299 conn(0x7fa7f8048230 msgr2=0x7fa7f8048610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 shutdown_connections 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7fa7eaffd640 1 -- 172.21.15.89:0/4098192299 wait complete. 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3498005510 con 0x7f34b81ec2c0 2023-12-07T09:59:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.539+0000 7f349ffff640 1 -- 172.21.15.89:0/478626658 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34b0055900 con 0x7f34b81ec2c0 2023-12-07T09:59:21.547 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-12-07T09:59:21.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34a40668d0 msgr2=0x7f34a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34a40668d0 0x7f34a4068d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34a8007fd0 tx=0x7f34a8007960 comp rx=0 tx=0).stop 2023-12-07T09:59:21.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 msgr2=0x7f34b80bf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 0x7f34b80bf1d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34b000ef40 tx=0x7f34b000c870 comp rx=0 tx=0).stop 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 shutdown_connections 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b81572b0 0x7f34b80bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34a40668d0 0x7f34a4068d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34b81ec2c0 0x7f34b80bf1d0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34b000ef40 tx=0x7f34b000c870 comp rx=0 tx=0).stop 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 --2- 172.21.15.89:0/478626658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a00052b0 0x7f34b81ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 >> 172.21.15.89:0/478626658 conn(0x7f34b80c2ad0 msgr2=0x7f34b80a8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 shutdown_connections 2023-12-07T09:59:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.543+0000 7f34bdda1640 1 -- 172.21.15.89:0/478626658 wait complete. 2023-12-07T09:59:21.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.547+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81440050d0 con 0x7f816415cb80 2023-12-07T09:59:21.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.547+0000 7f814b7fe640 1 -- 172.21.15.89:0/2359739998 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f815c054e00 con 0x7f816415cb80 2023-12-07T09:59:21.556 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f81500669a0 msgr2=0x7f8150068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f81500669a0 0x7f8150068e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8158006aa0 tx=0x7f8158008040 comp rx=0 tx=0).stop 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f816415cb80 msgr2=0x7f816414c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f816415cb80 0x7f816414c950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f815c00be20 tx=0x7f815c00bf10 comp rx=0 tx=0).stop 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 shutdown_connections 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f816415cb80 0x7f816414c950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071340 0x7f816414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f81500669a0 0x7f8150068e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 --2- 172.21.15.89:0/2359739998 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f816406db10 0x7f816414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 >> 172.21.15.89:0/2359739998 conn(0x7f81640c2ad0 msgr2=0x7f81640665f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 shutdown_connections 2023-12-07T09:59:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.551+0000 7f81497fa640 1 -- 172.21.15.89:0/2359739998 wait complete. 2023-12-07T09:59:21.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.571+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fef5806cb70 con 0x7fef580ca610 2023-12-07T09:59:21.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.571+0000 7fef54ff9640 1 -- 172.21.15.89:0/2170902091 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef50014db0 con 0x7fef580ca610 2023-12-07T09:59:21.578 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef44066920 msgr2=0x7fef44068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef44066920 0x7fef44068de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009940 tx=0x7fef4c009240 comp rx=0 tx=0).stop 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 msgr2=0x7fef581eed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 0x7fef581eed90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef50007e60 tx=0x7fef5000e4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 shutdown_connections 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef44066920 0x7fef44068de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef580ca610 0x7fef581eed90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef580bd720 0x7fef581ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 --2- 172.21.15.89:0/2170902091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef5806cd90 0x7fef5814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 >> 172.21.15.89:0/2170902091 conn(0x7fef58071ea0 msgr2=0x7fef58155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 shutdown_connections 2023-12-07T09:59:21.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-12-07T09:59:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.575+0000 7fef5e6fe640 1 -- 172.21.15.89:0/2170902091 wait complete. 2023-12-07T09:59:21.585 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-12-07T09:59:21.588 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-12-07T09:59:21.592 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-12-07T09:59:21.605 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.599+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f19500057e0 con 0x7f196804a410 2023-12-07T09:59:21.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.599+0000 7f195bfff640 1 -- 172.21.15.89:0/1828367425 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f195c021020 con 0x7f196804a410 2023-12-07T09:59:21.606 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:21.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19540669a0 msgr2=0x7f1954068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19540669a0 0x7f1954068e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19700642e0 tx=0x7f1970129040 comp rx=0 tx=0).stop 2023-12-07T09:59:21.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 msgr2=0x7f19680ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 0x7f19680ccad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c390 tx=0x7f195c00c850 comp rx=0 tx=0).stop 2023-12-07T09:59:21.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 shutdown_connections 2023-12-07T09:59:21.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19540669a0 0x7f1954068e60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19680d46b0 0x7f19680cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f196804a410 0x7f19680ccad0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 --2- 172.21.15.89:0/1828367425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1968006ed0 0x7f19680cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 >> 172.21.15.89:0/1828367425 conn(0x7f1968048230 msgr2=0x7f196802cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 shutdown_connections 2023-12-07T09:59:21.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.603+0000 7f1975baa640 1 -- 172.21.15.89:0/1828367425 wait complete. 2023-12-07T09:59:21.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.615+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f825014b880 con 0x7f825006cdc0 2023-12-07T09:59:21.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.615+0000 7f823effd640 1 -- 172.21.15.89:0/3853536969 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f825014b880 con 0x7f825006cdc0 2023-12-07T09:59:21.620 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8230066900 msgr2=0x7f8230068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8230066900 0x7f8230068dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82400b1000 tx=0x7f824000a040 comp rx=0 tx=0).stop 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 msgr2=0x7f82501f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 0x7f82501f5fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f824800ba50 tx=0x7f824800bf10 comp rx=0 tx=0).stop 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 shutdown_connections 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f825014de50 0x7f8250145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8250070380 0x7f8250142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8230066900 0x7f8230068dc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 --2- 172.21.15.89:0/3853536969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f825006cdc0 0x7f82501f5fd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 >> 172.21.15.89:0/3853536969 conn(0x7f82500c60c0 msgr2=0x7f825015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 shutdown_connections 2023-12-07T09:59:21.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.619+0000 7f824f59e640 1 -- 172.21.15.89:0/3853536969 wait complete. 2023-12-07T09:59:21.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-07T09:59:21.629 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.635+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5bf80749e0 con 0x7f5bf80c1b90 2023-12-07T09:59:21.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bf57fa640 1 -- 172.21.15.89:0/1940297327 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bf0019090 con 0x7f5bf80c1b90 2023-12-07T09:59:21.644 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5bdc0668d0 msgr2=0x7f5bdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5bdc0668d0 0x7f5bdc068d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5be40ae000 tx=0x7f5be40a7000 comp rx=0 tx=0).stop 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 msgr2=0x7f5bf80aa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80aa5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b990 tx=0x7f5bf000be50 comp rx=0 tx=0).stop 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 shutdown_connections 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5bdc0668d0 0x7f5bdc068d90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf80c1b90 0x7f5bf80aa5b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf80c01e0 0x7f5bf81f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 --2- 172.21.15.89:0/1940297327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf806dfb0 0x7f5bf81524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 >> 172.21.15.89:0/1940297327 conn(0x7f5bf80c5f60 msgr2=0x7f5bf80ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 shutdown_connections 2023-12-07T09:59:21.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.639+0000 7f5bfeb8d640 1 -- 172.21.15.89:0/1940297327 wait complete. 2023-12-07T09:59:21.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-12-07T09:59:21.648 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-12-07T09:59:21.664 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:21.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-07T09:59:21.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T09:59:21.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 Processor -- start 2023-12-07T09:59:21.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 -- start start 2023-12-07T09:59:21.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc0c8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23fc0c6d20 0x7f23fc158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc0c7180 con 0x7f23fc154fe0 2023-12-07T09:59:21.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc158cd0 con 0x7f23fc0c6d20 2023-12-07T09:59:21.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f24017b5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1521b0 con 0x7f23fc0c6940 2023-12-07T09:59:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23fc0c6d20 0x7f23fc158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23fc0c6d20 0x7f23fc158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:33042/0 (socket says 172.21.15.89:33042) 2023-12-07T09:59:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 -- 172.21.15.89:0/3761345941 learned_addr learned my addr 172.21.15.89:0/3761345941 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fbfff640 1 --2- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc0c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 -- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 msgr2=0x7f23fc0c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 --2- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc0c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 -- 172.21.15.89:0/3761345941 >> v1:172.21.15.97:6789/0 conn(0x7f23fc154fe0 legacy=0x7f23fc06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.839+0000 7f23fb7fe640 1 -- 172.21.15.89:0/3761345941 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0c4c60 con 0x7f23fc0c6d20 2023-12-07T09:59:21.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f23fb7fe640 1 --2- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc158790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006fd0 tx=0x7f23f001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4a3694c563d0e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f23faffd640 1 -- 172.21.15.89:0/3761345941 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00ab600 con 0x7f23fc0c6d20 2023-12-07T09:59:21.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f23faffd640 1 -- 172.21.15.89:0/3761345941 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f00a7050 con 0x7f23fc0c6d20 2023-12-07T09:59:21.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f23faffd640 1 -- 172.21.15.89:0/3761345941 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00ab980 con 0x7f23fc0c6d20 2023-12-07T09:59:21.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 -- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 msgr2=0x7f23fc158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 --2- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc158790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006fd0 tx=0x7f23f001c460 comp rx=0 tx=0).stop 2023-12-07T09:59:21.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 -- 172.21.15.89:0/3761345941 shutdown_connections 2023-12-07T09:59:21.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 --2- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc158790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 --2- 172.21.15.89:0/3761345941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 -- 172.21.15.89:0/3761345941 >> 172.21.15.89:0/3761345941 conn(0x7f23fc0ca140 msgr2=0x7f23fc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:21.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 -- 172.21.15.89:0/3761345941 shutdown_connections 2023-12-07T09:59:21.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 -- 172.21.15.89:0/3761345941 wait complete. 2023-12-07T09:59:21.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.843+0000 7f24017b5640 1 Processor -- start 2023-12-07T09:59:21.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- start start 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 0x7f23fc156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1ee470 con 0x7f23fc154fe0 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc155bd0 con 0x7f23fc0c6d20 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc155eb0 con 0x7f23fc0c6940 2023-12-07T09:59:21.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 0x7f23fc156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 0x7f23fc156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40034/0 (socket says 172.21.15.89:40034) 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 -- 172.21.15.89:0/648981608 learned_addr learned my addr 172.21.15.89:0/648981608 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f23fbfff640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f23fb7fe640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 -- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 msgr2=0x7f23fc146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 -- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 msgr2=0x7f23fc157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 -- 172.21.15.89:0/648981608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0009480 con 0x7f23fc154fe0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f2400fb4640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 0x7f23fc156990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c730 tx=0x7f23f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4003b80 con 0x7f23fc154fe0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4003ce0 con 0x7f23fc154fe0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400aa30 con 0x7f23fc154fe0 2023-12-07T09:59:21.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc156190 con 0x7f23fc154fe0 2023-12-07T09:59:21.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc14e240 con 0x7f23fc154fe0 2023-12-07T09:59:21.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.847+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc04e890 con 0x7f23fc154fe0 2023-12-07T09:59:21.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.851+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f23f400ab90 con 0x7f23fc154fe0 2023-12-07T09:59:21.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.851+0000 7f23f8ff9640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23e80668d0 0x7f23e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:21.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.851+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23f40840c0 con 0x7f23fc154fe0 2023-12-07T09:59:21.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.851+0000 7f23fbfff640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23e80668d0 0x7f23e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:21.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.851+0000 7f23fbfff640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23e80668d0 0x7f23e8068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009b60 tx=0x7f23ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:21.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:21.855+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23f40513a0 con 0x7f23fc154fe0 2023-12-07T09:59:22.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.003+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23fc0c7490 con 0x7f23e80668d0 2023-12-07T09:59:22.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.007+0000 7f23f8ff9640 1 -- 172.21.15.89:0/648981608 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264595 (secure 0 0 0) 0x7f23fc0c7490 con 0x7f23e80668d0 2023-12-07T09:59:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:22.020 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T09:59:22.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23e80668d0 msgr2=0x7f23e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23e80668d0 0x7f23e8068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009b60 tx=0x7f23ec009190 comp rx=0 tx=0).stop 2023-12-07T09:59:22.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 msgr2=0x7f23fc156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 0x7f23fc156990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c730 tx=0x7f23f400cbf0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 shutdown_connections 2023-12-07T09:59:22.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc154fe0 0x7f23fc156990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23fc0c6d20 0x7f23fc157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23e80668d0 0x7f23e8068d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 --2- 172.21.15.89:0/648981608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23fc0c6940 0x7f23fc146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 >> 172.21.15.89:0/648981608 conn(0x7f23fc0ca140 msgr2=0x7f23fc15f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 shutdown_connections 2023-12-07T09:59:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.011+0000 7f24017b5640 1 -- 172.21.15.89:0/648981608 wait complete. 2023-12-07T09:59:22.037 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-07T09:59:20.343458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.921904"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209408+0000","last_change":"2023-12-07T09:59:13.243605+0000","last_active":"2023-12-07T09:59:14.209408+0000","last_peered":"2023-12-07T09:59:14.209408+0000","last_clean":"2023-12-07T09:59:14.209408+0000","last_became_active":"2023-12-07T09:59:13.243400+0000","last_became_peered":"2023-12-07T09:59:13.243400+0000","last_unstale":"2023-12-07T09:59:14.209408+0000","last_undegraded":"2023-12-07T09:59:14.209408+0000","last_fullsized":"2023-12-07T09:59:14.209408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:07.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.212830+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.212534+0000","last_became_peered":"2023-12-07T09:59:13.212534+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856465+0000","last_change":"2023-12-07T09:59:13.215703+0000","last_active":"2023-12-07T09:59:14.856465+0000","last_peered":"2023-12-07T09:59:14.856465+0000","last_clean":"2023-12-07T09:59:14.856465+0000","last_became_active":"2023-12-07T09:59:13.215423+0000","last_became_peered":"2023-12-07T09:59:13.215423+0000","last_unstale":"2023-12-07T09:59:14.856465+0000","last_undegraded":"2023-12-07T09:59:14.856465+0000","last_fullsized":"2023-12-07T09:59:14.856465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856651+0000","last_change":"2023-12-07T09:59:13.220582+0000","last_active":"2023-12-07T09:59:14.856651+0000","last_peered":"2023-12-07T09:59:14.856651+0000","last_clean":"2023-12-07T09:59:14.856651+0000","last_became_active":"2023-12-07T09:59:13.219984+0000","last_became_peered":"2023-12-07T09:59:13.219984+0000","last_unstale":"2023-12-07T09:59:14.856651+0000","last_undegraded":"2023-12-07T09:59:14.856651+0000","last_fullsized":"2023-12-07T09:59:14.856651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209013+0000","last_change":"2023-12-07T09:59:13.226763+0000","last_active":"2023-12-07T09:59:14.209013+0000","last_peered":"2023-12-07T09:59:14.209013+0000","last_clean":"2023-12-07T09:59:14.209013+0000","last_became_active":"2023-12-07T09:59:13.226473+0000","last_became_peered":"2023-12-07T09:59:13.226473+0000","last_unstale":"2023-12-07T09:59:14.209013+0000","last_undegraded":"2023-12-07T09:59:14.209013+0000","last_fullsized":"2023-12-07T09:59:14.209013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856311+0000","last_change":"2023-12-07T09:59:13.224914+0000","last_active":"2023-12-07T09:59:14.856311+0000","last_peered":"2023-12-07T09:59:14.856311+0000","last_clean":"2023-12-07T09:59:14.856311+0000","last_became_active":"2023-12-07T09:59:13.224520+0000","last_became_peered":"2023-12-07T09:59:13.224520+0000","last_unstale":"2023-12-07T09:59:14.856311+0000","last_undegraded":"2023-12-07T09:59:14.856311+0000","last_fullsized":"2023-12-07T09:59:14.856311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208595+0000","last_change":"2023-12-07T09:59:13.220721+0000","last_active":"2023-12-07T09:59:14.208595+0000","last_peered":"2023-12-07T09:59:14.208595+0000","last_clean":"2023-12-07T09:59:14.208595+0000","last_became_active":"2023-12-07T09:59:13.220444+0000","last_became_peered":"2023-12-07T09:59:13.220444+0000","last_unstale":"2023-12-07T09:59:14.208595+0000","last_undegraded":"2023-12-07T09:59:14.208595+0000","last_fullsized":"2023-12-07T09:59:14.208595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204871+0000","last_change":"2023-12-07T09:59:13.225842+0000","last_active":"2023-12-07T09:59:14.204871+0000","last_peered":"2023-12-07T09:59:14.204871+0000","last_clean":"2023-12-07T09:59:14.204871+0000","last_became_active":"2023-12-07T09:59:13.225534+0000","last_became_peered":"2023-12-07T09:59:13.225534+0000","last_unstale":"2023-12-07T09:59:14.204871+0000","last_undegraded":"2023-12-07T09:59:14.204871+0000","last_fullsized":"2023-12-07T09:59:14.204871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209416+0000","last_change":"2023-12-07T09:59:13.236754+0000","last_active":"2023-12-07T09:59:14.209416+0000","last_peered":"2023-12-07T09:59:14.209416+0000","last_clean":"2023-12-07T09:59:14.209416+0000","last_became_active":"2023-12-07T09:59:13.236474+0000","last_became_peered":"2023-12-07T09:59:13.236474+0000","last_unstale":"2023-12-07T09:59:14.209416+0000","last_undegraded":"2023-12-07T09:59:14.209416+0000","last_fullsized":"2023-12-07T09:59:14.209416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:02.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856024+0000","last_change":"2023-12-07T09:59:13.244846+0000","last_active":"2023-12-07T09:59:14.856024+0000","last_peered":"2023-12-07T09:59:14.856024+0000","last_clean":"2023-12-07T09:59:14.856024+0000","last_became_active":"2023-12-07T09:59:13.242324+0000","last_became_peered":"2023-12-07T09:59:13.242324+0000","last_unstale":"2023-12-07T09:59:14.856024+0000","last_undegraded":"2023-12-07T09:59:14.856024+0000","last_fullsized":"2023-12-07T09:59:14.856024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856304+0000","last_change":"2023-12-07T09:59:13.240209+0000","last_active":"2023-12-07T09:59:14.856304+0000","last_peered":"2023-12-07T09:59:14.856304+0000","last_clean":"2023-12-07T09:59:14.856304+0000","last_became_active":"2023-12-07T09:59:13.239803+0000","last_became_peered":"2023-12-07T09:59:13.239803+0000","last_unstale":"2023-12-07T09:59:14.856304+0000","last_undegraded":"2023-12-07T09:59:14.856304+0000","last_fullsized":"2023-12-07T09:59:14.856304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209848+0000","last_change":"2023-12-07T09:59:13.243615+0000","last_active":"2023-12-07T09:59:14.209848+0000","last_peered":"2023-12-07T09:59:14.209848+0000","last_clean":"2023-12-07T09:59:14.209848+0000","last_became_active":"2023-12-07T09:59:13.242637+0000","last_became_peered":"2023-12-07T09:59:13.242637+0000","last_unstale":"2023-12-07T09:59:14.209848+0000","last_undegraded":"2023-12-07T09:59:14.209848+0000","last_fullsized":"2023-12-07T09:59:14.209848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205211+0000","last_change":"2023-12-07T09:59:13.236803+0000","last_active":"2023-12-07T09:59:14.205211+0000","last_peered":"2023-12-07T09:59:14.205211+0000","last_clean":"2023-12-07T09:59:14.205211+0000","last_became_active":"2023-12-07T09:59:13.236552+0000","last_became_peered":"2023-12-07T09:59:13.236552+0000","last_unstale":"2023-12-07T09:59:14.205211+0000","last_undegraded":"2023-12-07T09:59:14.205211+0000","last_fullsized":"2023-12-07T09:59:14.205211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856315+0000","last_change":"2023-12-07T09:59:13.214434+0000","last_active":"2023-12-07T09:59:14.856315+0000","last_peered":"2023-12-07T09:59:14.856315+0000","last_clean":"2023-12-07T09:59:14.856315+0000","last_became_active":"2023-12-07T09:59:13.214166+0000","last_became_peered":"2023-12-07T09:59:13.214166+0000","last_unstale":"2023-12-07T09:59:14.856315+0000","last_undegraded":"2023-12-07T09:59:14.856315+0000","last_fullsized":"2023-12-07T09:59:14.856315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:12.020167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855595+0000","last_change":"2023-12-07T09:59:13.229160+0000","last_active":"2023-12-07T09:59:14.855595+0000","last_peered":"2023-12-07T09:59:14.855595+0000","last_clean":"2023-12-07T09:59:14.855595+0000","last_became_active":"2023-12-07T09:59:13.228864+0000","last_became_peered":"2023-12-07T09:59:13.228864+0000","last_unstale":"2023-12-07T09:59:14.855595+0000","last_undegraded":"2023-12-07T09:59:14.855595+0000","last_fullsized":"2023-12-07T09:59:14.855595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855752+0000","last_change":"2023-12-07T09:59:13.227080+0000","last_active":"2023-12-07T09:59:14.855752+0000","last_peered":"2023-12-07T09:59:14.855752+0000","last_clean":"2023-12-07T09:59:14.855752+0000","last_became_active":"2023-12-07T09:59:13.226779+0000","last_became_peered":"2023-12-07T09:59:13.226779+0000","last_unstale":"2023-12-07T09:59:14.855752+0000","last_undegraded":"2023-12-07T09:59:14.855752+0000","last_fullsized":"2023-12-07T09:59:14.855752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.857170+0000","last_change":"2023-12-07T09:59:13.231346+0000","last_active":"2023-12-07T09:59:14.857170+0000","last_peered":"2023-12-07T09:59:14.857170+0000","last_clean":"2023-12-07T09:59:14.857170+0000","last_became_active":"2023-12-07T09:59:13.230979+0000","last_became_peered":"2023-12-07T09:59:13.230979+0000","last_unstale":"2023-12-07T09:59:14.857170+0000","last_undegraded":"2023-12-07T09:59:14.857170+0000","last_fullsized":"2023-12-07T09:59:14.857170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855462+0000","last_change":"2023-12-07T09:59:13.237675+0000","last_active":"2023-12-07T09:59:14.855462+0000","last_peered":"2023-12-07T09:59:14.855462+0000","last_clean":"2023-12-07T09:59:14.855462+0000","last_became_active":"2023-12-07T09:59:13.237296+0000","last_became_peered":"2023-12-07T09:59:13.237296+0000","last_unstale":"2023-12-07T09:59:14.855462+0000","last_undegraded":"2023-12-07T09:59:14.855462+0000","last_fullsized":"2023-12-07T09:59:14.855462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209370+0000","last_change":"2023-12-07T09:59:13.226161+0000","last_active":"2023-12-07T09:59:14.209370+0000","last_peered":"2023-12-07T09:59:14.209370+0000","last_clean":"2023-12-07T09:59:14.209370+0000","last_became_active":"2023-12-07T09:59:13.225859+0000","last_became_peered":"2023-12-07T09:59:13.225859+0000","last_unstale":"2023-12-07T09:59:14.209370+0000","last_undegraded":"2023-12-07T09:59:14.209370+0000","last_fullsized":"2023-12-07T09:59:14.209370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:32:17.070492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856173+0000","last_change":"2023-12-07T09:59:13.243132+0000","last_active":"2023-12-07T09:59:14.856173+0000","last_peered":"2023-12-07T09:59:14.856173+0000","last_clean":"2023-12-07T09:59:14.856173+0000","last_became_active":"2023-12-07T09:59:13.242916+0000","last_became_peered":"2023-12-07T09:59:13.242916+0000","last_unstale":"2023-12-07T09:59:14.856173+0000","last_undegraded":"2023-12-07T09:59:14.856173+0000","last_fullsized":"2023-12-07T09:59:14.856173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856497+0000","last_change":"2023-12-07T09:59:13.215353+0000","last_active":"2023-12-07T09:59:14.856497+0000","last_peered":"2023-12-07T09:59:14.856497+0000","last_clean":"2023-12-07T09:59:14.856497+0000","last_became_active":"2023-12-07T09:59:13.215031+0000","last_became_peered":"2023-12-07T09:59:13.215031+0000","last_unstale":"2023-12-07T09:59:14.856497+0000","last_undegraded":"2023-12-07T09:59:14.856497+0000","last_fullsized":"2023-12-07T09:59:14.856497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856448+0000","last_change":"2023-12-07T09:59:13.229476+0000","last_active":"2023-12-07T09:59:14.856448+0000","last_peered":"2023-12-07T09:59:14.856448+0000","last_clean":"2023-12-07T09:59:14.856448+0000","last_became_active":"2023-12-07T09:59:13.229204+0000","last_became_peered":"2023-12-07T09:59:13.229204+0000","last_unstale":"2023-12-07T09:59:14.856448+0000","last_undegraded":"2023-12-07T09:59:14.856448+0000","last_fullsized":"2023-12-07T09:59:14.856448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204948+0000","last_change":"2023-12-07T09:59:13.229199+0000","last_active":"2023-12-07T09:59:14.204948+0000","last_peered":"2023-12-07T09:59:14.204948+0000","last_clean":"2023-12-07T09:59:14.204948+0000","last_became_active":"2023-12-07T09:59:13.227858+0000","last_became_peered":"2023-12-07T09:59:13.227858+0000","last_unstale":"2023-12-07T09:59:14.204948+0000","last_undegraded":"2023-12-07T09:59:14.204948+0000","last_fullsized":"2023-12-07T09:59:14.204948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856087+0000","last_change":"2023-12-07T09:59:13.219925+0000","last_active":"2023-12-07T09:59:14.856087+0000","last_peered":"2023-12-07T09:59:14.856087+0000","last_clean":"2023-12-07T09:59:14.856087+0000","last_became_active":"2023-12-07T09:59:13.219578+0000","last_became_peered":"2023-12-07T09:59:13.219578+0000","last_unstale":"2023-12-07T09:59:14.856087+0000","last_undegraded":"2023-12-07T09:59:14.856087+0000","last_fullsized":"2023-12-07T09:59:14.856087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205159+0000","last_change":"2023-12-07T09:59:13.223429+0000","last_active":"2023-12-07T09:59:14.205159+0000","last_peered":"2023-12-07T09:59:14.205159+0000","last_clean":"2023-12-07T09:59:14.205159+0000","last_became_active":"2023-12-07T09:59:13.223049+0000","last_became_peered":"2023-12-07T09:59:13.223049+0000","last_unstale":"2023-12-07T09:59:14.205159+0000","last_undegraded":"2023-12-07T09:59:14.205159+0000","last_fullsized":"2023-12-07T09:59:14.205159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856062+0000","last_change":"2023-12-07T09:59:13.236777+0000","last_active":"2023-12-07T09:59:14.856062+0000","last_peered":"2023-12-07T09:59:14.856062+0000","last_clean":"2023-12-07T09:59:14.856062+0000","last_became_active":"2023-12-07T09:59:13.236213+0000","last_became_peered":"2023-12-07T09:59:13.236213+0000","last_unstale":"2023-12-07T09:59:14.856062+0000","last_undegraded":"2023-12-07T09:59:14.856062+0000","last_fullsized":"2023-12-07T09:59:14.856062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855812+0000","last_change":"2023-12-07T09:59:13.225469+0000","last_active":"2023-12-07T09:59:14.855812+0000","last_peered":"2023-12-07T09:59:14.855812+0000","last_clean":"2023-12-07T09:59:14.855812+0000","last_became_active":"2023-12-07T09:59:13.224304+0000","last_became_peered":"2023-12-07T09:59:13.224304+0000","last_unstale":"2023-12-07T09:59:14.855812+0000","last_undegraded":"2023-12-07T09:59:14.855812+0000","last_fullsized":"2023-12-07T09:59:14.855812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205265+0000","last_change":"2023-12-07T09:59:13.228379+0000","last_active":"2023-12-07T09:59:14.205265+0000","last_peered":"2023-12-07T09:59:14.205265+0000","last_clean":"2023-12-07T09:59:14.205265+0000","last_became_active":"2023-12-07T09:59:13.227897+0000","last_became_peered":"2023-12-07T09:59:13.227897+0000","last_unstale":"2023-12-07T09:59:14.205265+0000","last_undegraded":"2023-12-07T09:59:14.205265+0000","last_fullsized":"2023-12-07T09:59:14.205265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856333+0000","last_change":"2023-12-07T09:59:13.222608+0000","last_active":"2023-12-07T09:59:14.856333+0000","last_peered":"2023-12-07T09:59:14.856333+0000","last_clean":"2023-12-07T09:59:14.856333+0000","last_became_active":"2023-12-07T09:59:13.219912+0000","last_became_peered":"2023-12-07T09:59:13.219912+0000","last_unstale":"2023-12-07T09:59:14.856333+0000","last_undegraded":"2023-12-07T09:59:14.856333+0000","last_fullsized":"2023-12-07T09:59:14.856333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856650+0000","last_change":"2023-12-07T09:59:13.237134+0000","last_active":"2023-12-07T09:59:14.856650+0000","last_peered":"2023-12-07T09:59:14.856650+0000","last_clean":"2023-12-07T09:59:14.856650+0000","last_became_active":"2023-12-07T09:59:13.235178+0000","last_became_peered":"2023-12-07T09:59:13.235178+0000","last_unstale":"2023-12-07T09:59:14.856650+0000","last_undegraded":"2023-12-07T09:59:14.856650+0000","last_fullsized":"2023-12-07T09:59:14.856650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855309+0000","last_change":"2023-12-07T09:59:13.215170+0000","last_active":"2023-12-07T09:59:14.855309+0000","last_peered":"2023-12-07T09:59:14.855309+0000","last_clean":"2023-12-07T09:59:14.855309+0000","last_became_active":"2023-12-07T09:59:13.214893+0000","last_became_peered":"2023-12-07T09:59:13.214893+0000","last_unstale":"2023-12-07T09:59:14.855309+0000","last_undegraded":"2023-12-07T09:59:14.855309+0000","last_fullsized":"2023-12-07T09:59:14.855309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855956+0000","last_change":"2023-12-07T09:59:13.238320+0000","last_active":"2023-12-07T09:59:14.855956+0000","last_peered":"2023-12-07T09:59:14.855956+0000","last_clean":"2023-12-07T09:59:14.855956+0000","last_became_active":"2023-12-07T09:59:13.236975+0000","last_became_peered":"2023-12-07T09:59:13.236975+0000","last_unstale":"2023-12-07T09:59:14.855956+0000","last_undegraded":"2023-12-07T09:59:14.855956+0000","last_fullsized":"2023-12-07T09:59:14.855956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209622+0000","last_change":"2023-12-07T09:59:13.223573+0000","last_active":"2023-12-07T09:59:14.209622+0000","last_peered":"2023-12-07T09:59:14.209622+0000","last_clean":"2023-12-07T09:59:14.209622+0000","last_became_active":"2023-12-07T09:59:13.223311+0000","last_became_peered":"2023-12-07T09:59:13.223311+0000","last_unstale":"2023-12-07T09:59:14.209622+0000","last_undegraded":"2023-12-07T09:59:14.209622+0000","last_fullsized":"2023-12-07T09:59:14.209622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:53.489945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205303+0000","last_change":"2023-12-07T09:59:12.445561+0000","last_active":"2023-12-07T09:59:14.205303+0000","last_peered":"2023-12-07T09:59:14.205303+0000","last_clean":"2023-12-07T09:59:14.205303+0000","last_became_active":"2023-12-07T09:59:12.445157+0000","last_became_peered":"2023-12-07T09:59:12.445157+0000","last_unstale":"2023-12-07T09:59:14.205303+0000","last_undegraded":"2023-12-07T09:59:14.205303+0000","last_fullsized":"2023-12-07T09:59:14.205303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856519+0000","last_change":"2023-12-07T09:59:13.223869+0000","last_active":"2023-12-07T09:59:14.856519+0000","last_peered":"2023-12-07T09:59:14.856519+0000","last_clean":"2023-12-07T09:59:14.856519+0000","last_became_active":"2023-12-07T09:59:13.223599+0000","last_became_peered":"2023-12-07T09:59:13.223599+0000","last_unstale":"2023-12-07T09:59:14.856519+0000","last_undegraded":"2023-12-07T09:59:14.856519+0000","last_fullsized":"2023-12-07T09:59:14.856519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855929+0000","last_change":"2023-12-07T09:59:12.447360+0000","last_active":"2023-12-07T09:59:14.855929+0000","last_peered":"2023-12-07T09:59:14.855929+0000","last_clean":"2023-12-07T09:59:14.855929+0000","last_became_active":"2023-12-07T09:59:12.445342+0000","last_became_peered":"2023-12-07T09:59:12.445342+0000","last_unstale":"2023-12-07T09:59:14.855929+0000","last_undegraded":"2023-12-07T09:59:14.855929+0000","last_fullsized":"2023-12-07T09:59:14.855929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205055+0000","last_change":"2023-12-07T09:59:12.445519+0000","last_active":"2023-12-07T09:59:14.205055+0000","last_peered":"2023-12-07T09:59:14.205055+0000","last_clean":"2023-12-07T09:59:14.205055+0000","last_became_active":"2023-12-07T09:59:12.445216+0000","last_became_peered":"2023-12-07T09:59:12.445216+0000","last_unstale":"2023-12-07T09:59:14.205055+0000","last_undegraded":"2023-12-07T09:59:14.205055+0000","last_fullsized":"2023-12-07T09:59:14.205055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204981+0000","last_change":"2023-12-07T09:59:13.222784+0000","last_active":"2023-12-07T09:59:14.204981+0000","last_peered":"2023-12-07T09:59:14.204981+0000","last_clean":"2023-12-07T09:59:14.204981+0000","last_became_active":"2023-12-07T09:59:13.221094+0000","last_became_peered":"2023-12-07T09:59:13.221094+0000","last_unstale":"2023-12-07T09:59:14.204981+0000","last_undegraded":"2023-12-07T09:59:14.204981+0000","last_fullsized":"2023-12-07T09:59:14.204981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856191+0000","last_change":"2023-12-07T09:59:12.444592+0000","last_active":"2023-12-07T09:59:14.856191+0000","last_peered":"2023-12-07T09:59:14.856191+0000","last_clean":"2023-12-07T09:59:14.856191+0000","last_became_active":"2023-12-07T09:59:12.444319+0000","last_became_peered":"2023-12-07T09:59:12.444319+0000","last_unstale":"2023-12-07T09:59:14.856191+0000","last_undegraded":"2023-12-07T09:59:14.856191+0000","last_fullsized":"2023-12-07T09:59:14.856191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:17.193358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855494+0000","last_change":"2023-12-07T09:59:13.217769+0000","last_active":"2023-12-07T09:59:14.855494+0000","last_peered":"2023-12-07T09:59:14.855494+0000","last_clean":"2023-12-07T09:59:14.855494+0000","last_became_active":"2023-12-07T09:59:13.217483+0000","last_became_peered":"2023-12-07T09:59:13.217483+0000","last_unstale":"2023-12-07T09:59:14.855494+0000","last_undegraded":"2023-12-07T09:59:14.855494+0000","last_fullsized":"2023-12-07T09:59:14.855494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856282+0000","last_change":"2023-12-07T09:59:12.446477+0000","last_active":"2023-12-07T09:59:14.856282+0000","last_peered":"2023-12-07T09:59:14.856282+0000","last_clean":"2023-12-07T09:59:14.856282+0000","last_became_active":"2023-12-07T09:59:12.446203+0000","last_became_peered":"2023-12-07T09:59:12.446203+0000","last_unstale":"2023-12-07T09:59:14.856282+0000","last_undegraded":"2023-12-07T09:59:14.856282+0000","last_fullsized":"2023-12-07T09:59:14.856282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856664+0000","last_change":"2023-12-07T09:59:13.228184+0000","last_active":"2023-12-07T09:59:14.856664+0000","last_peered":"2023-12-07T09:59:14.856664+0000","last_clean":"2023-12-07T09:59:14.856664+0000","last_became_active":"2023-12-07T09:59:13.227834+0000","last_became_peered":"2023-12-07T09:59:13.227834+0000","last_unstale":"2023-12-07T09:59:14.856664+0000","last_undegraded":"2023-12-07T09:59:14.856664+0000","last_fullsized":"2023-12-07T09:59:14.856664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856790+0000","last_change":"2023-12-07T09:59:12.445865+0000","last_active":"2023-12-07T09:59:14.856790+0000","last_peered":"2023-12-07T09:59:14.856790+0000","last_clean":"2023-12-07T09:59:14.856790+0000","last_became_active":"2023-12-07T09:59:12.445572+0000","last_became_peered":"2023-12-07T09:59:12.445572+0000","last_unstale":"2023-12-07T09:59:14.856790+0000","last_undegraded":"2023-12-07T09:59:14.856790+0000","last_fullsized":"2023-12-07T09:59:14.856790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856567+0000","last_change":"2023-12-07T09:59:13.223916+0000","last_active":"2023-12-07T09:59:14.856567+0000","last_peered":"2023-12-07T09:59:14.856567+0000","last_clean":"2023-12-07T09:59:14.856567+0000","last_became_active":"2023-12-07T09:59:13.221626+0000","last_became_peered":"2023-12-07T09:59:13.221626+0000","last_unstale":"2023-12-07T09:59:14.856567+0000","last_undegraded":"2023-12-07T09:59:14.856567+0000","last_fullsized":"2023-12-07T09:59:14.856567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855897+0000","last_change":"2023-12-07T09:59:12.444220+0000","last_active":"2023-12-07T09:59:14.855897+0000","last_peered":"2023-12-07T09:59:14.855897+0000","last_clean":"2023-12-07T09:59:14.855897+0000","last_became_active":"2023-12-07T09:59:12.443588+0000","last_became_peered":"2023-12-07T09:59:12.443588+0000","last_unstale":"2023-12-07T09:59:14.855897+0000","last_undegraded":"2023-12-07T09:59:14.855897+0000","last_fullsized":"2023-12-07T09:59:14.855897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209944+0000","last_change":"2023-12-07T09:59:13.232678+0000","last_active":"2023-12-07T09:59:14.209944+0000","last_peered":"2023-12-07T09:59:14.209944+0000","last_clean":"2023-12-07T09:59:14.209944+0000","last_became_active":"2023-12-07T09:59:13.232421+0000","last_became_peered":"2023-12-07T09:59:13.232421+0000","last_unstale":"2023-12-07T09:59:14.209944+0000","last_undegraded":"2023-12-07T09:59:14.209944+0000","last_fullsized":"2023-12-07T09:59:14.209944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856093+0000","last_change":"2023-12-07T09:59:12.442066+0000","last_active":"2023-12-07T09:59:14.856093+0000","last_peered":"2023-12-07T09:59:14.856093+0000","last_clean":"2023-12-07T09:59:14.856093+0000","last_became_active":"2023-12-07T09:59:12.441817+0000","last_became_peered":"2023-12-07T09:59:12.441817+0000","last_unstale":"2023-12-07T09:59:14.856093+0000","last_undegraded":"2023-12-07T09:59:14.856093+0000","last_fullsized":"2023-12-07T09:59:14.856093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208914+0000","last_change":"2023-12-07T09:59:13.227653+0000","last_active":"2023-12-07T09:59:14.208914+0000","last_peered":"2023-12-07T09:59:14.208914+0000","last_clean":"2023-12-07T09:59:14.208914+0000","last_became_active":"2023-12-07T09:59:13.227307+0000","last_became_peered":"2023-12-07T09:59:13.227307+0000","last_unstale":"2023-12-07T09:59:14.208914+0000","last_undegraded":"2023-12-07T09:59:14.208914+0000","last_fullsized":"2023-12-07T09:59:14.208914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856577+0000","last_change":"2023-12-07T09:59:12.447857+0000","last_active":"2023-12-07T09:59:14.856577+0000","last_peered":"2023-12-07T09:59:14.856577+0000","last_clean":"2023-12-07T09:59:14.856577+0000","last_became_active":"2023-12-07T09:59:12.447625+0000","last_became_peered":"2023-12-07T09:59:12.447625+0000","last_unstale":"2023-12-07T09:59:14.856577+0000","last_undegraded":"2023-12-07T09:59:14.856577+0000","last_fullsized":"2023-12-07T09:59:14.856577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856290+0000","last_change":"2023-12-07T09:59:13.221295+0000","last_active":"2023-12-07T09:59:14.856290+0000","last_peered":"2023-12-07T09:59:14.856290+0000","last_clean":"2023-12-07T09:59:14.856290+0000","last_became_active":"2023-12-07T09:59:13.220976+0000","last_became_peered":"2023-12-07T09:59:13.220976+0000","last_unstale":"2023-12-07T09:59:14.856290+0000","last_undegraded":"2023-12-07T09:59:14.856290+0000","last_fullsized":"2023-12-07T09:59:14.856290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:47.462027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856560+0000","last_change":"2023-12-07T09:59:12.441312+0000","last_active":"2023-12-07T09:59:14.856560+0000","last_peered":"2023-12-07T09:59:14.856560+0000","last_clean":"2023-12-07T09:59:14.856560+0000","last_became_active":"2023-12-07T09:59:12.441028+0000","last_became_peered":"2023-12-07T09:59:12.441028+0000","last_unstale":"2023-12-07T09:59:14.856560+0000","last_undegraded":"2023-12-07T09:59:14.856560+0000","last_fullsized":"2023-12-07T09:59:14.856560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:26.967332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209168+0000","last_change":"2023-12-07T09:59:13.232850+0000","last_active":"2023-12-07T09:59:14.209168+0000","last_peered":"2023-12-07T09:59:14.209168+0000","last_clean":"2023-12-07T09:59:14.209168+0000","last_became_active":"2023-12-07T09:59:13.232332+0000","last_became_peered":"2023-12-07T09:59:13.232332+0000","last_unstale":"2023-12-07T09:59:14.209168+0000","last_undegraded":"2023-12-07T09:59:14.209168+0000","last_fullsized":"2023-12-07T09:59:14.209168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855793+0000","last_change":"2023-12-07T09:59:12.445929+0000","last_active":"2023-12-07T09:59:14.855793+0000","last_peered":"2023-12-07T09:59:14.855793+0000","last_clean":"2023-12-07T09:59:14.855793+0000","last_became_active":"2023-12-07T09:59:12.445461+0000","last_became_peered":"2023-12-07T09:59:12.445461+0000","last_unstale":"2023-12-07T09:59:14.855793+0000","last_undegraded":"2023-12-07T09:59:14.855793+0000","last_fullsized":"2023-12-07T09:59:14.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.235497+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.231385+0000","last_became_peered":"2023-12-07T09:59:13.231385+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855650+0000","last_change":"2023-12-07T09:59:12.439722+0000","last_active":"2023-12-07T09:59:14.855650+0000","last_peered":"2023-12-07T09:59:14.855650+0000","last_clean":"2023-12-07T09:59:14.855650+0000","last_became_active":"2023-12-07T09:59:12.438240+0000","last_became_peered":"2023-12-07T09:59:12.438240+0000","last_unstale":"2023-12-07T09:59:14.855650+0000","last_undegraded":"2023-12-07T09:59:14.855650+0000","last_fullsized":"2023-12-07T09:59:14.855650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208754+0000","last_change":"2023-12-07T09:59:13.234272+0000","last_active":"2023-12-07T09:59:14.208754+0000","last_peered":"2023-12-07T09:59:14.208754+0000","last_clean":"2023-12-07T09:59:14.208754+0000","last_became_active":"2023-12-07T09:59:13.231957+0000","last_became_peered":"2023-12-07T09:59:13.231957+0000","last_unstale":"2023-12-07T09:59:14.208754+0000","last_undegraded":"2023-12-07T09:59:14.208754+0000","last_fullsized":"2023-12-07T09:59:14.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.210004+0000","last_change":"2023-12-07T09:59:12.439194+0000","last_active":"2023-12-07T09:59:14.210004+0000","last_peered":"2023-12-07T09:59:14.210004+0000","last_clean":"2023-12-07T09:59:14.210004+0000","last_became_active":"2023-12-07T09:59:12.438884+0000","last_became_peered":"2023-12-07T09:59:12.438884+0000","last_unstale":"2023-12-07T09:59:14.210004+0000","last_undegraded":"2023-12-07T09:59:14.210004+0000","last_fullsized":"2023-12-07T09:59:14.210004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208903+0000","last_change":"2023-12-07T09:59:13.230666+0000","last_active":"2023-12-07T09:59:14.208903+0000","last_peered":"2023-12-07T09:59:14.208903+0000","last_clean":"2023-12-07T09:59:14.208903+0000","last_became_active":"2023-12-07T09:59:13.230390+0000","last_became_peered":"2023-12-07T09:59:13.230390+0000","last_unstale":"2023-12-07T09:59:14.208903+0000","last_undegraded":"2023-12-07T09:59:14.208903+0000","last_fullsized":"2023-12-07T09:59:14.208903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855548+0000","last_change":"2023-12-07T09:59:12.444548+0000","last_active":"2023-12-07T09:59:14.855548+0000","last_peered":"2023-12-07T09:59:14.855548+0000","last_clean":"2023-12-07T09:59:14.855548+0000","last_became_active":"2023-12-07T09:59:12.444265+0000","last_became_peered":"2023-12-07T09:59:12.444265+0000","last_unstale":"2023-12-07T09:59:14.855548+0000","last_undegraded":"2023-12-07T09:59:14.855548+0000","last_fullsized":"2023-12-07T09:59:14.855548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209558+0000","last_change":"2023-12-07T09:59:13.232945+0000","last_active":"2023-12-07T09:59:14.209558+0000","last_peered":"2023-12-07T09:59:14.209558+0000","last_clean":"2023-12-07T09:59:14.209558+0000","last_became_active":"2023-12-07T09:59:13.232656+0000","last_became_peered":"2023-12-07T09:59:13.232656+0000","last_unstale":"2023-12-07T09:59:14.209558+0000","last_undegraded":"2023-12-07T09:59:14.209558+0000","last_fullsized":"2023-12-07T09:59:14.209558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:31.593646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855993+0000","last_change":"2023-12-07T09:59:12.439997+0000","last_active":"2023-12-07T09:59:14.855993+0000","last_peered":"2023-12-07T09:59:14.855993+0000","last_clean":"2023-12-07T09:59:14.855993+0000","last_became_active":"2023-12-07T09:59:12.439732+0000","last_became_peered":"2023-12-07T09:59:12.439732+0000","last_unstale":"2023-12-07T09:59:14.855993+0000","last_undegraded":"2023-12-07T09:59:14.855993+0000","last_fullsized":"2023-12-07T09:59:14.855993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856858+0000","last_change":"2023-12-07T09:59:13.222198+0000","last_active":"2023-12-07T09:59:14.856858+0000","last_peered":"2023-12-07T09:59:14.856858+0000","last_clean":"2023-12-07T09:59:14.856858+0000","last_became_active":"2023-12-07T09:59:13.219609+0000","last_became_peered":"2023-12-07T09:59:13.219609+0000","last_unstale":"2023-12-07T09:59:14.856858+0000","last_undegraded":"2023-12-07T09:59:14.856858+0000","last_fullsized":"2023-12-07T09:59:14.856858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855424+0000","last_change":"2023-12-07T09:59:12.442621+0000","last_active":"2023-12-07T09:59:14.855424+0000","last_peered":"2023-12-07T09:59:14.855424+0000","last_clean":"2023-12-07T09:59:14.855424+0000","last_became_active":"2023-12-07T09:59:12.442335+0000","last_became_peered":"2023-12-07T09:59:12.442335+0000","last_unstale":"2023-12-07T09:59:14.855424+0000","last_undegraded":"2023-12-07T09:59:14.855424+0000","last_fullsized":"2023-12-07T09:59:14.855424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:52.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209055+0000","last_change":"2023-12-07T09:59:13.236569+0000","last_active":"2023-12-07T09:59:14.209055+0000","last_peered":"2023-12-07T09:59:14.209055+0000","last_clean":"2023-12-07T09:59:14.209055+0000","last_became_active":"2023-12-07T09:59:13.236202+0000","last_became_peered":"2023-12-07T09:59:13.236202+0000","last_unstale":"2023-12-07T09:59:14.209055+0000","last_undegraded":"2023-12-07T09:59:14.209055+0000","last_fullsized":"2023-12-07T09:59:14.209055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-07T09:59:13.208674+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:13.208674+0000","last_peered":"2023-12-07T09:59:13.208674+0000","last_clean":"2023-12-07T09:59:13.208674+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:13.208674+0000","last_undegraded":"2023-12-07T09:59:13.208674+0000","last_fullsized":"2023-12-07T09:59:13.208674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856471+0000","last_change":"2023-12-07T09:59:12.448949+0000","last_active":"2023-12-07T09:59:14.856471+0000","last_peered":"2023-12-07T09:59:14.856471+0000","last_clean":"2023-12-07T09:59:14.856471+0000","last_became_active":"2023-12-07T09:59:12.448415+0000","last_became_peered":"2023-12-07T09:59:12.448415+0000","last_unstale":"2023-12-07T09:59:14.856471+0000","last_undegraded":"2023-12-07T09:59:14.856471+0000","last_fullsized":"2023-12-07T09:59:14.856471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205136+0000","last_change":"2023-12-07T09:59:13.236914+0000","last_active":"2023-12-07T09:59:14.205136+0000","last_peered":"2023-12-07T09:59:14.205136+0000","last_clean":"2023-12-07T09:59:14.205136+0000","last_became_active":"2023-12-07T09:59:13.236582+0000","last_became_peered":"2023-12-07T09:59:13.236582+0000","last_unstale":"2023-12-07T09:59:14.205136+0000","last_undegraded":"2023-12-07T09:59:14.205136+0000","last_fullsized":"2023-12-07T09:59:14.205136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208617+0000","last_change":"2023-12-07T09:59:12.453760+0000","last_active":"2023-12-07T09:59:14.208617+0000","last_peered":"2023-12-07T09:59:14.208617+0000","last_clean":"2023-12-07T09:59:14.208617+0000","last_became_active":"2023-12-07T09:59:12.451737+0000","last_became_peered":"2023-12-07T09:59:12.451737+0000","last_unstale":"2023-12-07T09:59:14.208617+0000","last_undegraded":"2023-12-07T09:59:14.208617+0000","last_fullsized":"2023-12-07T09:59:14.208617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:16.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856296+0000","last_change":"2023-12-07T09:59:13.229329+0000","last_active":"2023-12-07T09:59:14.856296+0000","last_peered":"2023-12-07T09:59:14.856296+0000","last_clean":"2023-12-07T09:59:14.856296+0000","last_became_active":"2023-12-07T09:59:13.229012+0000","last_became_peered":"2023-12-07T09:59:13.229012+0000","last_unstale":"2023-12-07T09:59:14.856296+0000","last_undegraded":"2023-12-07T09:59:14.856296+0000","last_fullsized":"2023-12-07T09:59:14.856296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:16.553666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855396+0000","last_change":"2023-12-07T09:59:12.443723+0000","last_active":"2023-12-07T09:59:14.855396+0000","last_peered":"2023-12-07T09:59:14.855396+0000","last_clean":"2023-12-07T09:59:14.855396+0000","last_became_active":"2023-12-07T09:59:12.443456+0000","last_became_peered":"2023-12-07T09:59:12.443456+0000","last_unstale":"2023-12-07T09:59:14.855396+0000","last_undegraded":"2023-12-07T09:59:14.855396+0000","last_fullsized":"2023-12-07T09:59:14.855396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:29.302595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855830+0000","last_change":"2023-12-07T09:59:13.216025+0000","last_active":"2023-12-07T09:59:14.855830+0000","last_peered":"2023-12-07T09:59:14.855830+0000","last_clean":"2023-12-07T09:59:14.855830+0000","last_became_active":"2023-12-07T09:59:13.215772+0000","last_became_peered":"2023-12-07T09:59:13.215772+0000","last_unstale":"2023-12-07T09:59:14.855830+0000","last_undegraded":"2023-12-07T09:59:14.855830+0000","last_fullsized":"2023-12-07T09:59:14.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856711+0000","last_change":"2023-12-07T09:59:12.442740+0000","last_active":"2023-12-07T09:59:14.856711+0000","last_peered":"2023-12-07T09:59:14.856711+0000","last_clean":"2023-12-07T09:59:14.856711+0000","last_became_active":"2023-12-07T09:59:12.442434+0000","last_became_peered":"2023-12-07T09:59:12.442434+0000","last_unstale":"2023-12-07T09:59:14.856711+0000","last_undegraded":"2023-12-07T09:59:14.856711+0000","last_fullsized":"2023-12-07T09:59:14.856711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209730+0000","last_change":"2023-12-07T09:59:13.229519+0000","last_active":"2023-12-07T09:59:14.209730+0000","last_peered":"2023-12-07T09:59:14.209730+0000","last_clean":"2023-12-07T09:59:14.209730+0000","last_became_active":"2023-12-07T09:59:13.229213+0000","last_became_peered":"2023-12-07T09:59:13.229213+0000","last_unstale":"2023-12-07T09:59:14.209730+0000","last_undegraded":"2023-12-07T09:59:14.209730+0000","last_fullsized":"2023-12-07T09:59:14.209730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:11.313416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855747+0000","last_change":"2023-12-07T09:59:12.444649+0000","last_active":"2023-12-07T09:59:14.855747+0000","last_peered":"2023-12-07T09:59:14.855747+0000","last_clean":"2023-12-07T09:59:14.855747+0000","last_became_active":"2023-12-07T09:59:12.444396+0000","last_became_peered":"2023-12-07T09:59:12.444396+0000","last_unstale":"2023-12-07T09:59:14.855747+0000","last_undegraded":"2023-12-07T09:59:14.855747+0000","last_fullsized":"2023-12-07T09:59:14.855747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856950+0000","last_change":"2023-12-07T09:59:13.235666+0000","last_active":"2023-12-07T09:59:14.856950+0000","last_peered":"2023-12-07T09:59:14.856950+0000","last_clean":"2023-12-07T09:59:14.856950+0000","last_became_active":"2023-12-07T09:59:13.235387+0000","last_became_peered":"2023-12-07T09:59:13.235387+0000","last_unstale":"2023-12-07T09:59:14.856950+0000","last_undegraded":"2023-12-07T09:59:14.856950+0000","last_fullsized":"2023-12-07T09:59:14.856950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209610+0000","last_change":"2023-12-07T09:59:12.453170+0000","last_active":"2023-12-07T09:59:14.209610+0000","last_peered":"2023-12-07T09:59:14.209610+0000","last_clean":"2023-12-07T09:59:14.209610+0000","last_became_active":"2023-12-07T09:59:12.452722+0000","last_became_peered":"2023-12-07T09:59:12.452722+0000","last_unstale":"2023-12-07T09:59:14.209610+0000","last_undegraded":"2023-12-07T09:59:14.209610+0000","last_fullsized":"2023-12-07T09:59:14.209610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:11.940444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855656+0000","last_change":"2023-12-07T09:59:13.218149+0000","last_active":"2023-12-07T09:59:14.855656+0000","last_peered":"2023-12-07T09:59:14.855656+0000","last_clean":"2023-12-07T09:59:14.855656+0000","last_became_active":"2023-12-07T09:59:13.217830+0000","last_became_peered":"2023-12-07T09:59:13.217830+0000","last_unstale":"2023-12-07T09:59:14.855656+0000","last_undegraded":"2023-12-07T09:59:14.855656+0000","last_fullsized":"2023-12-07T09:59:14.855656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:15.372027+0000","last_change":"2023-12-07T09:59:12.449220+0000","last_active":"2023-12-07T09:59:15.372027+0000","last_peered":"2023-12-07T09:59:15.372027+0000","last_clean":"2023-12-07T09:59:15.372027+0000","last_became_active":"2023-12-07T09:59:12.448837+0000","last_became_peered":"2023-12-07T09:59:12.448837+0000","last_unstale":"2023-12-07T09:59:15.372027+0000","last_undegraded":"2023-12-07T09:59:15.372027+0000","last_fullsized":"2023-12-07T09:59:15.372027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205360+0000","last_change":"2023-12-07T09:59:13.229085+0000","last_active":"2023-12-07T09:59:14.205360+0000","last_peered":"2023-12-07T09:59:14.205360+0000","last_clean":"2023-12-07T09:59:14.205360+0000","last_became_active":"2023-12-07T09:59:13.227932+0000","last_became_peered":"2023-12-07T09:59:13.227932+0000","last_unstale":"2023-12-07T09:59:14.205360+0000","last_undegraded":"2023-12-07T09:59:14.205360+0000","last_fullsized":"2023-12-07T09:59:14.205360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856299+0000","last_change":"2023-12-07T09:59:12.453221+0000","last_active":"2023-12-07T09:59:14.856299+0000","last_peered":"2023-12-07T09:59:14.856299+0000","last_clean":"2023-12-07T09:59:14.856299+0000","last_became_active":"2023-12-07T09:59:12.452946+0000","last_became_peered":"2023-12-07T09:59:12.452946+0000","last_unstale":"2023-12-07T09:59:14.856299+0000","last_undegraded":"2023-12-07T09:59:14.856299+0000","last_fullsized":"2023-12-07T09:59:14.856299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856524+0000","last_change":"2023-12-07T09:59:13.214345+0000","last_active":"2023-12-07T09:59:14.856524+0000","last_peered":"2023-12-07T09:59:14.856524+0000","last_clean":"2023-12-07T09:59:14.856524+0000","last_became_active":"2023-12-07T09:59:13.214065+0000","last_became_peered":"2023-12-07T09:59:13.214065+0000","last_unstale":"2023-12-07T09:59:14.856524+0000","last_undegraded":"2023-12-07T09:59:14.856524+0000","last_fullsized":"2023-12-07T09:59:14.856524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208601+0000","last_change":"2023-12-07T09:59:12.454383+0000","last_active":"2023-12-07T09:59:14.208601+0000","last_peered":"2023-12-07T09:59:14.208601+0000","last_clean":"2023-12-07T09:59:14.208601+0000","last_became_active":"2023-12-07T09:59:12.454061+0000","last_became_peered":"2023-12-07T09:59:12.454061+0000","last_unstale":"2023-12-07T09:59:14.208601+0000","last_undegraded":"2023-12-07T09:59:14.208601+0000","last_fullsized":"2023-12-07T09:59:14.208601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209349+0000","last_change":"2023-12-07T09:59:13.222718+0000","last_active":"2023-12-07T09:59:14.209349+0000","last_peered":"2023-12-07T09:59:14.209349+0000","last_clean":"2023-12-07T09:59:14.209349+0000","last_became_active":"2023-12-07T09:59:13.222405+0000","last_became_peered":"2023-12-07T09:59:13.222405+0000","last_unstale":"2023-12-07T09:59:14.209349+0000","last_undegraded":"2023-12-07T09:59:14.209349+0000","last_fullsized":"2023-12-07T09:59:14.209349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:30.311283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855995+0000","last_change":"2023-12-07T09:59:12.439274+0000","last_active":"2023-12-07T09:59:14.855995+0000","last_peered":"2023-12-07T09:59:14.855995+0000","last_clean":"2023-12-07T09:59:14.855995+0000","last_became_active":"2023-12-07T09:59:12.438973+0000","last_became_peered":"2023-12-07T09:59:12.438973+0000","last_unstale":"2023-12-07T09:59:14.855995+0000","last_undegraded":"2023-12-07T09:59:14.855995+0000","last_fullsized":"2023-12-07T09:59:14.855995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205003+0000","last_change":"2023-12-07T09:59:13.225445+0000","last_active":"2023-12-07T09:59:14.205003+0000","last_peered":"2023-12-07T09:59:14.205003+0000","last_clean":"2023-12-07T09:59:14.205003+0000","last_became_active":"2023-12-07T09:59:13.225149+0000","last_became_peered":"2023-12-07T09:59:13.225149+0000","last_unstale":"2023-12-07T09:59:14.205003+0000","last_undegraded":"2023-12-07T09:59:14.205003+0000","last_fullsized":"2023-12-07T09:59:14.205003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855648+0000","last_change":"2023-12-07T09:59:12.442112+0000","last_active":"2023-12-07T09:59:14.855648+0000","last_peered":"2023-12-07T09:59:14.855648+0000","last_clean":"2023-12-07T09:59:14.855648+0000","last_became_active":"2023-12-07T09:59:12.441793+0000","last_became_peered":"2023-12-07T09:59:12.441793+0000","last_unstale":"2023-12-07T09:59:14.855648+0000","last_undegraded":"2023-12-07T09:59:14.855648+0000","last_fullsized":"2023-12-07T09:59:14.855648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205346+0000","last_change":"2023-12-07T09:59:13.221842+0000","last_active":"2023-12-07T09:59:14.205346+0000","last_peered":"2023-12-07T09:59:14.205346+0000","last_clean":"2023-12-07T09:59:14.205346+0000","last_became_active":"2023-12-07T09:59:13.221454+0000","last_became_peered":"2023-12-07T09:59:13.221454+0000","last_unstale":"2023-12-07T09:59:14.205346+0000","last_undegraded":"2023-12-07T09:59:14.205346+0000","last_fullsized":"2023-12-07T09:59:14.205346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209325+0000","last_change":"2023-12-07T09:59:12.453238+0000","last_active":"2023-12-07T09:59:14.209325+0000","last_peered":"2023-12-07T09:59:14.209325+0000","last_clean":"2023-12-07T09:59:14.209325+0000","last_became_active":"2023-12-07T09:59:12.452285+0000","last_became_peered":"2023-12-07T09:59:12.452285+0000","last_unstale":"2023-12-07T09:59:14.209325+0000","last_undegraded":"2023-12-07T09:59:14.209325+0000","last_fullsized":"2023-12-07T09:59:14.209325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:05.804533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855821+0000","last_change":"2023-12-07T09:59:13.243271+0000","last_active":"2023-12-07T09:59:14.855821+0000","last_peered":"2023-12-07T09:59:14.855821+0000","last_clean":"2023-12-07T09:59:14.855821+0000","last_became_active":"2023-12-07T09:59:13.242931+0000","last_became_peered":"2023-12-07T09:59:13.242931+0000","last_unstale":"2023-12-07T09:59:14.855821+0000","last_undegraded":"2023-12-07T09:59:14.855821+0000","last_fullsized":"2023-12-07T09:59:14.855821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856927+0000","last_change":"2023-12-07T09:59:13.232574+0000","last_active":"2023-12-07T09:59:14.856927+0000","last_peered":"2023-12-07T09:59:14.856927+0000","last_clean":"2023-12-07T09:59:14.856927+0000","last_became_active":"2023-12-07T09:59:13.232262+0000","last_became_peered":"2023-12-07T09:59:13.232262+0000","last_unstale":"2023-12-07T09:59:14.856927+0000","last_undegraded":"2023-12-07T09:59:14.856927+0000","last_fullsized":"2023-12-07T09:59:14.856927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208855+0000","last_change":"2023-12-07T09:59:12.454304+0000","last_active":"2023-12-07T09:59:14.208855+0000","last_peered":"2023-12-07T09:59:14.208855+0000","last_clean":"2023-12-07T09:59:14.208855+0000","last_became_active":"2023-12-07T09:59:12.454038+0000","last_became_peered":"2023-12-07T09:59:12.454038+0000","last_unstale":"2023-12-07T09:59:14.208855+0000","last_undegraded":"2023-12-07T09:59:14.208855+0000","last_fullsized":"2023-12-07T09:59:14.208855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856881+0000","last_change":"2023-12-07T09:59:13.232029+0000","last_active":"2023-12-07T09:59:14.856881+0000","last_peered":"2023-12-07T09:59:14.856881+0000","last_clean":"2023-12-07T09:59:14.856881+0000","last_became_active":"2023-12-07T09:59:13.231273+0000","last_became_peered":"2023-12-07T09:59:13.231273+0000","last_unstale":"2023-12-07T09:59:14.856881+0000","last_undegraded":"2023-12-07T09:59:14.856881+0000","last_fullsized":"2023-12-07T09:59:14.856881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209153+0000","last_change":"2023-12-07T09:59:12.452964+0000","last_active":"2023-12-07T09:59:14.209153+0000","last_peered":"2023-12-07T09:59:14.209153+0000","last_clean":"2023-12-07T09:59:14.209153+0000","last_became_active":"2023-12-07T09:59:12.452651+0000","last_became_peered":"2023-12-07T09:59:12.452651+0000","last_unstale":"2023-12-07T09:59:14.209153+0000","last_undegraded":"2023-12-07T09:59:14.209153+0000","last_fullsized":"2023-12-07T09:59:14.209153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856607+0000","last_change":"2023-12-07T09:59:13.224204+0000","last_active":"2023-12-07T09:59:14.856607+0000","last_peered":"2023-12-07T09:59:14.856607+0000","last_clean":"2023-12-07T09:59:14.856607+0000","last_became_active":"2023-12-07T09:59:13.222519+0000","last_became_peered":"2023-12-07T09:59:13.222519+0000","last_unstale":"2023-12-07T09:59:14.856607+0000","last_undegraded":"2023-12-07T09:59:14.856607+0000","last_fullsized":"2023-12-07T09:59:14.856607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205381+0000","last_change":"2023-12-07T09:59:12.440360+0000","last_active":"2023-12-07T09:59:14.205381+0000","last_peered":"2023-12-07T09:59:14.205381+0000","last_clean":"2023-12-07T09:59:14.205381+0000","last_became_active":"2023-12-07T09:59:12.440087+0000","last_became_peered":"2023-12-07T09:59:12.440087+0000","last_unstale":"2023-12-07T09:59:14.205381+0000","last_undegraded":"2023-12-07T09:59:14.205381+0000","last_fullsized":"2023-12-07T09:59:14.205381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:25.030548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205333+0000","last_change":"2023-12-07T09:59:13.237795+0000","last_active":"2023-12-07T09:59:14.205333+0000","last_peered":"2023-12-07T09:59:14.205333+0000","last_clean":"2023-12-07T09:59:14.205333+0000","last_became_active":"2023-12-07T09:59:13.237488+0000","last_became_peered":"2023-12-07T09:59:13.237488+0000","last_unstale":"2023-12-07T09:59:14.205333+0000","last_undegraded":"2023-12-07T09:59:14.205333+0000","last_fullsized":"2023-12-07T09:59:14.205333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856662+0000","last_change":"2023-12-07T09:59:12.453157+0000","last_active":"2023-12-07T09:59:14.856662+0000","last_peered":"2023-12-07T09:59:14.856662+0000","last_clean":"2023-12-07T09:59:14.856662+0000","last_became_active":"2023-12-07T09:59:12.452900+0000","last_became_peered":"2023-12-07T09:59:12.452900+0000","last_unstale":"2023-12-07T09:59:14.856662+0000","last_undegraded":"2023-12-07T09:59:14.856662+0000","last_fullsized":"2023-12-07T09:59:14.856662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1029999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0370000000000008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1690000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7270000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7969999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8640000000000008}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8239999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T09:59:22.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T09:59:22.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 Processor -- start 2023-12-07T09:59:22.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 -- start start 2023-12-07T09:59:22.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8800bd720 0x7fc880158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc88006cd90 0x7fc880158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc880155790 con 0x7fc8800ca610 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800c4b00 con 0x7fc88006cd90 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc8860fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800c4de0 con 0x7fc8800bd720 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc88006cd90 0x7fc880158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc88006cd90 0x7fc880158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40042/0 (socket says 172.21.15.89:40042) 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 -- 172.21.15.89:0/2584713385 learned_addr learned my addr 172.21.15.89:0/2584713385 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:22.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87effd640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8800bd720 0x7fc880158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 -- 172.21.15.89:0/2584713385 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8800bd720 msgr2=0x7fc880158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:22.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8800bd720 0x7fc880158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 -- 172.21.15.89:0/2584713385 >> v1:172.21.15.97:6789/0 conn(0x7fc8800ca610 legacy=0x7fc8800c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:22.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87ffff640 1 -- 172.21.15.89:0/2584713385 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880157e30 con 0x7fc88006cd90 2023-12-07T09:59:22.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.211+0000 7fc87effd640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8800bd720 0x7fc880158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:22.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc87ffff640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88006cd90 0x7fc880158890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc878009e50 tx=0x7fc87801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de86556e908ff3d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc87e7fc640 1 -- 172.21.15.89:0/2584713385 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800c52d0 con 0x7fc88006cd90 2023-12-07T09:59:22.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc87e7fc640 1 -- 172.21.15.89:0/2584713385 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780a5640 con 0x7fc88006cd90 2023-12-07T09:59:22.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc87e7fc640 1 -- 172.21.15.89:0/2584713385 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780a59d0 con 0x7fc88006cd90 2023-12-07T09:59:22.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 -- 172.21.15.89:0/2584713385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88006cd90 msgr2=0x7fc880158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88006cd90 0x7fc880158890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc878009e50 tx=0x7fc87801c8b0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 -- 172.21.15.89:0/2584713385 shutdown_connections 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88006cd90 0x7fc880158890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 --2- 172.21.15.89:0/2584713385 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8800bd720 0x7fc880158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 -- 172.21.15.89:0/2584713385 >> 172.21.15.89:0/2584713385 conn(0x7fc880071ea0 msgr2=0x7fc8800722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 -- 172.21.15.89:0/2584713385 shutdown_connections 2023-12-07T09:59:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.215+0000 7fc8860fe640 1 -- 172.21.15.89:0/2584713385 wait complete. 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 Processor -- start 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- start start 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc88006cd90 0x7fc880155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8800bd720 0x7fc88014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 0x7fc88014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc880156b40 con 0x7fc8800ca610 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801f1c90 con 0x7fc8800bd720 2023-12-07T09:59:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801f1f70 con 0x7fc88006cd90 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 0x7fc88014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 0x7fc88014a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40048/0 (socket says 172.21.15.89:40048) 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 -- 172.21.15.89:0/3695089503 learned_addr learned my addr 172.21.15.89:0/3695089503 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87f7fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc88006cd90 0x7fc880155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87effd640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8800bd720 0x7fc88014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 -- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc88006cd90 msgr2=0x7fc880155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc88006cd90 0x7fc880155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 -- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8800bd720 msgr2=0x7fc88014b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8800bd720 0x7fc88014b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 -- 172.21.15.89:0/3695089503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009b30 con 0x7fc8800ca610 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87f7fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc88006cd90 0x7fc880155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:22.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87effd640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8800bd720 0x7fc88014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:22.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc87ffff640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 0x7fc88014a4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc8780af040 tx=0x7fc878019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780b8670 con 0x7fc8800ca610 2023-12-07T09:59:22.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780b87f0 con 0x7fc8800ca610 2023-12-07T09:59:22.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780b8ba0 con 0x7fc8800ca610 2023-12-07T09:59:22.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc880156d50 con 0x7fc8800ca610 2023-12-07T09:59:22.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8801567f0 con 0x7fc8800ca610 2023-12-07T09:59:22.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.219+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8801f2130 con 0x7fc8800ca610 2023-12-07T09:59:22.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.223+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8780b8d00 con 0x7fc8800ca610 2023-12-07T09:59:22.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.223+0000 7fc867fff640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc86c066900 0x7fc86c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.223+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc87811f730 con 0x7fc8800ca610 2023-12-07T09:59:22.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.223+0000 7fc87f7fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc86c066900 0x7fc86c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.223+0000 7fc87f7fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc86c066900 0x7fc86c068dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc8800c4270 tx=0x7fc870009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.227+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8801f2130 con 0x7fc8800ca610 2023-12-07T09:59:22.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.375+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8801f2130 con 0x7fc86c066900 2023-12-07T09:59:22.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.383+0000 7fc867fff640 1 -- 172.21.15.89:0/3695089503 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264587 (secure 0 0 0) 0x7fc8801f2130 con 0x7fc86c066900 2023-12-07T09:59:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:22.396 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T09:59:22.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc86c066900 msgr2=0x7fc86c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc86c066900 0x7fc86c068dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc8800c4270 tx=0x7fc870009040 comp rx=0 tx=0).stop 2023-12-07T09:59:22.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 msgr2=0x7fc88014a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 0x7fc88014a4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc8780af040 tx=0x7fc878019650 comp rx=0 tx=0).stop 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 shutdown_connections 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8800ca610 0x7fc88014a4d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8800bd720 0x7fc88014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc86c066900 0x7fc86c068dc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 --2- 172.21.15.89:0/3695089503 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc88006cd90 0x7fc880155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 >> 172.21.15.89:0/3695089503 conn(0x7fc880071ea0 msgr2=0x7fc8801541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 shutdown_connections 2023-12-07T09:59:22.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.387+0000 7fc8860fe640 1 -- 172.21.15.89:0/3695089503 wait complete. 2023-12-07T09:59:22.413 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-07T09:59:22.344043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.137875"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209408+0000","last_change":"2023-12-07T09:59:13.243605+0000","last_active":"2023-12-07T09:59:14.209408+0000","last_peered":"2023-12-07T09:59:14.209408+0000","last_clean":"2023-12-07T09:59:14.209408+0000","last_became_active":"2023-12-07T09:59:13.243400+0000","last_became_peered":"2023-12-07T09:59:13.243400+0000","last_unstale":"2023-12-07T09:59:14.209408+0000","last_undegraded":"2023-12-07T09:59:14.209408+0000","last_fullsized":"2023-12-07T09:59:14.209408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:07.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.212830+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.212534+0000","last_became_peered":"2023-12-07T09:59:13.212534+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856465+0000","last_change":"2023-12-07T09:59:13.215703+0000","last_active":"2023-12-07T09:59:14.856465+0000","last_peered":"2023-12-07T09:59:14.856465+0000","last_clean":"2023-12-07T09:59:14.856465+0000","last_became_active":"2023-12-07T09:59:13.215423+0000","last_became_peered":"2023-12-07T09:59:13.215423+0000","last_unstale":"2023-12-07T09:59:14.856465+0000","last_undegraded":"2023-12-07T09:59:14.856465+0000","last_fullsized":"2023-12-07T09:59:14.856465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856651+0000","last_change":"2023-12-07T09:59:13.220582+0000","last_active":"2023-12-07T09:59:14.856651+0000","last_peered":"2023-12-07T09:59:14.856651+0000","last_clean":"2023-12-07T09:59:14.856651+0000","last_became_active":"2023-12-07T09:59:13.219984+0000","last_became_peered":"2023-12-07T09:59:13.219984+0000","last_unstale":"2023-12-07T09:59:14.856651+0000","last_undegraded":"2023-12-07T09:59:14.856651+0000","last_fullsized":"2023-12-07T09:59:14.856651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209013+0000","last_change":"2023-12-07T09:59:13.226763+0000","last_active":"2023-12-07T09:59:14.209013+0000","last_peered":"2023-12-07T09:59:14.209013+0000","last_clean":"2023-12-07T09:59:14.209013+0000","last_became_active":"2023-12-07T09:59:13.226473+0000","last_became_peered":"2023-12-07T09:59:13.226473+0000","last_unstale":"2023-12-07T09:59:14.209013+0000","last_undegraded":"2023-12-07T09:59:14.209013+0000","last_fullsized":"2023-12-07T09:59:14.209013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856311+0000","last_change":"2023-12-07T09:59:13.224914+0000","last_active":"2023-12-07T09:59:14.856311+0000","last_peered":"2023-12-07T09:59:14.856311+0000","last_clean":"2023-12-07T09:59:14.856311+0000","last_became_active":"2023-12-07T09:59:13.224520+0000","last_became_peered":"2023-12-07T09:59:13.224520+0000","last_unstale":"2023-12-07T09:59:14.856311+0000","last_undegraded":"2023-12-07T09:59:14.856311+0000","last_fullsized":"2023-12-07T09:59:14.856311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208595+0000","last_change":"2023-12-07T09:59:13.220721+0000","last_active":"2023-12-07T09:59:14.208595+0000","last_peered":"2023-12-07T09:59:14.208595+0000","last_clean":"2023-12-07T09:59:14.208595+0000","last_became_active":"2023-12-07T09:59:13.220444+0000","last_became_peered":"2023-12-07T09:59:13.220444+0000","last_unstale":"2023-12-07T09:59:14.208595+0000","last_undegraded":"2023-12-07T09:59:14.208595+0000","last_fullsized":"2023-12-07T09:59:14.208595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204871+0000","last_change":"2023-12-07T09:59:13.225842+0000","last_active":"2023-12-07T09:59:14.204871+0000","last_peered":"2023-12-07T09:59:14.204871+0000","last_clean":"2023-12-07T09:59:14.204871+0000","last_became_active":"2023-12-07T09:59:13.225534+0000","last_became_peered":"2023-12-07T09:59:13.225534+0000","last_unstale":"2023-12-07T09:59:14.204871+0000","last_undegraded":"2023-12-07T09:59:14.204871+0000","last_fullsized":"2023-12-07T09:59:14.204871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209416+0000","last_change":"2023-12-07T09:59:13.236754+0000","last_active":"2023-12-07T09:59:14.209416+0000","last_peered":"2023-12-07T09:59:14.209416+0000","last_clean":"2023-12-07T09:59:14.209416+0000","last_became_active":"2023-12-07T09:59:13.236474+0000","last_became_peered":"2023-12-07T09:59:13.236474+0000","last_unstale":"2023-12-07T09:59:14.209416+0000","last_undegraded":"2023-12-07T09:59:14.209416+0000","last_fullsized":"2023-12-07T09:59:14.209416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:02.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856024+0000","last_change":"2023-12-07T09:59:13.244846+0000","last_active":"2023-12-07T09:59:14.856024+0000","last_peered":"2023-12-07T09:59:14.856024+0000","last_clean":"2023-12-07T09:59:14.856024+0000","last_became_active":"2023-12-07T09:59:13.242324+0000","last_became_peered":"2023-12-07T09:59:13.242324+0000","last_unstale":"2023-12-07T09:59:14.856024+0000","last_undegraded":"2023-12-07T09:59:14.856024+0000","last_fullsized":"2023-12-07T09:59:14.856024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856304+0000","last_change":"2023-12-07T09:59:13.240209+0000","last_active":"2023-12-07T09:59:14.856304+0000","last_peered":"2023-12-07T09:59:14.856304+0000","last_clean":"2023-12-07T09:59:14.856304+0000","last_became_active":"2023-12-07T09:59:13.239803+0000","last_became_peered":"2023-12-07T09:59:13.239803+0000","last_unstale":"2023-12-07T09:59:14.856304+0000","last_undegraded":"2023-12-07T09:59:14.856304+0000","last_fullsized":"2023-12-07T09:59:14.856304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209848+0000","last_change":"2023-12-07T09:59:13.243615+0000","last_active":"2023-12-07T09:59:14.209848+0000","last_peered":"2023-12-07T09:59:14.209848+0000","last_clean":"2023-12-07T09:59:14.209848+0000","last_became_active":"2023-12-07T09:59:13.242637+0000","last_became_peered":"2023-12-07T09:59:13.242637+0000","last_unstale":"2023-12-07T09:59:14.209848+0000","last_undegraded":"2023-12-07T09:59:14.209848+0000","last_fullsized":"2023-12-07T09:59:14.209848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205211+0000","last_change":"2023-12-07T09:59:13.236803+0000","last_active":"2023-12-07T09:59:14.205211+0000","last_peered":"2023-12-07T09:59:14.205211+0000","last_clean":"2023-12-07T09:59:14.205211+0000","last_became_active":"2023-12-07T09:59:13.236552+0000","last_became_peered":"2023-12-07T09:59:13.236552+0000","last_unstale":"2023-12-07T09:59:14.205211+0000","last_undegraded":"2023-12-07T09:59:14.205211+0000","last_fullsized":"2023-12-07T09:59:14.205211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856315+0000","last_change":"2023-12-07T09:59:13.214434+0000","last_active":"2023-12-07T09:59:14.856315+0000","last_peered":"2023-12-07T09:59:14.856315+0000","last_clean":"2023-12-07T09:59:14.856315+0000","last_became_active":"2023-12-07T09:59:13.214166+0000","last_became_peered":"2023-12-07T09:59:13.214166+0000","last_unstale":"2023-12-07T09:59:14.856315+0000","last_undegraded":"2023-12-07T09:59:14.856315+0000","last_fullsized":"2023-12-07T09:59:14.856315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:12.020167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855595+0000","last_change":"2023-12-07T09:59:13.229160+0000","last_active":"2023-12-07T09:59:14.855595+0000","last_peered":"2023-12-07T09:59:14.855595+0000","last_clean":"2023-12-07T09:59:14.855595+0000","last_became_active":"2023-12-07T09:59:13.228864+0000","last_became_peered":"2023-12-07T09:59:13.228864+0000","last_unstale":"2023-12-07T09:59:14.855595+0000","last_undegraded":"2023-12-07T09:59:14.855595+0000","last_fullsized":"2023-12-07T09:59:14.855595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855752+0000","last_change":"2023-12-07T09:59:13.227080+0000","last_active":"2023-12-07T09:59:14.855752+0000","last_peered":"2023-12-07T09:59:14.855752+0000","last_clean":"2023-12-07T09:59:14.855752+0000","last_became_active":"2023-12-07T09:59:13.226779+0000","last_became_peered":"2023-12-07T09:59:13.226779+0000","last_unstale":"2023-12-07T09:59:14.855752+0000","last_undegraded":"2023-12-07T09:59:14.855752+0000","last_fullsized":"2023-12-07T09:59:14.855752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.857170+0000","last_change":"2023-12-07T09:59:13.231346+0000","last_active":"2023-12-07T09:59:14.857170+0000","last_peered":"2023-12-07T09:59:14.857170+0000","last_clean":"2023-12-07T09:59:14.857170+0000","last_became_active":"2023-12-07T09:59:13.230979+0000","last_became_peered":"2023-12-07T09:59:13.230979+0000","last_unstale":"2023-12-07T09:59:14.857170+0000","last_undegraded":"2023-12-07T09:59:14.857170+0000","last_fullsized":"2023-12-07T09:59:14.857170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855462+0000","last_change":"2023-12-07T09:59:13.237675+0000","last_active":"2023-12-07T09:59:14.855462+0000","last_peered":"2023-12-07T09:59:14.855462+0000","last_clean":"2023-12-07T09:59:14.855462+0000","last_became_active":"2023-12-07T09:59:13.237296+0000","last_became_peered":"2023-12-07T09:59:13.237296+0000","last_unstale":"2023-12-07T09:59:14.855462+0000","last_undegraded":"2023-12-07T09:59:14.855462+0000","last_fullsized":"2023-12-07T09:59:14.855462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209370+0000","last_change":"2023-12-07T09:59:13.226161+0000","last_active":"2023-12-07T09:59:14.209370+0000","last_peered":"2023-12-07T09:59:14.209370+0000","last_clean":"2023-12-07T09:59:14.209370+0000","last_became_active":"2023-12-07T09:59:13.225859+0000","last_became_peered":"2023-12-07T09:59:13.225859+0000","last_unstale":"2023-12-07T09:59:14.209370+0000","last_undegraded":"2023-12-07T09:59:14.209370+0000","last_fullsized":"2023-12-07T09:59:14.209370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:32:17.070492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856173+0000","last_change":"2023-12-07T09:59:13.243132+0000","last_active":"2023-12-07T09:59:14.856173+0000","last_peered":"2023-12-07T09:59:14.856173+0000","last_clean":"2023-12-07T09:59:14.856173+0000","last_became_active":"2023-12-07T09:59:13.242916+0000","last_became_peered":"2023-12-07T09:59:13.242916+0000","last_unstale":"2023-12-07T09:59:14.856173+0000","last_undegraded":"2023-12-07T09:59:14.856173+0000","last_fullsized":"2023-12-07T09:59:14.856173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856497+0000","last_change":"2023-12-07T09:59:13.215353+0000","last_active":"2023-12-07T09:59:14.856497+0000","last_peered":"2023-12-07T09:59:14.856497+0000","last_clean":"2023-12-07T09:59:14.856497+0000","last_became_active":"2023-12-07T09:59:13.215031+0000","last_became_peered":"2023-12-07T09:59:13.215031+0000","last_unstale":"2023-12-07T09:59:14.856497+0000","last_undegraded":"2023-12-07T09:59:14.856497+0000","last_fullsized":"2023-12-07T09:59:14.856497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856448+0000","last_change":"2023-12-07T09:59:13.229476+0000","last_active":"2023-12-07T09:59:14.856448+0000","last_peered":"2023-12-07T09:59:14.856448+0000","last_clean":"2023-12-07T09:59:14.856448+0000","last_became_active":"2023-12-07T09:59:13.229204+0000","last_became_peered":"2023-12-07T09:59:13.229204+0000","last_unstale":"2023-12-07T09:59:14.856448+0000","last_undegraded":"2023-12-07T09:59:14.856448+0000","last_fullsized":"2023-12-07T09:59:14.856448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:28.742043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204948+0000","last_change":"2023-12-07T09:59:13.229199+0000","last_active":"2023-12-07T09:59:14.204948+0000","last_peered":"2023-12-07T09:59:14.204948+0000","last_clean":"2023-12-07T09:59:14.204948+0000","last_became_active":"2023-12-07T09:59:13.227858+0000","last_became_peered":"2023-12-07T09:59:13.227858+0000","last_unstale":"2023-12-07T09:59:14.204948+0000","last_undegraded":"2023-12-07T09:59:14.204948+0000","last_fullsized":"2023-12-07T09:59:14.204948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856087+0000","last_change":"2023-12-07T09:59:13.219925+0000","last_active":"2023-12-07T09:59:14.856087+0000","last_peered":"2023-12-07T09:59:14.856087+0000","last_clean":"2023-12-07T09:59:14.856087+0000","last_became_active":"2023-12-07T09:59:13.219578+0000","last_became_peered":"2023-12-07T09:59:13.219578+0000","last_unstale":"2023-12-07T09:59:14.856087+0000","last_undegraded":"2023-12-07T09:59:14.856087+0000","last_fullsized":"2023-12-07T09:59:14.856087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205159+0000","last_change":"2023-12-07T09:59:13.223429+0000","last_active":"2023-12-07T09:59:14.205159+0000","last_peered":"2023-12-07T09:59:14.205159+0000","last_clean":"2023-12-07T09:59:14.205159+0000","last_became_active":"2023-12-07T09:59:13.223049+0000","last_became_peered":"2023-12-07T09:59:13.223049+0000","last_unstale":"2023-12-07T09:59:14.205159+0000","last_undegraded":"2023-12-07T09:59:14.205159+0000","last_fullsized":"2023-12-07T09:59:14.205159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:12.949133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856062+0000","last_change":"2023-12-07T09:59:13.236777+0000","last_active":"2023-12-07T09:59:14.856062+0000","last_peered":"2023-12-07T09:59:14.856062+0000","last_clean":"2023-12-07T09:59:14.856062+0000","last_became_active":"2023-12-07T09:59:13.236213+0000","last_became_peered":"2023-12-07T09:59:13.236213+0000","last_unstale":"2023-12-07T09:59:14.856062+0000","last_undegraded":"2023-12-07T09:59:14.856062+0000","last_fullsized":"2023-12-07T09:59:14.856062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855812+0000","last_change":"2023-12-07T09:59:13.225469+0000","last_active":"2023-12-07T09:59:14.855812+0000","last_peered":"2023-12-07T09:59:14.855812+0000","last_clean":"2023-12-07T09:59:14.855812+0000","last_became_active":"2023-12-07T09:59:13.224304+0000","last_became_peered":"2023-12-07T09:59:13.224304+0000","last_unstale":"2023-12-07T09:59:14.855812+0000","last_undegraded":"2023-12-07T09:59:14.855812+0000","last_fullsized":"2023-12-07T09:59:14.855812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205265+0000","last_change":"2023-12-07T09:59:13.228379+0000","last_active":"2023-12-07T09:59:14.205265+0000","last_peered":"2023-12-07T09:59:14.205265+0000","last_clean":"2023-12-07T09:59:14.205265+0000","last_became_active":"2023-12-07T09:59:13.227897+0000","last_became_peered":"2023-12-07T09:59:13.227897+0000","last_unstale":"2023-12-07T09:59:14.205265+0000","last_undegraded":"2023-12-07T09:59:14.205265+0000","last_fullsized":"2023-12-07T09:59:14.205265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856333+0000","last_change":"2023-12-07T09:59:13.222608+0000","last_active":"2023-12-07T09:59:14.856333+0000","last_peered":"2023-12-07T09:59:14.856333+0000","last_clean":"2023-12-07T09:59:14.856333+0000","last_became_active":"2023-12-07T09:59:13.219912+0000","last_became_peered":"2023-12-07T09:59:13.219912+0000","last_unstale":"2023-12-07T09:59:14.856333+0000","last_undegraded":"2023-12-07T09:59:14.856333+0000","last_fullsized":"2023-12-07T09:59:14.856333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856650+0000","last_change":"2023-12-07T09:59:13.237134+0000","last_active":"2023-12-07T09:59:14.856650+0000","last_peered":"2023-12-07T09:59:14.856650+0000","last_clean":"2023-12-07T09:59:14.856650+0000","last_became_active":"2023-12-07T09:59:13.235178+0000","last_became_peered":"2023-12-07T09:59:13.235178+0000","last_unstale":"2023-12-07T09:59:14.856650+0000","last_undegraded":"2023-12-07T09:59:14.856650+0000","last_fullsized":"2023-12-07T09:59:14.856650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:06.813221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855309+0000","last_change":"2023-12-07T09:59:13.215170+0000","last_active":"2023-12-07T09:59:14.855309+0000","last_peered":"2023-12-07T09:59:14.855309+0000","last_clean":"2023-12-07T09:59:14.855309+0000","last_became_active":"2023-12-07T09:59:13.214893+0000","last_became_peered":"2023-12-07T09:59:13.214893+0000","last_unstale":"2023-12-07T09:59:14.855309+0000","last_undegraded":"2023-12-07T09:59:14.855309+0000","last_fullsized":"2023-12-07T09:59:14.855309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:35.167212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855956+0000","last_change":"2023-12-07T09:59:13.238320+0000","last_active":"2023-12-07T09:59:14.855956+0000","last_peered":"2023-12-07T09:59:14.855956+0000","last_clean":"2023-12-07T09:59:14.855956+0000","last_became_active":"2023-12-07T09:59:13.236975+0000","last_became_peered":"2023-12-07T09:59:13.236975+0000","last_unstale":"2023-12-07T09:59:14.855956+0000","last_undegraded":"2023-12-07T09:59:14.855956+0000","last_fullsized":"2023-12-07T09:59:14.855956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:18.202046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209622+0000","last_change":"2023-12-07T09:59:13.223573+0000","last_active":"2023-12-07T09:59:14.209622+0000","last_peered":"2023-12-07T09:59:14.209622+0000","last_clean":"2023-12-07T09:59:14.209622+0000","last_became_active":"2023-12-07T09:59:13.223311+0000","last_became_peered":"2023-12-07T09:59:13.223311+0000","last_unstale":"2023-12-07T09:59:14.209622+0000","last_undegraded":"2023-12-07T09:59:14.209622+0000","last_fullsized":"2023-12-07T09:59:14.209622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:53.489945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205303+0000","last_change":"2023-12-07T09:59:12.445561+0000","last_active":"2023-12-07T09:59:14.205303+0000","last_peered":"2023-12-07T09:59:14.205303+0000","last_clean":"2023-12-07T09:59:14.205303+0000","last_became_active":"2023-12-07T09:59:12.445157+0000","last_became_peered":"2023-12-07T09:59:12.445157+0000","last_unstale":"2023-12-07T09:59:14.205303+0000","last_undegraded":"2023-12-07T09:59:14.205303+0000","last_fullsized":"2023-12-07T09:59:14.205303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856519+0000","last_change":"2023-12-07T09:59:13.223869+0000","last_active":"2023-12-07T09:59:14.856519+0000","last_peered":"2023-12-07T09:59:14.856519+0000","last_clean":"2023-12-07T09:59:14.856519+0000","last_became_active":"2023-12-07T09:59:13.223599+0000","last_became_peered":"2023-12-07T09:59:13.223599+0000","last_unstale":"2023-12-07T09:59:14.856519+0000","last_undegraded":"2023-12-07T09:59:14.856519+0000","last_fullsized":"2023-12-07T09:59:14.856519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855929+0000","last_change":"2023-12-07T09:59:12.447360+0000","last_active":"2023-12-07T09:59:14.855929+0000","last_peered":"2023-12-07T09:59:14.855929+0000","last_clean":"2023-12-07T09:59:14.855929+0000","last_became_active":"2023-12-07T09:59:12.445342+0000","last_became_peered":"2023-12-07T09:59:12.445342+0000","last_unstale":"2023-12-07T09:59:14.855929+0000","last_undegraded":"2023-12-07T09:59:14.855929+0000","last_fullsized":"2023-12-07T09:59:14.855929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205055+0000","last_change":"2023-12-07T09:59:12.445519+0000","last_active":"2023-12-07T09:59:14.205055+0000","last_peered":"2023-12-07T09:59:14.205055+0000","last_clean":"2023-12-07T09:59:14.205055+0000","last_became_active":"2023-12-07T09:59:12.445216+0000","last_became_peered":"2023-12-07T09:59:12.445216+0000","last_unstale":"2023-12-07T09:59:14.205055+0000","last_undegraded":"2023-12-07T09:59:14.205055+0000","last_fullsized":"2023-12-07T09:59:14.205055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.204981+0000","last_change":"2023-12-07T09:59:13.222784+0000","last_active":"2023-12-07T09:59:14.204981+0000","last_peered":"2023-12-07T09:59:14.204981+0000","last_clean":"2023-12-07T09:59:14.204981+0000","last_became_active":"2023-12-07T09:59:13.221094+0000","last_became_peered":"2023-12-07T09:59:13.221094+0000","last_unstale":"2023-12-07T09:59:14.204981+0000","last_undegraded":"2023-12-07T09:59:14.204981+0000","last_fullsized":"2023-12-07T09:59:14.204981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856191+0000","last_change":"2023-12-07T09:59:12.444592+0000","last_active":"2023-12-07T09:59:14.856191+0000","last_peered":"2023-12-07T09:59:14.856191+0000","last_clean":"2023-12-07T09:59:14.856191+0000","last_became_active":"2023-12-07T09:59:12.444319+0000","last_became_peered":"2023-12-07T09:59:12.444319+0000","last_unstale":"2023-12-07T09:59:14.856191+0000","last_undegraded":"2023-12-07T09:59:14.856191+0000","last_fullsized":"2023-12-07T09:59:14.856191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:19:17.193358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855494+0000","last_change":"2023-12-07T09:59:13.217769+0000","last_active":"2023-12-07T09:59:14.855494+0000","last_peered":"2023-12-07T09:59:14.855494+0000","last_clean":"2023-12-07T09:59:14.855494+0000","last_became_active":"2023-12-07T09:59:13.217483+0000","last_became_peered":"2023-12-07T09:59:13.217483+0000","last_unstale":"2023-12-07T09:59:14.855494+0000","last_undegraded":"2023-12-07T09:59:14.855494+0000","last_fullsized":"2023-12-07T09:59:14.855494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856282+0000","last_change":"2023-12-07T09:59:12.446477+0000","last_active":"2023-12-07T09:59:14.856282+0000","last_peered":"2023-12-07T09:59:14.856282+0000","last_clean":"2023-12-07T09:59:14.856282+0000","last_became_active":"2023-12-07T09:59:12.446203+0000","last_became_peered":"2023-12-07T09:59:12.446203+0000","last_unstale":"2023-12-07T09:59:14.856282+0000","last_undegraded":"2023-12-07T09:59:14.856282+0000","last_fullsized":"2023-12-07T09:59:14.856282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856664+0000","last_change":"2023-12-07T09:59:13.228184+0000","last_active":"2023-12-07T09:59:14.856664+0000","last_peered":"2023-12-07T09:59:14.856664+0000","last_clean":"2023-12-07T09:59:14.856664+0000","last_became_active":"2023-12-07T09:59:13.227834+0000","last_became_peered":"2023-12-07T09:59:13.227834+0000","last_unstale":"2023-12-07T09:59:14.856664+0000","last_undegraded":"2023-12-07T09:59:14.856664+0000","last_fullsized":"2023-12-07T09:59:14.856664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856790+0000","last_change":"2023-12-07T09:59:12.445865+0000","last_active":"2023-12-07T09:59:14.856790+0000","last_peered":"2023-12-07T09:59:14.856790+0000","last_clean":"2023-12-07T09:59:14.856790+0000","last_became_active":"2023-12-07T09:59:12.445572+0000","last_became_peered":"2023-12-07T09:59:12.445572+0000","last_unstale":"2023-12-07T09:59:14.856790+0000","last_undegraded":"2023-12-07T09:59:14.856790+0000","last_fullsized":"2023-12-07T09:59:14.856790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856567+0000","last_change":"2023-12-07T09:59:13.223916+0000","last_active":"2023-12-07T09:59:14.856567+0000","last_peered":"2023-12-07T09:59:14.856567+0000","last_clean":"2023-12-07T09:59:14.856567+0000","last_became_active":"2023-12-07T09:59:13.221626+0000","last_became_peered":"2023-12-07T09:59:13.221626+0000","last_unstale":"2023-12-07T09:59:14.856567+0000","last_undegraded":"2023-12-07T09:59:14.856567+0000","last_fullsized":"2023-12-07T09:59:14.856567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855897+0000","last_change":"2023-12-07T09:59:12.444220+0000","last_active":"2023-12-07T09:59:14.855897+0000","last_peered":"2023-12-07T09:59:14.855897+0000","last_clean":"2023-12-07T09:59:14.855897+0000","last_became_active":"2023-12-07T09:59:12.443588+0000","last_became_peered":"2023-12-07T09:59:12.443588+0000","last_unstale":"2023-12-07T09:59:14.855897+0000","last_undegraded":"2023-12-07T09:59:14.855897+0000","last_fullsized":"2023-12-07T09:59:14.855897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209944+0000","last_change":"2023-12-07T09:59:13.232678+0000","last_active":"2023-12-07T09:59:14.209944+0000","last_peered":"2023-12-07T09:59:14.209944+0000","last_clean":"2023-12-07T09:59:14.209944+0000","last_became_active":"2023-12-07T09:59:13.232421+0000","last_became_peered":"2023-12-07T09:59:13.232421+0000","last_unstale":"2023-12-07T09:59:14.209944+0000","last_undegraded":"2023-12-07T09:59:14.209944+0000","last_fullsized":"2023-12-07T09:59:14.209944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:17.930416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856093+0000","last_change":"2023-12-07T09:59:12.442066+0000","last_active":"2023-12-07T09:59:14.856093+0000","last_peered":"2023-12-07T09:59:14.856093+0000","last_clean":"2023-12-07T09:59:14.856093+0000","last_became_active":"2023-12-07T09:59:12.441817+0000","last_became_peered":"2023-12-07T09:59:12.441817+0000","last_unstale":"2023-12-07T09:59:14.856093+0000","last_undegraded":"2023-12-07T09:59:14.856093+0000","last_fullsized":"2023-12-07T09:59:14.856093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208914+0000","last_change":"2023-12-07T09:59:13.227653+0000","last_active":"2023-12-07T09:59:14.208914+0000","last_peered":"2023-12-07T09:59:14.208914+0000","last_clean":"2023-12-07T09:59:14.208914+0000","last_became_active":"2023-12-07T09:59:13.227307+0000","last_became_peered":"2023-12-07T09:59:13.227307+0000","last_unstale":"2023-12-07T09:59:14.208914+0000","last_undegraded":"2023-12-07T09:59:14.208914+0000","last_fullsized":"2023-12-07T09:59:14.208914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856577+0000","last_change":"2023-12-07T09:59:12.447857+0000","last_active":"2023-12-07T09:59:14.856577+0000","last_peered":"2023-12-07T09:59:14.856577+0000","last_clean":"2023-12-07T09:59:14.856577+0000","last_became_active":"2023-12-07T09:59:12.447625+0000","last_became_peered":"2023-12-07T09:59:12.447625+0000","last_unstale":"2023-12-07T09:59:14.856577+0000","last_undegraded":"2023-12-07T09:59:14.856577+0000","last_fullsized":"2023-12-07T09:59:14.856577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856290+0000","last_change":"2023-12-07T09:59:13.221295+0000","last_active":"2023-12-07T09:59:14.856290+0000","last_peered":"2023-12-07T09:59:14.856290+0000","last_clean":"2023-12-07T09:59:14.856290+0000","last_became_active":"2023-12-07T09:59:13.220976+0000","last_became_peered":"2023-12-07T09:59:13.220976+0000","last_unstale":"2023-12-07T09:59:14.856290+0000","last_undegraded":"2023-12-07T09:59:14.856290+0000","last_fullsized":"2023-12-07T09:59:14.856290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:47.462027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856560+0000","last_change":"2023-12-07T09:59:12.441312+0000","last_active":"2023-12-07T09:59:14.856560+0000","last_peered":"2023-12-07T09:59:14.856560+0000","last_clean":"2023-12-07T09:59:14.856560+0000","last_became_active":"2023-12-07T09:59:12.441028+0000","last_became_peered":"2023-12-07T09:59:12.441028+0000","last_unstale":"2023-12-07T09:59:14.856560+0000","last_undegraded":"2023-12-07T09:59:14.856560+0000","last_fullsized":"2023-12-07T09:59:14.856560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:26.967332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209168+0000","last_change":"2023-12-07T09:59:13.232850+0000","last_active":"2023-12-07T09:59:14.209168+0000","last_peered":"2023-12-07T09:59:14.209168+0000","last_clean":"2023-12-07T09:59:14.209168+0000","last_became_active":"2023-12-07T09:59:13.232332+0000","last_became_peered":"2023-12-07T09:59:13.232332+0000","last_unstale":"2023-12-07T09:59:14.209168+0000","last_undegraded":"2023-12-07T09:59:14.209168+0000","last_fullsized":"2023-12-07T09:59:14.209168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:43:19.978210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855793+0000","last_change":"2023-12-07T09:59:12.445929+0000","last_active":"2023-12-07T09:59:14.855793+0000","last_peered":"2023-12-07T09:59:14.855793+0000","last_clean":"2023-12-07T09:59:14.855793+0000","last_became_active":"2023-12-07T09:59:12.445461+0000","last_became_peered":"2023-12-07T09:59:12.445461+0000","last_unstale":"2023-12-07T09:59:14.855793+0000","last_undegraded":"2023-12-07T09:59:14.855793+0000","last_fullsized":"2023-12-07T09:59:14.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855799+0000","last_change":"2023-12-07T09:59:13.235497+0000","last_active":"2023-12-07T09:59:14.855799+0000","last_peered":"2023-12-07T09:59:14.855799+0000","last_clean":"2023-12-07T09:59:14.855799+0000","last_became_active":"2023-12-07T09:59:13.231385+0000","last_became_peered":"2023-12-07T09:59:13.231385+0000","last_unstale":"2023-12-07T09:59:14.855799+0000","last_undegraded":"2023-12-07T09:59:14.855799+0000","last_fullsized":"2023-12-07T09:59:14.855799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:58.648093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855650+0000","last_change":"2023-12-07T09:59:12.439722+0000","last_active":"2023-12-07T09:59:14.855650+0000","last_peered":"2023-12-07T09:59:14.855650+0000","last_clean":"2023-12-07T09:59:14.855650+0000","last_became_active":"2023-12-07T09:59:12.438240+0000","last_became_peered":"2023-12-07T09:59:12.438240+0000","last_unstale":"2023-12-07T09:59:14.855650+0000","last_undegraded":"2023-12-07T09:59:14.855650+0000","last_fullsized":"2023-12-07T09:59:14.855650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208754+0000","last_change":"2023-12-07T09:59:13.234272+0000","last_active":"2023-12-07T09:59:14.208754+0000","last_peered":"2023-12-07T09:59:14.208754+0000","last_clean":"2023-12-07T09:59:14.208754+0000","last_became_active":"2023-12-07T09:59:13.231957+0000","last_became_peered":"2023-12-07T09:59:13.231957+0000","last_unstale":"2023-12-07T09:59:14.208754+0000","last_undegraded":"2023-12-07T09:59:14.208754+0000","last_fullsized":"2023-12-07T09:59:14.208754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.210004+0000","last_change":"2023-12-07T09:59:12.439194+0000","last_active":"2023-12-07T09:59:14.210004+0000","last_peered":"2023-12-07T09:59:14.210004+0000","last_clean":"2023-12-07T09:59:14.210004+0000","last_became_active":"2023-12-07T09:59:12.438884+0000","last_became_peered":"2023-12-07T09:59:12.438884+0000","last_unstale":"2023-12-07T09:59:14.210004+0000","last_undegraded":"2023-12-07T09:59:14.210004+0000","last_fullsized":"2023-12-07T09:59:14.210004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:25.926504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208903+0000","last_change":"2023-12-07T09:59:13.230666+0000","last_active":"2023-12-07T09:59:14.208903+0000","last_peered":"2023-12-07T09:59:14.208903+0000","last_clean":"2023-12-07T09:59:14.208903+0000","last_became_active":"2023-12-07T09:59:13.230390+0000","last_became_peered":"2023-12-07T09:59:13.230390+0000","last_unstale":"2023-12-07T09:59:14.208903+0000","last_undegraded":"2023-12-07T09:59:14.208903+0000","last_fullsized":"2023-12-07T09:59:14.208903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855548+0000","last_change":"2023-12-07T09:59:12.444548+0000","last_active":"2023-12-07T09:59:14.855548+0000","last_peered":"2023-12-07T09:59:14.855548+0000","last_clean":"2023-12-07T09:59:14.855548+0000","last_became_active":"2023-12-07T09:59:12.444265+0000","last_became_peered":"2023-12-07T09:59:12.444265+0000","last_unstale":"2023-12-07T09:59:14.855548+0000","last_undegraded":"2023-12-07T09:59:14.855548+0000","last_fullsized":"2023-12-07T09:59:14.855548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209558+0000","last_change":"2023-12-07T09:59:13.232945+0000","last_active":"2023-12-07T09:59:14.209558+0000","last_peered":"2023-12-07T09:59:14.209558+0000","last_clean":"2023-12-07T09:59:14.209558+0000","last_became_active":"2023-12-07T09:59:13.232656+0000","last_became_peered":"2023-12-07T09:59:13.232656+0000","last_unstale":"2023-12-07T09:59:14.209558+0000","last_undegraded":"2023-12-07T09:59:14.209558+0000","last_fullsized":"2023-12-07T09:59:14.209558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:31.593646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855993+0000","last_change":"2023-12-07T09:59:12.439997+0000","last_active":"2023-12-07T09:59:14.855993+0000","last_peered":"2023-12-07T09:59:14.855993+0000","last_clean":"2023-12-07T09:59:14.855993+0000","last_became_active":"2023-12-07T09:59:12.439732+0000","last_became_peered":"2023-12-07T09:59:12.439732+0000","last_unstale":"2023-12-07T09:59:14.855993+0000","last_undegraded":"2023-12-07T09:59:14.855993+0000","last_fullsized":"2023-12-07T09:59:14.855993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:15.544977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856858+0000","last_change":"2023-12-07T09:59:13.222198+0000","last_active":"2023-12-07T09:59:14.856858+0000","last_peered":"2023-12-07T09:59:14.856858+0000","last_clean":"2023-12-07T09:59:14.856858+0000","last_became_active":"2023-12-07T09:59:13.219609+0000","last_became_peered":"2023-12-07T09:59:13.219609+0000","last_unstale":"2023-12-07T09:59:14.856858+0000","last_undegraded":"2023-12-07T09:59:14.856858+0000","last_fullsized":"2023-12-07T09:59:14.856858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855424+0000","last_change":"2023-12-07T09:59:12.442621+0000","last_active":"2023-12-07T09:59:14.855424+0000","last_peered":"2023-12-07T09:59:14.855424+0000","last_clean":"2023-12-07T09:59:14.855424+0000","last_became_active":"2023-12-07T09:59:12.442335+0000","last_became_peered":"2023-12-07T09:59:12.442335+0000","last_unstale":"2023-12-07T09:59:14.855424+0000","last_undegraded":"2023-12-07T09:59:14.855424+0000","last_fullsized":"2023-12-07T09:59:14.855424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:52.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209055+0000","last_change":"2023-12-07T09:59:13.236569+0000","last_active":"2023-12-07T09:59:14.209055+0000","last_peered":"2023-12-07T09:59:14.209055+0000","last_clean":"2023-12-07T09:59:14.209055+0000","last_became_active":"2023-12-07T09:59:13.236202+0000","last_became_peered":"2023-12-07T09:59:13.236202+0000","last_unstale":"2023-12-07T09:59:14.209055+0000","last_undegraded":"2023-12-07T09:59:14.209055+0000","last_fullsized":"2023-12-07T09:59:14.209055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-07T09:59:13.208674+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:13.208674+0000","last_peered":"2023-12-07T09:59:13.208674+0000","last_clean":"2023-12-07T09:59:13.208674+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:13.208674+0000","last_undegraded":"2023-12-07T09:59:13.208674+0000","last_fullsized":"2023-12-07T09:59:13.208674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856471+0000","last_change":"2023-12-07T09:59:12.448949+0000","last_active":"2023-12-07T09:59:14.856471+0000","last_peered":"2023-12-07T09:59:14.856471+0000","last_clean":"2023-12-07T09:59:14.856471+0000","last_became_active":"2023-12-07T09:59:12.448415+0000","last_became_peered":"2023-12-07T09:59:12.448415+0000","last_unstale":"2023-12-07T09:59:14.856471+0000","last_undegraded":"2023-12-07T09:59:14.856471+0000","last_fullsized":"2023-12-07T09:59:14.856471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:10.304728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205136+0000","last_change":"2023-12-07T09:59:13.236914+0000","last_active":"2023-12-07T09:59:14.205136+0000","last_peered":"2023-12-07T09:59:14.205136+0000","last_clean":"2023-12-07T09:59:14.205136+0000","last_became_active":"2023-12-07T09:59:13.236582+0000","last_became_peered":"2023-12-07T09:59:13.236582+0000","last_unstale":"2023-12-07T09:59:14.205136+0000","last_undegraded":"2023-12-07T09:59:14.205136+0000","last_fullsized":"2023-12-07T09:59:14.205136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208617+0000","last_change":"2023-12-07T09:59:12.453760+0000","last_active":"2023-12-07T09:59:14.208617+0000","last_peered":"2023-12-07T09:59:14.208617+0000","last_clean":"2023-12-07T09:59:14.208617+0000","last_became_active":"2023-12-07T09:59:12.451737+0000","last_became_peered":"2023-12-07T09:59:12.451737+0000","last_unstale":"2023-12-07T09:59:14.208617+0000","last_undegraded":"2023-12-07T09:59:14.208617+0000","last_fullsized":"2023-12-07T09:59:14.208617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:16.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856296+0000","last_change":"2023-12-07T09:59:13.229329+0000","last_active":"2023-12-07T09:59:14.856296+0000","last_peered":"2023-12-07T09:59:14.856296+0000","last_clean":"2023-12-07T09:59:14.856296+0000","last_became_active":"2023-12-07T09:59:13.229012+0000","last_became_peered":"2023-12-07T09:59:13.229012+0000","last_unstale":"2023-12-07T09:59:14.856296+0000","last_undegraded":"2023-12-07T09:59:14.856296+0000","last_fullsized":"2023-12-07T09:59:14.856296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:47:16.553666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855396+0000","last_change":"2023-12-07T09:59:12.443723+0000","last_active":"2023-12-07T09:59:14.855396+0000","last_peered":"2023-12-07T09:59:14.855396+0000","last_clean":"2023-12-07T09:59:14.855396+0000","last_became_active":"2023-12-07T09:59:12.443456+0000","last_became_peered":"2023-12-07T09:59:12.443456+0000","last_unstale":"2023-12-07T09:59:14.855396+0000","last_undegraded":"2023-12-07T09:59:14.855396+0000","last_fullsized":"2023-12-07T09:59:14.855396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:29.302595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855830+0000","last_change":"2023-12-07T09:59:13.216025+0000","last_active":"2023-12-07T09:59:14.855830+0000","last_peered":"2023-12-07T09:59:14.855830+0000","last_clean":"2023-12-07T09:59:14.855830+0000","last_became_active":"2023-12-07T09:59:13.215772+0000","last_became_peered":"2023-12-07T09:59:13.215772+0000","last_unstale":"2023-12-07T09:59:14.855830+0000","last_undegraded":"2023-12-07T09:59:14.855830+0000","last_fullsized":"2023-12-07T09:59:14.855830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856711+0000","last_change":"2023-12-07T09:59:12.442740+0000","last_active":"2023-12-07T09:59:14.856711+0000","last_peered":"2023-12-07T09:59:14.856711+0000","last_clean":"2023-12-07T09:59:14.856711+0000","last_became_active":"2023-12-07T09:59:12.442434+0000","last_became_peered":"2023-12-07T09:59:12.442434+0000","last_unstale":"2023-12-07T09:59:14.856711+0000","last_undegraded":"2023-12-07T09:59:14.856711+0000","last_fullsized":"2023-12-07T09:59:14.856711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209730+0000","last_change":"2023-12-07T09:59:13.229519+0000","last_active":"2023-12-07T09:59:14.209730+0000","last_peered":"2023-12-07T09:59:14.209730+0000","last_clean":"2023-12-07T09:59:14.209730+0000","last_became_active":"2023-12-07T09:59:13.229213+0000","last_became_peered":"2023-12-07T09:59:13.229213+0000","last_unstale":"2023-12-07T09:59:14.209730+0000","last_undegraded":"2023-12-07T09:59:14.209730+0000","last_fullsized":"2023-12-07T09:59:14.209730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:44:11.313416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855747+0000","last_change":"2023-12-07T09:59:12.444649+0000","last_active":"2023-12-07T09:59:14.855747+0000","last_peered":"2023-12-07T09:59:14.855747+0000","last_clean":"2023-12-07T09:59:14.855747+0000","last_became_active":"2023-12-07T09:59:12.444396+0000","last_became_peered":"2023-12-07T09:59:12.444396+0000","last_unstale":"2023-12-07T09:59:14.855747+0000","last_undegraded":"2023-12-07T09:59:14.855747+0000","last_fullsized":"2023-12-07T09:59:14.855747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856950+0000","last_change":"2023-12-07T09:59:13.235666+0000","last_active":"2023-12-07T09:59:14.856950+0000","last_peered":"2023-12-07T09:59:14.856950+0000","last_clean":"2023-12-07T09:59:14.856950+0000","last_became_active":"2023-12-07T09:59:13.235387+0000","last_became_peered":"2023-12-07T09:59:13.235387+0000","last_unstale":"2023-12-07T09:59:14.856950+0000","last_undegraded":"2023-12-07T09:59:14.856950+0000","last_fullsized":"2023-12-07T09:59:14.856950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:29:09.174108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209610+0000","last_change":"2023-12-07T09:59:12.453170+0000","last_active":"2023-12-07T09:59:14.209610+0000","last_peered":"2023-12-07T09:59:14.209610+0000","last_clean":"2023-12-07T09:59:14.209610+0000","last_became_active":"2023-12-07T09:59:12.452722+0000","last_became_peered":"2023-12-07T09:59:12.452722+0000","last_unstale":"2023-12-07T09:59:14.209610+0000","last_undegraded":"2023-12-07T09:59:14.209610+0000","last_fullsized":"2023-12-07T09:59:14.209610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:20:11.940444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855656+0000","last_change":"2023-12-07T09:59:13.218149+0000","last_active":"2023-12-07T09:59:14.855656+0000","last_peered":"2023-12-07T09:59:14.855656+0000","last_clean":"2023-12-07T09:59:14.855656+0000","last_became_active":"2023-12-07T09:59:13.217830+0000","last_became_peered":"2023-12-07T09:59:13.217830+0000","last_unstale":"2023-12-07T09:59:14.855656+0000","last_undegraded":"2023-12-07T09:59:14.855656+0000","last_fullsized":"2023-12-07T09:59:14.855656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:27.976020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:15.372027+0000","last_change":"2023-12-07T09:59:12.449220+0000","last_active":"2023-12-07T09:59:15.372027+0000","last_peered":"2023-12-07T09:59:15.372027+0000","last_clean":"2023-12-07T09:59:15.372027+0000","last_became_active":"2023-12-07T09:59:12.448837+0000","last_became_peered":"2023-12-07T09:59:12.448837+0000","last_unstale":"2023-12-07T09:59:15.372027+0000","last_undegraded":"2023-12-07T09:59:15.372027+0000","last_fullsized":"2023-12-07T09:59:15.372027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:50:57.639404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205360+0000","last_change":"2023-12-07T09:59:13.229085+0000","last_active":"2023-12-07T09:59:14.205360+0000","last_peered":"2023-12-07T09:59:14.205360+0000","last_clean":"2023-12-07T09:59:14.205360+0000","last_became_active":"2023-12-07T09:59:13.227932+0000","last_became_peered":"2023-12-07T09:59:13.227932+0000","last_unstale":"2023-12-07T09:59:14.205360+0000","last_undegraded":"2023-12-07T09:59:14.205360+0000","last_fullsized":"2023-12-07T09:59:14.205360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:25:39.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856299+0000","last_change":"2023-12-07T09:59:12.453221+0000","last_active":"2023-12-07T09:59:14.856299+0000","last_peered":"2023-12-07T09:59:14.856299+0000","last_clean":"2023-12-07T09:59:14.856299+0000","last_became_active":"2023-12-07T09:59:12.452946+0000","last_became_peered":"2023-12-07T09:59:12.452946+0000","last_unstale":"2023-12-07T09:59:14.856299+0000","last_undegraded":"2023-12-07T09:59:14.856299+0000","last_fullsized":"2023-12-07T09:59:14.856299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:07:11.011479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856524+0000","last_change":"2023-12-07T09:59:13.214345+0000","last_active":"2023-12-07T09:59:14.856524+0000","last_peered":"2023-12-07T09:59:14.856524+0000","last_clean":"2023-12-07T09:59:14.856524+0000","last_became_active":"2023-12-07T09:59:13.214065+0000","last_became_peered":"2023-12-07T09:59:13.214065+0000","last_unstale":"2023-12-07T09:59:14.856524+0000","last_undegraded":"2023-12-07T09:59:14.856524+0000","last_fullsized":"2023-12-07T09:59:14.856524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:45.248485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208601+0000","last_change":"2023-12-07T09:59:12.454383+0000","last_active":"2023-12-07T09:59:14.208601+0000","last_peered":"2023-12-07T09:59:14.208601+0000","last_clean":"2023-12-07T09:59:14.208601+0000","last_became_active":"2023-12-07T09:59:12.454061+0000","last_became_peered":"2023-12-07T09:59:12.454061+0000","last_unstale":"2023-12-07T09:59:14.208601+0000","last_undegraded":"2023-12-07T09:59:14.208601+0000","last_fullsized":"2023-12-07T09:59:14.208601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209349+0000","last_change":"2023-12-07T09:59:13.222718+0000","last_active":"2023-12-07T09:59:14.209349+0000","last_peered":"2023-12-07T09:59:14.209349+0000","last_clean":"2023-12-07T09:59:14.209349+0000","last_became_active":"2023-12-07T09:59:13.222405+0000","last_became_peered":"2023-12-07T09:59:13.222405+0000","last_unstale":"2023-12-07T09:59:14.209349+0000","last_undegraded":"2023-12-07T09:59:14.209349+0000","last_fullsized":"2023-12-07T09:59:14.209349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:52:30.311283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855995+0000","last_change":"2023-12-07T09:59:12.439274+0000","last_active":"2023-12-07T09:59:14.855995+0000","last_peered":"2023-12-07T09:59:14.855995+0000","last_clean":"2023-12-07T09:59:14.855995+0000","last_became_active":"2023-12-07T09:59:12.438973+0000","last_became_peered":"2023-12-07T09:59:12.438973+0000","last_unstale":"2023-12-07T09:59:14.855995+0000","last_undegraded":"2023-12-07T09:59:14.855995+0000","last_fullsized":"2023-12-07T09:59:14.855995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:28:11.313622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205003+0000","last_change":"2023-12-07T09:59:13.225445+0000","last_active":"2023-12-07T09:59:14.205003+0000","last_peered":"2023-12-07T09:59:14.205003+0000","last_clean":"2023-12-07T09:59:14.205003+0000","last_became_active":"2023-12-07T09:59:13.225149+0000","last_became_peered":"2023-12-07T09:59:13.225149+0000","last_unstale":"2023-12-07T09:59:14.205003+0000","last_undegraded":"2023-12-07T09:59:14.205003+0000","last_fullsized":"2023-12-07T09:59:14.205003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:58.637263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855648+0000","last_change":"2023-12-07T09:59:12.442112+0000","last_active":"2023-12-07T09:59:14.855648+0000","last_peered":"2023-12-07T09:59:14.855648+0000","last_clean":"2023-12-07T09:59:14.855648+0000","last_became_active":"2023-12-07T09:59:12.441793+0000","last_became_peered":"2023-12-07T09:59:12.441793+0000","last_unstale":"2023-12-07T09:59:14.855648+0000","last_undegraded":"2023-12-07T09:59:14.855648+0000","last_fullsized":"2023-12-07T09:59:14.855648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:13:52.294096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205346+0000","last_change":"2023-12-07T09:59:13.221842+0000","last_active":"2023-12-07T09:59:14.205346+0000","last_peered":"2023-12-07T09:59:14.205346+0000","last_clean":"2023-12-07T09:59:14.205346+0000","last_became_active":"2023-12-07T09:59:13.221454+0000","last_became_peered":"2023-12-07T09:59:13.221454+0000","last_unstale":"2023-12-07T09:59:14.205346+0000","last_undegraded":"2023-12-07T09:59:14.205346+0000","last_fullsized":"2023-12-07T09:59:14.205346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:28:42.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209325+0000","last_change":"2023-12-07T09:59:12.453238+0000","last_active":"2023-12-07T09:59:14.209325+0000","last_peered":"2023-12-07T09:59:14.209325+0000","last_clean":"2023-12-07T09:59:14.209325+0000","last_became_active":"2023-12-07T09:59:12.452285+0000","last_became_peered":"2023-12-07T09:59:12.452285+0000","last_unstale":"2023-12-07T09:59:14.209325+0000","last_undegraded":"2023-12-07T09:59:14.209325+0000","last_fullsized":"2023-12-07T09:59:14.209325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:17:05.804533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.855821+0000","last_change":"2023-12-07T09:59:13.243271+0000","last_active":"2023-12-07T09:59:14.855821+0000","last_peered":"2023-12-07T09:59:14.855821+0000","last_clean":"2023-12-07T09:59:14.855821+0000","last_became_active":"2023-12-07T09:59:13.242931+0000","last_became_peered":"2023-12-07T09:59:13.242931+0000","last_unstale":"2023-12-07T09:59:14.855821+0000","last_undegraded":"2023-12-07T09:59:14.855821+0000","last_fullsized":"2023-12-07T09:59:14.855821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:26.039237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856927+0000","last_change":"2023-12-07T09:59:13.232574+0000","last_active":"2023-12-07T09:59:14.856927+0000","last_peered":"2023-12-07T09:59:14.856927+0000","last_clean":"2023-12-07T09:59:14.856927+0000","last_became_active":"2023-12-07T09:59:13.232262+0000","last_became_peered":"2023-12-07T09:59:13.232262+0000","last_unstale":"2023-12-07T09:59:14.856927+0000","last_undegraded":"2023-12-07T09:59:14.856927+0000","last_fullsized":"2023-12-07T09:59:14.856927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:13:48.451359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.208855+0000","last_change":"2023-12-07T09:59:12.454304+0000","last_active":"2023-12-07T09:59:14.208855+0000","last_peered":"2023-12-07T09:59:14.208855+0000","last_clean":"2023-12-07T09:59:14.208855+0000","last_became_active":"2023-12-07T09:59:12.454038+0000","last_became_peered":"2023-12-07T09:59:12.454038+0000","last_unstale":"2023-12-07T09:59:14.208855+0000","last_undegraded":"2023-12-07T09:59:14.208855+0000","last_fullsized":"2023-12-07T09:59:14.208855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:31:46.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856881+0000","last_change":"2023-12-07T09:59:13.232029+0000","last_active":"2023-12-07T09:59:14.856881+0000","last_peered":"2023-12-07T09:59:14.856881+0000","last_clean":"2023-12-07T09:59:14.856881+0000","last_became_active":"2023-12-07T09:59:13.231273+0000","last_became_peered":"2023-12-07T09:59:13.231273+0000","last_unstale":"2023-12-07T09:59:14.856881+0000","last_undegraded":"2023-12-07T09:59:14.856881+0000","last_fullsized":"2023-12-07T09:59:14.856881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:24:13.524533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.209153+0000","last_change":"2023-12-07T09:59:12.452964+0000","last_active":"2023-12-07T09:59:14.209153+0000","last_peered":"2023-12-07T09:59:14.209153+0000","last_clean":"2023-12-07T09:59:14.209153+0000","last_became_active":"2023-12-07T09:59:12.452651+0000","last_became_peered":"2023-12-07T09:59:12.452651+0000","last_unstale":"2023-12-07T09:59:14.209153+0000","last_undegraded":"2023-12-07T09:59:14.209153+0000","last_fullsized":"2023-12-07T09:59:14.209153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:44.239797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856607+0000","last_change":"2023-12-07T09:59:13.224204+0000","last_active":"2023-12-07T09:59:14.856607+0000","last_peered":"2023-12-07T09:59:14.856607+0000","last_clean":"2023-12-07T09:59:14.856607+0000","last_became_active":"2023-12-07T09:59:13.222519+0000","last_became_peered":"2023-12-07T09:59:13.222519+0000","last_unstale":"2023-12-07T09:59:14.856607+0000","last_undegraded":"2023-12-07T09:59:14.856607+0000","last_fullsized":"2023-12-07T09:59:14.856607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:33:43.957117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205381+0000","last_change":"2023-12-07T09:59:12.440360+0000","last_active":"2023-12-07T09:59:14.205381+0000","last_peered":"2023-12-07T09:59:14.205381+0000","last_clean":"2023-12-07T09:59:14.205381+0000","last_became_active":"2023-12-07T09:59:12.440087+0000","last_became_peered":"2023-12-07T09:59:12.440087+0000","last_unstale":"2023-12-07T09:59:14.205381+0000","last_undegraded":"2023-12-07T09:59:14.205381+0000","last_fullsized":"2023-12-07T09:59:14.205381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:25.030548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.205333+0000","last_change":"2023-12-07T09:59:13.237795+0000","last_active":"2023-12-07T09:59:14.205333+0000","last_peered":"2023-12-07T09:59:14.205333+0000","last_clean":"2023-12-07T09:59:14.205333+0000","last_became_active":"2023-12-07T09:59:13.237488+0000","last_became_peered":"2023-12-07T09:59:13.237488+0000","last_unstale":"2023-12-07T09:59:14.205333+0000","last_undegraded":"2023-12-07T09:59:14.205333+0000","last_fullsized":"2023-12-07T09:59:14.205333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:12.412038+0000","last_clean_scrub_stamp":"2023-12-07T09:59:12.412038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:46.589242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-07T09:59:14.856662+0000","last_change":"2023-12-07T09:59:12.453157+0000","last_active":"2023-12-07T09:59:14.856662+0000","last_peered":"2023-12-07T09:59:14.856662+0000","last_clean":"2023-12-07T09:59:14.856662+0000","last_became_active":"2023-12-07T09:59:12.452900+0000","last_became_peered":"2023-12-07T09:59:12.452900+0000","last_unstale":"2023-12-07T09:59:14.856662+0000","last_undegraded":"2023-12-07T09:59:14.856662+0000","last_fullsized":"2023-12-07T09:59:14.856662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:11.403349+0000","last_clean_scrub_stamp":"2023-12-07T09:59:11.403349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:47:34.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3159999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8650000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5379999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T09:59:22.417 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-07T09:59:22.417 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-07T09:59:22.418 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-07T09:59:22.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-07T09:59:22.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.583+0000 7f1ca9e82640 1 Processor -- start 2023-12-07T09:59:22.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.583+0000 7f1ca9e82640 1 -- start start 2023-12-07T09:59:22.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca9e82640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ca40caba0 0x7f1ca4151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca9e82640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca4151cd0 0x7f1ca4154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca9e82640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca41589b0 con 0x7f1ca40ca7c0 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca9e82640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca406ce30 con 0x7f1ca40caba0 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca9e82640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca4152180 con 0x7f1ca4151cd0 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ca40caba0 0x7f1ca4151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ca40caba0 0x7f1ca4151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40058/0 (socket says 172.21.15.89:40058) 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca8e80640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1ca40ca7c0 0x7f1ca40c7f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57858/0 (socket says 172.21.15.89:57858) 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 -- 172.21.15.89:0/3064163004 learned_addr learned my addr 172.21.15.89:0/3064163004 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:22.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca9681640 1 --2- 172.21.15.89:0/3064163004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca4151cd0 0x7f1ca4154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 -- 172.21.15.89:0/3064163004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca4151cd0 msgr2=0x7f1ca4154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:22.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 --2- 172.21.15.89:0/3064163004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca4151cd0 0x7f1ca4154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 -- 172.21.15.89:0/3064163004 >> v1:172.21.15.89:6789/0 conn(0x7f1ca40ca7c0 legacy=0x7f1ca40c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca3fff640 1 -- 172.21.15.89:0/3064163004 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4157da0 con 0x7f1ca40caba0 2023-12-07T09:59:22.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.587+0000 7f1ca37fe640 1 -- 172.21.15.89:0/3064163004 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303948981 0 0) 0x7f1ca41589b0 con 0x7f1ca40ca7c0 2023-12-07T09:59:22.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca3fff640 1 --2- 172.21.15.89:0/3064163004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca40caba0 0x7f1ca4151790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009870 tx=0x7f1c9001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5096fdc2932149 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca37fe640 1 -- 172.21.15.89:0/3064163004 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ac600 con 0x7f1ca40caba0 2023-12-07T09:59:22.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca37fe640 1 -- 172.21.15.89:0/3064163004 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900a8050 con 0x7f1ca40caba0 2023-12-07T09:59:22.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca37fe640 1 -- 172.21.15.89:0/3064163004 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ac980 con 0x7f1ca40caba0 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- 172.21.15.89:0/3064163004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca40caba0 msgr2=0x7f1ca4151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/3064163004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca40caba0 0x7f1ca4151790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009870 tx=0x7f1c9001c4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- 172.21.15.89:0/3064163004 shutdown_connections 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/3064163004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca4151cd0 0x7f1ca4154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/3064163004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca40caba0 0x7f1ca4151790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- 172.21.15.89:0/3064163004 >> 172.21.15.89:0/3064163004 conn(0x7f1ca40720d0 msgr2=0x7f1ca40724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:22.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- 172.21.15.89:0/3064163004 shutdown_connections 2023-12-07T09:59:22.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- 172.21.15.89:0/3064163004 wait complete. 2023-12-07T09:59:22.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 Processor -- start 2023-12-07T09:59:22.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- start start 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca40ca7c0 0x7f1ca414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ca40caba0 0x7f1ca41ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 0x7f1ca41edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40ad840 con 0x7f1ca4151cd0 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca41ee040 con 0x7f1ca40caba0 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9e82640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca41ed0c0 con 0x7f1ca40ca7c0 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9681640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 0x7f1ca41edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9681640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 0x7f1ca41edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40068/0 (socket says 172.21.15.89:40068) 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.591+0000 7f1ca9681640 1 -- 172.21.15.89:0/729001275 learned_addr learned my addr 172.21.15.89:0/729001275 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca8e80640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca40ca7c0 0x7f1ca414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca3fff640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ca40caba0 0x7f1ca41ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9681640 1 -- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca40ca7c0 msgr2=0x7f1ca414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9681640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca40ca7c0 0x7f1ca414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9681640 1 -- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ca40caba0 msgr2=0x7f1ca41ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9681640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ca40caba0 0x7f1ca41ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9681640 1 -- 172.21.15.89:0/729001275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900094d0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9681640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 0x7f1ca41edb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007e60 tx=0x7f1c9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c014420 con 0x7f1ca4151cd0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0145a0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c014950 con 0x7f1ca4151cd0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca40ad070 con 0x7f1ca4151cd0 2023-12-07T09:59:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca41f10e0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca41ed2e0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c9c014ab0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.595+0000 7f1ca17fa640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1c880668d0 0x7f1c88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.599+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c9c084cd0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.599+0000 7f1ca8e80640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1c880668d0 0x7f1c88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.599+0000 7f1ca8e80640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1c880668d0 0x7f1c88068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c98007fd0 tx=0x7f1c98007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.599+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ca41ed2e0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1ca41ed2e0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca17fa640 1 -- 172.21.15.89:0/729001275 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1ca41ed2e0 con 0x7f1ca4151cd0 2023-12-07T09:59:22.788 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:22.788 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1c880668d0 msgr2=0x7f1c88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1c880668d0 0x7f1c88068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c98007fd0 tx=0x7f1c98007d60 comp rx=0 tx=0).stop 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 msgr2=0x7f1ca41edb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 0x7f1ca41edb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007e60 tx=0x7f1c9c00e4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 shutdown_connections 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca4151cd0 0x7f1ca41edb00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ca40caba0 0x7f1ca41ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1c880668d0 0x7f1c88068d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 --2- 172.21.15.89:0/729001275 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ca40ca7c0 0x7f1ca414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 >> 172.21.15.89:0/729001275 conn(0x7f1ca40720d0 msgr2=0x7f1ca4157130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 shutdown_connections 2023-12-07T09:59:22.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.783+0000 7f1ca9e82640 1 -- 172.21.15.89:0/729001275 wait complete. 2023-12-07T09:59:22.809 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-07T09:59:22.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:22.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.939+0000 7fc755646640 1 Processor -- start 2023-12-07T09:59:22.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.939+0000 7fc755646640 1 -- start start 2023-12-07T09:59:22.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc755646640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7500700a0 0x7fc75006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc755646640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc750072780 con 0x7fc750154870 2023-12-07T09:59:22.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc755646640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500ac160 con 0x7fc7500aacd0 2023-12-07T09:59:22.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc755646640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500abe80 con 0x7fc7500700a0 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7500700a0 0x7fc75006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc7467fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc750154870 0x7fc75006c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57868/0 (socket says 172.21.15.89:57868) 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7500700a0 0x7fc75006d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40072/0 (socket says 172.21.15.89:40072) 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc7467fc640 1 -- 172.21.15.89:0/1527336474 learned_addr learned my addr 172.21.15.89:0/1527336474 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74f7fe640 1 -- 172.21.15.89:0/1527336474 >> v1:172.21.15.97:6789/0 conn(0x7fc7500aacd0 legacy=0x7fc750154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74f7fe640 1 -- 172.21.15.89:0/1527336474 >> v1:172.21.15.89:6789/0 conn(0x7fc750154870 legacy=0x7fc75006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74f7fe640 1 -- 172.21.15.89:0/1527336474 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750154cf0 con 0x7fc7500700a0 2023-12-07T09:59:22.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74f7fe640 1 --2- 172.21.15.89:0/1527336474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75006d060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7480097c0 tx=0x7fc74801d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dedd74e1bee2b04 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74e7fc640 1 -- 172.21.15.89:0/1527336474 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480ab660 con 0x7fc7500700a0 2023-12-07T09:59:22.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.943+0000 7fc74e7fc640 1 -- 172.21.15.89:0/1527336474 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480ab7c0 con 0x7fc7500700a0 2023-12-07T09:59:22.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74e7fc640 1 -- 172.21.15.89:0/1527336474 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480abb50 con 0x7fc7500700a0 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- 172.21.15.89:0/1527336474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 msgr2=0x7fc75006d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 --2- 172.21.15.89:0/1527336474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75006d060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7480097c0 tx=0x7fc74801d480 comp rx=0 tx=0).stop 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- 172.21.15.89:0/1527336474 shutdown_connections 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 --2- 172.21.15.89:0/1527336474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75006d060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- 172.21.15.89:0/1527336474 >> 172.21.15.89:0/1527336474 conn(0x7fc7500c2ad0 msgr2=0x7fc7500c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- 172.21.15.89:0/1527336474 shutdown_connections 2023-12-07T09:59:22.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- 172.21.15.89:0/1527336474 wait complete. 2023-12-07T09:59:22.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 Processor -- start 2023-12-07T09:59:22.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- start start 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7500aacd0 0x7fc75014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc750154870 0x7fc750152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c4c20 con 0x7fc7500700a0 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c4140 con 0x7fc7500aacd0 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc755646640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7501542e0 con 0x7fc750154870 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75014ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40074/0 (socket says 172.21.15.89:40074) 2023-12-07T09:59:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74effd640 1 -- 172.21.15.89:0/2154707910 learned_addr learned my addr 172.21.15.89:0/2154707910 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74f7fe640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc750154870 0x7fc750152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc7467fc640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7500aacd0 0x7fc75014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74effd640 1 -- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc750154870 msgr2=0x7fc750152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.947+0000 7fc74effd640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc750154870 0x7fc750152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc74effd640 1 -- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7500aacd0 msgr2=0x7fc75014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc74effd640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7500aacd0 0x7fc75014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc74effd640 1 -- 172.21.15.89:0/2154707910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748009420 con 0x7fc7500700a0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc7467fc640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7500aacd0 0x7fc75014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc74f7fe640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc750154870 0x7fc750152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc74effd640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75014ccf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c500 tx=0x7fc74000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740005220 con 0x7fc7500700a0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740005380 con 0x7fc7500700a0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740007270 con 0x7fc7500700a0 2023-12-07T09:59:22.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc750153d20 con 0x7fc7500700a0 2023-12-07T09:59:22.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7500c3d60 con 0x7fc7500700a0 2023-12-07T09:59:22.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7500c4280 con 0x7fc7500700a0 2023-12-07T09:59:22.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7400073d0 con 0x7fc7500700a0 2023-12-07T09:59:22.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc747fff640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7300668d0 0x7fc730068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:22.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc740083d20 con 0x7fc7500700a0 2023-12-07T09:59:22.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.951+0000 7fc7467fc640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7300668d0 0x7fc730068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:22.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.955+0000 7fc7467fc640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7300668d0 0x7fc730068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc75014e460 tx=0x7fc738009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:22.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:22.955+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7500c4280 con 0x7fc7500700a0 2023-12-07T09:59:23.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7500c4280 con 0x7fc7500700a0 2023-12-07T09:59:23.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc747fff640 1 -- 172.21.15.89:0/2154707910 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fc7500c4280 con 0x7fc7500700a0 2023-12-07T09:59:23.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:23.117 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7300668d0 msgr2=0x7fc730068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7300668d0 0x7fc730068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc75014e460 tx=0x7fc738009040 comp rx=0 tx=0).stop 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 msgr2=0x7fc75014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75014ccf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c500 tx=0x7fc74000c9c0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 shutdown_connections 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7300668d0 0x7fc730068d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc750154870 0x7fc750152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7500aacd0 0x7fc75014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 --2- 172.21.15.89:0/2154707910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500700a0 0x7fc75014ccf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 >> 172.21.15.89:0/2154707910 conn(0x7fc7500c2ad0 msgr2=0x7fc750143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 shutdown_connections 2023-12-07T09:59:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.111+0000 7fc755646640 1 -- 172.21.15.89:0/2154707910 wait complete. 2023-12-07T09:59:23.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:23.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:23.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f468b9b8640 1 Processor -- start 2023-12-07T09:59:23.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f468b9b8640 1 -- start start 2023-12-07T09:59:23.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f468b9b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4684072330 0x7f46840c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f468b9b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46841522c0 con 0x7f46840c1ae0 2023-12-07T09:59:23.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f468b9b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4684155040 con 0x7f4684151ee0 2023-12-07T09:59:23.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f468b9b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46840c1610 con 0x7f4684072330 2023-12-07T09:59:23.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f4688f53640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f46840c1ae0 0x7f46840c09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57870/0 (socket says 172.21.15.89:57870) 2023-12-07T09:59:23.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f4688f53640 1 -- 172.21.15.89:0/2112920348 learned_addr learned my addr 172.21.15.89:0/2112920348 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:23.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f4689f55640 1 --2- 172.21.15.89:0/2112920348 >> v2:172.21.15.97:3300/0 conn(0x7f4684072330 0x7f46840c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f467bfff640 1 -- 172.21.15.89:0/2112920348 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447838106 0 0) 0x7f46841522c0 con 0x7f46840c1ae0 2023-12-07T09:59:23.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.275+0000 7f467bfff640 1 -- 172.21.15.89:0/2112920348 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4670003530 con 0x7f46840c1ae0 2023-12-07T09:59:23.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f4689f55640 1 -- 172.21.15.89:0/2112920348 >> v1:172.21.15.97:6789/0 conn(0x7f4684151ee0 legacy=0x7f468406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f4689f55640 1 -- 172.21.15.89:0/2112920348 >> v1:172.21.15.89:6789/0 conn(0x7f46840c1ae0 legacy=0x7f46840c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f4689f55640 1 -- 172.21.15.89:0/2112920348 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46841555c0 con 0x7f4684072330 2023-12-07T09:59:23.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f4689f55640 1 --2- 172.21.15.89:0/2112920348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684072330 0x7f46840c10d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f467c009d90 tx=0x7f467c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4bf58550986c458 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f467bfff640 1 -- 172.21.15.89:0/2112920348 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0a5980 con 0x7f4684072330 2023-12-07T09:59:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f467bfff640 1 -- 172.21.15.89:0/2112920348 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c0a5ae0 con 0x7f4684072330 2023-12-07T09:59:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f467bfff640 1 -- 172.21.15.89:0/2112920348 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0a5e70 con 0x7f4684072330 2023-12-07T09:59:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f468b9b8640 1 -- 172.21.15.89:0/2112920348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684072330 msgr2=0x7f46840c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2112920348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684072330 0x7f46840c10d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f467c009d90 tx=0x7f467c01c8c0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f468b9b8640 1 -- 172.21.15.89:0/2112920348 shutdown_connections 2023-12-07T09:59:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2112920348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684072330 0x7f46840c10d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.279+0000 7f468b9b8640 1 -- 172.21.15.89:0/2112920348 >> 172.21.15.89:0/2112920348 conn(0x7f46840c3b70 msgr2=0x7f46840c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:23.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- 172.21.15.89:0/2112920348 shutdown_connections 2023-12-07T09:59:23.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- 172.21.15.89:0/2112920348 wait complete. 2023-12-07T09:59:23.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 Processor -- start 2023-12-07T09:59:23.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- start start 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 0x7f46841570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46840c1ae0 0x7f46841ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684151ee0 0x7f468414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4684153890 con 0x7f4684072330 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468414c9c0 con 0x7f4684151ee0 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468414cc60 con 0x7f46840c1ae0 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 0x7f46841570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 0x7f46841570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40076/0 (socket says 172.21.15.89:40076) 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 -- 172.21.15.89:0/2268098709 learned_addr learned my addr 172.21.15.89:0/2268098709 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689f55640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684151ee0 0x7f468414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4688f53640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46840c1ae0 0x7f46841ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 -- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46840c1ae0 msgr2=0x7f46841ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46840c1ae0 0x7f46841ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 -- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684151ee0 msgr2=0x7f468414da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684151ee0 0x7f468414da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 -- 172.21.15.89:0/2268098709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009a70 con 0x7f4684072330 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4688f53640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46840c1ae0 0x7f46841ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4689754640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 0x7f46841570b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f468000c3c0 tx=0x7f468000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800052d0 con 0x7f4684072330 2023-12-07T09:59:23.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680005430 con 0x7f4684072330 2023-12-07T09:59:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468414cf40 con 0x7f4684072330 2023-12-07T09:59:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.283+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680003840 con 0x7f4684072330 2023-12-07T09:59:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468414d500 con 0x7f4684072330 2023-12-07T09:59:23.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468404e890 con 0x7f4684072330 2023-12-07T09:59:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f46800039a0 con 0x7f4684072330 2023-12-07T09:59:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f4679ffb640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4668066900 0x7f4668068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4680083900 con 0x7f4684072330 2023-12-07T09:59:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f4688f53640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4668066900 0x7f4668068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.287+0000 7f4688f53640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4668066900 0x7f4668068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46841ea9a0 tx=0x7f4674009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.291+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4680050b60 con 0x7f4684072330 2023-12-07T09:59:23.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f468406eeb0 con 0x7f4684072330 2023-12-07T09:59:23.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f4679ffb640 1 -- 172.21.15.89:0/2268098709 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46800170a0 con 0x7f4684072330 2023-12-07T09:59:23.448 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4668066900 msgr2=0x7f4668068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4668066900 0x7f4668068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46841ea9a0 tx=0x7f4674009040 comp rx=0 tx=0).stop 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 msgr2=0x7f46841570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 0x7f46841570b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f468000c3c0 tx=0x7f468000c880 comp rx=0 tx=0).stop 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 shutdown_connections 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4684151ee0 0x7f468414da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4668066900 0x7f4668068dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46840c1ae0 0x7f46841ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 --2- 172.21.15.89:0/2268098709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4684072330 0x7f46841570b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 >> 172.21.15.89:0/2268098709 conn(0x7f46840c3b70 msgr2=0x7f4684152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:23.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 shutdown_connections 2023-12-07T09:59:23.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.443+0000 7f468b9b8640 1 -- 172.21.15.89:0/2268098709 wait complete. 2023-12-07T09:59:23.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:23.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.603+0000 7f12c3038640 1 Processor -- start 2023-12-07T09:59:23.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.603+0000 7f12c3038640 1 -- start start 2023-12-07T09:59:23.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c3038640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12bc0c2750 0x7f12bc0bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c3038640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0c1410 con 0x7f12bc071f30 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c3038640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0c0e90 con 0x7f12bc0c0460 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c3038640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0c1130 con 0x7f12bc0c2750 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c2837640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f12bc071f30 0x7f12bc0c5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57884/0 (socket says 172.21.15.89:57884) 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c2837640 1 -- 172.21.15.89:0/4239811522 learned_addr learned my addr 172.21.15.89:0/4239811522 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c2036640 1 --2- 172.21.15.89:0/4239811522 >> v2:172.21.15.97:3300/0 conn(0x7f12bc0c2750 0x7f12bc0bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381646292 0 0) 0x7f12bc0c1410 con 0x7f12bc071f30 2023-12-07T09:59:23.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a8003530 con 0x7f12bc071f30 2023-12-07T09:59:23.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254301088 0 0) 0x7f12a8003530 con 0x7f12bc071f30 2023-12-07T09:59:23.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 >> v2:172.21.15.97:3300/0 conn(0x7f12bc0c2750 msgr2=0x7f12bc0bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:23.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 --2- 172.21.15.89:0/4239811522 >> v2:172.21.15.97:3300/0 conn(0x7f12bc0c2750 0x7f12bc0bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 >> v1:172.21.15.97:6789/0 conn(0x7f12bc0c0460 legacy=0x7f12bc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc06da20 con 0x7f12bc071f30 2023-12-07T09:59:23.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f12b4001a00 con 0x7f12bc071f30 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 >> v1:172.21.15.89:6789/0 conn(0x7f12bc071f30 legacy=0x7f12bc0c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12a80039d0 0x7f12a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12a80052b0 0x7f12a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c1130 con 0x7f12a80047d0 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a800c1b0 con 0x7f12a80039d0 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a800c370 con 0x7f12a80052b0 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1835640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c2036640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12a80039d0 0x7f12a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c2837640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12a80052b0 0x7f12a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1835640 1 -- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12a80052b0 msgr2=0x7f12a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1835640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12a80052b0 0x7f12a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1835640 1 -- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12a80039d0 msgr2=0x7f12a8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:23.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1835640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12a80039d0 0x7f12a8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c1835640 1 -- 172.21.15.89:0/4239811522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8003530 con 0x7f12a80047d0 2023-12-07T09:59:23.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.607+0000 7f12c2837640 1 -- 172.21.15.89:0/4239811522 reap_dead start 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c1835640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12a8004c50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12ac001780 tx=0x7f12ac01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac1f4f13c6c35a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0052d0 con 0x7f12a80047d0 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac0a7050 con 0x7f12a80047d0 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c1034640 1 -- 172.21.15.89:0/4239811522 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac003600 con 0x7f12a80047d0 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 -- 172.21.15.89:0/4239811522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 msgr2=0x7f12a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12a8004c50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12ac001780 tx=0x7f12ac01c3b0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 -- 172.21.15.89:0/4239811522 shutdown_connections 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 --2- 172.21.15.89:0/4239811522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12a8004c50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 -- 172.21.15.89:0/4239811522 >> 172.21.15.89:0/4239811522 conn(0x7f12bc0c5a60 msgr2=0x7f12bc0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 -- 172.21.15.89:0/4239811522 shutdown_connections 2023-12-07T09:59:23.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 -- 172.21.15.89:0/4239811522 wait complete. 2023-12-07T09:59:23.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 Processor -- start 2023-12-07T09:59:23.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.611+0000 7f12c3038640 1 -- start start 2023-12-07T09:59:23.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12bc0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12bc0bdeb0 0x7f12bc0bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12bc0bef00 0x7f12bc1e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0bea70 con 0x7f12a80047d0 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0aa3f0 con 0x7f12bc0bdeb0 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0be460 con 0x7f12bc0bef00 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12bc0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12bc0a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40108/0 (socket says 172.21.15.89:40108) 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 -- 172.21.15.89:0/3720979199 learned_addr learned my addr 172.21.15.89:0/3720979199 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c1835640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12bc0bdeb0 0x7f12bc0bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2837640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12bc0bef00 0x7f12bc1e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 -- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12bc0bef00 msgr2=0x7f12bc1e87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12bc0bef00 0x7f12bc1e87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 -- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12bc0bdeb0 msgr2=0x7f12bc0bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12bc0bdeb0 0x7f12bc0bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 -- 172.21.15.89:0/3720979199 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0a9e70 con 0x7f12a80047d0 2023-12-07T09:59:23.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c2036640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12bc0a9930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12b8011aa0 tx=0x7f12b8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800fb80 con 0x7f12a80047d0 2023-12-07T09:59:23.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800fce0 con 0x7f12a80047d0 2023-12-07T09:59:23.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc0aa110 con 0x7f12a80047d0 2023-12-07T09:59:23.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8014680 con 0x7f12a80047d0 2023-12-07T09:59:23.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc152ec0 con 0x7f12a80047d0 2023-12-07T09:59:23.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc0680c0 con 0x7f12a80047d0 2023-12-07T09:59:23.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.615+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f12b80147e0 con 0x7f12a80047d0 2023-12-07T09:59:23.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.619+0000 7f12b2ffd640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f12a00668d0 0x7f12a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.619+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12b8084d30 con 0x7f12a80047d0 2023-12-07T09:59:23.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.619+0000 7f12c1835640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f12a00668d0 0x7f12a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.619+0000 7f12c1835640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f12a00668d0 0x7f12a0068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12ac001750 tx=0x7f12ac0011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.623+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12b8052000 con 0x7f12a80047d0 2023-12-07T09:59:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.767+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12bc074970 con 0x7f12a80047d0 2023-12-07T09:59:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12b2ffd640 1 -- 172.21.15.89:0/3720979199 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12b8055620 con 0x7f12a80047d0 2023-12-07T09:59:23.780 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:23.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f12a00668d0 msgr2=0x7f12a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f12a00668d0 0x7f12a0068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12ac001750 tx=0x7f12ac0011a0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 msgr2=0x7f12bc0a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12bc0a9930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12b8011aa0 tx=0x7f12b8011f60 comp rx=0 tx=0).stop 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 shutdown_connections 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f12a00668d0 0x7f12a0068d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f12bc0bef00 0x7f12bc1e87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12bc0bdeb0 0x7f12bc0bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 --2- 172.21.15.89:0/3720979199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12a80047d0 0x7f12bc0a9930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 >> 172.21.15.89:0/3720979199 conn(0x7f12bc0c5a60 msgr2=0x7f12bc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 shutdown_connections 2023-12-07T09:59:23.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.771+0000 7f12c3038640 1 -- 172.21.15.89:0/3720979199 wait complete. 2023-12-07T09:59:23.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:23.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 Processor -- start 2023-12-07T09:59:23.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 -- start start 2023-12-07T09:59:23.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd59014eaf0 0x7fd590151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd590151f90 0x7fd59006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5900c0370 0x7fd59006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59006de00 con 0x7fd590151f90 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd590070390 con 0x7fd59014eaf0 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd595432640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59006db90 con 0x7fd5900c0370 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd590151f90 0x7fd59006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd590151f90 0x7fd59006d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40114/0 (socket says 172.21.15.89:40114) 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 -- 172.21.15.89:0/3971496257 learned_addr learned my addr 172.21.15.89:0/3971496257 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd58effd640 1 --2- 172.21.15.89:0/3971496257 >> v2:172.21.15.97:3300/0 conn(0x7fd59014eaf0 0x7fd590151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd58f7fe640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5900c0370 0x7fd59006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 -- 172.21.15.89:0/3971496257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5900c0370 msgr2=0x7fd59006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:23.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5900c0370 0x7fd59006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 -- 172.21.15.89:0/3971496257 >> v2:172.21.15.97:3300/0 conn(0x7fd59014eaf0 msgr2=0x7fd590151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:23.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 --2- 172.21.15.89:0/3971496257 >> v2:172.21.15.97:3300/0 conn(0x7fd59014eaf0 0x7fd590151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd5867fc640 1 -- 172.21.15.89:0/3971496257 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59014eed0 con 0x7fd590151f90 2023-12-07T09:59:23.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.931+0000 7fd58f7fe640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5900c0370 0x7fd59006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:23.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd5867fc640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd590151f90 0x7fd59006d110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5900c3b00 tx=0x7fd57801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d18cb14793960c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd58e7fc640 1 -- 172.21.15.89:0/3971496257 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780ac600 con 0x7fd590151f90 2023-12-07T09:59:23.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd58e7fc640 1 -- 172.21.15.89:0/3971496257 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5780a8050 con 0x7fd590151f90 2023-12-07T09:59:23.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd58e7fc640 1 -- 172.21.15.89:0/3971496257 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780ac980 con 0x7fd590151f90 2023-12-07T09:59:23.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 -- 172.21.15.89:0/3971496257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd590151f90 msgr2=0x7fd59006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd590151f90 0x7fd59006d110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5900c3b00 tx=0x7fd57801c3e0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 -- 172.21.15.89:0/3971496257 shutdown_connections 2023-12-07T09:59:23.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5900c0370 0x7fd59006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 --2- 172.21.15.89:0/3971496257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd590151f90 0x7fd59006d110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 --2- 172.21.15.89:0/3971496257 >> v2:172.21.15.97:3300/0 conn(0x7fd59014eaf0 0x7fd590151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 -- 172.21.15.89:0/3971496257 >> 172.21.15.89:0/3971496257 conn(0x7fd5900c2a60 msgr2=0x7fd5900c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:23.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 -- 172.21.15.89:0/3971496257 shutdown_connections 2023-12-07T09:59:23.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.935+0000 7fd595432640 1 -- 172.21.15.89:0/3971496257 wait complete. 2023-12-07T09:59:23.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 Processor -- start 2023-12-07T09:59:23.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 -- start start 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 0x7fd590071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59014eaf0 0x7fd5901418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59014b8b0 0x7fd5901ee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5901eb170 con 0x7fd5900c0370 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5901eb450 con 0x7fd59014b8b0 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5901eb730 con 0x7fd59014eaf0 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 0x7fd590071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 0x7fd590071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40122/0 (socket says 172.21.15.89:40122) 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 -- 172.21.15.89:0/1717105643 learned_addr learned my addr 172.21.15.89:0/1717105643 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd5867fc640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59014eaf0 0x7fd5901418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58f7fe640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59014b8b0 0x7fd5901ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 -- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59014eaf0 msgr2=0x7fd5901418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59014eaf0 0x7fd5901418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 -- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59014b8b0 msgr2=0x7fd5901ee750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59014b8b0 0x7fd5901ee750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 -- 172.21.15.89:0/1717105643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780094d0 con 0x7fd5900c0370 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd58effd640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 0x7fd590071e70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd58000d800 tx=0x7fd58000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000b6c0 con 0x7fd5900c0370 2023-12-07T09:59:23.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000b820 con 0x7fd5900c0370 2023-12-07T09:59:23.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5901eba10 con 0x7fd5900c0370 2023-12-07T09:59:23.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000bb90 con 0x7fd5900c0370 2023-12-07T09:59:23.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.939+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900723b0 con 0x7fd5900c0370 2023-12-07T09:59:23.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.943+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59004e890 con 0x7fd5900c0370 2023-12-07T09:59:23.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.943+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd58000bcf0 con 0x7fd5900c0370 2023-12-07T09:59:23.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.943+0000 7fd587fff640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5700668d0 0x7fd570068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:23.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.943+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd580084850 con 0x7fd5900c0370 2023-12-07T09:59:23.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.943+0000 7fd5867fc640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5700668d0 0x7fd570068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:23.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.943+0000 7fd5867fc640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5700668d0 0x7fd570068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5780ae000 tx=0x7fd5780a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:23.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:23.947+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd580051b30 con 0x7fd5900c0370 2023-12-07T09:59:24.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.107+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd59014be00 con 0x7fd5900c0370 2023-12-07T09:59:24.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.107+0000 7fd587fff640 1 -- 172.21.15.89:0/1717105643 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd580055150 con 0x7fd5900c0370 2023-12-07T09:59:24.114 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5700668d0 msgr2=0x7fd570068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5700668d0 0x7fd570068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5780ae000 tx=0x7fd5780a7000 comp rx=0 tx=0).stop 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 msgr2=0x7fd590071e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 0x7fd590071e70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd58000d800 tx=0x7fd58000dcc0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 shutdown_connections 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd59014b8b0 0x7fd5901ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5700668d0 0x7fd570068d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd59014eaf0 0x7fd5901418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 --2- 172.21.15.89:0/1717105643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900c0370 0x7fd590071e70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 >> 172.21.15.89:0/1717105643 conn(0x7fd5900c2a60 msgr2=0x7fd590150180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:24.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 shutdown_connections 2023-12-07T09:59:24.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.111+0000 7fd595432640 1 -- 172.21.15.89:0/1717105643 wait complete. 2023-12-07T09:59:24.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:24.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.263+0000 7fa624be6640 1 Processor -- start 2023-12-07T09:59:24.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.263+0000 7fa624be6640 1 -- start start 2023-12-07T09:59:24.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa624be6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa62014e9d0 0x7fa620151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa624be6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa6200a8470 0x7fa62006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa624be6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62006d320 con 0x7fa620070b80 2023-12-07T09:59:24.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa624be6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200721b0 con 0x7fa62014e9d0 2023-12-07T09:59:24.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa624be6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200c2830 con 0x7fa6200a8470 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa61e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa62014e9d0 0x7fa620151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa617fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa620070b80 0x7fa6200c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57900/0 (socket says 172.21.15.89:57900) 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa617fff640 1 -- 172.21.15.89:0/1662642426 learned_addr learned my addr 172.21.15.89:0/1662642426 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa61e59c640 1 -- 172.21.15.89:0/1662642426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa6200a8470 msgr2=0x7fa62006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa61e59c640 1 --2- 172.21.15.89:0/1662642426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa6200a8470 0x7fa62006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa61e59c640 1 -- 172.21.15.89:0/1662642426 >> v1:172.21.15.89:6789/0 conn(0x7fa620070b80 legacy=0x7fa6200c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.267+0000 7fa61e59c640 1 -- 172.21.15.89:0/1662642426 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620072450 con 0x7fa62014e9d0 2023-12-07T09:59:24.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa61e59c640 1 --2- 172.21.15.89:0/1662642426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa62014e9d0 0x7fa620151e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6100097c0 tx=0x7fa61001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d487286618c149f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa61dd9b640 1 -- 172.21.15.89:0/1662642426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100ab600 con 0x7fa62014e9d0 2023-12-07T09:59:24.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa61dd9b640 1 -- 172.21.15.89:0/1662642426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6100a7050 con 0x7fa62014e9d0 2023-12-07T09:59:24.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa61dd9b640 1 -- 172.21.15.89:0/1662642426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100ab980 con 0x7fa62014e9d0 2023-12-07T09:59:24.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 -- 172.21.15.89:0/1662642426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa62014e9d0 msgr2=0x7fa620151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 --2- 172.21.15.89:0/1662642426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa62014e9d0 0x7fa620151e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6100097c0 tx=0x7fa61001c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 -- 172.21.15.89:0/1662642426 shutdown_connections 2023-12-07T09:59:24.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 --2- 172.21.15.89:0/1662642426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa6200a8470 0x7fa62006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 --2- 172.21.15.89:0/1662642426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa62014e9d0 0x7fa620151e60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 -- 172.21.15.89:0/1662642426 >> 172.21.15.89:0/1662642426 conn(0x7fa6200c2ad0 msgr2=0x7fa6200c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:24.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 -- 172.21.15.89:0/1662642426 shutdown_connections 2023-12-07T09:59:24.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 -- 172.21.15.89:0/1662642426 wait complete. 2023-12-07T09:59:24.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 Processor -- start 2023-12-07T09:59:24.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.271+0000 7fa624be6640 1 -- start start 2023-12-07T09:59:24.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa620070b80 0x7fa6200c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 0x7fa62014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa62014e9d0 0x7fa62014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620146ad0 con 0x7fa6200a8470 2023-12-07T09:59:24.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620152150 con 0x7fa62014e9d0 2023-12-07T09:59:24.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201467f0 con 0x7fa620070b80 2023-12-07T09:59:24.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 0x7fa62014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 0x7fa62014f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40142/0 (socket says 172.21.15.89:40142) 2023-12-07T09:59:24.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 -- 172.21.15.89:0/3085522691 learned_addr learned my addr 172.21.15.89:0/3085522691 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:24.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa61e59c640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa620070b80 0x7fa6200c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa61ed9d640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa62014e9d0 0x7fa62014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 -- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa620070b80 msgr2=0x7fa6200c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa620070b80 0x7fa6200c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 -- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa62014e9d0 msgr2=0x7fa62014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa62014e9d0 0x7fa62014f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 -- 172.21.15.89:0/3085522691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009420 con 0x7fa6200a8470 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa61e59c640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa620070b80 0x7fa6200c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa61ed9d640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa62014e9d0 0x7fa62014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa617fff640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 0x7fa62014f250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa60800c4d0 tx=0x7fa60800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608005cf0 con 0x7fa6200a8470 2023-12-07T09:59:24.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa608005e50 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608007270 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6201446a0 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6200c13e0 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.275+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa620145dc0 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.279+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa6080073d0 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.279+0000 7fa616ffd640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa6000668d0 0x7fa600068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.279+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa608083890 con 0x7fa6200a8470 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.279+0000 7fa61e59c640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa6000668d0 0x7fa600068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.279+0000 7fa61e59c640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa6000668d0 0x7fa600068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6100ad000 tx=0x7fa6100a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.283+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa620145dc0 con 0x7fa6200a8470 2023-12-07T09:59:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.463+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa620145dc0 con 0x7fa6200a8470 2023-12-07T09:59:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.463+0000 7fa616ffd640 1 -- 172.21.15.89:0/3085522691 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fa620145dc0 con 0x7fa6200a8470 2023-12-07T09:59:24.469 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:24.470 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:24.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa6000668d0 msgr2=0x7fa600068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa6000668d0 0x7fa600068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6100ad000 tx=0x7fa6100a4f90 comp rx=0 tx=0).stop 2023-12-07T09:59:24.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 msgr2=0x7fa62014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 0x7fa62014f250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa60800c4d0 tx=0x7fa60800c990 comp rx=0 tx=0).stop 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 shutdown_connections 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa62014e9d0 0x7fa62014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6200a8470 0x7fa62014f250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa6000668d0 0x7fa600068d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 --2- 172.21.15.89:0/3085522691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa620070b80 0x7fa6200c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 >> 172.21.15.89:0/3085522691 conn(0x7fa6200c2ad0 msgr2=0x7fa6201431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 shutdown_connections 2023-12-07T09:59:24.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.467+0000 7fa624be6640 1 -- 172.21.15.89:0/3085522691 wait complete. 2023-12-07T09:59:24.490 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:24.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 Processor -- start 2023-12-07T09:59:24.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 -- start start 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f715006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f71500c2050 0x7f7150152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71500c2880 con 0x7f71500a9460 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715006e010 con 0x7f71500c2050 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f7155879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71500a84e0 con 0x7f715014f850 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f714f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f71500c2050 0x7f7150152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f714effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f715006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f71467fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f71500a9460 0x7f7150152280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:41520/0 (socket says 172.21.15.89:41520) 2023-12-07T09:59:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.623+0000 7f71467fc640 1 -- 172.21.15.89:0/613061752 learned_addr learned my addr 172.21.15.89:0/613061752 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714e7fc640 1 -- 172.21.15.89:0/613061752 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219546355 0 0) 0x7f71500c2880 con 0x7f71500a9460 2023-12-07T09:59:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714e7fc640 1 -- 172.21.15.89:0/613061752 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c003530 con 0x7f71500a9460 2023-12-07T09:59:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714effd640 1 -- 172.21.15.89:0/613061752 >> v2:172.21.15.97:3300/0 conn(0x7f71500c2050 msgr2=0x7f7150152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714effd640 1 --2- 172.21.15.89:0/613061752 >> v2:172.21.15.97:3300/0 conn(0x7f71500c2050 0x7f7150152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714effd640 1 -- 172.21.15.89:0/613061752 >> v1:172.21.15.97:6789/0 conn(0x7f71500a9460 legacy=0x7f7150152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714effd640 1 -- 172.21.15.89:0/613061752 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500a87a0 con 0x7f715014f850 2023-12-07T09:59:24.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714f7fe640 1 --2- 172.21.15.89:0/613061752 >> v2:172.21.15.97:3300/0 conn(0x7f71500c2050 0x7f7150152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:24.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714effd640 1 --2- 172.21.15.89:0/613061752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f715006cfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71400097c0 tx=0x7f714001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13cc5ce54cc9c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.627+0000 7f714e7fc640 1 -- 172.21.15.89:0/613061752 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400ab600 con 0x7f715014f850 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f714e7fc640 1 -- 172.21.15.89:0/613061752 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400a7050 con 0x7f715014f850 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f714e7fc640 1 -- 172.21.15.89:0/613061752 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400ab980 con 0x7f715014f850 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- 172.21.15.89:0/613061752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 msgr2=0x7f715006cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 --2- 172.21.15.89:0/613061752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f715006cfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71400097c0 tx=0x7f714001c330 comp rx=0 tx=0).stop 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- 172.21.15.89:0/613061752 shutdown_connections 2023-12-07T09:59:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 --2- 172.21.15.89:0/613061752 >> v2:172.21.15.97:3300/0 conn(0x7f71500c2050 0x7f7150152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 --2- 172.21.15.89:0/613061752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f715006cfa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- 172.21.15.89:0/613061752 >> 172.21.15.89:0/613061752 conn(0x7f71500c5f60 msgr2=0x7f71500c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:24.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- 172.21.15.89:0/613061752 shutdown_connections 2023-12-07T09:59:24.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- 172.21.15.89:0/613061752 wait complete. 2023-12-07T09:59:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 Processor -- start 2023-12-07T09:59:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- start start 2023-12-07T09:59:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 0x7f71501515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500c2050 0x7f71501407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f7150140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500c4d10 con 0x7f71500a9460 2023-12-07T09:59:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500c4ff0 con 0x7f71500c2050 2023-12-07T09:59:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f7155879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7150150f60 con 0x7f715014f850 2023-12-07T09:59:24.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f714effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 0x7f71501515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f714effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 0x7f71501515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40150/0 (socket says 172.21.15.89:40150) 2023-12-07T09:59:24.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.631+0000 7f714effd640 1 -- 172.21.15.89:0/2912362143 learned_addr learned my addr 172.21.15.89:0/2912362143 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714f7fe640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f7150140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f71467fc640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500c2050 0x7f71501407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714effd640 1 -- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 msgr2=0x7f7150140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714effd640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f7150140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714effd640 1 -- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500c2050 msgr2=0x7f71501407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714effd640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500c2050 0x7f71501407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714effd640 1 -- 172.21.15.89:0/2912362143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009a70 con 0x7f71500a9460 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f71467fc640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500c2050 0x7f71501407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714effd640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 0x7f71501515c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714001a9e0 tx=0x7f71400190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140006e20 con 0x7f71500a9460 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400b5470 con 0x7f71500a9460 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400b5840 con 0x7f71500a9460 2023-12-07T09:59:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7140009420 con 0x7f71500a9460 2023-12-07T09:59:24.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7150150c80 con 0x7f71500a9460 2023-12-07T09:59:24.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500c4e50 con 0x7f71500a9460 2023-12-07T09:59:24.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71400b2040 con 0x7f71500a9460 2023-12-07T09:59:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714cff9640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71300668d0 0x7f7130068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f714011e730 con 0x7f71500a9460 2023-12-07T09:59:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.635+0000 7f71467fc640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71300668d0 0x7f7130068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.639+0000 7f71467fc640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71300668d0 0x7f7130068d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7150067a90 tx=0x7f7138009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.639+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71500c4e50 con 0x7f71500a9460 2023-12-07T09:59:24.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.791+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71500c4e50 con 0x7f71500a9460 2023-12-07T09:59:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.791+0000 7f714cff9640 1 -- 172.21.15.89:0/2912362143 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f71500c4e50 con 0x7f71500a9460 2023-12-07T09:59:24.799 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:24.799 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71300668d0 msgr2=0x7f7130068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71300668d0 0x7f7130068d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7150067a90 tx=0x7f7138009040 comp rx=0 tx=0).stop 2023-12-07T09:59:24.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 msgr2=0x7f71501515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 0x7f71501515c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714001a9e0 tx=0x7f71400190d0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 shutdown_connections 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71300668d0 0x7f7130068d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f715014f850 0x7f7150140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500c2050 0x7f71501407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 --2- 172.21.15.89:0/2912362143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71500a9460 0x7f71501515c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 >> 172.21.15.89:0/2912362143 conn(0x7f71500c5f60 msgr2=0x7f71501471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 shutdown_connections 2023-12-07T09:59:24.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.795+0000 7f7155879640 1 -- 172.21.15.89:0/2912362143 wait complete. 2023-12-07T09:59:24.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:24.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:24.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 Processor -- start 2023-12-07T09:59:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 -- start start 2023-12-07T09:59:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fafdc0c1bd0 0x7fafdc151c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafdc157d20 con 0x7fafdc152150 2023-12-07T09:59:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafdc06deb0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe39b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc06e100 con 0x7fafdc06c5c0 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe1754640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fafdc0c1bd0 0x7fafdc151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe1f55640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fafdc152150 0x7fafdc1586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57904/0 (socket says 172.21.15.89:57904) 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe1754640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fafdc0c1bd0 0x7fafdc151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40166/0 (socket says 172.21.15.89:40166) 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.955+0000 7fafe1f55640 1 -- 172.21.15.89:0/1532712337 learned_addr learned my addr 172.21.15.89:0/1532712337 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe0f53640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe1754640 1 -- 172.21.15.89:0/1532712337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 msgr2=0x7fafdc1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe1754640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe1754640 1 -- 172.21.15.89:0/1532712337 >> v1:172.21.15.89:6789/0 conn(0x7fafdc152150 legacy=0x7fafdc1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe1754640 1 -- 172.21.15.89:0/1532712337 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0700f0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe0f53640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe1754640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc151c10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafd80097c0 tx=0x7fafd801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19b4bdd4eb909e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafd3fff640 1 -- 172.21.15.89:0/1532712337 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80ad680 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafd3fff640 1 -- 172.21.15.89:0/1532712337 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80ad7e0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafd3fff640 1 -- 172.21.15.89:0/1532712337 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80adb70 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe39b8640 1 -- 172.21.15.89:0/1532712337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 msgr2=0x7fafdc151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.959+0000 7fafe39b8640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc151c10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafd80097c0 tx=0x7fafd801c360 comp rx=0 tx=0).stop 2023-12-07T09:59:24.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- 172.21.15.89:0/1532712337 shutdown_connections 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 --2- 172.21.15.89:0/1532712337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc151c10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- 172.21.15.89:0/1532712337 >> 172.21.15.89:0/1532712337 conn(0x7fafdc0c2a60 msgr2=0x7fafdc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- 172.21.15.89:0/1532712337 shutdown_connections 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- 172.21.15.89:0/1532712337 wait complete. 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 Processor -- start 2023-12-07T09:59:24.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- start start 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc1f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc152150 0x7fafdc14df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc1f0f60 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc14eb10 con 0x7fafdc152150 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0ab3b0 con 0x7fafdc06c5c0 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc1f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc1f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40182/0 (socket says 172.21.15.89:40182) 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 -- 172.21.15.89:0/999664900 learned_addr learned my addr 172.21.15.89:0/999664900 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe1754640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe1f55640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc152150 0x7fafdc14df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 -- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 msgr2=0x7fafdc149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 -- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc152150 msgr2=0x7fafdc14df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc152150 0x7fafdc14df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:24.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 -- 172.21.15.89:0/999664900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009420 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe1754640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:24.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe1f55640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc152150 0x7fafdc14df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:24.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe0f53640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc1f13f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c7f0 tx=0x7fafcc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00cea0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc007a30 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc007dc0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.963+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc0ab690 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc1f0bf0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc1f10d0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fafcc0113f0 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafd1ffb640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:24.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafcc084660 con 0x7fafdc0c1bd0 2023-12-07T09:59:24.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafe1754640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:24.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.967+0000 7fafe1754640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafd80af000 tx=0x7fafd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:24.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:24.971+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafcc051890 con 0x7fafdc0c1bd0 2023-12-07T09:59:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafdc04e890 con 0x7fafdc0c1bd0 2023-12-07T09:59:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafd1ffb640 1 -- 172.21.15.89:0/999664900 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafcc054eb0 con 0x7fafdc0c1bd0 2023-12-07T09:59:25.129 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 msgr2=0x7fafc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafd80af000 tx=0x7fafd8008040 comp rx=0 tx=0).stop 2023-12-07T09:59:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 msgr2=0x7fafdc1f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc1f13f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c7f0 tx=0x7fafcc00ccb0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 shutdown_connections 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafdc152150 0x7fafdc14df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafdc0c1bd0 0x7fafdc1f13f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 --2- 172.21.15.89:0/999664900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafdc06c5c0 0x7fafdc149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.123+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 >> 172.21.15.89:0/999664900 conn(0x7fafdc0c2a60 msgr2=0x7fafdc15e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.127+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 shutdown_connections 2023-12-07T09:59:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.127+0000 7fafe39b8640 1 -- 172.21.15.89:0/999664900 wait complete. 2023-12-07T09:59:25.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 Processor -- start 2023-12-07T09:59:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 -- start start 2023-12-07T09:59:25.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ef80700f0 0x7f1ef8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 0x7f1ef80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef8154b90 con 0x7f1ef8154000 2023-12-07T09:59:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef80a8710 con 0x7f1ef80700f0 2023-12-07T09:59:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1efe3aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80abd70 con 0x7f1ef806df30 2023-12-07T09:59:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1ef7fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1ef8154000 0x7f1ef81543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57916/0 (socket says 172.21.15.89:57916) 2023-12-07T09:59:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.283+0000 7f1ef7fff640 1 -- 172.21.15.89:0/3341794949 learned_addr learned my addr 172.21.15.89:0/3341794949 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824528608 0 0) 0x7f1ef8154b90 con 0x7f1ef8154000 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1efc947640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 0x7f1ef80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee0005740 con 0x7f1ef8154000 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 --2- 172.21.15.89:0/3341794949 >> v2:172.21.15.97:3300/0 conn(0x7f1ef80700f0 0x7f1ef8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133553705 0 0) 0x7f1ee0005740 con 0x7f1ef8154000 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 msgr2=0x7f1ef80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 0x7f1ef80714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 >> v2:172.21.15.97:3300/0 conn(0x7f1ef80700f0 msgr2=0x7f1ef8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 --2- 172.21.15.89:0/3341794949 >> v2:172.21.15.97:3300/0 conn(0x7f1ef80700f0 0x7f1ef8070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80ab820 con 0x7f1ef8154000 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f1ee8001680 con 0x7f1ef8154000 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 >> v1:172.21.15.89:6789/0 conn(0x7f1ef8154000 legacy=0x7f1ef81543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee0005b90 0x7f1ee0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee00069e0 0x7f1ee0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 0x7f1ee00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80abd70 con 0x7f1ee00069e0 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee000dc80 con 0x7f1ee0005b90 2023-12-07T09:59:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee000de40 con 0x7f1ef806df30 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee00069e0 0x7f1ee0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef7fff640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee0005b90 0x7f1ee0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1efc947640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 0x7f1ee00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 -- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 msgr2=0x7f1ee00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef806df30 0x7f1ee00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 -- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee0005b90 msgr2=0x7f1ee0005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee0005b90 0x7f1ee0005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.287+0000 7f1ef77fe640 1 -- 172.21.15.89:0/3341794949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0005740 con 0x7f1ee00069e0 2023-12-07T09:59:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1ef77fe640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee00069e0 0x7f1ee0006e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00ba00 tx=0x7f1eec01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c392cdcca9e786 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0a7070 con 0x7f1ee00069e0 2023-12-07T09:59:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec0ad400 con 0x7f1ee00069e0 2023-12-07T09:59:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1ef6ffd640 1 -- 172.21.15.89:0/3341794949 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0ad7b0 con 0x7f1ee00069e0 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3341794949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee00069e0 msgr2=0x7f1ee0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3341794949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee00069e0 0x7f1ee0006e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00ba00 tx=0x7f1eec01c680 comp rx=0 tx=0).stop 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efc947640 1 -- 172.21.15.89:0/3341794949 reap_dead start 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3341794949 shutdown_connections 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3341794949 >> 172.21.15.89:0/3341794949 conn(0x7f1ef80c2a60 msgr2=0x7f1ef80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3341794949 shutdown_connections 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3341794949 wait complete. 2023-12-07T09:59:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 Processor -- start 2023-12-07T09:59:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- start start 2023-12-07T09:59:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee00069e0 0x7f1ef81ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef814eae0 0x7f1ef814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 0x7f1ef8142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef814f520 con 0x7f1ef8142920 2023-12-07T09:59:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80c4bc0 con 0x7f1ee00069e0 2023-12-07T09:59:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efe3aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80c5170 con 0x7f1ef814eae0 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efc947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 0x7f1ef8142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efc947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 0x7f1ef8142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40196/0 (socket says 172.21.15.89:40196) 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.291+0000 7f1efc947640 1 -- 172.21.15.89:0/3897252905 learned_addr learned my addr 172.21.15.89:0/3897252905 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef7fff640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee00069e0 0x7f1ef81ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef77fe640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef814eae0 0x7f1ef814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efc947640 1 -- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef814eae0 msgr2=0x7f1ef814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efc947640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef814eae0 0x7f1ef814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efc947640 1 -- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee00069e0 msgr2=0x7f1ef81ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efc947640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee00069e0 0x7f1ef81ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efc947640 1 -- 172.21.15.89:0/3897252905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80c5450 con 0x7f1ef8142920 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efc947640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 0x7f1ef8142da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8074330 tx=0x7f1ef000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000e040 con 0x7f1ef8142920 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef000f040 con 0x7f1ef8142920 2023-12-07T09:59:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef80c5730 con 0x7f1ef8142920 2023-12-07T09:59:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0015430 con 0x7f1ef8142920 2023-12-07T09:59:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef8148af0 con 0x7f1ef8142920 2023-12-07T09:59:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef804e890 con 0x7f1ef8142920 2023-12-07T09:59:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1ef0015590 con 0x7f1ef8142920 2023-12-07T09:59:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef4ff9640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ee40668d0 0x7f1ee4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ef0084a20 con 0x7f1ef8142920 2023-12-07T09:59:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.295+0000 7f1ef7fff640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ee40668d0 0x7f1ee4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.299+0000 7f1ef7fff640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ee40668d0 0x7f1ee4068d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8001130 tx=0x7f1ee8007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.299+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ef0051bc0 con 0x7f1ef8142920 2023-12-07T09:59:25.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.451+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ef80aaaf0 con 0x7f1ef8142920 2023-12-07T09:59:25.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.451+0000 7f1ef4ff9640 1 -- 172.21.15.89:0/3897252905 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ef00551e0 con 0x7f1ef8142920 2023-12-07T09:59:25.459 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ee40668d0 msgr2=0x7f1ee4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ee40668d0 0x7f1ee4068d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8001130 tx=0x7f1ee8007900 comp rx=0 tx=0).stop 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 msgr2=0x7f1ef8142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 0x7f1ef8142da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8074330 tx=0x7f1ef000f1b0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 shutdown_connections 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef8142920 0x7f1ef8142da0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ee40668d0 0x7f1ee4068d90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ef814eae0 0x7f1ef814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 --2- 172.21.15.89:0/3897252905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ee00069e0 0x7f1ef81ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 >> 172.21.15.89:0/3897252905 conn(0x7f1ef80c2a60 msgr2=0x7f1ef8070560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 shutdown_connections 2023-12-07T09:59:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.455+0000 7f1efe3aa640 1 -- 172.21.15.89:0/3897252905 wait complete. 2023-12-07T09:59:25.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:25.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 Processor -- start 2023-12-07T09:59:25.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 -- start start 2023-12-07T09:59:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c8430 0x7f850806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85080c7f20 0x7f850806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850806cf70 con 0x7f8508151d80 2023-12-07T09:59:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8508152160 con 0x7f85080c7f20 2023-12-07T09:59:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f850dbc4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c6a30 con 0x7f85080c8430 2023-12-07T09:59:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f85077fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8508151d80 0x7f85080c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57922/0 (socket says 172.21.15.89:57922) 2023-12-07T09:59:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f85077fe640 1 -- 172.21.15.89:0/3217549599 learned_addr learned my addr 172.21.15.89:0/3217549599 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f8507fff640 1 --2- 172.21.15.89:0/3217549599 >> v2:172.21.15.89:3300/0 conn(0x7f85080c7f20 0x7f850806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f8506ffd640 1 --2- 172.21.15.89:0/3217549599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c8430 0x7f850806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f85067fc640 1 -- 172.21.15.89:0/3217549599 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050346408 0 0) 0x7f850806cf70 con 0x7f8508151d80 2023-12-07T09:59:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f85067fc640 1 -- 172.21.15.89:0/3217549599 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f0003530 con 0x7f8508151d80 2023-12-07T09:59:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f8507fff640 1 -- 172.21.15.89:0/3217549599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c8430 msgr2=0x7f850806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f8507fff640 1 --2- 172.21.15.89:0/3217549599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c8430 0x7f850806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f8507fff640 1 -- 172.21.15.89:0/3217549599 >> v1:172.21.15.89:6789/0 conn(0x7f8508151d80 legacy=0x7f85080c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.615+0000 7f8507fff640 1 -- 172.21.15.89:0/3217549599 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080c72d0 con 0x7f85080c7f20 2023-12-07T09:59:25.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f8507fff640 1 --2- 172.21.15.89:0/3217549599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c7f20 0x7f850806bc60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8500009d90 tx=0x7f850001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3970bd6bcb85c370 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f85067fc640 1 -- 172.21.15.89:0/3217549599 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000a5950 con 0x7f85080c7f20 2023-12-07T09:59:25.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f85067fc640 1 -- 172.21.15.89:0/3217549599 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85000a5ab0 con 0x7f85080c7f20 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f85067fc640 1 -- 172.21.15.89:0/3217549599 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000a5e40 con 0x7f85080c7f20 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 -- 172.21.15.89:0/3217549599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c7f20 msgr2=0x7f850806bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 --2- 172.21.15.89:0/3217549599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c7f20 0x7f850806bc60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8500009d90 tx=0x7f850001c890 comp rx=0 tx=0).stop 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 -- 172.21.15.89:0/3217549599 shutdown_connections 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 --2- 172.21.15.89:0/3217549599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c7f20 0x7f850806bc60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 --2- 172.21.15.89:0/3217549599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c8430 0x7f850806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 -- 172.21.15.89:0/3217549599 >> 172.21.15.89:0/3217549599 conn(0x7f85080abd00 msgr2=0x7f85080ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 -- 172.21.15.89:0/3217549599 shutdown_connections 2023-12-07T09:59:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 -- 172.21.15.89:0/3217549599 wait complete. 2023-12-07T09:59:25.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.619+0000 7f850dbc4640 1 Processor -- start 2023-12-07T09:59:25.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- start start 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c7f20 0x7f85080aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 0x7f8508149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8508151d80 0x7f85081ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080aa030 con 0x7f85080c8430 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8508144970 con 0x7f8508151d80 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8508145d80 con 0x7f85080c7f20 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 0x7f8508149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 0x7f8508149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40212/0 (socket says 172.21.15.89:40212) 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 -- 172.21.15.89:0/829041188 learned_addr learned my addr 172.21.15.89:0/829041188 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f85077fe640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c7f20 0x7f85080aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8507fff640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8508151d80 0x7f85081ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 -- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c7f20 msgr2=0x7f85080aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c7f20 0x7f85080aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 -- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8508151d80 msgr2=0x7f85081ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8508151d80 0x7f85081ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 -- 172.21.15.89:0/829041188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500009a70 con 0x7f85080c8430 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8507fff640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8508151d80 0x7f85081ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f8506ffd640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 0x7f8508149d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00d800 tx=0x7f84fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00b6c0 con 0x7f85080c8430 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc00b820 con 0x7f85080c8430 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85081457c0 con 0x7f85080c8430 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00bb90 con 0x7f85080c8430 2023-12-07T09:59:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080a9c50 con 0x7f85080c8430 2023-12-07T09:59:25.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.623+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850804e890 con 0x7f85080c8430 2023-12-07T09:59:25.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.627+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f84fc00bcf0 con 0x7f85080c8430 2023-12-07T09:59:25.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.627+0000 7f84effff640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84f4066900 0x7f84f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.627+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84fc0848d0 con 0x7f85080c8430 2023-12-07T09:59:25.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.627+0000 7f85077fe640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84f4066900 0x7f84f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.627+0000 7f85077fe640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84f4066900 0x7f84f4068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84f80011f0 tx=0x7f84f8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.631+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84fc051b00 con 0x7f85080c8430 2023-12-07T09:59:25.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85080aa970 con 0x7f85080c8430 2023-12-07T09:59:25.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f84effff640 1 -- 172.21.15.89:0/829041188 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84fc055120 con 0x7f85080c8430 2023-12-07T09:59:25.788 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84f4066900 msgr2=0x7f84f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84f4066900 0x7f84f4068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84f80011f0 tx=0x7f84f8007d40 comp rx=0 tx=0).stop 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 msgr2=0x7f8508149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 0x7f8508149d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00d800 tx=0x7f84fc00dcc0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 shutdown_connections 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8508151d80 0x7f85081ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85080c8430 0x7f8508149d20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84f4066900 0x7f84f4068dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 --2- 172.21.15.89:0/829041188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85080c7f20 0x7f85080aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 >> 172.21.15.89:0/829041188 conn(0x7f85080abd00 msgr2=0x7f85080ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:25.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 shutdown_connections 2023-12-07T09:59:25.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.783+0000 7f850dbc4640 1 -- 172.21.15.89:0/829041188 wait complete. 2023-12-07T09:59:25.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:25.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 Processor -- start 2023-12-07T09:59:25.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 -- start start 2023-12-07T09:59:25.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0bd014e9d0 0x7f0bd0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd0070b80 0x7f0bd00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd006d320 con 0x7f0bd00c1f20 2023-12-07T09:59:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00721b0 con 0x7f0bd014e9d0 2023-12-07T09:59:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd7294640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00c2830 con 0x7f0bd0070b80 2023-12-07T09:59:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd5030640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0bd014e9d0 0x7f0bd0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd5831640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0bd00c1f20 0x7f0bd006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57934/0 (socket says 172.21.15.89:57934) 2023-12-07T09:59:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.939+0000 7f0bd5831640 1 -- 172.21.15.89:0/3279194510 learned_addr learned my addr 172.21.15.89:0/3279194510 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bd482f640 1 --2- 172.21.15.89:0/3279194510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd0070b80 0x7f0bd00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bd5030640 1 -- 172.21.15.89:0/3279194510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd0070b80 msgr2=0x7f0bd00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bd5030640 1 --2- 172.21.15.89:0/3279194510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd0070b80 0x7f0bd00c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bd5030640 1 -- 172.21.15.89:0/3279194510 >> v1:172.21.15.89:6789/0 conn(0x7f0bd00c1f20 legacy=0x7f0bd006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bd5030640 1 -- 172.21.15.89:0/3279194510 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0072450 con 0x7f0bd014e9d0 2023-12-07T09:59:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bd5030640 1 --2- 172.21.15.89:0/3279194510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd0151e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097c0 tx=0x7f0bcc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7399671a6a1c1bfb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bc7fff640 1 -- 172.21.15.89:0/3279194510 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0ab600 con 0x7f0bd014e9d0 2023-12-07T09:59:25.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bc7fff640 1 -- 172.21.15.89:0/3279194510 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc0a7050 con 0x7f0bd014e9d0 2023-12-07T09:59:25.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.943+0000 7f0bc7fff640 1 -- 172.21.15.89:0/3279194510 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0ab980 con 0x7f0bd014e9d0 2023-12-07T09:59:25.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- 172.21.15.89:0/3279194510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 msgr2=0x7f0bd0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3279194510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd0151e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097c0 tx=0x7f0bcc01c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- 172.21.15.89:0/3279194510 shutdown_connections 2023-12-07T09:59:25.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3279194510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd0070b80 0x7f0bd00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3279194510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd0151e60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- 172.21.15.89:0/3279194510 >> 172.21.15.89:0/3279194510 conn(0x7f0bd00c2ad0 msgr2=0x7f0bd00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:25.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- 172.21.15.89:0/3279194510 shutdown_connections 2023-12-07T09:59:25.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- 172.21.15.89:0/3279194510 wait complete. 2023-12-07T09:59:25.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 Processor -- start 2023-12-07T09:59:25.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- start start 2023-12-07T09:59:25.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0070b80 0x7f0bd014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd00c1f20 0x7f0bd014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd01f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0149490 con 0x7f0bd014e9d0 2023-12-07T09:59:25.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00ac3b0 con 0x7f0bd0070b80 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd7294640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01496e0 con 0x7f0bd00c1f20 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd01f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd01f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40234/0 (socket says 172.21.15.89:40234) 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 -- 172.21.15.89:0/3774252908 learned_addr learned my addr 172.21.15.89:0/3774252908 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd482f640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd00c1f20 0x7f0bd014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5030640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0070b80 0x7f0bd014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 -- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd00c1f20 msgr2=0x7f0bd014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd00c1f20 0x7f0bd014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 -- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0070b80 msgr2=0x7f0bd014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0070b80 0x7f0bd014a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.947+0000 7f0bd5831640 1 -- 172.21.15.89:0/3774252908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009420 con 0x7f0bd014e9d0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bd5831640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd01f0920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800cbc0 tx=0x7f0bc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800ad40 con 0x7f0bd014e9d0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8012400 con 0x7f0bd014e9d0 2023-12-07T09:59:25.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800aea0 con 0x7f0bd014e9d0 2023-12-07T09:59:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd01499c0 con 0x7f0bd014e9d0 2023-12-07T09:59:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd00aa9d0 con 0x7f0bd014e9d0 2023-12-07T09:59:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00aabc0 con 0x7f0bd014e9d0 2023-12-07T09:59:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0bc8007070 con 0x7f0bd014e9d0 2023-12-07T09:59:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bc5ffb640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0bb40668d0 0x7f0bb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bc80842a0 con 0x7f0bd014e9d0 2023-12-07T09:59:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.951+0000 7f0bd5030640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0bb40668d0 0x7f0bb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:25.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.955+0000 7f0bd5030640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0bb40668d0 0x7f0bb4068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0ad000 tx=0x7f0bcc0a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:25.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:25.955+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bc8051580 con 0x7f0bd014e9d0 2023-12-07T09:59:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bd004e890 con 0x7f0bd014e9d0 2023-12-07T09:59:26.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bc5ffb640 1 -- 172.21.15.89:0/3774252908 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f0bc8054ba0 con 0x7f0bd014e9d0 2023-12-07T09:59:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:26.141 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:26.141 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0bb40668d0 msgr2=0x7f0bb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0bb40668d0 0x7f0bb4068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0ad000 tx=0x7f0bcc0a4f90 comp rx=0 tx=0).stop 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 msgr2=0x7f0bd01f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd01f0920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800cbc0 tx=0x7f0bc800a430 comp rx=0 tx=0).stop 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 shutdown_connections 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bd014e9d0 0x7f0bd01f0920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0bb40668d0 0x7f0bb4068d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bd00c1f20 0x7f0bd014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 --2- 172.21.15.89:0/3774252908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0070b80 0x7f0bd014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 >> 172.21.15.89:0/3774252908 conn(0x7f0bd00c2ad0 msgr2=0x7f0bd0148540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 shutdown_connections 2023-12-07T09:59:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.135+0000 7f0bd7294640 1 -- 172.21.15.89:0/3774252908 wait complete. 2023-12-07T09:59:26.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:26.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.291+0000 7f6d5246b640 1 Processor -- start 2023-12-07T09:59:26.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.291+0000 7f6d5246b640 1 -- start start 2023-12-07T09:59:26.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d5246b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0aacd0 0x7f6d4c154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d5246b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d4c0ab7a0 0x7f6d4c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d5246b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c072780 con 0x7f6d4c0700a0 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d5246b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c0ac160 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d5246b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0abe80 con 0x7f6d4c0aacd0 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d4c0ab7a0 0x7f6d4c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d4c0ab7a0 0x7f6d4c1546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40238/0 (socket says 172.21.15.89:40238) 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 -- 172.21.15.89:0/6793086 learned_addr learned my addr 172.21.15.89:0/6793086 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d4bfff640 1 --2- 172.21.15.89:0/6793086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0aacd0 0x7f6d4c154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 -- 172.21.15.89:0/6793086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0aacd0 msgr2=0x7f6d4c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 --2- 172.21.15.89:0/6793086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0aacd0 0x7f6d4c154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 -- 172.21.15.89:0/6793086 >> v1:172.21.15.97:6789/0 conn(0x7f6d4c0700a0 legacy=0x7f6d4c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:26.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.295+0000 7f6d50a08640 1 -- 172.21.15.89:0/6793086 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c154cf0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d50a08640 1 --2- 172.21.15.89:0/6793086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c1546a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009e50 tx=0x7f6d4401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eeb0f1e38ece75 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:26.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d4affd640 1 -- 172.21.15.89:0/6793086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440a5680 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d4affd640 1 -- 172.21.15.89:0/6793086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d440a57e0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d4affd640 1 -- 172.21.15.89:0/6793086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440a5b70 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 -- 172.21.15.89:0/6793086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 msgr2=0x7f6d4c1546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 --2- 172.21.15.89:0/6793086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c1546a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009e50 tx=0x7f6d4401c910 comp rx=0 tx=0).stop 2023-12-07T09:59:26.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 -- 172.21.15.89:0/6793086 shutdown_connections 2023-12-07T09:59:26.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 --2- 172.21.15.89:0/6793086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c1546a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 --2- 172.21.15.89:0/6793086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0aacd0 0x7f6d4c154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 -- 172.21.15.89:0/6793086 >> 172.21.15.89:0/6793086 conn(0x7f6d4c0c2ad0 msgr2=0x7f6d4c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:26.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 -- 172.21.15.89:0/6793086 shutdown_connections 2023-12-07T09:59:26.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 -- 172.21.15.89:0/6793086 wait complete. 2023-12-07T09:59:26.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 Processor -- start 2023-12-07T09:59:26.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.299+0000 7f6d5246b640 1 -- start start 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0700a0 0x7f6d4c146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d4c0aacd0 0x7f6d4c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c14a9d0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1473a0 con 0x7f6d4c0aacd0 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c14b3a0 con 0x7f6d4c0700a0 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c15ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40244/0 (socket says 172.21.15.89:40244) 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 -- 172.21.15.89:0/767197259 learned_addr learned my addr 172.21.15.89:0/767197259 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:26.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d4b7fe640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d4c0aacd0 0x7f6d4c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d4bfff640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0700a0 0x7f6d4c146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 -- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0700a0 msgr2=0x7f6d4c146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0700a0 0x7f6d4c146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 -- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d4c0aacd0 msgr2=0x7f6d4c14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d4c0aacd0 0x7f6d4c14ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 -- 172.21.15.89:0/767197259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44009b30 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d50a08640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c15ee70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d440af040 tx=0x7f6d440196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440b8670 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d440b87d0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440b8b80 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c14c950 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c14a660 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c14a7f0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.303+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6d440b8ce0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.307+0000 7f6d48ff9640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6d380668d0 0x7f6d38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.307+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d4411f810 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.307+0000 7f6d4bfff640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6d380668d0 0x7f6d38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.307+0000 7f6d4bfff640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6d380668d0 0x7f6d38068d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c15f840 tx=0x7f6d3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:26.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.311+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d440eccd0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.463+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4c04e890 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.463+0000 7f6d48ff9640 1 -- 172.21.15.89:0/767197259 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f6d440f02f0 con 0x7f6d4c0ab7a0 2023-12-07T09:59:26.470 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:26.470 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:26.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6d380668d0 msgr2=0x7f6d38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6d380668d0 0x7f6d38068d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c15f840 tx=0x7f6d3c008040 comp rx=0 tx=0).stop 2023-12-07T09:59:26.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 msgr2=0x7f6d4c15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c15ee70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d440af040 tx=0x7f6d440196b0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 shutdown_connections 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4c0ab7a0 0x7f6d4c15ee70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6d4c0aacd0 0x7f6d4c14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6d380668d0 0x7f6d38068d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 --2- 172.21.15.89:0/767197259 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6d4c0700a0 0x7f6d4c146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 >> 172.21.15.89:0/767197259 conn(0x7f6d4c0c2ad0 msgr2=0x7f6d4c154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 shutdown_connections 2023-12-07T09:59:26.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.467+0000 7f6d5246b640 1 -- 172.21.15.89:0/767197259 wait complete. 2023-12-07T09:59:26.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:26.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 Processor -- start 2023-12-07T09:59:26.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 -- start start 2023-12-07T09:59:26.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ad014e9d0 0x7f6ad0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ad00a8470 0x7f6ad006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad006d320 con 0x7f6ad0070b80 2023-12-07T09:59:26.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad00721b0 con 0x7f6ad00a8470 2023-12-07T09:59:26.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad6a17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad00c2830 con 0x7f6ad014e9d0 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad4fb4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ad00a8470 0x7f6ad006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.623+0000 7f6ad4fb4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ad00a8470 0x7f6ad006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40260/0 (socket says 172.21.15.89:40260) 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6ad4fb4640 1 -- 172.21.15.89:0/1356085114 learned_addr learned my addr 172.21.15.89:0/1356085114 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6acffff640 1 --2- 172.21.15.89:0/1356085114 >> v2:172.21.15.97:3300/0 conn(0x7f6ad014e9d0 0x7f6ad0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6ad4fb4640 1 -- 172.21.15.89:0/1356085114 >> v2:172.21.15.97:3300/0 conn(0x7f6ad014e9d0 msgr2=0x7f6ad0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6ad4fb4640 1 --2- 172.21.15.89:0/1356085114 >> v2:172.21.15.97:3300/0 conn(0x7f6ad014e9d0 0x7f6ad0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6ad4fb4640 1 -- 172.21.15.89:0/1356085114 >> v1:172.21.15.97:6789/0 conn(0x7f6ad0070b80 legacy=0x7f6ad00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6ad4fb4640 1 -- 172.21.15.89:0/1356085114 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0072450 con 0x7f6ad00a8470 2023-12-07T09:59:26.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6acffff640 1 --2- 172.21.15.89:0/1356085114 >> v2:172.21.15.97:3300/0 conn(0x7f6ad014e9d0 0x7f6ad0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:26.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6ad4fb4640 1 --2- 172.21.15.89:0/1356085114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad00a8470 0x7f6ad006d7b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00c3980 tx=0x7f6ac801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd297fccea6c453 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:26.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6aceffd640 1 -- 172.21.15.89:0/1356085114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80a5710 con 0x7f6ad00a8470 2023-12-07T09:59:26.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6aceffd640 1 -- 172.21.15.89:0/1356085114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80a5870 con 0x7f6ad00a8470 2023-12-07T09:59:26.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.627+0000 7f6aceffd640 1 -- 172.21.15.89:0/1356085114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80a5c00 con 0x7f6ad00a8470 2023-12-07T09:59:26.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- 172.21.15.89:0/1356085114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad00a8470 msgr2=0x7f6ad006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/1356085114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad00a8470 0x7f6ad006d7b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00c3980 tx=0x7f6ac801c940 comp rx=0 tx=0).stop 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- 172.21.15.89:0/1356085114 shutdown_connections 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/1356085114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad00a8470 0x7f6ad006d7b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/1356085114 >> v2:172.21.15.97:3300/0 conn(0x7f6ad014e9d0 0x7f6ad0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- 172.21.15.89:0/1356085114 >> 172.21.15.89:0/1356085114 conn(0x7f6ad00c2ad0 msgr2=0x7f6ad00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- 172.21.15.89:0/1356085114 shutdown_connections 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- 172.21.15.89:0/1356085114 wait complete. 2023-12-07T09:59:26.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 Processor -- start 2023-12-07T09:59:26.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- start start 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 0x7f6ad00c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad00a8470 0x7f6ad00aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad014e9d0 0x7f6ad00aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad014e280 con 0x7f6ad0070b80 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad014ddf0 con 0x7f6ad014e9d0 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad6a17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00c3e10 con 0x7f6ad00a8470 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 0x7f6ad00c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 0x7f6ad00c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40264/0 (socket says 172.21.15.89:40264) 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 -- 172.21.15.89:0/4100370605 learned_addr learned my addr 172.21.15.89:0/4100370605 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6ad4fb4640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad014e9d0 0x7f6ad00aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 -- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad00a8470 msgr2=0x7f6ad00aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad00a8470 0x7f6ad00aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 -- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad014e9d0 msgr2=0x7f6ad00aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad014e9d0 0x7f6ad00aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 -- 172.21.15.89:0/4100370605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8009b30 con 0x7f6ad0070b80 2023-12-07T09:59:26.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.631+0000 7f6acffff640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 0x7f6ad00c4d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d800 tx=0x7f6ac000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:26.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00096c0 con 0x7f6ad0070b80 2023-12-07T09:59:26.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0009820 con 0x7f6ad0070b80 2023-12-07T09:59:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0009bd0 con 0x7f6ad0070b80 2023-12-07T09:59:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad014d7a0 con 0x7f6ad0070b80 2023-12-07T09:59:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad00c5250 con 0x7f6ad0070b80 2023-12-07T09:59:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad004e890 con 0x7f6ad0070b80 2023-12-07T09:59:26.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6ac0009d30 con 0x7f6ad0070b80 2023-12-07T09:59:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6accff9640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6abc066900 0x7f6abc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ac0084b90 con 0x7f6ad0070b80 2023-12-07T09:59:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6acf7fe640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6abc066900 0x7f6abc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:26.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.635+0000 7f6acf7fe640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6abc066900 0x7f6abc068dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4000f70 tx=0x7f6ac40079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:26.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.639+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ac0051dc0 con 0x7f6ad0070b80 2023-12-07T09:59:26.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad00700a0 con 0x7f6ad0070b80 2023-12-07T09:59:26.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6accff9640 1 -- 172.21.15.89:0/4100370605 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f6ac00553e0 con 0x7f6ad0070b80 2023-12-07T09:59:26.824 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:26.824 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:26.825 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6abc066900 msgr2=0x7f6abc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6abc066900 0x7f6abc068dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4000f70 tx=0x7f6ac40079c0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 msgr2=0x7f6ad00c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 0x7f6ad00c4d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d800 tx=0x7f6ac000dcc0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 shutdown_connections 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ad014e9d0 0x7f6ad00aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6abc066900 0x7f6abc068dc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ad00a8470 0x7f6ad00aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 --2- 172.21.15.89:0/4100370605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad0070b80 0x7f6ad00c4d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:26.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 >> 172.21.15.89:0/4100370605 conn(0x7f6ad00c2ad0 msgr2=0x7f6ad006be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:26.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 shutdown_connections 2023-12-07T09:59:26.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:26.819+0000 7f6ad6a17640 1 -- 172.21.15.89:0/4100370605 wait complete. 2023-12-07T09:59:27.247 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T09:59:12.803446+0000', 'modified': '2023-12-07T09:59:15.812452+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6835/351680850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6833', 'nonce': 351680850}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 351680850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-07T09:59:27.247 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T09:59:27.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-07T09:59:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.379+0000 7fb294f01640 1 Processor -- start 2023-12-07T09:59:27.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.379+0000 7fb294f01640 1 -- start start 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb294f01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900ca610 0x7fb2900c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb294f01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2900bd720 0x7fb2900c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb294f01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb290155790 con 0x7fb29006cd90 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb294f01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900c4b00 con 0x7fb2900bd720 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb294f01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900c4de0 con 0x7fb2900ca610 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb287fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2900bd720 0x7fb2900c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb28ed9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb29006cd90 0x7fb290158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57940/0 (socket says 172.21.15.89:57940) 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb28ed9d640 1 -- 172.21.15.89:0/1507182753 learned_addr learned my addr 172.21.15.89:0/1507182753 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb28e59c640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900ca610 0x7fb2900c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb287fff640 1 -- 172.21.15.89:0/1507182753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900ca610 msgr2=0x7fb2900c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb287fff640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900ca610 0x7fb2900c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb287fff640 1 -- 172.21.15.89:0/1507182753 >> v1:172.21.15.89:6789/0 conn(0x7fb29006cd90 legacy=0x7fb290158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb287fff640 1 -- 172.21.15.89:0/1507182753 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290157e30 con 0x7fb2900bd720 2023-12-07T09:59:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb28dd9b640 1 -- 172.21.15.89:0/1507182753 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277653430 0 0) 0x7fb290155790 con 0x7fb29006cd90 2023-12-07T09:59:27.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb28e59c640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900ca610 0x7fb2900c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:27.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.383+0000 7fb287fff640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2900bd720 0x7fb2900c9a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2780097c0 tx=0x7fb27801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf9ecee647d39e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb28dd9b640 1 -- 172.21.15.89:0/1507182753 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2900c52d0 con 0x7fb2900bd720 2023-12-07T09:59:27.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb28dd9b640 1 -- 172.21.15.89:0/1507182753 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2780a4880 con 0x7fb2900bd720 2023-12-07T09:59:27.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb28dd9b640 1 -- 172.21.15.89:0/1507182753 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780a4c10 con 0x7fb2900bd720 2023-12-07T09:59:27.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- 172.21.15.89:0/1507182753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2900bd720 msgr2=0x7fb2900c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2900bd720 0x7fb2900c9a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2780097c0 tx=0x7fb27801c040 comp rx=0 tx=0).stop 2023-12-07T09:59:27.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- 172.21.15.89:0/1507182753 shutdown_connections 2023-12-07T09:59:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2900bd720 0x7fb2900c9a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 --2- 172.21.15.89:0/1507182753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900ca610 0x7fb2900c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- 172.21.15.89:0/1507182753 >> 172.21.15.89:0/1507182753 conn(0x7fb290071ea0 msgr2=0x7fb2900722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- 172.21.15.89:0/1507182753 shutdown_connections 2023-12-07T09:59:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- 172.21.15.89:0/1507182753 wait complete. 2023-12-07T09:59:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 Processor -- start 2023-12-07T09:59:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- start start 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 0x7fb29014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900bd720 0x7fb2900aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2900ca610 0x7fb290155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900aed40 con 0x7fb29006cd90 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900aeaa0 con 0x7fb2900ca610 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb294f01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb290155940 con 0x7fb2900bd720 2023-12-07T09:59:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb28e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 0x7fb29014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb28e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 0x7fb29014b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40288/0 (socket says 172.21.15.89:40288) 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.387+0000 7fb28e59c640 1 -- 172.21.15.89:0/2431674084 learned_addr learned my addr 172.21.15.89:0/2431674084 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb287fff640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900bd720 0x7fb2900aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2900ca610 0x7fb290155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28e59c640 1 -- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900bd720 msgr2=0x7fb2900aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28e59c640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900bd720 0x7fb2900aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28e59c640 1 -- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2900ca610 msgr2=0x7fb290155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28e59c640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2900ca610 0x7fb290155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28e59c640 1 -- 172.21.15.89:0/2431674084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278009420 con 0x7fb29006cd90 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb28e59c640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 0x7fb29014b3d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb28000d800 tx=0x7fb28000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb286ffd640 1 -- 172.21.15.89:0/2431674084 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800096c0 con 0x7fb29006cd90 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb286ffd640 1 -- 172.21.15.89:0/2431674084 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280009820 con 0x7fb29006cd90 2023-12-07T09:59:27.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb290149580 con 0x7fb29006cd90 2023-12-07T09:59:27.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb286ffd640 1 -- 172.21.15.89:0/2431674084 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280009bd0 con 0x7fb29006cd90 2023-12-07T09:59:27.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29014b910 con 0x7fb29006cd90 2023-12-07T09:59:27.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb286ffd640 1 -- 172.21.15.89:0/2431674084 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb280009d30 con 0x7fb29006cd90 2023-12-07T09:59:27.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb286ffd640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2700668d0 0x7fb270068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.391+0000 7fb286ffd640 1 -- 172.21.15.89:0/2431674084 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb280084b20 con 0x7fb29006cd90 2023-12-07T09:59:27.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb287fff640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2700668d0 0x7fb270068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 Processor -- start 2023-12-07T09:59:27.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- start start 2023-12-07T09:59:27.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb287fff640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2700668d0 0x7fb270068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2780ae000 tx=0x7fb2780a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5bfc0 0x55a388b5c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b5ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 0x55a388ba6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a388a25110 con 0x55a388b5d200 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3889b59a0 con 0x55a388b5c8e0 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3889b2ed0 con 0x55a388b5bfc0 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 0x55a388ba6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 0x55a388ba6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40294/0 (socket says 172.21.15.89:40294) 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 -- 172.21.15.89:0/1031964995 learned_addr learned my addr 172.21.15.89:0/1031964995 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28e59c640 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5bfc0 0x55a388b5c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb287fff640 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b5ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 -- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5bfc0 msgr2=0x55a388b5c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5bfc0 0x55a388b5c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 -- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 msgr2=0x55a388b5ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b5ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 -- 172.21.15.89:0/1031964995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3886a6890 con 0x55a388b5d200 2023-12-07T09:59:27.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 0x55a388ba6ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb288007280 tx=0x7fb288007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e9ace73707ebd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb26ffff640 1 -- 172.21.15.89:0/1031964995 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288004b70 con 0x55a388b5d200 2023-12-07T09:59:27.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb26ffff640 1 -- 172.21.15.89:0/1031964995 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb288004cd0 con 0x55a388b5d200 2023-12-07T09:59:27.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb26ffff640 1 -- 172.21.15.89:0/1031964995 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288001e40 con 0x55a388b5d200 2023-12-07T09:59:27.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- 172.21.15.89:0/1031964995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 msgr2=0x55a388ba6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 0x55a388ba6ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb288007280 tx=0x7fb288007740 comp rx=0 tx=0).stop 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- 172.21.15.89:0/1031964995 shutdown_connections 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5d200 0x55a388ba6ad0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b5ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 --2- 172.21.15.89:0/1031964995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5bfc0 0x55a388b5c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- 172.21.15.89:0/1031964995 >> 172.21.15.89:0/1031964995 conn(0x55a388b9a830 msgr2=0x55a388b9cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- 172.21.15.89:0/1031964995 shutdown_connections 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.395+0000 7fb298271000 1 -- 172.21.15.89:0/1031964995 wait complete. 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- start start 2023-12-07T09:59:27.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 Processor -- start 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388b62e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b63360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5d200 0x55a388b638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3889ae7c0 con 0x55a388b5bfc0 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a388966bf0 con 0x55a388b5c8e0 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a38896ca90 con 0x55a388b5d200 2023-12-07T09:59:27.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 10 client.0 _ll_register_callbacks cb 0x55a388b49e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388b62e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388b62e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40306/0 (socket says 172.21.15.89:40306) 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 -- 172.21.15.89:0/71879928 learned_addr learned my addr 172.21.15.89:0/71879928 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5d200 0x55a388b638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb287fff640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b63360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 -- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5d200 msgr2=0x55a388b638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5d200 0x55a388b638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 -- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 msgr2=0x55a388b63360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b63360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 -- 172.21.15.89:0/71879928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28800f040 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb28e59c640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388b62e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb280083040 tx=0x7fb280056250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5294f8399a16886d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb26d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb26d7fa640 1 -- 172.21.15.89:0/71879928 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280052120 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb26d7fa640 1 -- 172.21.15.89:0/71879928 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb280052280 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a388970470 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb26d7fa640 1 -- 172.21.15.89:0/71879928 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb28005d880 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 10 client.4695 fetch_fsmap learned FSMap version 8 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a38896f190 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb26d7fa640 1 -- 172.21.15.89:0/71879928 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a388970470 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb26d7fa640 1 -- 172.21.15.89:0/71879928 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb28007cd20 con 0x55a388b5bfc0 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2023-12-07T09:59:27.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-07T09:59:27.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 20 client.4695 populate_metadata read hostname 'smithi089' 2023-12-07T09:59:27.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388bafe40 0x55a388bb2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 4 client.4695 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T09:59:27.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 --> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a388973b50 con 0x55a388bafe40 2023-12-07T09:59:27.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.399+0000 7fb287fff640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388bafe40 0x55a388bb2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb287fff640 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388bafe40 0x55a388bb2230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ce252fca9e5e09a server_cookie=1353f2d48b874467 in_seq=0 out_seq=0 2023-12-07T09:59:27.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb26d7fa640 10 client.4695 ms_handle_connect on v2:172.21.15.97:6833/351680850 2023-12-07T09:59:27.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb26d7fa640 1 -- 172.21.15.89:0/71879928 <== mds.0 v2:172.21.15.97:6833/351680850 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a388973b50 con 0x55a388bafe40 2023-12-07T09:59:27.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb26d7fa640 10 client.4695 handle_command_reply: tid=0 2023-12-07T09:59:27.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 client.4695 shutdown 2023-12-07T09:59:27.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 msgr2=0x55a388b62e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388b62e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb280083040 tx=0x7fb280056250 comp rx=0 tx=0).stop 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 shutdown_connections 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388bafe40 0x55a388bb2230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5d200 0x55a388b638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5c8e0 0x55a388b63360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb26d7fa640 0 client.4695 ms_handle_reset on v2:172.21.15.97:6833/351680850 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 --2- 172.21.15.89:0/71879928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388b62e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 >> 172.21.15.89:0/71879928 conn(0x55a388b9a830 msgr2=0x55a388b9cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 shutdown_connections 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 1 -- 172.21.15.89:0/71879928 wait complete. 2023-12-07T09:59:27.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.403+0000 7fb298271000 20 client.4695 trim_cache size 0 max 16384 2023-12-07T09:59:27.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 Processor -- start 2023-12-07T09:59:27.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 -- start start 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b9a830 0x55a388bb4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5bfc0 0x55a388bb3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 0x55a388bc1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a388667940 con 0x55a388b5c8e0 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3886a71b0 con 0x55a388b5bfc0 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a388a4c2a0 con 0x55a388b9a830 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 0x55a388bc1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 0x55a388bc1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40318/0 (socket says 172.21.15.89:40318) 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 -- 172.21.15.89:0/3531719718 learned_addr learned my addr 172.21.15.89:0/3531719718 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28e59c640 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b9a830 0x55a388bb4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb287fff640 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5bfc0 0x55a388bb3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 -- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b9a830 msgr2=0x55a388bb4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b9a830 0x55a388bb4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 -- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5bfc0 msgr2=0x55a388bb3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5bfc0 0x55a388bb3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 -- 172.21.15.89:0/3531719718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a388955490 con 0x55a388b5c8e0 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 0x55a388bc1ce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb288000f90 tx=0x7fb28800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4247b198d89baa2a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb284ff9640 1 -- 172.21.15.89:0/3531719718 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288004b70 con 0x55a388b5c8e0 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb284ff9640 1 -- 172.21.15.89:0/3531719718 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb288004cd0 con 0x55a388b5c8e0 2023-12-07T09:59:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.419+0000 7fb284ff9640 1 -- 172.21.15.89:0/3531719718 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288001e20 con 0x55a388b5c8e0 2023-12-07T09:59:27.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/3531719718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 msgr2=0x55a388bc1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 0x55a388bc1ce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb288000f90 tx=0x7fb28800e000 comp rx=0 tx=0).stop 2023-12-07T09:59:27.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/3531719718 shutdown_connections 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5c8e0 0x55a388bc1ce0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b5bfc0 0x55a388bb3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- 172.21.15.89:0/3531719718 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b9a830 0x55a388bb4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/3531719718 >> 172.21.15.89:0/3531719718 conn(0x55a388b5f960 msgr2=0x55a388bb2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/3531719718 shutdown_connections 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/3531719718 wait complete. 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- start start 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 Processor -- start 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388bfd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5c8e0 0x55a388bfdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b9a830 0x55a388bfe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3889b27c0 con 0x55a388b5bfc0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3889ef440 con 0x55a388b9a830 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3889ad650 con 0x55a388b5c8e0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 10 client.0 _ll_register_callbacks cb 0x55a3889b98e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388bfd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388bfd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40324/0 (socket says 172.21.15.89:40324) 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 -- 172.21.15.89:0/2561845752 learned_addr learned my addr 172.21.15.89:0/2561845752 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b9a830 0x55a388bfe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb287fff640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5c8e0 0x55a388bfdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 -- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5c8e0 msgr2=0x55a388bfdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5c8e0 0x55a388bfdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 -- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b9a830 msgr2=0x55a388bfe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b9a830 0x55a388bfe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 -- 172.21.15.89:0/2561845752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3886a6890 con 0x55a388b5bfc0 2023-12-07T09:59:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb287fff640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5c8e0 0x55a388bfdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28ed9d640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b9a830 0x55a388bfe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb28e59c640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388bfd7b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb28000bfd0 tx=0x7fb280082f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2360219c6e5011 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb26d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb26d7fa640 1 -- 172.21.15.89:0/2561845752 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280059b60 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb26d7fa640 1 -- 172.21.15.89:0/2561845752 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb28006d210 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3889ad110 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb26d7fa640 1 -- 172.21.15.89:0/2561845752 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb280055370 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 10 client.4701 fetch_fsmap learned FSMap version 8 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a3886a6cc0 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb26d7fa640 1 -- 172.21.15.89:0/2561845752 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3889ad110 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb26d7fa640 1 -- 172.21.15.89:0/2561845752 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb28007cd20 con 0x55a388b5bfc0 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 10 client.4701 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-07T09:59:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 20 client.4701 populate_metadata read hostname 'smithi089' 2023-12-07T09:59:27.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388b5d200 0x55a388bfed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 4 client.4701 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T09:59:27.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.423+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 --> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a3889db650 con 0x55a388b5d200 2023-12-07T09:59:27.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb287fff640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388b5d200 0x55a388bfed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb287fff640 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388b5d200 0x55a388bfed30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=726ca7e8ad564052 server_cookie=e2da4caf485d3e0 in_seq=0 out_seq=0 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb26d7fa640 10 client.4701 ms_handle_connect on v2:172.21.15.97:6833/351680850 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb26d7fa640 1 -- 172.21.15.89:0/2561845752 <== mds.0 v2:172.21.15.97:6833/351680850 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a3889db650 con 0x55a388b5d200 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb26d7fa640 10 client.4701 handle_command_reply: tid=0 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 client.4701 shutdown 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 msgr2=0x55a388bfd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388bfd7b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb28000bfd0 tx=0x7fb280082f10 comp rx=0 tx=0).stop 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 shutdown_connections 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a388b9a830 0x55a388bfe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:6833/351680850,v1:172.21.15.97:6835/351680850] conn(0x55a388b5d200 0x55a388bfed30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55a388b5c8e0 0x55a388bfdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 --2- 172.21.15.89:0/2561845752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a388b5bfc0 0x55a388bfd7b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb26d7fa640 0 client.4701 ms_handle_reset on v2:172.21.15.97:6833/351680850 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 >> 172.21.15.89:0/2561845752 conn(0x55a388b5f960 msgr2=0x55a388bb2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 shutdown_connections 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 1 -- 172.21.15.89:0/2561845752 wait complete. 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb298271000 20 client.4701 trim_cache size 0 max 16384 2023-12-07T09:59:27.437 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "06923b89-f6c6-4736-b27e-9e03456ddc01", 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4302, 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 14.009099743, 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 8, 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 20, 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 20, 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 21.477261763000001 2023-12-07T09:59:27.438 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T09:59:27.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2700668d0 msgr2=0x7fb270068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2700668d0 0x7fb270068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2780ae000 tx=0x7fb2780a6070 comp rx=0 tx=0).stop 2023-12-07T09:59:27.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 msgr2=0x7fb29014b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 0x7fb29014b3d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb28000d800 tx=0x7fb28000dcc0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 shutdown_connections 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2900ca610 0x7fb290155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2700668d0 0x7fb270068d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb2900bd720 0x7fb2900aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 --2- 172.21.15.89:0/2431674084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb29006cd90 0x7fb29014b3d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 >> 172.21.15.89:0/2431674084 conn(0x7fb290071ea0 msgr2=0x7fb29014f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 shutdown_connections 2023-12-07T09:59:27.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.427+0000 7fb294f01640 1 -- 172.21.15.89:0/2431674084 wait complete. 2023-12-07T09:59:27.452 INFO:teuthology.run_tasks:Running task kclient... 2023-12-07T09:59:27.476 INFO:tasks.kclient:Mounting kernel clients... 2023-12-07T09:59:27.476 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-07T09:59:27.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:27.476 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T09:59:27.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:27.487 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-12-07T09:59:27.549 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-12-07T09:59:27.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:59:27.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:27.552 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T09:59:27.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:27.563 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2023-12-07T09:59:27.630 INFO:teuthology.orchestra.run.smithi097.stderr:Cannot find device "ceph-brx" 2023-12-07T09:59:27.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T09:59:27.633 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-07T09:59:27.634 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T09:59:27.634 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T09:59:27.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T09:59:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.763+0000 7efff6bf8640 1 Processor -- start 2023-12-07T09:59:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.763+0000 7efff6bf8640 1 -- start start 2023-12-07T09:59:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff6bf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff0155360 0x7efff006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff6bf8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efff01580b0 0x7efff0158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff6bf8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff006e280 con 0x7efff006baf0 2023-12-07T09:59:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff6bf8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff00c2150 con 0x7efff01580b0 2023-12-07T09:59:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff6bf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff0157c60 con 0x7efff0155360 2023-12-07T09:59:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efff01580b0 0x7efff0158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efff01580b0 0x7efff0158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40332/0 (socket says 172.21.15.89:40332) 2023-12-07T09:59:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 -- 172.21.15.89:0/313642453 learned_addr learned my addr 172.21.15.89:0/313642453 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff4994640 1 --2- 172.21.15.89:0/313642453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff0155360 0x7efff006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 -- 172.21.15.89:0/313642453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff0155360 msgr2=0x7efff006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 --2- 172.21.15.89:0/313642453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff0155360 0x7efff006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 -- 172.21.15.89:0/313642453 >> v1:172.21.15.97:6789/0 conn(0x7efff006baf0 legacy=0x7efff006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.767+0000 7efff5195640 1 -- 172.21.15.89:0/313642453 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00c1bd0 con 0x7efff01580b0 2023-12-07T09:59:27.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff5195640 1 --2- 172.21.15.89:0/313642453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff01580b0 0x7efff0158540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effe8009e50 tx=0x7effe801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8023d7d965ba9a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7effef7fe640 1 -- 172.21.15.89:0/313642453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe80a5760 con 0x7efff01580b0 2023-12-07T09:59:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7effef7fe640 1 -- 172.21.15.89:0/313642453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe80a58c0 con 0x7efff01580b0 2023-12-07T09:59:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7effef7fe640 1 -- 172.21.15.89:0/313642453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe80a5c50 con 0x7efff01580b0 2023-12-07T09:59:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 -- 172.21.15.89:0/313642453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff01580b0 msgr2=0x7efff0158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 --2- 172.21.15.89:0/313642453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff01580b0 0x7efff0158540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effe8009e50 tx=0x7effe801c9d0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 -- 172.21.15.89:0/313642453 shutdown_connections 2023-12-07T09:59:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 --2- 172.21.15.89:0/313642453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff01580b0 0x7efff0158540 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 --2- 172.21.15.89:0/313642453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff0155360 0x7efff006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 -- 172.21.15.89:0/313642453 >> 172.21.15.89:0/313642453 conn(0x7efff00c3240 msgr2=0x7efff00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 -- 172.21.15.89:0/313642453 shutdown_connections 2023-12-07T09:59:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 -- 172.21.15.89:0/313642453 wait complete. 2023-12-07T09:59:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 Processor -- start 2023-12-07T09:59:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.771+0000 7efff6bf8640 1 -- start start 2023-12-07T09:59:27.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efff006baf0 0x7efff0072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 0x7efff014b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff01580b0 0x7efff0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0070f50 con 0x7efff0155360 2023-12-07T09:59:27.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff01f1290 con 0x7efff006baf0 2023-12-07T09:59:27.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff01f1530 con 0x7efff01580b0 2023-12-07T09:59:27.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 0x7efff014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 0x7efff014b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40340/0 (socket says 172.21.15.89:40340) 2023-12-07T09:59:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 -- 172.21.15.89:0/4145151062 learned_addr learned my addr 172.21.15.89:0/4145151062 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff4994640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efff006baf0 0x7efff0072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff5195640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff01580b0 0x7efff0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 -- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff01580b0 msgr2=0x7efff0155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff01580b0 0x7efff0155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 -- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efff006baf0 msgr2=0x7efff0072380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efff006baf0 0x7efff0072380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 -- 172.21.15.89:0/4145151062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8009b30 con 0x7efff0155360 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effeffff640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 0x7efff014b840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effdc00b410 tx=0x7effdc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc004020 con 0x7efff0155360 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc004180 con 0x7efff0155360 2023-12-07T09:59:27.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00711a0 con 0x7efff0155360 2023-12-07T09:59:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc011630 con 0x7efff0155360 2023-12-07T09:59:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff0156200 con 0x7efff0155360 2023-12-07T09:59:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff004e890 con 0x7efff0155360 2023-12-07T09:59:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.775+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7effdc011790 con 0x7efff0155360 2023-12-07T09:59:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.779+0000 7effed7fa640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effd40668d0 0x7effd4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.779+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effdc084070 con 0x7efff0155360 2023-12-07T09:59:27.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.779+0000 7efff4994640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effd40668d0 0x7effd4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:27.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.779+0000 7efff4994640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effd40668d0 0x7effd4068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efff0151f40 tx=0x7effe4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:27.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.783+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7effdc0b5280 con 0x7efff0155360 2023-12-07T09:59:27.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efff00c4780 con 0x7efff0155360 2023-12-07T09:59:27.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7effed7fa640 1 -- 172.21.15.89:0/4145151062 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7effdc015060 con 0x7efff0155360 2023-12-07T09:59:27.969 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effd40668d0 msgr2=0x7effd4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effd40668d0 0x7effd4068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efff0151f40 tx=0x7effe4008040 comp rx=0 tx=0).stop 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 msgr2=0x7efff014b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 0x7efff014b840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effdc00b410 tx=0x7effdc00b8d0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 shutdown_connections 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effd40668d0 0x7effd4068d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efff01580b0 0x7efff0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efff0155360 0x7efff014b840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 --2- 172.21.15.89:0/4145151062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efff006baf0 0x7efff0072380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 >> 172.21.15.89:0/4145151062 conn(0x7efff00c3240 msgr2=0x7efff006d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 shutdown_connections 2023-12-07T09:59:27.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:27.963+0000 7efff6bf8640 1 -- 172.21.15.89:0/4145151062 wait complete. 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T09:59:27.990 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T09:59:27.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:27.990 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T09:59:28.001 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T09:59:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T09:59:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T09:59:28.001 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T09:59:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-12-07T09:59:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T09:59:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:28.003 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T09:59:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T09:59:28.003 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:28.004 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T09:59:28.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.004 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T09:59:28.004 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T09:59:28.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2023-12-07T09:59:28.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2023-12-07T09:59:28.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2023-12-07T09:59:28.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T09:59:28.005 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T09:59:28.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.116 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T09:59:28.135 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T09:59:28.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.138 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T09:59:28.218 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T09:59:28.219 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T09:59:28.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.220 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T09:59:28.220 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T09:59:28.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T09:59:28.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T09:59:28.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T09:59:28.220 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T09:59:28.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.309 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T09:59:28.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.319 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-12-07T09:59:28.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.368 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T09:59:28.368 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T09:59:28.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T09:59:28.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-07T09:59:28.369 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T09:59:28.453 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-07T09:59:28.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-07T09:59:28.454 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T09:59:28.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.631 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T09:59:28.632 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T09:59:28.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T09:59:28.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T09:59:28.632 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T09:59:28.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T09:59:28.674 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T09:59:28.724 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T09:59:28.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T09:59:28.724 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T09:59:28.779 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-07T09:59:28.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:28.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T09:59:28.890 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T09:59:28.890 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T09:59:29.003 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T09:59:29.003 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T09:59:29.003 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T09:59:29.004 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 0@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T09:59:29.004 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T09:59:29.007 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T09:59:29.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T09:59:29.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.031 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T09:59:29.105 INFO:teuthology.orchestra.run.smithi089.stdout:client4710 2023-12-07T09:59:29.105 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:59:29.105 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:29.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.156 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T09:59:29.219 INFO:teuthology.orchestra.run.smithi089.stdout:client4710 2023-12-07T09:59:29.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.220 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T09:59:29.283 INFO:teuthology.orchestra.run.smithi089.stdout:client4710 2023-12-07T09:59:29.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.283 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/06923b89-f6c6-4736-b27e-9e03456ddc01.client4710/status') 2023-12-07T09:59:29.353 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4710 (3)192.168.0.1:0/4155651229 2023-12-07T09:59:29.353 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2023-12-07T09:59:29.353 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2023-12-07T09:59:29.354 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2023-12-07T09:59:29.354 INFO:teuthology.orchestra.run.smithi089.stderr:69 bytes copied, 5.1389e-05 s, 1.3 MB/s 2023-12-07T09:59:29.355 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-07T09:59:29.355 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T09:59:29.355 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T09:59:29.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T09:59:29.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 Processor -- start 2023-12-07T09:59:29.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 -- start start 2023-12-07T09:59:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f29140ca610 0x7f29140c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29140bd720 0x7f29140c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2914155790 con 0x7f291406cd90 2023-12-07T09:59:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29140c4b00 con 0x7f29140bd720 2023-12-07T09:59:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f291a91d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29140c4de0 con 0x7f29140ca610 2023-12-07T09:59:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29140bd720 0x7f29140c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29140bd720 0x7f29140c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34316/0 (socket says 172.21.15.89:34316) 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 -- 172.21.15.89:0/208674590 learned_addr learned my addr 172.21.15.89:0/208674590 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f2913fff640 1 --2- 172.21.15.89:0/208674590 >> v2:172.21.15.97:3300/0 conn(0x7f29140ca610 0x7f29140c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 -- 172.21.15.89:0/208674590 >> v2:172.21.15.97:3300/0 conn(0x7f29140ca610 msgr2=0x7f29140c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 --2- 172.21.15.89:0/208674590 >> v2:172.21.15.97:3300/0 conn(0x7f29140ca610 0x7f29140c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 -- 172.21.15.89:0/208674590 >> v1:172.21.15.97:6789/0 conn(0x7f291406cd90 legacy=0x7f2914158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f29137fe640 1 -- 172.21.15.89:0/208674590 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914157e30 con 0x7f29140bd720 2023-12-07T09:59:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.535+0000 7f2913fff640 1 --2- 172.21.15.89:0/208674590 >> v2:172.21.15.97:3300/0 conn(0x7f29140ca610 0x7f29140c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f29137fe640 1 --2- 172.21.15.89:0/208674590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140bd720 0x7f29140c9a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29140acc80 tx=0x7f290801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db26f46448610f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f2912ffd640 1 -- 172.21.15.89:0/208674590 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140c52d0 con 0x7f29140bd720 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f2912ffd640 1 -- 172.21.15.89:0/208674590 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29080a4900 con 0x7f29140bd720 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f2912ffd640 1 -- 172.21.15.89:0/208674590 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080a4c90 con 0x7f29140bd720 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 -- 172.21.15.89:0/208674590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140bd720 msgr2=0x7f29140c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 --2- 172.21.15.89:0/208674590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140bd720 0x7f29140c9a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29140acc80 tx=0x7f290801c0c0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 -- 172.21.15.89:0/208674590 shutdown_connections 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 --2- 172.21.15.89:0/208674590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140bd720 0x7f29140c9a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 --2- 172.21.15.89:0/208674590 >> v2:172.21.15.97:3300/0 conn(0x7f29140ca610 0x7f29140c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 -- 172.21.15.89:0/208674590 >> 172.21.15.89:0/208674590 conn(0x7f2914071ea0 msgr2=0x7f29140722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 -- 172.21.15.89:0/208674590 shutdown_connections 2023-12-07T09:59:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.539+0000 7f291a91d640 1 -- 172.21.15.89:0/208674590 wait complete. 2023-12-07T09:59:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 Processor -- start 2023-12-07T09:59:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- start start 2023-12-07T09:59:29.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291406cd90 0x7f29140a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:29.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29140bd720 0x7f29140aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 0x7f29140aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914152e60 con 0x7f29140ca610 2023-12-07T09:59:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914152ba0 con 0x7f291406cd90 2023-12-07T09:59:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29141535b0 con 0x7f29140bd720 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 0x7f29140aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 0x7f29140aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34318/0 (socket says 172.21.15.89:34318) 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 -- 172.21.15.89:0/2646541570 learned_addr learned my addr 172.21.15.89:0/2646541570 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2913fff640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291406cd90 0x7f29140a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f29137fe640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29140bd720 0x7f29140aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 -- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29140bd720 msgr2=0x7f29140aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29140bd720 0x7f29140aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 -- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291406cd90 msgr2=0x7f29140a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291406cd90 0x7f29140a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 -- 172.21.15.89:0/2646541570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080094d0 con 0x7f29140ca610 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2918eba640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 0x7f29140aba30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c770 tx=0x7f290c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c003b80 con 0x7f29140ca610 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c003ce0 con 0x7f29140ca610 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c00aa90 con 0x7f29140ca610 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29140bd1f0 con 0x7f29140ca610 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29140bcf10 con 0x7f29140ca610 2023-12-07T09:59:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.543+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291404e890 con 0x7f29140ca610 2023-12-07T09:59:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.547+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f290c00abf0 con 0x7f29140ca610 2023-12-07T09:59:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.547+0000 7f2910ff9640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f29000668d0 0x7f2900068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.547+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f290c084140 con 0x7f29140ca610 2023-12-07T09:59:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.547+0000 7f2913fff640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f29000668d0 0x7f2900068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.547+0000 7f2913fff640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f29000668d0 0x7f2900068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29040045f0 tx=0x7f2904008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:29.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.551+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f290c051420 con 0x7f29140ca610 2023-12-07T09:59:29.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.731+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f291406cb70 con 0x7f29140ca610 2023-12-07T09:59:29.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.731+0000 7f2910ff9640 1 -- 172.21.15.89:0/2646541570 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f290c054a40 con 0x7f29140ca610 2023-12-07T09:59:29.739 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T09:59:29.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f29000668d0 msgr2=0x7f2900068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:29.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f29000668d0 0x7f2900068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29040045f0 tx=0x7f2904008040 comp rx=0 tx=0).stop 2023-12-07T09:59:29.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 msgr2=0x7f29140aba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:29.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 0x7f29140aba30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c770 tx=0x7f290c00cc30 comp rx=0 tx=0).stop 2023-12-07T09:59:29.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 shutdown_connections 2023-12-07T09:59:29.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29140ca610 0x7f29140aba30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f29000668d0 0x7f2900068d90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29140bd720 0x7f29140aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 --2- 172.21.15.89:0/2646541570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f291406cd90 0x7f29140a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 >> 172.21.15.89:0/2646541570 conn(0x7f2914071ea0 msgr2=0x7f2914156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 shutdown_connections 2023-12-07T09:59:29.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:29.735+0000 7f291a91d640 1 -- 172.21.15.89:0/2646541570 wait complete. 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T09:59:29.760 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T09:59:29.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.761 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T09:59:29.772 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T09:59:29.773 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T09:59:29.774 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T09:59:29.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.774 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T09:59:29.774 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T09:59:29.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add name ceph-brx type bridge 2023-12-07T09:59:29.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr flush dev ceph-brx 2023-12-07T09:59:29.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set ceph-brx up 2023-12-07T09:59:29.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T09:59:29.775 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T09:59:29.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.890 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T09:59:29.909 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T09:59:29.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:29.911 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T09:59:30.262 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T09:59:30.263 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T09:59:30.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.264 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T09:59:30.264 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T09:59:30.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T09:59:30.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T09:59:30.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T09:59:30.264 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T09:59:30.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.316 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T09:59:30.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.326 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2023-12-07T09:59:30.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.377 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T09:59:30.377 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T09:59:30.377 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T09:59:30.377 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-07T09:59:30.378 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T09:59:30.461 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-07T09:59:30.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-07T09:59:30.461 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T09:59:30.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.661 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T09:59:30.661 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T09:59:30.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T09:59:30.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T09:59:30.661 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T09:59:30.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T09:59:30.702 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T09:59:30.757 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T09:59:30.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T09:59:30.757 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T09:59:30.808 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-07T09:59:30.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:30.808 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T09:59:30.913 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T09:59:30.913 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T09:59:31.032 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T09:59:31.032 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T09:59:31.032 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T09:59:31.032 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T09:59:31.032 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T09:59:31.036 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T09:59:31.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:31.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T09:59:31.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:31.057 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T09:59:31.129 INFO:teuthology.orchestra.run.smithi097.stdout:client4719 2023-12-07T09:59:31.129 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:59:31.129 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:31.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:31.181 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T09:59:31.235 INFO:teuthology.orchestra.run.smithi097.stdout:client4719 2023-12-07T09:59:31.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:31.235 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T09:59:31.287 INFO:teuthology.orchestra.run.smithi097.stdout:client4719 2023-12-07T09:59:31.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:31.287 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/06923b89-f6c6-4736-b27e-9e03456ddc01.client4719/status') 2023-12-07T09:59:31.348 INFO:teuthology.orchestra.run.smithi097.stdout:instance: client.4719 (3)172.21.15.97:0/1479089586 2023-12-07T09:59:31.348 INFO:teuthology.orchestra.run.smithi097.stdout:blocklisted: false 2023-12-07T09:59:31.348 INFO:teuthology.orchestra.run.smithi097.stderr:0+1 records in 2023-12-07T09:59:31.348 INFO:teuthology.orchestra.run.smithi097.stderr:0+1 records out 2023-12-07T09:59:31.348 INFO:teuthology.orchestra.run.smithi097.stderr:70 bytes copied, 5.0707e-05 s, 1.4 MB/s 2023-12-07T09:59:31.350 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-07T09:59:31.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:31.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 Processor -- start 2023-12-07T09:59:31.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 -- start start 2023-12-07T09:59:31.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa55814e9d0 0x7fa558151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa558070b80 0x7fa5580c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa55806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55806d320 con 0x7fa55814e9d0 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5580721b0 con 0x7fa558070b80 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa55dfa1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580c2830 con 0x7fa5580c1f20 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa5577fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa55814e9d0 0x7fa558151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa5577fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa55814e9d0 0x7fa558151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34332/0 (socket says 172.21.15.89:34332) 2023-12-07T09:59:31.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa5577fe640 1 -- 172.21.15.89:0/4081248187 learned_addr learned my addr 172.21.15.89:0/4081248187 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa54ffff640 1 --2- 172.21.15.89:0/4081248187 >> v2:172.21.15.97:3300/0 conn(0x7fa558070b80 0x7fa5580c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.511+0000 7fa557fff640 1 --2- 172.21.15.89:0/4081248187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa55806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa5577fe640 1 -- 172.21.15.89:0/4081248187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 msgr2=0x7fa55806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa5577fe640 1 --2- 172.21.15.89:0/4081248187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa55806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa5577fe640 1 -- 172.21.15.89:0/4081248187 >> v2:172.21.15.97:3300/0 conn(0x7fa558070b80 msgr2=0x7fa5580c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa5577fe640 1 --2- 172.21.15.89:0/4081248187 >> v2:172.21.15.97:3300/0 conn(0x7fa558070b80 0x7fa5580c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa5577fe640 1 -- 172.21.15.89:0/4081248187 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558072450 con 0x7fa55814e9d0 2023-12-07T09:59:31.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa54ffff640 1 --2- 172.21.15.89:0/4081248187 >> v2:172.21.15.97:3300/0 conn(0x7fa558070b80 0x7fa5580c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:31.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa5577fe640 1 --2- 172.21.15.89:0/4081248187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa558151e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa55806e420 tx=0x7fa54801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639aa0b46af03e71 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:31.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa556ffd640 1 -- 172.21.15.89:0/4081248187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480ab600 con 0x7fa55814e9d0 2023-12-07T09:59:31.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa556ffd640 1 -- 172.21.15.89:0/4081248187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5480a7050 con 0x7fa55814e9d0 2023-12-07T09:59:31.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.515+0000 7fa556ffd640 1 -- 172.21.15.89:0/4081248187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480ab980 con 0x7fa55814e9d0 2023-12-07T09:59:31.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- 172.21.15.89:0/4081248187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 msgr2=0x7fa558151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/4081248187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa558151e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa55806e420 tx=0x7fa54801c470 comp rx=0 tx=0).stop 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- 172.21.15.89:0/4081248187 shutdown_connections 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/4081248187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa55806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/4081248187 >> v2:172.21.15.97:3300/0 conn(0x7fa558070b80 0x7fa5580c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/4081248187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa558151e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- 172.21.15.89:0/4081248187 >> 172.21.15.89:0/4081248187 conn(0x7fa5580c2ad0 msgr2=0x7fa5580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- 172.21.15.89:0/4081248187 shutdown_connections 2023-12-07T09:59:31.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- 172.21.15.89:0/4081248187 wait complete. 2023-12-07T09:59:31.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 Processor -- start 2023-12-07T09:59:31.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- start start 2023-12-07T09:59:31.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa558070b80 0x7fa5581f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa5580bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa5581ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5581f1940 con 0x7fa55814e9d0 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580aac20 con 0x7fa558070b80 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa55dfa1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa558151bb0 con 0x7fa5580c1f20 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa5581ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa5581ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34340/0 (socket says 172.21.15.89:34340) 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 -- 172.21.15.89:0/587570716 learned_addr learned my addr 172.21.15.89:0/587570716 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa5577fe640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa558070b80 0x7fa5581f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa54ffff640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa5580bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 -- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 msgr2=0x7fa5580bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa5580bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 -- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa558070b80 msgr2=0x7fa5581f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa558070b80 0x7fa5581f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.519+0000 7fa557fff640 1 -- 172.21.15.89:0/587570716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480094d0 con 0x7fa55814e9d0 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa557fff640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa5581ed480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa550007e70 tx=0x7fa55000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:31.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550014420 con 0x7fa55814e9d0 2023-12-07T09:59:31.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5500145a0 con 0x7fa55814e9d0 2023-12-07T09:59:31.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550014950 con 0x7fa55814e9d0 2023-12-07T09:59:31.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5580ac1b0 con 0x7fa55814e9d0 2023-12-07T09:59:31.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5580ab150 con 0x7fa55814e9d0 2023-12-07T09:59:31.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa558151d40 con 0x7fa55814e9d0 2023-12-07T09:59:31.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa550014ab0 con 0x7fa55814e9d0 2023-12-07T09:59:31.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa554ff9640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5380668d0 0x7fa538068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa550084c80 con 0x7fa55814e9d0 2023-12-07T09:59:31.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.523+0000 7fa5577fe640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5380668d0 0x7fa538068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.527+0000 7fa5577fe640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5380668d0 0x7fa538068d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa5580c3980 tx=0x7fa548009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:31.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.527+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa550051f60 con 0x7fa55814e9d0 2023-12-07T09:59:31.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.679+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa55804e890 con 0x7fa55814e9d0 2023-12-07T09:59:31.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.679+0000 7fa554ff9640 1 -- 172.21.15.89:0/587570716 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa550055580 con 0x7fa55814e9d0 2023-12-07T09:59:31.686 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:31.686 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5380668d0 msgr2=0x7fa538068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5380668d0 0x7fa538068d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa5580c3980 tx=0x7fa548009040 comp rx=0 tx=0).stop 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 msgr2=0x7fa5581ed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa5581ed480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa550007e70 tx=0x7fa55000e4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 shutdown_connections 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55814e9d0 0x7fa5581ed480 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5380668d0 0x7fa538068d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5580c1f20 0x7fa5580bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 --2- 172.21.15.89:0/587570716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa558070b80 0x7fa5581f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 >> 172.21.15.89:0/587570716 conn(0x7fa5580c2ad0 msgr2=0x7fa55814d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:31.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 shutdown_connections 2023-12-07T09:59:31.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.683+0000 7fa55dfa1640 1 -- 172.21.15.89:0/587570716 wait complete. 2023-12-07T09:59:31.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:31.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 Processor -- start 2023-12-07T09:59:31.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 -- start start 2023-12-07T09:59:31.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc858151d80 0x7fc8580c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc8580c7f20 0x7fc85806be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85806cf70 con 0x7fc8580c8430 2023-12-07T09:59:31.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc858152160 con 0x7fc858151d80 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc85db72640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8580c6a30 con 0x7fc8580c7f20 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc858151d80 0x7fc8580c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc858151d80 0x7fc8580c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34350/0 (socket says 172.21.15.89:34350) 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc856ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc8580c8430 0x7fc85806b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41372/0 (socket says 172.21.15.89:41372) 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 -- 172.21.15.89:0/1205527351 learned_addr learned my addr 172.21.15.89:0/1205527351 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc857fff640 1 --2- 172.21.15.89:0/1205527351 >> v2:172.21.15.97:3300/0 conn(0x7fc8580c7f20 0x7fc85806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 -- 172.21.15.89:0/1205527351 >> v2:172.21.15.97:3300/0 conn(0x7fc8580c7f20 msgr2=0x7fc85806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 --2- 172.21.15.89:0/1205527351 >> v2:172.21.15.97:3300/0 conn(0x7fc8580c7f20 0x7fc85806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 -- 172.21.15.89:0/1205527351 >> v1:172.21.15.89:6789/0 conn(0x7fc8580c8430 legacy=0x7fc85806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8577fe640 1 -- 172.21.15.89:0/1205527351 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580c72d0 con 0x7fc858151d80 2023-12-07T09:59:31.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.843+0000 7fc8567fc640 1 -- 172.21.15.89:0/1205527351 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241237973 0 0) 0x7fc85806cf70 con 0x7fc8580c8430 2023-12-07T09:59:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc8577fe640 1 --2- 172.21.15.89:0/1205527351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc858151d80 0x7fc8580c49a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8580c4220 tx=0x7fc84801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690269d316db43f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:31.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc8567fc640 1 -- 172.21.15.89:0/1205527351 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480a57d0 con 0x7fc858151d80 2023-12-07T09:59:31.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc8567fc640 1 -- 172.21.15.89:0/1205527351 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8480a5930 con 0x7fc858151d80 2023-12-07T09:59:31.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc8567fc640 1 -- 172.21.15.89:0/1205527351 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480a5cc0 con 0x7fc858151d80 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 -- 172.21.15.89:0/1205527351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc858151d80 msgr2=0x7fc8580c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 --2- 172.21.15.89:0/1205527351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc858151d80 0x7fc8580c49a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8580c4220 tx=0x7fc84801c910 comp rx=0 tx=0).stop 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 -- 172.21.15.89:0/1205527351 shutdown_connections 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 --2- 172.21.15.89:0/1205527351 >> v2:172.21.15.97:3300/0 conn(0x7fc8580c7f20 0x7fc85806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 --2- 172.21.15.89:0/1205527351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc858151d80 0x7fc8580c49a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 -- 172.21.15.89:0/1205527351 >> 172.21.15.89:0/1205527351 conn(0x7fc8580abd00 msgr2=0x7fc8580ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 -- 172.21.15.89:0/1205527351 shutdown_connections 2023-12-07T09:59:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.847+0000 7fc85db72640 1 -- 172.21.15.89:0/1205527351 wait complete. 2023-12-07T09:59:31.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 Processor -- start 2023-12-07T09:59:31.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 -- start start 2023-12-07T09:59:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 0x7fc8581ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8580c8430 0x7fc8580af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc858151d80 0x7fc8581ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580afc70 con 0x7fc8580c7f20 2023-12-07T09:59:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85814bf90 con 0x7fc858151d80 2023-12-07T09:59:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8581ecf70 con 0x7fc8580c8430 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 0x7fc8581ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 0x7fc8581ee3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34352/0 (socket says 172.21.15.89:34352) 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 -- 172.21.15.89:0/2577976698 learned_addr learned my addr 172.21.15.89:0/2577976698 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc856ffd640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8580c8430 0x7fc8580af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc857fff640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc858151d80 0x7fc8581ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 -- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8580c8430 msgr2=0x7fc8580af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8580c8430 0x7fc8580af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 -- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc858151d80 msgr2=0x7fc8581ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc858151d80 0x7fc8581ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 -- 172.21.15.89:0/2577976698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848009b30 con 0x7fc8580c7f20 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc8577fe640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 0x7fc8581ee3e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc84801afc0 tx=0x7fc8480196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480b8470 con 0x7fc8580c7f20 2023-12-07T09:59:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8480b85d0 con 0x7fc8580c7f20 2023-12-07T09:59:31.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480b8980 con 0x7fc8580c7f20 2023-12-07T09:59:31.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8580bfaa0 con 0x7fc8580c7f20 2023-12-07T09:59:31.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.851+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8580c0060 con 0x7fc8580c7f20 2023-12-07T09:59:31.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.855+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8580c0710 con 0x7fc8580c7f20 2023-12-07T09:59:31.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.855+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8480b8ae0 con 0x7fc8580c7f20 2023-12-07T09:59:31.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.855+0000 7fc83ffff640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc844066900 0x7fc844068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:31.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.855+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc84811f570 con 0x7fc8580c7f20 2023-12-07T09:59:31.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.855+0000 7fc856ffd640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc844066900 0x7fc844068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:31.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.855+0000 7fc856ffd640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc844066900 0x7fc844068dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc85814e050 tx=0x7fc84c007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:31.859+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8480ec7c0 con 0x7fc8580c7f20 2023-12-07T09:59:32.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.011+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc85804e890 con 0x7fc8580c7f20 2023-12-07T09:59:32.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.011+0000 7fc83ffff640 1 -- 172.21.15.89:0/2577976698 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8480efde0 con 0x7fc8580c7f20 2023-12-07T09:59:32.017 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.011+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc844066900 msgr2=0x7fc844068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.011+0000 7fc85db72640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc844066900 0x7fc844068dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc85814e050 tx=0x7fc84c007e10 comp rx=0 tx=0).stop 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.011+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 msgr2=0x7fc8581ee3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.011+0000 7fc85db72640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 0x7fc8581ee3e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc84801afc0 tx=0x7fc8480196b0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 shutdown_connections 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc858151d80 0x7fc8581ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc844066900 0x7fc844068dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8580c8430 0x7fc8580af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 --2- 172.21.15.89:0/2577976698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8580c7f20 0x7fc8581ee3e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 >> 172.21.15.89:0/2577976698 conn(0x7fc8580abd00 msgr2=0x7fc85814c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 shutdown_connections 2023-12-07T09:59:32.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.015+0000 7fc85db72640 1 -- 172.21.15.89:0/2577976698 wait complete. 2023-12-07T09:59:32.039 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:32.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.171+0000 7f3502b0e640 1 Processor -- start 2023-12-07T09:59:32.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.171+0000 7f3502b0e640 1 -- start start 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f3502b0e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34fc0a86d0 0x7f34fc0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f3502b0e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34fc14fd00 0x7f34fc0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f3502b0e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc152d90 con 0x7f34fc156600 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f3502b0e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc152480 con 0x7f34fc14fd00 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f3502b0e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc0a9760 con 0x7f34fc0a86d0 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34fc14fd00 0x7f34fc0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34fc14fd00 0x7f34fc0aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34366/0 (socket says 172.21.15.89:34366) 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 -- 172.21.15.89:0/3413244143 learned_addr learned my addr 172.21.15.89:0/3413244143 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35008aa640 1 --2- 172.21.15.89:0/3413244143 >> v2:172.21.15.97:3300/0 conn(0x7f34fc0a86d0 0x7f34fc0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 -- 172.21.15.89:0/3413244143 >> v2:172.21.15.97:3300/0 conn(0x7f34fc0a86d0 msgr2=0x7f34fc0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 --2- 172.21.15.89:0/3413244143 >> v2:172.21.15.97:3300/0 conn(0x7f34fc0a86d0 0x7f34fc0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 -- 172.21.15.89:0/3413244143 >> v1:172.21.15.97:6789/0 conn(0x7f34fc156600 legacy=0x7f34fc14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.175+0000 7f35010ab640 1 -- 172.21.15.89:0/3413244143 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc152740 con 0x7f34fc14fd00 2023-12-07T09:59:32.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f35010ab640 1 --2- 172.21.15.89:0/3413244143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc0aae40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009e50 tx=0x7f34f401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a46fa486ac2a26 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f34f37fe640 1 -- 172.21.15.89:0/3413244143 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a5780 con 0x7f34fc14fd00 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f34f37fe640 1 -- 172.21.15.89:0/3413244143 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40a58e0 con 0x7f34fc14fd00 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f34f37fe640 1 -- 172.21.15.89:0/3413244143 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a5c70 con 0x7f34fc14fd00 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 -- 172.21.15.89:0/3413244143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 msgr2=0x7f34fc0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 --2- 172.21.15.89:0/3413244143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc0aae40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009e50 tx=0x7f34f401c9d0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 -- 172.21.15.89:0/3413244143 shutdown_connections 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 --2- 172.21.15.89:0/3413244143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc0aae40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 --2- 172.21.15.89:0/3413244143 >> v2:172.21.15.97:3300/0 conn(0x7f34fc0a86d0 0x7f34fc0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 -- 172.21.15.89:0/3413244143 >> 172.21.15.89:0/3413244143 conn(0x7f34fc0c2a60 msgr2=0x7f34fc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 -- 172.21.15.89:0/3413244143 shutdown_connections 2023-12-07T09:59:32.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 -- 172.21.15.89:0/3413244143 wait complete. 2023-12-07T09:59:32.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 Processor -- start 2023-12-07T09:59:32.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.179+0000 7f3502b0e640 1 -- start start 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 0x7f34fc1f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc156600 0x7f34fc144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0bfe70 con 0x7f34fc14fd00 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1f0d20 con 0x7f34fc156600 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1f1000 con 0x7f34fc0a86d0 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f34f3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 0x7f34fc1f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 0x7f34fc1f06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:49322/0 (socket says 172.21.15.89:49322) 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35010ab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc156600 0x7f34fc144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 -- 172.21.15.89:0/1864430566 learned_addr learned my addr 172.21.15.89:0/1864430566 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 -- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc156600 msgr2=0x7f34fc144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc156600 0x7f34fc144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 -- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 msgr2=0x7f34fc071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 -- 172.21.15.89:0/1864430566 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4009b30 con 0x7f34fc0a86d0 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f34f3fff640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f35008aa640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 0x7f34fc1f06b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34f800d5f0 tx=0x7f34f800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80125f0 con 0x7f34fc0a86d0 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8012750 con 0x7f34fc0a86d0 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8012b00 con 0x7f34fc0a86d0 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc1f12e0 con 0x7f34fc0a86d0 2023-12-07T09:59:32.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc1ed1d0 con 0x7f34fc0a86d0 2023-12-07T09:59:32.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc04e890 con 0x7f34fc0a86d0 2023-12-07T09:59:32.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.183+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f34f8012c60 con 0x7f34fc0a86d0 2023-12-07T09:59:32.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.187+0000 7f34f17fa640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34e8066900 0x7f34e8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.187+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34f8084830 con 0x7f34fc0a86d0 2023-12-07T09:59:32.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.187+0000 7f34f3fff640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34e8066900 0x7f34e8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.187+0000 7f34f3fff640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34e8066900 0x7f34e8068dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f34fc15c160 tx=0x7f34ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.191+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34f8051b10 con 0x7f34fc0a86d0 2023-12-07T09:59:32.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.343+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34fc0c3090 con 0x7f34fc0a86d0 2023-12-07T09:59:32.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f34f17fa640 1 -- 172.21.15.89:0/1864430566 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34f8055130 con 0x7f34fc0a86d0 2023-12-07T09:59:32.352 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34e8066900 msgr2=0x7f34e8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34e8066900 0x7f34e8068dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f34fc15c160 tx=0x7f34ec009040 comp rx=0 tx=0).stop 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 msgr2=0x7f34fc1f06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 0x7f34fc1f06b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34f800d5f0 tx=0x7f34f800dab0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 shutdown_connections 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc156600 0x7f34fc144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34fc14fd00 0x7f34fc071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34e8066900 0x7f34e8068dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 --2- 172.21.15.89:0/1864430566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34fc0a86d0 0x7f34fc1f06b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 >> 172.21.15.89:0/1864430566 conn(0x7f34fc0c2a60 msgr2=0x7f34fc0c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 shutdown_connections 2023-12-07T09:59:32.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.347+0000 7f3502b0e640 1 -- 172.21.15.89:0/1864430566 wait complete. 2023-12-07T09:59:32.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:32.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 Processor -- start 2023-12-07T09:59:32.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 -- start start 2023-12-07T09:59:32.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea8151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ea8151f90 0x7f3ea806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3ea80c0370 0x7f3ea806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea806de00 con 0x7f3ea8151f90 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea8070390 con 0x7f3ea80c0370 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eaffb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea806db90 con 0x7f3ea814eaf0 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3ead553640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ea8151f90 0x7f3ea806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3ead553640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ea8151f90 0x7f3ea806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34390/0 (socket says 172.21.15.89:34390) 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3ead553640 1 -- 172.21.15.89:0/2522684636 learned_addr learned my addr 172.21.15.89:0/2522684636 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3eadd54640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea8151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.507+0000 7f3ead553640 1 -- 172.21.15.89:0/2522684636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 msgr2=0x7f3ea8151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:32.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3ead553640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea8151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eae555640 1 --2- 172.21.15.89:0/2522684636 >> v2:172.21.15.97:3300/0 conn(0x7f3ea80c0370 0x7f3ea806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3ead553640 1 -- 172.21.15.89:0/2522684636 >> v2:172.21.15.97:3300/0 conn(0x7f3ea80c0370 msgr2=0x7f3ea806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3ead553640 1 --2- 172.21.15.89:0/2522684636 >> v2:172.21.15.97:3300/0 conn(0x7f3ea80c0370 0x7f3ea806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3ead553640 1 -- 172.21.15.89:0/2522684636 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea814eed0 con 0x7f3ea8151f90 2023-12-07T09:59:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eadd54640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea8151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:32.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eae555640 1 --2- 172.21.15.89:0/2522684636 >> v2:172.21.15.97:3300/0 conn(0x7f3ea80c0370 0x7f3ea806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:32.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3ead553640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea8151f90 0x7f3ea806d110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80ac250 tx=0x7f3e9801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d720a479e3f728 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eacd52640 1 -- 172.21.15.89:0/2522684636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980ac600 con 0x7f3ea8151f90 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eacd52640 1 -- 172.21.15.89:0/2522684636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e980a8050 con 0x7f3ea8151f90 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eacd52640 1 -- 172.21.15.89:0/2522684636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980ac980 con 0x7f3ea8151f90 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 -- 172.21.15.89:0/2522684636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea8151f90 msgr2=0x7f3ea806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea8151f90 0x7f3ea806d110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80ac250 tx=0x7f3e9801c3e0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 -- 172.21.15.89:0/2522684636 shutdown_connections 2023-12-07T09:59:32.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/2522684636 >> v2:172.21.15.97:3300/0 conn(0x7f3ea80c0370 0x7f3ea806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea8151f90 0x7f3ea806d110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/2522684636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea8151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.511+0000 7f3eaffb8640 1 -- 172.21.15.89:0/2522684636 >> 172.21.15.89:0/2522684636 conn(0x7f3ea80c2a60 msgr2=0x7f3ea80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 -- 172.21.15.89:0/2522684636 shutdown_connections 2023-12-07T09:59:32.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 -- 172.21.15.89:0/2522684636 wait complete. 2023-12-07T09:59:32.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 Processor -- start 2023-12-07T09:59:32.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 -- start start 2023-12-07T09:59:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 0x7f3ea8140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea81eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ea81413d0 0x7f3ea81ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81f0440 con 0x7f3ea80c0370 2023-12-07T09:59:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea814e160 con 0x7f3ea81413d0 2023-12-07T09:59:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eaffb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81f0690 con 0x7f3ea814eaf0 2023-12-07T09:59:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 0x7f3ea8140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 0x7f3ea8140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34406/0 (socket says 172.21.15.89:34406) 2023-12-07T09:59:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 -- 172.21.15.89:0/683563841 learned_addr learned my addr 172.21.15.89:0/683563841 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:32.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 -- 172.21.15.89:0/683563841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 msgr2=0x7f3ea81eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea81eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 -- 172.21.15.89:0/683563841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ea81413d0 msgr2=0x7f3ea81ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ea81413d0 0x7f3ea81ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 -- 172.21.15.89:0/683563841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980094d0 con 0x7f3ea80c0370 2023-12-07T09:59:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3eadd54640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 0x7f3ea8140e90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c7c0 tx=0x7f3ea400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4007a30 con 0x7f3ea80c0370 2023-12-07T09:59:32.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4007b90 con 0x7f3ea80c0370 2023-12-07T09:59:32.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.515+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400ce70 con 0x7f3ea80c0370 2023-12-07T09:59:32.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea81f0970 con 0x7f3ea80c0370 2023-12-07T09:59:32.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea81f1170 con 0x7f3ea80c0370 2023-12-07T09:59:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea804e890 con 0x7f3ea80c0370 2023-12-07T09:59:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ea40113f0 con 0x7f3ea80c0370 2023-12-07T09:59:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3e9e7fc640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3e8c0668d0 0x7f3e8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ea40848d0 con 0x7f3ea80c0370 2023-12-07T09:59:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3ead553640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3e8c0668d0 0x7f3e8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.519+0000 7f3ead553640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3e8c0668d0 0x7f3e8c068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3e980ae000 tx=0x7f3e98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.523+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ea4051b00 con 0x7f3ea80c0370 2023-12-07T09:59:32.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.671+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ea81f0e20 con 0x7f3ea80c0370 2023-12-07T09:59:32.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3e9e7fc640 1 -- 172.21.15.89:0/683563841 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ea401e0a0 con 0x7f3ea80c0370 2023-12-07T09:59:32.679 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:32.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3e8c0668d0 msgr2=0x7f3e8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3e8c0668d0 0x7f3e8c068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3e980ae000 tx=0x7f3e98008040 comp rx=0 tx=0).stop 2023-12-07T09:59:32.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 msgr2=0x7f3ea8140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 0x7f3ea8140e90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c7c0 tx=0x7f3ea400cc80 comp rx=0 tx=0).stop 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 shutdown_connections 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ea81413d0 0x7f3ea81ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3e8c0668d0 0x7f3e8c068d90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ea814eaf0 0x7f3ea81eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 --2- 172.21.15.89:0/683563841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c0370 0x7f3ea8140e90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 >> 172.21.15.89:0/683563841 conn(0x7f3ea80c2a60 msgr2=0x7f3ea8070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 shutdown_connections 2023-12-07T09:59:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.675+0000 7f3eaffb8640 1 -- 172.21.15.89:0/683563841 wait complete. 2023-12-07T09:59:32.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:32.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.831+0000 7faf33c32640 1 Processor -- start 2023-12-07T09:59:32.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.831+0000 7faf33c32640 1 -- start start 2023-12-07T09:59:32.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf33c32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faf2c14e4d0 0x7faf2c0c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf33c32640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0c2290 con 0x7faf2c150b80 2023-12-07T09:59:32.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf33c32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0c3010 con 0x7faf2c0c2a50 2023-12-07T09:59:32.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf33c32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c14e8b0 con 0x7faf2c14e4d0 2023-12-07T09:59:32.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf321cf640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7faf2c150b80 0x7faf2c151030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41388/0 (socket says 172.21.15.89:41388) 2023-12-07T09:59:32.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf321cf640 1 -- 172.21.15.89:0/3242011507 learned_addr learned my addr 172.21.15.89:0/3242011507 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:32.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf319ce640 1 --2- 172.21.15.89:0/3242011507 >> v2:172.21.15.97:3300/0 conn(0x7faf2c14e4d0 0x7faf2c0c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf309cc640 1 -- 172.21.15.89:0/3242011507 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206608929 0 0) 0x7faf2c0c2290 con 0x7faf2c150b80 2023-12-07T09:59:32.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf309cc640 1 -- 172.21.15.89:0/3242011507 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf18003530 con 0x7faf2c150b80 2023-12-07T09:59:32.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf319ce640 1 -- 172.21.15.89:0/3242011507 >> v1:172.21.15.97:6789/0 conn(0x7faf2c0c2a50 legacy=0x7faf2c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf319ce640 1 -- 172.21.15.89:0/3242011507 >> v1:172.21.15.89:6789/0 conn(0x7faf2c150b80 legacy=0x7faf2c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf319ce640 1 -- 172.21.15.89:0/3242011507 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0c17a0 con 0x7faf2c14e4d0 2023-12-07T09:59:32.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.835+0000 7faf319ce640 1 --2- 172.21.15.89:0/3242011507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0c19f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a960 tx=0x7faf2801d790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f6bd01440dd700 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf309cc640 1 -- 172.21.15.89:0/3242011507 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280a67c0 con 0x7faf2c14e4d0 2023-12-07T09:59:32.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf309cc640 1 -- 172.21.15.89:0/3242011507 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280a6920 con 0x7faf2c14e4d0 2023-12-07T09:59:32.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf309cc640 1 -- 172.21.15.89:0/3242011507 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280a6c90 con 0x7faf2c14e4d0 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- 172.21.15.89:0/3242011507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 msgr2=0x7faf2c0c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 --2- 172.21.15.89:0/3242011507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0c19f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a960 tx=0x7faf2801d790 comp rx=0 tx=0).stop 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- 172.21.15.89:0/3242011507 shutdown_connections 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 --2- 172.21.15.89:0/3242011507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0c19f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- 172.21.15.89:0/3242011507 >> 172.21.15.89:0/3242011507 conn(0x7faf2c0c3240 msgr2=0x7faf2c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- 172.21.15.89:0/3242011507 shutdown_connections 2023-12-07T09:59:32.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- 172.21.15.89:0/3242011507 wait complete. 2023-12-07T09:59:32.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 Processor -- start 2023-12-07T09:59:32.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- start start 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 0x7faf2c0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf2c150b80 0x7faf2c0a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0a9d00 con 0x7faf2c0c2a50 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0aa3c0 con 0x7faf2c14e4d0 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.839+0000 7faf33c32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c13f460 con 0x7faf2c150b80 2023-12-07T09:59:32.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 0x7faf2c0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 0x7faf2c0ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34412/0 (socket says 172.21.15.89:34412) 2023-12-07T09:59:32.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 -- 172.21.15.89:0/1708386762 learned_addr learned my addr 172.21.15.89:0/1708386762 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf311cd640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf321cf640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf2c150b80 0x7faf2c0a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 -- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf2c150b80 msgr2=0x7faf2c0a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf2c150b80 0x7faf2c0a6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 -- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 msgr2=0x7faf2c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 -- 172.21.15.89:0/1708386762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2800a5c0 con 0x7faf2c0c2a50 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf311cd640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf321cf640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf2c150b80 0x7faf2c0a6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf319ce640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 0x7faf2c0ab7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf2801a3a0 tx=0x7faf2801a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28004220 con 0x7faf2c0c2a50 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28004380 con 0x7faf2c0c2a50 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c0ac220 con 0x7faf2c0c2a50 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28003820 con 0x7faf2c0c2a50 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c13f180 con 0x7faf2c0c2a50 2023-12-07T09:59:32.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c067a40 con 0x7faf2c0c2a50 2023-12-07T09:59:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf280b5050 con 0x7faf2c0c2a50 2023-12-07T09:59:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.843+0000 7faf227fc640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf100668d0 0x7faf10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.847+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf2811eae0 con 0x7faf2c0c2a50 2023-12-07T09:59:32.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.847+0000 7faf311cd640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf100668d0 0x7faf10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:32.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.847+0000 7faf311cd640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf100668d0 0x7faf10068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0a7e70 tx=0x7faf1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:32.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.851+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf280ebe30 con 0x7faf2c0c2a50 2023-12-07T09:59:33.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.999+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf2c0a9e40 con 0x7faf2c0c2a50 2023-12-07T09:59:33.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:32.999+0000 7faf227fc640 1 -- 172.21.15.89:0/1708386762 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7faf280bc090 con 0x7faf2c0c2a50 2023-12-07T09:59:33.006 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:33.006 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf100668d0 msgr2=0x7faf10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf100668d0 0x7faf10068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0a7e70 tx=0x7faf1c009040 comp rx=0 tx=0).stop 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 msgr2=0x7faf2c0ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 0x7faf2c0ab7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faf2801a3a0 tx=0x7faf2801a530 comp rx=0 tx=0).stop 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 shutdown_connections 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf100668d0 0x7faf10068d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf2c150b80 0x7faf2c0a6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf2c14e4d0 0x7faf2c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 --2- 172.21.15.89:0/1708386762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf2c0c2a50 0x7faf2c0ab7a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 >> 172.21.15.89:0/1708386762 conn(0x7faf2c0c3240 msgr2=0x7faf2c14bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 shutdown_connections 2023-12-07T09:59:33.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.003+0000 7faf33c32640 1 -- 172.21.15.89:0/1708386762 wait complete. 2023-12-07T09:59:33.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:33.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:33.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.159+0000 7fd42ec32640 1 Processor -- start 2023-12-07T09:59:33.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.159+0000 7fd42ec32640 1 -- start start 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd42ec32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd42814eaf0 0x7fd428151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd42ec32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd428151f90 0x7fd42806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd42ec32640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42806de00 con 0x7fd4280c0370 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd42ec32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd428070390 con 0x7fd428151f90 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd42ec32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42814eed0 con 0x7fd42814eaf0 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd428151f90 0x7fd42806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd428151f90 0x7fd42806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34418/0 (socket says 172.21.15.89:34418) 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 -- 172.21.15.89:0/1292151712 learned_addr learned my addr 172.21.15.89:0/1292151712 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd42c9ce640 1 --2- 172.21.15.89:0/1292151712 >> v2:172.21.15.97:3300/0 conn(0x7fd42814eaf0 0x7fd428151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 -- 172.21.15.89:0/1292151712 >> v2:172.21.15.97:3300/0 conn(0x7fd42814eaf0 msgr2=0x7fd428151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 --2- 172.21.15.89:0/1292151712 >> v2:172.21.15.97:3300/0 conn(0x7fd42814eaf0 0x7fd428151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 -- 172.21.15.89:0/1292151712 >> v1:172.21.15.89:6789/0 conn(0x7fd4280c0370 legacy=0x7fd42806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.163+0000 7fd427fff640 1 -- 172.21.15.89:0/1292151712 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428151270 con 0x7fd428151f90 2023-12-07T09:59:33.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd427fff640 1 --2- 172.21.15.89:0/1292151712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd428151f90 0x7fd42806d110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4280c3b00 tx=0x7fd41401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c0df8ab425c794 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd4277fe640 1 -- 172.21.15.89:0/1292151712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ac410 con 0x7fd428151f90 2023-12-07T09:59:33.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd4277fe640 1 -- 172.21.15.89:0/1292151712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140ac570 con 0x7fd428151f90 2023-12-07T09:59:33.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd4277fe640 1 -- 172.21.15.89:0/1292151712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ac900 con 0x7fd428151f90 2023-12-07T09:59:33.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 -- 172.21.15.89:0/1292151712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd428151f90 msgr2=0x7fd42806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 --2- 172.21.15.89:0/1292151712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd428151f90 0x7fd42806d110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4280c3b00 tx=0x7fd41401c3b0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 -- 172.21.15.89:0/1292151712 shutdown_connections 2023-12-07T09:59:33.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 --2- 172.21.15.89:0/1292151712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd428151f90 0x7fd42806d110 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 --2- 172.21.15.89:0/1292151712 >> v2:172.21.15.97:3300/0 conn(0x7fd42814eaf0 0x7fd428151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 -- 172.21.15.89:0/1292151712 >> 172.21.15.89:0/1292151712 conn(0x7fd4280c2a60 msgr2=0x7fd4280c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 -- 172.21.15.89:0/1292151712 shutdown_connections 2023-12-07T09:59:33.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 -- 172.21.15.89:0/1292151712 wait complete. 2023-12-07T09:59:33.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 Processor -- start 2023-12-07T09:59:33.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.167+0000 7fd42ec32640 1 -- start start 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 0x7fd4280c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42814eaf0 0x7fd4280bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4281ed5d0 0x7fd4281eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428154580 con 0x7fd4280c0370 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281f16f0 con 0x7fd42814eaf0 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280c5b20 con 0x7fd4281ed5d0 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 0x7fd4280c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 0x7fd4280c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34430/0 (socket says 172.21.15.89:34430) 2023-12-07T09:59:33.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 -- 172.21.15.89:0/342337113 learned_addr learned my addr 172.21.15.89:0/342337113 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42d1cf640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4281ed5d0 0x7fd4281eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd427fff640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42814eaf0 0x7fd4280bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 -- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4281ed5d0 msgr2=0x7fd4281eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4281ed5d0 0x7fd4281eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 -- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42814eaf0 msgr2=0x7fd4280bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42814eaf0 0x7fd4280bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 -- 172.21.15.89:0/342337113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140094d0 con 0x7fd4280c0370 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42d1cf640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4281ed5d0 0x7fd4281eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd427fff640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42814eaf0 0x7fd4280bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42c9ce640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 0x7fd4280c55e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00d800 tx=0x7fd41c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00b660 con 0x7fd4280c0370 2023-12-07T09:59:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00b7c0 con 0x7fd4280c0370 2023-12-07T09:59:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4281f0ae0 con 0x7fd4280c0370 2023-12-07T09:59:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00bb30 con 0x7fd4280c0370 2023-12-07T09:59:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4281f10a0 con 0x7fd4280c0370 2023-12-07T09:59:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42804e890 con 0x7fd4280c0370 2023-12-07T09:59:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.171+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd41c00bc90 con 0x7fd4280c0370 2023-12-07T09:59:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.175+0000 7fd4257fa640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd40c066900 0x7fd40c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.175+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd41c0849a0 con 0x7fd4280c0370 2023-12-07T09:59:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.175+0000 7fd427fff640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd40c066900 0x7fd40c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.175+0000 7fd427fff640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd40c066900 0x7fd40c068dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4140ae000 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.179+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd41c051bd0 con 0x7fd4280c0370 2023-12-07T09:59:33.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.327+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd428151050 con 0x7fd4280c0370 2023-12-07T09:59:33.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.327+0000 7fd4257fa640 1 -- 172.21.15.89:0/342337113 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd41c0551f0 con 0x7fd4280c0370 2023-12-07T09:59:33.334 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd40c066900 msgr2=0x7fd40c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd40c066900 0x7fd40c068dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4140ae000 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 msgr2=0x7fd4280c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 0x7fd4280c55e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00d800 tx=0x7fd41c00dcc0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 shutdown_connections 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd40c066900 0x7fd40c068dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4281ed5d0 0x7fd4281eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42814eaf0 0x7fd4280bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 --2- 172.21.15.89:0/342337113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4280c0370 0x7fd4280c55e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 >> 172.21.15.89:0/342337113 conn(0x7fd4280c2a60 msgr2=0x7fd4280711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 shutdown_connections 2023-12-07T09:59:33.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.331+0000 7fd42ec32640 1 -- 172.21.15.89:0/342337113 wait complete. 2023-12-07T09:59:33.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.487+0000 7f7dfa06b640 1 Processor -- start 2023-12-07T09:59:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.487+0000 7f7dfa06b640 1 -- start start 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7dfa06b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df414eaf0 0x7f7df4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7dfa06b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7df4151f90 0x7f7df406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7dfa06b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df406de00 con 0x7f7df40c0370 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7dfa06b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df4070390 con 0x7f7df4151f90 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7dfa06b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df414eed0 con 0x7f7df414eaf0 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7df4151f90 0x7f7df406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7df4151f90 0x7f7df406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34436/0 (socket says 172.21.15.89:34436) 2023-12-07T09:59:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 -- 172.21.15.89:0/2090068411 learned_addr learned my addr 172.21.15.89:0/2090068411 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df37fe640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df414eaf0 0x7f7df4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 -- 172.21.15.89:0/2090068411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df414eaf0 msgr2=0x7f7df4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df414eaf0 0x7f7df4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 -- 172.21.15.89:0/2090068411 >> v1:172.21.15.89:6789/0 conn(0x7f7df40c0370 legacy=0x7f7df406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df2ffd640 1 -- 172.21.15.89:0/2090068411 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4151270 con 0x7f7df4151f90 2023-12-07T09:59:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.491+0000 7f7df37fe640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df414eaf0 0x7f7df4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:33.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7df2ffd640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4151f90 0x7f7df406d110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009870 tx=0x7f7de801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75cc73d7ac8d98d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7df27fc640 1 -- 172.21.15.89:0/2090068411 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80ab5f0 con 0x7f7df4151f90 2023-12-07T09:59:33.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7df27fc640 1 -- 172.21.15.89:0/2090068411 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de80ab750 con 0x7f7df4151f90 2023-12-07T09:59:33.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7df27fc640 1 -- 172.21.15.89:0/2090068411 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80abae0 con 0x7f7df4151f90 2023-12-07T09:59:33.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 -- 172.21.15.89:0/2090068411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4151f90 msgr2=0x7f7df406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4151f90 0x7f7df406d110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009870 tx=0x7f7de801c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 -- 172.21.15.89:0/2090068411 shutdown_connections 2023-12-07T09:59:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4151f90 0x7f7df406d110 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/2090068411 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df414eaf0 0x7f7df4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 -- 172.21.15.89:0/2090068411 >> 172.21.15.89:0/2090068411 conn(0x7f7df40c2a60 msgr2=0x7f7df40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 -- 172.21.15.89:0/2090068411 shutdown_connections 2023-12-07T09:59:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 -- 172.21.15.89:0/2090068411 wait complete. 2023-12-07T09:59:33.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 Processor -- start 2023-12-07T09:59:33.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.495+0000 7f7dfa06b640 1 -- start start 2023-12-07T09:59:33.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7df40c0370 0x7f7df41eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 0x7f7df4141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df4142360 0x7f7df413d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df414a010 con 0x7f7df414eaf0 2023-12-07T09:59:33.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df414ad40 con 0x7f7df40c0370 2023-12-07T09:59:33.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4149850 con 0x7f7df4142360 2023-12-07T09:59:33.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 0x7f7df4141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 0x7f7df4141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34438/0 (socket says 172.21.15.89:34438) 2023-12-07T09:59:33.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 -- 172.21.15.89:0/1271536857 learned_addr learned my addr 172.21.15.89:0/1271536857 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:33.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df37fe640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7df40c0370 0x7f7df41eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df3fff640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df4142360 0x7f7df413d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 -- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df4142360 msgr2=0x7f7df413d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df4142360 0x7f7df413d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 -- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7df40c0370 msgr2=0x7f7df41eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7df40c0370 0x7f7df41eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 -- 172.21.15.89:0/1271536857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80094d0 con 0x7f7df414eaf0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df37fe640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7df40c0370 0x7f7df41eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df3fff640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df4142360 0x7f7df413d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7df2ffd640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 0x7f7df4141e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7de80ad040 tx=0x7f7de801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80b4800 con 0x7f7df414eaf0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de80b4980 con 0x7f7df414eaf0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df41ef660 con 0x7f7df414eaf0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80b4d30 con 0x7f7df414eaf0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df41ef940 con 0x7f7df414eaf0 2023-12-07T09:59:33.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df404e890 con 0x7f7df414eaf0 2023-12-07T09:59:33.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.499+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7de80c7440 con 0x7f7df414eaf0 2023-12-07T09:59:33.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.503+0000 7f7ddbfff640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7de0066900 0x7f7de0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.503+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7de80a8050 con 0x7f7df414eaf0 2023-12-07T09:59:33.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.503+0000 7f7df37fe640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7de0066900 0x7f7de0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.503+0000 7f7df37fe640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7de0066900 0x7f7de0068dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7de4008890 tx=0x7f7de4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.507+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7de80ec0a0 con 0x7f7df414eaf0 2023-12-07T09:59:33.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7df4149cc0 con 0x7f7df414eaf0 2023-12-07T09:59:33.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7ddbfff640 1 -- 172.21.15.89:0/1271536857 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7de80ab5b0 con 0x7f7df414eaf0 2023-12-07T09:59:33.660 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:33.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7de0066900 msgr2=0x7f7de0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7de0066900 0x7f7de0068dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7de4008890 tx=0x7f7de4008040 comp rx=0 tx=0).stop 2023-12-07T09:59:33.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 msgr2=0x7f7df4141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 0x7f7df4141e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7de80ad040 tx=0x7f7de801ac30 comp rx=0 tx=0).stop 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 shutdown_connections 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7de0066900 0x7f7de0068dc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7df4142360 0x7f7df413d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df414eaf0 0x7f7df4141e20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 --2- 172.21.15.89:0/1271536857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7df40c0370 0x7f7df41eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 >> 172.21.15.89:0/1271536857 conn(0x7f7df40c2a60 msgr2=0x7f7df4143c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 shutdown_connections 2023-12-07T09:59:33.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.655+0000 7f7dfa06b640 1 -- 172.21.15.89:0/1271536857 wait complete. 2023-12-07T09:59:33.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.815+0000 7f4135bb5640 1 Processor -- start 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.815+0000 7f4135bb5640 1 -- start start 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4135bb5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f41300c7ce0 0x7f41300c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4135bb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c4ca0 0x7f413006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4135bb5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4130151e90 con 0x7f4130151ab0 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4135bb5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41300c71a0 con 0x7f41300c7ce0 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4135bb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300c6900 con 0x7f41300c4ca0 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f41300c7ce0 0x7f41300c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f41300c7ce0 0x7f41300c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34452/0 (socket says 172.21.15.89:34452) 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 -- 172.21.15.89:0/342578627 learned_addr learned my addr 172.21.15.89:0/342578627 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:33.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f41353b4640 1 --2- 172.21.15.89:0/342578627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c4ca0 0x7f413006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 -- 172.21.15.89:0/342578627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c4ca0 msgr2=0x7f413006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 --2- 172.21.15.89:0/342578627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c4ca0 0x7f413006b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 -- 172.21.15.89:0/342578627 >> v1:172.21.15.97:6789/0 conn(0x7f4130151ab0 legacy=0x7f4130154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.819+0000 7f4127fff640 1 -- 172.21.15.89:0/342578627 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300c6be0 con 0x7f41300c7ce0 2023-12-07T09:59:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4127fff640 1 --2- 172.21.15.89:0/342578627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c7ce0 0x7f41300c4760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4120009870 tx=0x7f412001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf280db240991e5e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f41277fe640 1 -- 172.21.15.89:0/342578627 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200ad660 con 0x7f41300c7ce0 2023-12-07T09:59:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f41277fe640 1 -- 172.21.15.89:0/342578627 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41200ad7c0 con 0x7f41300c7ce0 2023-12-07T09:59:33.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f41277fe640 1 -- 172.21.15.89:0/342578627 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200adb50 con 0x7f41300c7ce0 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- 172.21.15.89:0/342578627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c7ce0 msgr2=0x7f41300c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 --2- 172.21.15.89:0/342578627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c7ce0 0x7f41300c4760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4120009870 tx=0x7f412001c470 comp rx=0 tx=0).stop 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- 172.21.15.89:0/342578627 shutdown_connections 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 --2- 172.21.15.89:0/342578627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c4ca0 0x7f413006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 --2- 172.21.15.89:0/342578627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c7ce0 0x7f41300c4760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- 172.21.15.89:0/342578627 >> 172.21.15.89:0/342578627 conn(0x7f41300abba0 msgr2=0x7f41300abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- 172.21.15.89:0/342578627 shutdown_connections 2023-12-07T09:59:33.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- 172.21.15.89:0/342578627 wait complete. 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 Processor -- start 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- start start 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 0x7f41301581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c7ce0 0x7f41301536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4130151ab0 0x7f41300bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300bfce0 con 0x7f41300c4ca0 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130158720 con 0x7f4130151ab0 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.823+0000 7f4135bb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413014bd50 con 0x7f41300c7ce0 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 0x7f41301581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 0x7f41301581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34458/0 (socket says 172.21.15.89:34458) 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 -- 172.21.15.89:0/2690781117 learned_addr learned my addr 172.21.15.89:0/2690781117 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:33.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4127fff640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c7ce0 0x7f41301536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f41353b4640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4130151ab0 0x7f41300bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 -- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c7ce0 msgr2=0x7f41301536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c7ce0 0x7f41301536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 -- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4130151ab0 msgr2=0x7f41300bdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4130151ab0 0x7f41300bdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 -- 172.21.15.89:0/2690781117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200094d0 con 0x7f41300c4ca0 2023-12-07T09:59:33.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4134bb3640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 0x7f41301581e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f412c00c530 tx=0x7f412c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c005220 con 0x7f41300c4ca0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c005380 con 0x7f41300c4ca0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c007270 con 0x7f41300c4ca0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41300aea80 con 0x7f41300c4ca0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41300af040 con 0x7f41300c4ca0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41300bd8f0 con 0x7f41300c4ca0 2023-12-07T09:59:33.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.827+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f412c0073d0 con 0x7f41300c4ca0 2023-12-07T09:59:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.831+0000 7f41257fa640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f411c066900 0x7f411c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.831+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f412c083af0 con 0x7f41300c4ca0 2023-12-07T09:59:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.831+0000 7f4127fff640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f411c066900 0x7f411c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:33.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.831+0000 7f4127fff640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f411c066900 0x7f411c068dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f41200af000 tx=0x7f4120008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:33.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.835+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f412c050e70 con 0x7f41300c4ca0 2023-12-07T09:59:33.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4130067a10 con 0x7f41300c4ca0 2023-12-07T09:59:33.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f41257fa640 1 -- 172.21.15.89:0/2690781117 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f412c054490 con 0x7f41300c4ca0 2023-12-07T09:59:33.989 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f411c066900 msgr2=0x7f411c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f411c066900 0x7f411c068dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f41200af000 tx=0x7f4120008040 comp rx=0 tx=0).stop 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 msgr2=0x7f41301581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 0x7f41301581e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f412c00c530 tx=0x7f412c00c9f0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 shutdown_connections 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4130151ab0 0x7f41300bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f411c066900 0x7f411c068dc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41300c7ce0 0x7f41301536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 --2- 172.21.15.89:0/2690781117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41300c4ca0 0x7f41301581e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:33.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 >> 172.21.15.89:0/2690781117 conn(0x7f41300abba0 msgr2=0x7f4130150450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:33.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 shutdown_connections 2023-12-07T09:59:33.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:33.983+0000 7f4135bb5640 1 -- 172.21.15.89:0/2690781117 wait complete. 2023-12-07T09:59:34.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 Processor -- start 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 -- start start 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbed40c4890 0x7fbed40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbed40bd5a0 0x7fbed40c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed406b7d0 con 0x7fbed40ca620 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed4155160 con 0x7fbed40bd5a0 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed8b3f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed406b180 con 0x7fbed40c4890 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbed40bd5a0 0x7fbed40c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbed40bd5a0 0x7fbed40c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34460/0 (socket says 172.21.15.89:34460) 2023-12-07T09:59:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 -- 172.21.15.89:0/643299219 learned_addr learned my addr 172.21.15.89:0/643299219 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed2ffd640 1 --2- 172.21.15.89:0/643299219 >> v2:172.21.15.97:3300/0 conn(0x7fbed40c4890 0x7fbed40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 -- 172.21.15.89:0/643299219 >> v2:172.21.15.97:3300/0 conn(0x7fbed40c4890 msgr2=0x7fbed40caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 --2- 172.21.15.89:0/643299219 >> v2:172.21.15.97:3300/0 conn(0x7fbed40c4890 0x7fbed40caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 -- 172.21.15.89:0/643299219 >> v1:172.21.15.97:6789/0 conn(0x7fbed40ca620 legacy=0x7fbed40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.143+0000 7fbed3fff640 1 -- 172.21.15.89:0/643299219 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed406b460 con 0x7fbed40bd5a0 2023-12-07T09:59:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed3fff640 1 --2- 172.21.15.89:0/643299219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c8620 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbed40c9380 tx=0x7fbecc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87efcdbb01d2a91 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed27fc640 1 -- 172.21.15.89:0/643299219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0a5790 con 0x7fbed40bd5a0 2023-12-07T09:59:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed27fc640 1 -- 172.21.15.89:0/643299219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc0a58f0 con 0x7fbed40bd5a0 2023-12-07T09:59:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed27fc640 1 -- 172.21.15.89:0/643299219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0a5c80 con 0x7fbed40bd5a0 2023-12-07T09:59:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 -- 172.21.15.89:0/643299219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 msgr2=0x7fbed40c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/643299219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c8620 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbed40c9380 tx=0x7fbecc01c940 comp rx=0 tx=0).stop 2023-12-07T09:59:34.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 -- 172.21.15.89:0/643299219 shutdown_connections 2023-12-07T09:59:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/643299219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c8620 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/643299219 >> v2:172.21.15.97:3300/0 conn(0x7fbed40c4890 0x7fbed40caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 -- 172.21.15.89:0/643299219 >> 172.21.15.89:0/643299219 conn(0x7fbed40ac0a0 msgr2=0x7fbed40c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 -- 172.21.15.89:0/643299219 shutdown_connections 2023-12-07T09:59:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 -- 172.21.15.89:0/643299219 wait complete. 2023-12-07T09:59:34.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 Processor -- start 2023-12-07T09:59:34.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.147+0000 7fbed8b3f640 1 -- start start 2023-12-07T09:59:34.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbed40c4890 0x7fbed414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbed40ca620 0x7fbed4157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed41585c0 con 0x7fbed40bd5a0 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed41edbc0 con 0x7fbed40c4890 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40c1480 con 0x7fbed40ca620 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34472/0 (socket says 172.21.15.89:34472) 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 -- 172.21.15.89:0/2498091326 learned_addr learned my addr 172.21.15.89:0/2498091326 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed2ffd640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbed40c4890 0x7fbed414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed3fff640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbed40ca620 0x7fbed4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 -- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbed40ca620 msgr2=0x7fbed4157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbed40ca620 0x7fbed4157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 -- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbed40c4890 msgr2=0x7fbed414cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbed40c4890 0x7fbed414cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 -- 172.21.15.89:0/2498091326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009b30 con 0x7fbed40bd5a0 2023-12-07T09:59:34.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed37fe640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c3a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c530 tx=0x7fbec400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4005220 con 0x7fbed40bd5a0 2023-12-07T09:59:34.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4005380 con 0x7fbed40bd5a0 2023-12-07T09:59:34.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed41ed660 con 0x7fbed40bd5a0 2023-12-07T09:59:34.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4007270 con 0x7fbed40bd5a0 2023-12-07T09:59:34.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed40c1110 con 0x7fbed40bd5a0 2023-12-07T09:59:34.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.151+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed404e890 con 0x7fbed40bd5a0 2023-12-07T09:59:34.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.155+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbec40073d0 con 0x7fbed40bd5a0 2023-12-07T09:59:34.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.155+0000 7fbebbfff640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbec0066900 0x7fbec0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.155+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbec4083b60 con 0x7fbed40bd5a0 2023-12-07T09:59:34.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.155+0000 7fbed2ffd640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbec0066900 0x7fbec0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.155+0000 7fbed2ffd640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbec0066900 0x7fbec0068dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbed40c8640 tx=0x7fbec8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.159+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbec4050ee0 con 0x7fbed40bd5a0 2023-12-07T09:59:34.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.307+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed40c98e0 con 0x7fbed40bd5a0 2023-12-07T09:59:34.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbebbfff640 1 -- 172.21.15.89:0/2498091326 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fbec4054500 con 0x7fbed40bd5a0 2023-12-07T09:59:34.315 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:34.316 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbec0066900 msgr2=0x7fbec0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbec0066900 0x7fbec0068dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbed40c8640 tx=0x7fbec8008040 comp rx=0 tx=0).stop 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 msgr2=0x7fbed40c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c3a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c530 tx=0x7fbec400c9f0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 shutdown_connections 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbec0066900 0x7fbec0068dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbed40ca620 0x7fbed4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbed40c4890 0x7fbed414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 --2- 172.21.15.89:0/2498091326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40bd5a0 0x7fbed40c3a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 >> 172.21.15.89:0/2498091326 conn(0x7fbed40ac0a0 msgr2=0x7fbed40aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 shutdown_connections 2023-12-07T09:59:34.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.311+0000 7fbed8b3f640 1 -- 172.21.15.89:0/2498091326 wait complete. 2023-12-07T09:59:34.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:34.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:34.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.471+0000 7fa8c073e640 1 Processor -- start 2023-12-07T09:59:34.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.471+0000 7fa8c073e640 1 -- start start 2023-12-07T09:59:34.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8c073e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8b814eaf0 0x7fa8b8151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8c073e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b806de00 con 0x7fa8b80c0370 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8c073e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b8070390 con 0x7fa8b8151f90 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8c073e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b814eed0 con 0x7fa8b814eaf0 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8be4da640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8b814eaf0 0x7fa8b8151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8becdb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa8b80c0370 0x7fa8b815bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41398/0 (socket says 172.21.15.89:41398) 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8be4da640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8b814eaf0 0x7fa8b8151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34484/0 (socket says 172.21.15.89:34484) 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8becdb640 1 -- 172.21.15.89:0/1867427540 learned_addr learned my addr 172.21.15.89:0/1867427540 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8be4da640 1 -- 172.21.15.89:0/1867427540 >> v1:172.21.15.97:6789/0 conn(0x7fa8b8151f90 legacy=0x7fa8b806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:34.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8be4da640 1 -- 172.21.15.89:0/1867427540 >> v1:172.21.15.89:6789/0 conn(0x7fa8b80c0370 legacy=0x7fa8b815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8bd4d8640 1 -- 172.21.15.89:0/1867427540 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892373651 0 0) 0x7fa8b806de00 con 0x7fa8b80c0370 2023-12-07T09:59:34.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8be4da640 1 -- 172.21.15.89:0/1867427540 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8151270 con 0x7fa8b814eaf0 2023-12-07T09:59:34.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.475+0000 7fa8be4da640 1 --2- 172.21.15.89:0/1867427540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b814eaf0 0x7fa8b8151a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40097c0 tx=0x7fa8b401c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dc78662357578f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8bd4d8640 1 -- 172.21.15.89:0/1867427540 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ab600 con 0x7fa8b814eaf0 2023-12-07T09:59:34.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8bd4d8640 1 -- 172.21.15.89:0/1867427540 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b40a7050 con 0x7fa8b814eaf0 2023-12-07T09:59:34.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8bd4d8640 1 -- 172.21.15.89:0/1867427540 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ab980 con 0x7fa8b814eaf0 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- 172.21.15.89:0/1867427540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b814eaf0 msgr2=0x7fa8b8151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 --2- 172.21.15.89:0/1867427540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b814eaf0 0x7fa8b8151a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40097c0 tx=0x7fa8b401c2f0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- 172.21.15.89:0/1867427540 shutdown_connections 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 --2- 172.21.15.89:0/1867427540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b814eaf0 0x7fa8b8151a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- 172.21.15.89:0/1867427540 >> 172.21.15.89:0/1867427540 conn(0x7fa8b80c2a60 msgr2=0x7fa8b80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- 172.21.15.89:0/1867427540 shutdown_connections 2023-12-07T09:59:34.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- 172.21.15.89:0/1867427540 wait complete. 2023-12-07T09:59:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 Processor -- start 2023-12-07T09:59:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- start start 2023-12-07T09:59:34.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 0x7fa8b80c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8b814eaf0 0x7fa8b813c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa8b8140e60 0x7fa8b813a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b813b3c0 con 0x7fa8b80c0370 2023-12-07T09:59:34.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80c51f0 con 0x7fa8b814eaf0 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8c073e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b814db60 con 0x7fa8b8140e60 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8be4da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 0x7fa8b80c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8be4da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 0x7fa8b80c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34486/0 (socket says 172.21.15.89:34486) 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.479+0000 7fa8be4da640 1 -- 172.21.15.89:0/2608567955 learned_addr learned my addr 172.21.15.89:0/2608567955 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8bdcd9640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8b814eaf0 0x7fa8b813c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8becdb640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa8b8140e60 0x7fa8b813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8be4da640 1 -- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa8b8140e60 msgr2=0x7fa8b813a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8be4da640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa8b8140e60 0x7fa8b813a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8be4da640 1 -- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8b814eaf0 msgr2=0x7fa8b813c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8be4da640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8b814eaf0 0x7fa8b813c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8be4da640 1 -- 172.21.15.89:0/2608567955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009420 con 0x7fa8b80c0370 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8be4da640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 0x7fa8b80c4560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4019f20 tx=0x7fa8b401ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4004020 con 0x7fa8b80c0370 2023-12-07T09:59:34.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b4004180 con 0x7fa8b80c0370 2023-12-07T09:59:34.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40044f0 con 0x7fa8b80c0370 2023-12-07T09:59:34.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b80c5440 con 0x7fa8b80c0370 2023-12-07T09:59:34.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b8140480 con 0x7fa8b80c0370 2023-12-07T09:59:34.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b814e370 con 0x7fa8b80c0370 2023-12-07T09:59:34.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.483+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa8b4003620 con 0x7fa8b80c0370 2023-12-07T09:59:34.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.487+0000 7fa8aeffd640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa89c0668d0 0x7fa89c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.487+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8b411e8e0 con 0x7fa8b80c0370 2023-12-07T09:59:34.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.487+0000 7fa8bdcd9640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa89c0668d0 0x7fa89c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.487+0000 7fa8bdcd9640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa89c0668d0 0x7fa89c068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8142cf0 tx=0x7fa8a8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.491+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8b40ebbc0 con 0x7fa8b80c0370 2023-12-07T09:59:34.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.639+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8b804e890 con 0x7fa8b80c0370 2023-12-07T09:59:34.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.639+0000 7fa8aeffd640 1 -- 172.21.15.89:0/2608567955 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8b40b00a0 con 0x7fa8b80c0370 2023-12-07T09:59:34.647 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:34.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa89c0668d0 msgr2=0x7fa89c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa89c0668d0 0x7fa89c068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8142cf0 tx=0x7fa8a8009060 comp rx=0 tx=0).stop 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 msgr2=0x7fa8b80c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 0x7fa8b80c4560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4019f20 tx=0x7fa8b401ab30 comp rx=0 tx=0).stop 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 shutdown_connections 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa89c0668d0 0x7fa89c068d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa8b8140e60 0x7fa8b813a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8b814eaf0 0x7fa8b813c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 --2- 172.21.15.89:0/2608567955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8b80c0370 0x7fa8b80c4560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 >> 172.21.15.89:0/2608567955 conn(0x7fa8b80c2a60 msgr2=0x7fa8b8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 shutdown_connections 2023-12-07T09:59:34.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.643+0000 7fa8c073e640 1 -- 172.21.15.89:0/2608567955 wait complete. 2023-12-07T09:59:34.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:34.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.799+0000 7f9678cbb640 1 Processor -- start 2023-12-07T09:59:34.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.799+0000 7f9678cbb640 1 -- start start 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9678cbb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f967414e590 0x7f9674154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9678cbb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96740c7d40 0x7f96740c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9678cbb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96740c4d00 0x7f967406b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9678cbb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96741554a0 con 0x7f967414e590 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9678cbb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967406b3d0 con 0x7f96740c4d00 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9678cbb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967414e970 con 0x7f96740c7d40 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f967414e590 0x7f9674154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f967414e590 0x7f9674154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34500/0 (socket says 172.21.15.89:34500) 2023-12-07T09:59:34.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 -- 172.21.15.89:0/2421854237 learned_addr learned my addr 172.21.15.89:0/2421854237 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9672ffd640 1 --2- 172.21.15.89:0/2421854237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96740c7d40 0x7f96740c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9673fff640 1 --2- 172.21.15.89:0/2421854237 >> v2:172.21.15.97:3300/0 conn(0x7f96740c4d00 0x7f967406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 -- 172.21.15.89:0/2421854237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96740c7d40 msgr2=0x7f96740c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 --2- 172.21.15.89:0/2421854237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96740c7d40 0x7f96740c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 -- 172.21.15.89:0/2421854237 >> v2:172.21.15.97:3300/0 conn(0x7f96740c4d00 msgr2=0x7f967406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 --2- 172.21.15.89:0/2421854237 >> v2:172.21.15.97:3300/0 conn(0x7f96740c4d00 0x7f967406b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f96737fe640 1 -- 172.21.15.89:0/2421854237 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740bd720 con 0x7f967414e590 2023-12-07T09:59:34.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.803+0000 7f9673fff640 1 --2- 172.21.15.89:0/2421854237 >> v2:172.21.15.97:3300/0 conn(0x7f96740c4d00 0x7f967406b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:34.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f96737fe640 1 --2- 172.21.15.89:0/2421854237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f967414e590 0x7f9674154f60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9664009870 tx=0x7f966401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97805ca7fa872782 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f96727fc640 1 -- 172.21.15.89:0/2421854237 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640a7070 con 0x7f967414e590 2023-12-07T09:59:34.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f96727fc640 1 -- 172.21.15.89:0/2421854237 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96640ab430 con 0x7f967414e590 2023-12-07T09:59:34.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f96727fc640 1 -- 172.21.15.89:0/2421854237 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640ab7c0 con 0x7f967414e590 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 -- 172.21.15.89:0/2421854237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f967414e590 msgr2=0x7f9674154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 --2- 172.21.15.89:0/2421854237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f967414e590 0x7f9674154f60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9664009870 tx=0x7f966401c470 comp rx=0 tx=0).stop 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 -- 172.21.15.89:0/2421854237 shutdown_connections 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 --2- 172.21.15.89:0/2421854237 >> v2:172.21.15.97:3300/0 conn(0x7f96740c4d00 0x7f967406b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 --2- 172.21.15.89:0/2421854237 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96740c7d40 0x7f96740c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 --2- 172.21.15.89:0/2421854237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f967414e590 0x7f9674154f60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 -- 172.21.15.89:0/2421854237 >> 172.21.15.89:0/2421854237 conn(0x7f96740abd70 msgr2=0x7f96740ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:34.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 -- 172.21.15.89:0/2421854237 shutdown_connections 2023-12-07T09:59:34.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 -- 172.21.15.89:0/2421854237 wait complete. 2023-12-07T09:59:34.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 Processor -- start 2023-12-07T09:59:34.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.807+0000 7f9678cbb640 1 -- start start 2023-12-07T09:59:34.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 0x7f96740c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96740c7d40 0x7f96740c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f967414e590 0x7f96741ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740af670 con 0x7f96740c4d00 2023-12-07T09:59:34.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740c0fb0 con 0x7f96740c7d40 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96741545e0 con 0x7f967414e590 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 0x7f96740c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 0x7f96740c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34504/0 (socket says 172.21.15.89:34504) 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 -- 172.21.15.89:0/1173773157 learned_addr learned my addr 172.21.15.89:0/1173773157 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9673fff640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f967414e590 0x7f96741ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9672ffd640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96740c7d40 0x7f96740c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 -- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f967414e590 msgr2=0x7f96741ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f967414e590 0x7f96741ed260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 -- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96740c7d40 msgr2=0x7f96740c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96740c7d40 0x7f96740c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 -- 172.21.15.89:0/1173773157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640094d0 con 0x7f96740c4d00 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f96737fe640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 0x7f96740c3ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f966401cd10 tx=0x7f9664019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640b4830 con 0x7f96740c4d00 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96640b49b0 con 0x7f96740c4d00 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640b4d60 con 0x7f96740c4d00 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96740af8c0 con 0x7f96740c4d00 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96740c1500 con 0x7f96740c4d00 2023-12-07T09:59:34.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.811+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9674074970 con 0x7f96740c4d00 2023-12-07T09:59:34.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.815+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f96640c0460 con 0x7f96740c4d00 2023-12-07T09:59:34.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.815+0000 7f965bfff640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96600668d0 0x7f9660068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:34.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.815+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f966411e990 con 0x7f96740c4d00 2023-12-07T09:59:34.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.815+0000 7f9672ffd640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96600668d0 0x7f9660068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:34.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.815+0000 7f9672ffd640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96600668d0 0x7f9660068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96741543a0 tx=0x7f9668008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:34.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.819+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96640ebb30 con 0x7f96740c4d00 2023-12-07T09:59:34.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.967+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f967414dcd0 con 0x7f96740c4d00 2023-12-07T09:59:34.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.967+0000 7f965bfff640 1 -- 172.21.15.89:0/1173773157 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96640ef150 con 0x7f96740c4d00 2023-12-07T09:59:34.975 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:34.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96600668d0 msgr2=0x7f9660068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96600668d0 0x7f9660068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96741543a0 tx=0x7f9668008040 comp rx=0 tx=0).stop 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 msgr2=0x7f96740c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 0x7f96740c3ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f966401cd10 tx=0x7f9664019210 comp rx=0 tx=0).stop 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 shutdown_connections 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96600668d0 0x7f9660068d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f967414e590 0x7f96741ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96740c7d40 0x7f96740c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 --2- 172.21.15.89:0/1173773157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96740c4d00 0x7f96740c3ae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:34.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 >> 172.21.15.89:0/1173773157 conn(0x7f96740abd70 msgr2=0x7f9674154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 shutdown_connections 2023-12-07T09:59:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:34.971+0000 7f9678cbb640 1 -- 172.21.15.89:0/1173773157 wait complete. 2023-12-07T09:59:34.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:35.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 Processor -- start 2023-12-07T09:59:35.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 -- start start 2023-12-07T09:59:35.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8ec156600 0x7fd8ec14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd8ec14fb30 0x7fd8ec0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec152d90 con 0x7fd8ec0a86d0 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec14ffa0 con 0x7fd8ec156600 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f34ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec152480 con 0x7fd8ec14fb30 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8ec156600 0x7fd8ec14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8ec156600 0x7fd8ec14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34514/0 (socket says 172.21.15.89:34514) 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f1249640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd8ec0a86d0 0x7fd8ec0a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41414/0 (socket says 172.21.15.89:41414) 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 -- 172.21.15.89:0/570266621 learned_addr learned my addr 172.21.15.89:0/570266621 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f1a4a640 1 --2- 172.21.15.89:0/570266621 >> v2:172.21.15.97:3300/0 conn(0x7fd8ec14fb30 0x7fd8ec0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 -- 172.21.15.89:0/570266621 >> v2:172.21.15.97:3300/0 conn(0x7fd8ec14fb30 msgr2=0x7fd8ec0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 --2- 172.21.15.89:0/570266621 >> v2:172.21.15.97:3300/0 conn(0x7fd8ec14fb30 0x7fd8ec0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 -- 172.21.15.89:0/570266621 >> v1:172.21.15.89:6789/0 conn(0x7fd8ec0a86d0 legacy=0x7fd8ec0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f0a48640 1 -- 172.21.15.89:0/570266621 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec0a9760 con 0x7fd8ec156600 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8f1a4a640 1 --2- 172.21.15.89:0/570266621 >> v2:172.21.15.97:3300/0 conn(0x7fd8ec14fb30 0x7fd8ec0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:35.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.131+0000 7fd8e3fff640 1 -- 172.21.15.89:0/570266621 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030038753 0 0) 0x7fd8ec152d90 con 0x7fd8ec0a86d0 2023-12-07T09:59:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f0a48640 1 --2- 172.21.15.89:0/570266621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14f5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009870 tx=0x7fd8dc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7cb4c08c8d2d34 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8e3fff640 1 -- 172.21.15.89:0/570266621 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0ab5f0 con 0x7fd8ec156600 2023-12-07T09:59:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8e3fff640 1 -- 172.21.15.89:0/570266621 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0ab750 con 0x7fd8ec156600 2023-12-07T09:59:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8e3fff640 1 -- 172.21.15.89:0/570266621 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0abae0 con 0x7fd8ec156600 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 -- 172.21.15.89:0/570266621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 msgr2=0x7fd8ec14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/570266621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14f5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009870 tx=0x7fd8dc01c500 comp rx=0 tx=0).stop 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 -- 172.21.15.89:0/570266621 shutdown_connections 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/570266621 >> v2:172.21.15.97:3300/0 conn(0x7fd8ec14fb30 0x7fd8ec0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/570266621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14f5f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 -- 172.21.15.89:0/570266621 >> 172.21.15.89:0/570266621 conn(0x7fd8ec0c2a60 msgr2=0x7fd8ec0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 -- 172.21.15.89:0/570266621 shutdown_connections 2023-12-07T09:59:35.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.135+0000 7fd8f34ad640 1 -- 172.21.15.89:0/570266621 wait complete. 2023-12-07T09:59:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 Processor -- start 2023-12-07T09:59:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 -- start start 2023-12-07T09:59:35.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8ec0a86d0 0x7fd8ec148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8ec14fb30 0x7fd8ec1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0709e0 con 0x7fd8ec156600 2023-12-07T09:59:35.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec072030 con 0x7fd8ec0a86d0 2023-12-07T09:59:35.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec1f1140 con 0x7fd8ec14fb30 2023-12-07T09:59:35.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34530/0 (socket says 172.21.15.89:34530) 2023-12-07T09:59:35.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 -- 172.21.15.89:0/3406165389 learned_addr learned my addr 172.21.15.89:0/3406165389 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:35.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1249640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8ec0a86d0 0x7fd8ec148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f0a48640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8ec14fb30 0x7fd8ec1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 -- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8ec14fb30 msgr2=0x7fd8ec1f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8ec14fb30 0x7fd8ec1f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 -- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8ec0a86d0 msgr2=0x7fd8ec148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8ec0a86d0 0x7fd8ec148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 -- 172.21.15.89:0/3406165389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0094d0 con 0x7fd8ec156600 2023-12-07T09:59:35.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f1a4a640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14c770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009fa0 tx=0x7fd8e400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4003ba0 con 0x7fd8ec156600 2023-12-07T09:59:35.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e400f040 con 0x7fd8ec156600 2023-12-07T09:59:35.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4004030 con 0x7fd8ec156600 2023-12-07T09:59:35.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ec1533a0 con 0x7fd8ec156600 2023-12-07T09:59:35.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.139+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec070c30 con 0x7fd8ec156600 2023-12-07T09:59:35.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.143+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec153200 con 0x7fd8ec156600 2023-12-07T09:59:35.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.143+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8e4004190 con 0x7fd8ec156600 2023-12-07T09:59:35.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.143+0000 7fd8e1ffb640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8d0066900 0x7fd8d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.143+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8e4084860 con 0x7fd8ec156600 2023-12-07T09:59:35.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.143+0000 7fd8f1249640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8d0066900 0x7fd8d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.143+0000 7fd8f1249640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8d0066900 0x7fd8d0068dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8000f70 tx=0x7fd8e8007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.147+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8ec153200 con 0x7fd8ec156600 2023-12-07T09:59:35.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.295+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8ec153200 con 0x7fd8ec156600 2023-12-07T09:59:35.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.295+0000 7fd8e1ffb640 1 -- 172.21.15.89:0/3406165389 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8e401a020 con 0x7fd8ec156600 2023-12-07T09:59:35.303 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:35.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8d0066900 msgr2=0x7fd8d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8d0066900 0x7fd8d0068dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8000f70 tx=0x7fd8e8007b60 comp rx=0 tx=0).stop 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 msgr2=0x7fd8ec14c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14c770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009fa0 tx=0x7fd8e400d560 comp rx=0 tx=0).stop 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 shutdown_connections 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8ec156600 0x7fd8ec14c770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8d0066900 0x7fd8d0068dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8ec14fb30 0x7fd8ec1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 --2- 172.21.15.89:0/3406165389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8ec0a86d0 0x7fd8ec148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 >> 172.21.15.89:0/3406165389 conn(0x7fd8ec0c2a60 msgr2=0x7fd8ec14eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 shutdown_connections 2023-12-07T09:59:35.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.299+0000 7fd8f34ad640 1 -- 172.21.15.89:0/3406165389 wait complete. 2023-12-07T09:59:35.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:35.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.455+0000 7fcbcf1d1640 1 Processor -- start 2023-12-07T09:59:35.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.455+0000 7fcbcf1d1640 1 -- start start 2023-12-07T09:59:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.455+0000 7fcbcf1d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbc8155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcf1d1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc806c440 con 0x7fcbc80bf400 2023-12-07T09:59:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcf1d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc8154790 con 0x7fcbc806bd00 2023-12-07T09:59:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcf1d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc806c6e0 con 0x7fcbc814ea60 2023-12-07T09:59:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcbc80bf400 0x7fcbc80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41418/0 (socket says 172.21.15.89:41418) 2023-12-07T09:59:35.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 -- 172.21.15.89:0/3675054677 learned_addr learned my addr 172.21.15.89:0/3675054677 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:35.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbc8155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651546607 0 0) 0x7fcbc806c440 con 0x7fcbc80bf400 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb0003530 con 0x7fcbc80bf400 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182289000 0 0) 0x7fcbc8154790 con 0x7fcbc806bd00 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc806c440 con 0x7fcbc806bd00 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804622847 0 0) 0x7fcbb0003530 con 0x7fcbc80bf400 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 msgr2=0x7fcbc8155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbc8155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 >> v1:172.21.15.97:6789/0 conn(0x7fcbc806bd00 legacy=0x7fcbc80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8154a50 con 0x7fcbc80bf400 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fcbc0001a00 con 0x7fcbc80bf400 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbc8155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 >> v1:172.21.15.89:6789/0 conn(0x7fcbc80bf400 legacy=0x7fcbc80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbb0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbb00040d0 0x7fcbb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb0004d10 0x7fcbb0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc806c6e0 con 0x7fcbb0004d10 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb000bbd0 con 0x7fcbb00040d0 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb000bd90 con 0x7fcbc814ea60 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb0004d10 0x7fcbb0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbb0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbbffff640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbb00040d0 0x7fcbb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 -- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 msgr2=0x7fcbb0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbc814ea60 0x7fcbb0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 -- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbb00040d0 msgr2=0x7fcbb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbb00040d0 0x7fcbb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.459+0000 7fcbcd76e640 1 -- 172.21.15.89:0/3675054677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009420 con 0x7fcbb0004d10 2023-12-07T09:59:35.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb0004d10 0x7fcbb0005190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000a710 tx=0x7fcbc001d1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b19c7ffc708d35 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ad630 con 0x7fcbb0004d10 2023-12-07T09:59:35.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc00a8070 con 0x7fcbb0004d10 2023-12-07T09:59:35.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbbf7fe640 1 -- 172.21.15.89:0/3675054677 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ada50 con 0x7fcbb0004d10 2023-12-07T09:59:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/3675054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb0004d10 msgr2=0x7fcbb0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/3675054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbb0004d10 0x7fcbb0005190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000a710 tx=0x7fcbc001d1d0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcd76e640 1 -- 172.21.15.89:0/3675054677 reap_dead start 2023-12-07T09:59:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/3675054677 shutdown_connections 2023-12-07T09:59:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/3675054677 >> 172.21.15.89:0/3675054677 conn(0x7fcbc80c2ad0 msgr2=0x7fcbc80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/3675054677 shutdown_connections 2023-12-07T09:59:35.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/3675054677 wait complete. 2023-12-07T09:59:35.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 Processor -- start 2023-12-07T09:59:35.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.463+0000 7fcbcf1d1640 1 -- start start 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbb0004d10 0x7fcbc80c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbc81ed2c0 0x7fcbc81ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 0x7fcbc81efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81ece30 con 0x7fcbc81ef620 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81ee2a0 con 0x7fcbc81ed2c0 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80c1800 con 0x7fcbb0004d10 2023-12-07T09:59:35.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 0x7fcbc81efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 0x7fcbc81efaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34536/0 (socket says 172.21.15.89:34536) 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 -- 172.21.15.89:0/4025653982 learned_addr learned my addr 172.21.15.89:0/4025653982 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbbffff640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbc81ed2c0 0x7fcbc81ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbb0004d10 0x7fcbc80c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 -- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbb0004d10 msgr2=0x7fcbc80c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbb0004d10 0x7fcbc80c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 -- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbc81ed2c0 msgr2=0x7fcbc81ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbc81ed2c0 0x7fcbc81ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 -- 172.21.15.89:0/4025653982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8148be0 con 0x7fcbc81ef620 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbbffff640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbc81ed2c0 0x7fcbc81ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbb0004d10 0x7fcbc80c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:35.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcd76e640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 0x7fcbc81efaa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcbc001cc40 tx=0x7fcbb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0001210 con 0x7fcbc81ef620 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc00ada30 con 0x7fcbc81ef620 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc8148ec0 con 0x7fcbc81ef620 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0001a00 con 0x7fcbc81ef620 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc80c0f00 con 0x7fcbc81ef620 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc81ecfe0 con 0x7fcbc81ef620 2023-12-07T09:59:35.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.467+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcbc00aa030 con 0x7fcbc81ef620 2023-12-07T09:59:35.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.471+0000 7fcbbd7fa640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcbb4066900 0x7fcbb4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.471+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbc011e9a0 con 0x7fcbc81ef620 2023-12-07T09:59:35.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.471+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcbb4066900 0x7fcbb4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.471+0000 7fcbccf6d640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcbb4066900 0x7fcbb4068dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009d70 tx=0x7fcbc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.475+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbc81ecfe0 con 0x7fcbc81ef620 2023-12-07T09:59:35.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.623+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbc81ecfe0 con 0x7fcbc81ef620 2023-12-07T09:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbbd7fa640 1 -- 172.21.15.89:0/4025653982 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fcbc81ecfe0 con 0x7fcbc81ef620 2023-12-07T09:59:35.631 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:35.631 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcbb4066900 msgr2=0x7fcbb4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcbb4066900 0x7fcbb4068dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009d70 tx=0x7fcbc4008040 comp rx=0 tx=0).stop 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 msgr2=0x7fcbc81efaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 0x7fcbc81efaa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcbc001cc40 tx=0x7fcbb0005800 comp rx=0 tx=0).stop 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 shutdown_connections 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbc81ef620 0x7fcbc81efaa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbc81ed2c0 0x7fcbc81ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcbb4066900 0x7fcbb4068dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 --2- 172.21.15.89:0/4025653982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbb0004d10 0x7fcbc80c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 >> 172.21.15.89:0/4025653982 conn(0x7fcbc80c2ad0 msgr2=0x7fcbc80c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 shutdown_connections 2023-12-07T09:59:35.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.627+0000 7fcbcf1d1640 1 -- 172.21.15.89:0/4025653982 wait complete. 2023-12-07T09:59:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:35.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:35.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 Processor -- start 2023-12-07T09:59:35.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 -- start start 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 0x7f2708158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f27080c7d60 0x7f27080c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2708151fc0 con 0x7f27080c4d20 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708154640 con 0x7f27080c7d60 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270f232640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080c6910 con 0x7f2708151be0 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270ea31640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f27080c4d20 0x7f2708154ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41432/0 (socket says 172.21.15.89:41432) 2023-12-07T09:59:35.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270ea31640 1 -- 172.21.15.89:0/3289797338 learned_addr learned my addr 172.21.15.89:0/3289797338 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568602223 0 0) 0x7f27000014a0 con 0x7f27080c4d20 2023-12-07T09:59:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270e230640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 0x7f2708158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f4003530 con 0x7f27080c4d20 2023-12-07T09:59:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270da2f640 1 --2- 172.21.15.89:0/3289797338 >> v2:172.21.15.97:3300/0 conn(0x7f27080c7d60 0x7f27080c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209401553 0 0) 0x7f26f4003530 con 0x7f27080c4d20 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 msgr2=0x7f2708158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 0x7f2708158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 >> v2:172.21.15.97:3300/0 conn(0x7f27080c7d60 msgr2=0x7f27080c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 --2- 172.21.15.89:0/3289797338 >> v2:172.21.15.97:3300/0 conn(0x7f27080c7d60 0x7f27080c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080c77e0 con 0x7f27080c4d20 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f2700001b90 con 0x7f27080c4d20 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.787+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 >> v1:172.21.15.89:6789/0 conn(0x7f27080c4d20 legacy=0x7f2708154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26f4003980 0x7f26f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26f40047d0 0x7f26f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 0x7f26f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708154640 con 0x7f26f40047d0 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080c6910 con 0x7f26f4003980 2023-12-07T09:59:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f400b9e0 con 0x7f2708151be0 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26f40047d0 0x7f26f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270e230640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26f4003980 0x7f26f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270ea31640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 0x7f26f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 -- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 msgr2=0x7f26f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2708151be0 0x7f26f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 -- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26f4003980 msgr2=0x7f26f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26f4003980 0x7f26f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 -- 172.21.15.89:0/3289797338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4003530 con 0x7f26f40047d0 2023-12-07T09:59:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270da2f640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26f40047d0 0x7f26f4004c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009ae0 tx=0x7f26f801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9510e10abc7032 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80a6440 con 0x7f26f40047d0 2023-12-07T09:59:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f80a65a0 con 0x7f26f40047d0 2023-12-07T09:59:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.791+0000 7f270d22e640 1 -- 172.21.15.89:0/3289797338 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80a6910 con 0x7f26f40047d0 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- 172.21.15.89:0/3289797338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26f40047d0 msgr2=0x7f26f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 --2- 172.21.15.89:0/3289797338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26f40047d0 0x7f26f4004c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009ae0 tx=0x7f26f801ca50 comp rx=0 tx=0).stop 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270ea31640 1 -- 172.21.15.89:0/3289797338 reap_dead start 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- 172.21.15.89:0/3289797338 shutdown_connections 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- 172.21.15.89:0/3289797338 >> 172.21.15.89:0/3289797338 conn(0x7f27080aba30 msgr2=0x7f27080abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- 172.21.15.89:0/3289797338 shutdown_connections 2023-12-07T09:59:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- 172.21.15.89:0/3289797338 wait complete. 2023-12-07T09:59:35.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 Processor -- start 2023-12-07T09:59:35.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- start start 2023-12-07T09:59:35.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26f40047d0 0x7f270814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27080c3070 0x7f270814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 0x7f27081f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081ef0b0 con 0x7f27081f0bb0 2023-12-07T09:59:35.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080c3850 con 0x7f27080c3070 2023-12-07T09:59:35.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270f232640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270814b8e0 con 0x7f26f40047d0 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270ea31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 0x7f27081f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270ea31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 0x7f27081f1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34562/0 (socket says 172.21.15.89:34562) 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270ea31640 1 -- 172.21.15.89:0/2580787435 learned_addr learned my addr 172.21.15.89:0/2580787435 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270e230640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26f40047d0 0x7f270814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.795+0000 7f270da2f640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27080c3070 0x7f270814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270ea31640 1 -- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26f40047d0 msgr2=0x7f270814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270ea31640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26f40047d0 0x7f270814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270ea31640 1 -- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27080c3070 msgr2=0x7f270814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270ea31640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27080c3070 0x7f270814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270ea31640 1 -- 172.21.15.89:0/2580787435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708158ab0 con 0x7f27081f0bb0 2023-12-07T09:59:35.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270ea31640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 0x7f27081f1040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f270808b960 tx=0x7f270000ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700007740 con 0x7f27081f0bb0 2023-12-07T09:59:35.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000078e0 con 0x7f27081f0bb0 2023-12-07T09:59:35.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000133f0 con 0x7f27081f0bb0 2023-12-07T09:59:35.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27080c3570 con 0x7f27081f0bb0 2023-12-07T09:59:35.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27081eecd0 con 0x7f27081f0bb0 2023-12-07T09:59:35.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27081ee850 con 0x7f27081f0bb0 2023-12-07T09:59:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2700013550 con 0x7f27081f0bb0 2023-12-07T09:59:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.799+0000 7f26feffd640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26ec066900 0x7f26ec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.803+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2700084b30 con 0x7f27081f0bb0 2023-12-07T09:59:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.803+0000 7f270e230640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26ec066900 0x7f26ec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.803+0000 7f270e230640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26ec066900 0x7f26ec068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2704009a80 tx=0x7f2704009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:35.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.803+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27081ee850 con 0x7f27081f0bb0 2023-12-07T09:59:35.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.959+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27081ef1f0 con 0x7f27081f0bb0 2023-12-07T09:59:35.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.959+0000 7f26feffd640 1 -- 172.21.15.89:0/2580787435 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27081ef1f0 con 0x7f27081f0bb0 2023-12-07T09:59:35.966 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:35.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26ec066900 msgr2=0x7f26ec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26ec066900 0x7f26ec068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2704009a80 tx=0x7f2704009190 comp rx=0 tx=0).stop 2023-12-07T09:59:35.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 msgr2=0x7f27081f1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:35.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 0x7f27081f1040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f270808b960 tx=0x7f270000ad70 comp rx=0 tx=0).stop 2023-12-07T09:59:35.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 shutdown_connections 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27081f0bb0 0x7f27081f1040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27080c3070 0x7f270814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26ec066900 0x7f26ec068dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 --2- 172.21.15.89:0/2580787435 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f26f40047d0 0x7f270814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 >> 172.21.15.89:0/2580787435 conn(0x7f27080aba30 msgr2=0x7f2708154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 shutdown_connections 2023-12-07T09:59:35.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:35.963+0000 7f270f232640 1 -- 172.21.15.89:0/2580787435 wait complete. 2023-12-07T09:59:35.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:36.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.119+0000 7f9d0a69c640 1 Processor -- start 2023-12-07T09:59:36.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.119+0000 7f9d0a69c640 1 -- start start 2023-12-07T09:59:36.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d0a69c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 0x7f9d041543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d0a69c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9d0406df30 0x7f9d040716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d0a69c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d04154920 con 0x7f9d040700f0 2023-12-07T09:59:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d0a69c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040a8710 con 0x7f9d0406df30 2023-12-07T09:59:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d0a69c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04071be0 con 0x7f9d04154000 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 0x7f9d041543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d08c39640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9d0406df30 0x7f9d040716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 0x7f9d041543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:49514/0 (socket says 172.21.15.89:49514) 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d03fff640 1 -- 172.21.15.89:0/73094228 learned_addr learned my addr 172.21.15.89:0/73094228 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d02ffd640 1 -- 172.21.15.89:0/73094228 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125411777 0 0) 0x7f9d04154920 con 0x7f9d040700f0 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d08c39640 1 -- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 msgr2=0x7f9d041543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d08c39640 1 --2- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 0x7f9d041543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d08c39640 1 -- 172.21.15.89:0/73094228 >> v1:172.21.15.97:6789/0 conn(0x7f9d040700f0 legacy=0x7f9d04070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d08c39640 1 -- 172.21.15.89:0/73094228 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d04154b90 con 0x7f9d0406df30 2023-12-07T09:59:36.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.123+0000 7f9d03fff640 1 --2- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 0x7f9d041543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d08c39640 1 --2- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0406df30 0x7f9d040716a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d90 tx=0x7f9cfc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=110dff6497bc93b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d02ffd640 1 -- 172.21.15.89:0/73094228 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0a5870 con 0x7f9d0406df30 2023-12-07T09:59:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d02ffd640 1 -- 172.21.15.89:0/73094228 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0a59d0 con 0x7f9d0406df30 2023-12-07T09:59:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d02ffd640 1 -- 172.21.15.89:0/73094228 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0a5d60 con 0x7f9d0406df30 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 -- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0406df30 msgr2=0x7f9d040716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0406df30 0x7f9d040716a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d90 tx=0x7f9cfc01c830 comp rx=0 tx=0).stop 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 -- 172.21.15.89:0/73094228 shutdown_connections 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d0406df30 0x7f9d040716a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/73094228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d04154000 0x7f9d041543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 -- 172.21.15.89:0/73094228 >> 172.21.15.89:0/73094228 conn(0x7f9d040c2a60 msgr2=0x7f9d040c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 -- 172.21.15.89:0/73094228 shutdown_connections 2023-12-07T09:59:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 -- 172.21.15.89:0/73094228 wait complete. 2023-12-07T09:59:36.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 Processor -- start 2023-12-07T09:59:36.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.127+0000 7f9d0a69c640 1 -- start start 2023-12-07T09:59:36.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 0x7f9d04149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d040700f0 0x7f9d040c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d04154000 0x7f9d041485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d041f1470 con 0x7f9d0406df30 2023-12-07T09:59:36.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c4090 con 0x7f9d04154000 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04149ae0 con 0x7f9d040700f0 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 0x7f9d04149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 0x7f9d04149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34572/0 (socket says 172.21.15.89:34572) 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 -- 172.21.15.89:0/2405316360 learned_addr learned my addr 172.21.15.89:0/2405316360 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d037fe640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d040700f0 0x7f9d040c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d08c39640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d04154000 0x7f9d041485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 -- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d040700f0 msgr2=0x7f9d040c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d040700f0 0x7f9d040c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 -- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d04154000 msgr2=0x7f9d041485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d04154000 0x7f9d041485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 -- 172.21.15.89:0/2405316360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf400a670 con 0x7f9d0406df30 2023-12-07T09:59:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d03fff640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 0x7f9d04149f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e860 tx=0x7f9cf400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400cc40 con 0x7f9d0406df30 2023-12-07T09:59:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400cda0 con 0x7f9d0406df30 2023-12-07T09:59:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4004230 con 0x7f9d0406df30 2023-12-07T09:59:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc009a70 con 0x7f9d0406df30 2023-12-07T09:59:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0414eff0 con 0x7f9d0406df30 2023-12-07T09:59:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0404e890 con 0x7f9d0406df30 2023-12-07T09:59:36.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.131+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9cf4004390 con 0x7f9d0406df30 2023-12-07T09:59:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.135+0000 7f9d00ff9640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cf0066900 0x7f9cf0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.135+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cf4084160 con 0x7f9d0406df30 2023-12-07T09:59:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.135+0000 7f9d037fe640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cf0066900 0x7f9cf0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.135+0000 7f9d037fe640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cf0066900 0x7f9cf0068dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d041ee0b0 tx=0x7f9cf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.139+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cf4051470 con 0x7f9d0406df30 2023-12-07T09:59:36.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d04153de0 con 0x7f9d0406df30 2023-12-07T09:59:36.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d00ff9640 1 -- 172.21.15.89:0/2405316360 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cf4054a90 con 0x7f9d0406df30 2023-12-07T09:59:36.293 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:36.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cf0066900 msgr2=0x7f9cf0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cf0066900 0x7f9cf0068dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d041ee0b0 tx=0x7f9cf8009040 comp rx=0 tx=0).stop 2023-12-07T09:59:36.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 msgr2=0x7f9d04149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 0x7f9d04149f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e860 tx=0x7f9cf400ed20 comp rx=0 tx=0).stop 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 shutdown_connections 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d04154000 0x7f9d041485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cf0066900 0x7f9cf0068dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9d040700f0 0x7f9d040c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 --2- 172.21.15.89:0/2405316360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d0406df30 0x7f9d04149f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.287+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 >> 172.21.15.89:0/2405316360 conn(0x7f9d040c2a60 msgr2=0x7f9d04070560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.291+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 shutdown_connections 2023-12-07T09:59:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.291+0000 7f9d0a69c640 1 -- 172.21.15.89:0/2405316360 wait complete. 2023-12-07T09:59:36.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:36.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 Processor -- start 2023-12-07T09:59:36.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 -- start start 2023-12-07T09:59:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f3814e590 0x7f7f38154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f380c7d40 0x7f7f380c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3806b3d0 con 0x7f7f380c4d00 2023-12-07T09:59:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f381554a0 con 0x7f7f3814e590 2023-12-07T09:59:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.451+0000 7f7f3cdb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3814e970 con 0x7f7f380c7d40 2023-12-07T09:59:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f3814e590 0x7f7f38154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f3814e590 0x7f7f38154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34586/0 (socket says 172.21.15.89:34586) 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 -- 172.21.15.89:0/436338569 learned_addr learned my addr 172.21.15.89:0/436338569 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f36ffd640 1 --2- 172.21.15.89:0/436338569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f380c7d40 0x7f7f380c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 -- 172.21.15.89:0/436338569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f380c7d40 msgr2=0x7f7f380c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 --2- 172.21.15.89:0/436338569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f380c7d40 0x7f7f380c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 -- 172.21.15.89:0/436338569 >> v1:172.21.15.97:6789/0 conn(0x7f7f380c4d00 legacy=0x7f7f3806b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 -- 172.21.15.89:0/436338569 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380bd720 con 0x7f7f3814e590 2023-12-07T09:59:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f377fe640 1 --2- 172.21.15.89:0/436338569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f3814e590 0x7f7f38154f60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f280098a0 tx=0x7f7f2801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b527b163ad4239eb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f367fc640 1 -- 172.21.15.89:0/436338569 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280ac600 con 0x7f7f3814e590 2023-12-07T09:59:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.455+0000 7f7f367fc640 1 -- 172.21.15.89:0/436338569 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f280a8050 con 0x7f7f3814e590 2023-12-07T09:59:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f367fc640 1 -- 172.21.15.89:0/436338569 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280ac980 con 0x7f7f3814e590 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/436338569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f3814e590 msgr2=0x7f7f38154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/436338569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f3814e590 0x7f7f38154f60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f280098a0 tx=0x7f7f2801c490 comp rx=0 tx=0).stop 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/436338569 shutdown_connections 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/436338569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f380c7d40 0x7f7f380c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/436338569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f3814e590 0x7f7f38154f60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/436338569 >> 172.21.15.89:0/436338569 conn(0x7f7f380abd70 msgr2=0x7f7f380ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/436338569 shutdown_connections 2023-12-07T09:59:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/436338569 wait complete. 2023-12-07T09:59:36.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 Processor -- start 2023-12-07T09:59:36.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- start start 2023-12-07T09:59:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f380c4d00 0x7f7f38157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 0x7f7f38156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f3814e590 0x7f7f38156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38157200 con 0x7f7f380c7d40 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f381431b0 con 0x7f7f380c4d00 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f3cdb5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f381562f0 con 0x7f7f3814e590 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 0x7f7f38156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 0x7f7f38156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34598/0 (socket says 172.21.15.89:34598) 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f36ffd640 1 -- 172.21.15.89:0/1124782911 learned_addr learned my addr 172.21.15.89:0/1124782911 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.459+0000 7f7f377fe640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f380c4d00 0x7f7f38157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f37fff640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f3814e590 0x7f7f38156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f36ffd640 1 -- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f3814e590 msgr2=0x7f7f38156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f36ffd640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f3814e590 0x7f7f38156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f36ffd640 1 -- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f380c4d00 msgr2=0x7f7f38157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f36ffd640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f380c4d00 0x7f7f38157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f36ffd640 1 -- 172.21.15.89:0/1124782911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280094d0 con 0x7f7f380c7d40 2023-12-07T09:59:36.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f36ffd640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 0x7f7f38156780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00e900 tx=0x7f7f2c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c009690 con 0x7f7f380c7d40 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00c9a0 con 0x7f7f380c7d40 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f381edf70 con 0x7f7f380c7d40 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00cd30 con 0x7f7f380c7d40 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f38155ca0 con 0x7f7f380c7d40 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f38074970 con 0x7f7f380c7d40 2023-12-07T09:59:36.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7f2c013470 con 0x7f7f380c7d40 2023-12-07T09:59:36.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f1ffff640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f240668d0 0x7f7f24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c0845b0 con 0x7f7f380c7d40 2023-12-07T09:59:36.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.463+0000 7f7f377fe640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f240668d0 0x7f7f24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.467+0000 7f7f377fe640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f240668d0 0x7f7f24068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f280ae000 tx=0x7f7f280a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.467+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f2c051890 con 0x7f7f380c7d40 2023-12-07T09:59:36.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.619+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f3806c9c0 con 0x7f7f380c7d40 2023-12-07T09:59:36.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.619+0000 7f7f1ffff640 1 -- 172.21.15.89:0/1124782911 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f2c082e60 con 0x7f7f380c7d40 2023-12-07T09:59:36.626 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:36.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f240668d0 msgr2=0x7f7f24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f240668d0 0x7f7f24068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f280ae000 tx=0x7f7f280a7000 comp rx=0 tx=0).stop 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 msgr2=0x7f7f38156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 0x7f7f38156780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00e900 tx=0x7f7f2c00edc0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 shutdown_connections 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7f240668d0 0x7f7f24068d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7f3814e590 0x7f7f38156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f380c7d40 0x7f7f38156780 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 --2- 172.21.15.89:0/1124782911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f380c4d00 0x7f7f38157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 >> 172.21.15.89:0/1124782911 conn(0x7f7f380abd70 msgr2=0x7f7f38154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 shutdown_connections 2023-12-07T09:59:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.623+0000 7f7f3cdb5640 1 -- 172.21.15.89:0/1124782911 wait complete. 2023-12-07T09:59:36.682 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-07T09:59:36.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:36.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff3958d640 1 Processor -- start 2023-12-07T09:59:36.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff3958d640 1 -- start start 2023-12-07T09:59:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff3958d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff340c77c0 0x7eff34151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff3958d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340c5b40 con 0x7eff3406c0a0 2023-12-07T09:59:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff3958d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff34158880 con 0x7eff34152060 2023-12-07T09:59:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff3958d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3406cb90 con 0x7eff340c77c0 2023-12-07T09:59:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff32ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7eff3406c0a0 0x7eff3406c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41440/0 (socket says 172.21.15.89:41440) 2023-12-07T09:59:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff32ffd640 1 -- 172.21.15.89:0/3643458033 learned_addr learned my addr 172.21.15.89:0/3643458033 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff2bfff640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff340c77c0 0x7eff34151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687674369 0 0) 0x7eff340c5b40 con 0x7eff3406c0a0 2023-12-07T09:59:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff20003530 con 0x7eff3406c0a0 2023-12-07T09:59:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4131612902 0 0) 0x7eff20003530 con 0x7eff3406c0a0 2023-12-07T09:59:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff340c77c0 msgr2=0x7eff34151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff340c77c0 0x7eff34151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 >> v1:172.21.15.97:6789/0 conn(0x7eff34152060 legacy=0x7eff340c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340c5de0 con 0x7eff3406c0a0 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7eff24001680 con 0x7eff3406c0a0 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 >> v1:172.21.15.89:6789/0 conn(0x7eff3406c0a0 legacy=0x7eff3406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff200039b0 0x7eff20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff200047d0 0x7eff20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff20005190 0x7eff2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3406cb90 con 0x7eff20005190 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2000c090 con 0x7eff200047d0 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2000c250 con 0x7eff200039b0 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.815+0000 7eff2bfff640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff340c77c0 0x7eff34151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff20005190 0x7eff2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff32ffd640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff200039b0 0x7eff20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 -- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff200039b0 msgr2=0x7eff20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff2bfff640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff200047d0 0x7eff20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff200039b0 0x7eff20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 -- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff200047d0 msgr2=0x7eff20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff200047d0 0x7eff20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 -- 172.21.15.89:0/3643458033 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20003530 con 0x7eff20005190 2023-12-07T09:59:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff2bfff640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff200047d0 0x7eff20004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:36.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff337fe640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff20005190 0x7eff2000b990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff2c001e70 tx=0x7eff2c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a045743d5e918238 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c003b80 con 0x7eff20005190 2023-12-07T09:59:36.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c003ce0 con 0x7eff20005190 2023-12-07T09:59:36.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.819+0000 7eff327fc640 1 -- 172.21.15.89:0/3643458033 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c005310 con 0x7eff20005190 2023-12-07T09:59:36.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- 172.21.15.89:0/3643458033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff20005190 msgr2=0x7eff2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 --2- 172.21.15.89:0/3643458033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff20005190 0x7eff2000b990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff2c001e70 tx=0x7eff2c01c700 comp rx=0 tx=0).stop 2023-12-07T09:59:36.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff337fe640 1 -- 172.21.15.89:0/3643458033 reap_dead start 2023-12-07T09:59:36.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- 172.21.15.89:0/3643458033 shutdown_connections 2023-12-07T09:59:36.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- 172.21.15.89:0/3643458033 >> 172.21.15.89:0/3643458033 conn(0x7eff340abcb0 msgr2=0x7eff340ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- 172.21.15.89:0/3643458033 shutdown_connections 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- 172.21.15.89:0/3643458033 wait complete. 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 Processor -- start 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- start start 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 0x7eff3414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff34152fe0 0x7eff34153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff341ecfe0 0x7eff341ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff341dd9f0 con 0x7eff34156ad0 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3414c580 con 0x7eff34152fe0 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff3958d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff341ddc00 con 0x7eff341ecfe0 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 0x7eff3414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 0x7eff3414c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34612/0 (socket says 172.21.15.89:34612) 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 -- 172.21.15.89:0/2948481709 learned_addr learned my addr 172.21.15.89:0/2948481709 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:36.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff2bfff640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff34152fe0 0x7eff34153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff337fe640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff341ecfe0 0x7eff341ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 -- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff341ecfe0 msgr2=0x7eff341ed460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff341ecfe0 0x7eff341ed460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 -- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff34152fe0 msgr2=0x7eff34153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff34152fe0 0x7eff34153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff32ffd640 1 -- 172.21.15.89:0/2948481709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff341ddee0 con 0x7eff34156ad0 2023-12-07T09:59:36.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.823+0000 7eff337fe640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff341ecfe0 0x7eff341ed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:36.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff32ffd640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 0x7eff3414c860 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7eff24001060 tx=0x7eff2400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24011e40 con 0x7eff34156ad0 2023-12-07T09:59:36.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2400fe60 con 0x7eff34156ad0 2023-12-07T09:59:36.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff34157990 con 0x7eff34156ad0 2023-12-07T09:59:36.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24015650 con 0x7eff34156ad0 2023-12-07T09:59:36.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff34157eb0 con 0x7eff34156ad0 2023-12-07T09:59:36.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff34157bd0 con 0x7eff34156ad0 2023-12-07T09:59:36.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff240157b0 con 0x7eff34156ad0 2023-12-07T09:59:36.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2b7fe640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff14066900 0x7eff14068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:36.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff24087940 con 0x7eff34156ad0 2023-12-07T09:59:36.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.827+0000 7eff2bfff640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff14066900 0x7eff14068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:36.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.831+0000 7eff2bfff640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff14066900 0x7eff14068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff340c8db0 tx=0x7eff1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:36.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.831+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff34157bd0 con 0x7eff34156ad0 2023-12-07T09:59:36.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.983+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff3404e890 con 0x7eff34156ad0 2023-12-07T09:59:36.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.983+0000 7eff2b7fe640 1 -- 172.21.15.89:0/2948481709 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7eff24058610 con 0x7eff34156ad0 2023-12-07T09:59:36.990 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:36.990 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff14066900 msgr2=0x7eff14068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff14066900 0x7eff14068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff340c8db0 tx=0x7eff1c008040 comp rx=0 tx=0).stop 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 msgr2=0x7eff3414c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 0x7eff3414c860 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7eff24001060 tx=0x7eff2400f540 comp rx=0 tx=0).stop 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 shutdown_connections 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff14066900 0x7eff14068dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff341ecfe0 0x7eff341ed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff34152fe0 0x7eff34153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 --2- 172.21.15.89:0/2948481709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff34156ad0 0x7eff3414c860 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:36.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 >> 172.21.15.89:0/2948481709 conn(0x7eff340abcb0 msgr2=0x7eff3406c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:36.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 shutdown_connections 2023-12-07T09:59:36.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:36.987+0000 7eff3958d640 1 -- 172.21.15.89:0/2948481709 wait complete. 2023-12-07T09:59:37.011 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:37.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:37.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.143+0000 7f1373a5a640 1 Processor -- start 2023-12-07T09:59:37.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.143+0000 7f1373a5a640 1 -- start start 2023-12-07T09:59:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1373a5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 0x7f136c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1373a5a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c157d20 con 0x7f136c06c5c0 2023-12-07T09:59:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1373a5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c06deb0 con 0x7f136c0c1bd0 2023-12-07T09:59:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1373a5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c06e100 con 0x7f136c0c24a0 2023-12-07T09:59:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1370ff5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f136c06c5c0 0x7f136c1581b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41446/0 (socket says 172.21.15.89:41446) 2023-12-07T09:59:37.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1370ff5640 1 -- 172.21.15.89:0/3254612056 learned_addr learned my addr 172.21.15.89:0/3254612056 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:37.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1371ff7640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 0x7f136c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86329601 0 0) 0x7f136c157d20 con 0x7f136c06c5c0 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1358003530 con 0x7f136c06c5c0 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037116496 0 0) 0x7f136c06deb0 con 0x7f136c0c1bd0 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f136c157d20 con 0x7f136c0c1bd0 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3230712314 0 0) 0x7f1358003530 con 0x7f136c06c5c0 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 msgr2=0x7f136c1588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 0x7f136c1588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 >> v1:172.21.15.97:6789/0 conn(0x7f136c0c1bd0 legacy=0x7f136c151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0700f0 con 0x7f136c06c5c0 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f135c001680 con 0x7f136c06c5c0 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 >> v1:172.21.15.89:6789/0 conn(0x7f136c06c5c0 legacy=0x7f136c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1358003b40 0x7f1358003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13580047d0 0x7f1358004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 0x7f1358005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c06e100 con 0x7f1358003b40 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135800bb50 con 0x7f13580047d0 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135800bd10 con 0x7f136c0c24a0 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f13717f6640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1358003b40 0x7f1358003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1370ff5640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13580047d0 0x7f1358004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f1371ff7640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 0x7f1358005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f13717f6640 1 -- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 msgr2=0x7f1358005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f13717f6640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c0c24a0 0x7f1358005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f13717f6640 1 -- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13580047d0 msgr2=0x7f1358004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f13717f6640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13580047d0 0x7f1358004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.147+0000 7f13717f6640 1 -- 172.21.15.89:0/3254612056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358003530 con 0x7f1358003b40 2023-12-07T09:59:37.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f13717f6640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1358003b40 0x7f1358003f40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f13680018d0 tx=0x7f136801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241eb00324f11237 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680052d0 con 0x7f1358003b40 2023-12-07T09:59:37.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368005450 con 0x7f1358003b40 2023-12-07T09:59:37.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1363fff640 1 -- 172.21.15.89:0/3254612056 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368003840 con 0x7f1358003b40 2023-12-07T09:59:37.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1373a5a640 1 -- 172.21.15.89:0/3254612056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1358003b40 msgr2=0x7f1358003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1373a5a640 1 --2- 172.21.15.89:0/3254612056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1358003b40 0x7f1358003f40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f13680018d0 tx=0x7f136801c560 comp rx=0 tx=0).stop 2023-12-07T09:59:37.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1371ff7640 1 -- 172.21.15.89:0/3254612056 reap_dead start 2023-12-07T09:59:37.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1373a5a640 1 -- 172.21.15.89:0/3254612056 shutdown_connections 2023-12-07T09:59:37.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1373a5a640 1 -- 172.21.15.89:0/3254612056 >> 172.21.15.89:0/3254612056 conn(0x7f136c0c2a60 msgr2=0x7f136c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:37.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1373a5a640 1 -- 172.21.15.89:0/3254612056 shutdown_connections 2023-12-07T09:59:37.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.151+0000 7f1373a5a640 1 -- 172.21.15.89:0/3254612056 wait complete. 2023-12-07T09:59:37.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 Processor -- start 2023-12-07T09:59:37.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- start start 2023-12-07T09:59:37.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358003b40 0x7f136c0a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c157610 0x7f136c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 0x7f136c1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14ca10 con 0x7f136c148370 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c148d30 con 0x7f1358003b40 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0aaad0 con 0x7f136c157610 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 0x7f136c1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 0x7f136c1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34630/0 (socket says 172.21.15.89:34630) 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 -- 172.21.15.89:0/1893543457 learned_addr learned my addr 172.21.15.89:0/1893543457 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f13717f6640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358003b40 0x7f136c0a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1370ff5640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c157610 0x7f136c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 -- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c157610 msgr2=0x7f136c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c157610 0x7f136c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 -- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358003b40 msgr2=0x7f136c0a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358003b40 0x7f136c0a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 -- 172.21.15.89:0/1893543457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0a9d30 con 0x7f136c148370 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1371ff7640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 0x7f136c1487f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f136c0c2950 tx=0x7f136400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400e040 con 0x7f136c148370 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136400f040 con 0x7f136c148370 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364003bc0 con 0x7f136c148370 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c14a650 con 0x7f136c148370 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c0a9ff0 con 0x7f136c148370 2023-12-07T09:59:37.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.155+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c04e890 con 0x7f136c148370 2023-12-07T09:59:37.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.159+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1364003d20 con 0x7f136c148370 2023-12-07T09:59:37.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.159+0000 7f1361ffb640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1350066900 0x7f1350068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.159+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1364084ce0 con 0x7f136c148370 2023-12-07T09:59:37.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.159+0000 7f13717f6640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1350066900 0x7f1350068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.159+0000 7f13717f6640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1350066900 0x7f1350068dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13680ad000 tx=0x7f13680a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.163+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1364051fc0 con 0x7f136c148370 2023-12-07T09:59:37.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.319+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f136c071270 con 0x7f136c148370 2023-12-07T09:59:37.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.319+0000 7f1361ffb640 1 -- 172.21.15.89:0/1893543457 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13640555e0 con 0x7f136c148370 2023-12-07T09:59:37.327 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1350066900 msgr2=0x7f1350068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1350066900 0x7f1350068dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13680ad000 tx=0x7f13680a7070 comp rx=0 tx=0).stop 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 msgr2=0x7f136c1487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 0x7f136c1487f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f136c0c2950 tx=0x7f136400f580 comp rx=0 tx=0).stop 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 shutdown_connections 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f136c148370 0x7f136c1487f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1350066900 0x7f1350068dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f136c157610 0x7f136c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 --2- 172.21.15.89:0/1893543457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358003b40 0x7f136c0a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 >> 172.21.15.89:0/1893543457 conn(0x7f136c0c2a60 msgr2=0x7f136c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 shutdown_connections 2023-12-07T09:59:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.323+0000 7f1373a5a640 1 -- 172.21.15.89:0/1893543457 wait complete. 2023-12-07T09:59:37.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:37.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 Processor -- start 2023-12-07T09:59:37.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 -- start start 2023-12-07T09:59:37.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13300a86d0 0x7f13300a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1330156600 0x7f133014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1330152d90 con 0x7f133014fb30 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133014ffa0 con 0x7f1330156600 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f133710e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1330152480 con 0x7f13300a86d0 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f132ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1330156600 0x7f133014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f13356ab640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f133014fb30 0x7f13300aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41462/0 (socket says 172.21.15.89:41462) 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f13356ab640 1 -- 172.21.15.89:0/4109253297 learned_addr learned my addr 172.21.15.89:0/4109253297 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f1334eaa640 1 --2- 172.21.15.89:0/4109253297 >> v2:172.21.15.97:3300/0 conn(0x7f13300a86d0 0x7f13300a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f132ffff640 1 -- 172.21.15.89:0/4109253297 >> v2:172.21.15.97:3300/0 conn(0x7f13300a86d0 msgr2=0x7f13300a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f132ffff640 1 --2- 172.21.15.89:0/4109253297 >> v2:172.21.15.97:3300/0 conn(0x7f13300a86d0 0x7f13300a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f132ffff640 1 -- 172.21.15.89:0/4109253297 >> v1:172.21.15.89:6789/0 conn(0x7f133014fb30 legacy=0x7f13300aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f132ffff640 1 -- 172.21.15.89:0/4109253297 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300a9760 con 0x7f1330156600 2023-12-07T09:59:37.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.483+0000 7f132f7fe640 1 -- 172.21.15.89:0/4109253297 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182523355 0 0) 0x7f1330152d90 con 0x7f133014fb30 2023-12-07T09:59:37.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f132ffff640 1 --2- 172.21.15.89:0/4109253297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1330156600 0x7f133014f5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f131c0097c0 tx=0x7f131c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de186538aee3096 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f132f7fe640 1 -- 172.21.15.89:0/4109253297 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0ab600 con 0x7f1330156600 2023-12-07T09:59:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f132f7fe640 1 -- 172.21.15.89:0/4109253297 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c0a7050 con 0x7f1330156600 2023-12-07T09:59:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f132f7fe640 1 -- 172.21.15.89:0/4109253297 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0ab980 con 0x7f1330156600 2023-12-07T09:59:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 -- 172.21.15.89:0/4109253297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1330156600 msgr2=0x7f133014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 --2- 172.21.15.89:0/4109253297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1330156600 0x7f133014f5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f131c0097c0 tx=0x7f131c01c440 comp rx=0 tx=0).stop 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 -- 172.21.15.89:0/4109253297 shutdown_connections 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 --2- 172.21.15.89:0/4109253297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1330156600 0x7f133014f5f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 --2- 172.21.15.89:0/4109253297 >> v2:172.21.15.97:3300/0 conn(0x7f13300a86d0 0x7f13300a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 -- 172.21.15.89:0/4109253297 >> 172.21.15.89:0/4109253297 conn(0x7f13300c2a60 msgr2=0x7f13300c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 -- 172.21.15.89:0/4109253297 shutdown_connections 2023-12-07T09:59:37.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.487+0000 7f133710e640 1 -- 172.21.15.89:0/4109253297 wait complete. 2023-12-07T09:59:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 Processor -- start 2023-12-07T09:59:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 -- start start 2023-12-07T09:59:37.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 0x7f1330146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133014fb30 0x7f1330149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1330156600 0x7f133014a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133014ba20 con 0x7f13300a86d0 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330149a00 con 0x7f1330156600 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1330147510 con 0x7f133014fb30 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 0x7f1330146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 0x7f1330146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34658/0 (socket says 172.21.15.89:34658) 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 -- 172.21.15.89:0/3125890365 learned_addr learned my addr 172.21.15.89:0/3125890365 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f132ffff640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133014fb30 0x7f1330149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f13356ab640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1330156600 0x7f133014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 -- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133014fb30 msgr2=0x7f1330149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133014fb30 0x7f1330149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 -- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1330156600 msgr2=0x7f133014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1330156600 0x7f133014a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 -- 172.21.15.89:0/3125890365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009420 con 0x7f13300a86d0 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f13356ab640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1330156600 0x7f133014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f1334eaa640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 0x7f1330146a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f132400d5f0 tx=0x7f132400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240125f0 con 0x7f13300a86d0 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324012750 con 0x7f13300a86d0 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13301edf70 con 0x7f13300a86d0 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324012ae0 con 0x7f13300a86d0 2023-12-07T09:59:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.491+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1330146f70 con 0x7f13300a86d0 2023-12-07T09:59:37.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.495+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13301eddd0 con 0x7f13300a86d0 2023-12-07T09:59:37.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.495+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1324012c40 con 0x7f13300a86d0 2023-12-07T09:59:37.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.495+0000 7f132d7fa640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f13140668d0 0x7f1314068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.495+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13240848f0 con 0x7f13300a86d0 2023-12-07T09:59:37.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.495+0000 7f132ffff640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f13140668d0 0x7f1314068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.495+0000 7f132ffff640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f13140668d0 0x7f1314068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f131c0ad000 tx=0x7f131c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.499+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13301eddd0 con 0x7f13300a86d0 2023-12-07T09:59:37.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13301eddd0 con 0x7f13300a86d0 2023-12-07T09:59:37.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f132d7fa640 1 -- 172.21.15.89:0/3125890365 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13301eddd0 con 0x7f13300a86d0 2023-12-07T09:59:37.657 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:37.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f13140668d0 msgr2=0x7f1314068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f13140668d0 0x7f1314068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f131c0ad000 tx=0x7f131c0a6000 comp rx=0 tx=0).stop 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 msgr2=0x7f1330146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 0x7f1330146a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f132400d5f0 tx=0x7f132400dab0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 shutdown_connections 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1330156600 0x7f133014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f13140668d0 0x7f1314068d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f133014fb30 0x7f1330149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 --2- 172.21.15.89:0/3125890365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13300a86d0 0x7f1330146a30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 >> 172.21.15.89:0/3125890365 conn(0x7f13300c2a60 msgr2=0x7f133006d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 shutdown_connections 2023-12-07T09:59:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.651+0000 7f133710e640 1 -- 172.21.15.89:0/3125890365 wait complete. 2023-12-07T09:59:37.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:37.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 Processor -- start 2023-12-07T09:59:37.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 -- start start 2023-12-07T09:59:37.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16980c8430 0x7f169806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169806cf70 con 0x7f16980c7f20 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1698152160 con 0x7f16980c8430 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169fed6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980c6a30 con 0x7f1698151d80 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169d471640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16980c8430 0x7f169806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169e473640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f16980c7f20 0x7f169806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41474/0 (socket says 172.21.15.89:41474) 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169e473640 1 -- 172.21.15.89:0/1858789940 learned_addr learned my addr 172.21.15.89:0/1858789940 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169dc72640 1 --2- 172.21.15.89:0/1858789940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169d471640 1 -- 172.21.15.89:0/1858789940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 msgr2=0x7f16980c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169d471640 1 --2- 172.21.15.89:0/1858789940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169d471640 1 -- 172.21.15.89:0/1858789940 >> v1:172.21.15.89:6789/0 conn(0x7f16980c7f20 legacy=0x7f169806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.811+0000 7f169d471640 1 -- 172.21.15.89:0/1858789940 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980c72d0 con 0x7f16980c8430 2023-12-07T09:59:37.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.815+0000 7f169d471640 1 --2- 172.21.15.89:0/1858789940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c8430 0x7f169806b720 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16880097c0 tx=0x7f168801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d23697b4b659af server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.815+0000 7f169cc70640 1 -- 172.21.15.89:0/1858789940 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880ac620 con 0x7f16980c8430 2023-12-07T09:59:37.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.815+0000 7f169cc70640 1 -- 172.21.15.89:0/1858789940 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880ac780 con 0x7f16980c8430 2023-12-07T09:59:37.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.815+0000 7f169cc70640 1 -- 172.21.15.89:0/1858789940 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880acb10 con 0x7f16980c8430 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- 172.21.15.89:0/1858789940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c8430 msgr2=0x7f169806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 --2- 172.21.15.89:0/1858789940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c8430 0x7f169806b720 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16880097c0 tx=0x7f168801c3c0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- 172.21.15.89:0/1858789940 shutdown_connections 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 --2- 172.21.15.89:0/1858789940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c8430 0x7f169806b720 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 --2- 172.21.15.89:0/1858789940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- 172.21.15.89:0/1858789940 >> 172.21.15.89:0/1858789940 conn(0x7f16980abd00 msgr2=0x7f16980ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- 172.21.15.89:0/1858789940 shutdown_connections 2023-12-07T09:59:37.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- 172.21.15.89:0/1858789940 wait complete. 2023-12-07T09:59:37.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 Processor -- start 2023-12-07T09:59:37.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- start start 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 0x7f16981ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16980c8430 0x7f169814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16981edec0 con 0x7f16980c7f20 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16980c37d0 con 0x7f16980c8430 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169fed6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169815ede0 con 0x7f1698151d80 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 0x7f16981ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 0x7f16981ed980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34672/0 (socket says 172.21.15.89:34672) 2023-12-07T09:59:37.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 -- 172.21.15.89:0/2089403995 learned_addr learned my addr 172.21.15.89:0/2089403995 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169d471640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16980c8430 0x7f169814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169e473640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 -- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 msgr2=0x7f16980c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 -- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16980c8430 msgr2=0x7f169814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16980c8430 0x7f169814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169dc72640 1 -- 172.21.15.89:0/2089403995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688009420 con 0x7f16980c7f20 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.819+0000 7f169e473640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f169dc72640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 0x7f16981ed980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f169400e930 tx=0x7f169400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694009690 con 0x7f16980c7f20 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400ca00 con 0x7f16980c7f20 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1698158780 con 0x7f16980c7f20 2023-12-07T09:59:37.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400cd70 con 0x7f16980c7f20 2023-12-07T09:59:37.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16980c3180 con 0x7f16980c7f20 2023-12-07T09:59:37.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169804e890 con 0x7f16980c7f20 2023-12-07T09:59:37.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1694013470 con 0x7f16980c7f20 2023-12-07T09:59:37.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f168e7fc640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f167c0668d0 0x7f167c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:37.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1694084550 con 0x7f16980c7f20 2023-12-07T09:59:37.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.823+0000 7f169d471640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f167c0668d0 0x7f167c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:37.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.827+0000 7f169d471640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f167c0668d0 0x7f167c068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f16880ae000 tx=0x7f1688008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:37.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.827+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1694051990 con 0x7f16980c7f20 2023-12-07T09:59:37.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.975+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f169806cb20 con 0x7f16980c7f20 2023-12-07T09:59:37.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f168e7fc640 1 -- 172.21.15.89:0/2089403995 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1694054fb0 con 0x7f16980c7f20 2023-12-07T09:59:37.984 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:37.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f167c0668d0 msgr2=0x7f167c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f167c0668d0 0x7f167c068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f16880ae000 tx=0x7f1688008040 comp rx=0 tx=0).stop 2023-12-07T09:59:37.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 msgr2=0x7f16981ed980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:37.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 0x7f16981ed980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f169400e930 tx=0x7f169400edf0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 shutdown_connections 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f167c0668d0 0x7f167c068d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1698151d80 0x7f16980c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16980c8430 0x7f169814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 --2- 172.21.15.89:0/2089403995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16980c7f20 0x7f16981ed980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 >> 172.21.15.89:0/2089403995 conn(0x7f16980abd00 msgr2=0x7f1698154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 shutdown_connections 2023-12-07T09:59:37.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:37.979+0000 7f169fed6640 1 -- 172.21.15.89:0/2089403995 wait complete. 2023-12-07T09:59:38.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-07T09:59:38.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 Processor -- start 2023-12-07T09:59:38.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 -- start start 2023-12-07T09:59:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40aacd0 0x7ff9e4154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff9e40700a0 0x7ff9e41546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e4072780 con 0x7ff9e40ab7a0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e40ac160 con 0x7ff9e40700a0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9eb0ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40abe80 con 0x7ff9e40aacd0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9e9687640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff9e40ab7a0 0x7ff9e406c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41480/0 (socket says 172.21.15.89:41480) 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9e9687640 1 -- 172.21.15.89:0/1410888919 learned_addr learned my addr 172.21.15.89:0/1410888919 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9e8e86640 1 --2- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40aacd0 0x7ff9e4154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.135+0000 7ff9dbfff640 1 --2- 172.21.15.89:0/1410888919 >> v2:172.21.15.97:3300/0 conn(0x7ff9e40700a0 0x7ff9e41546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9db7fe640 1 -- 172.21.15.89:0/1410888919 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661920558 0 0) 0x7ff9e4072780 con 0x7ff9e40ab7a0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9db7fe640 1 -- 172.21.15.89:0/1410888919 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9cc003530 con 0x7ff9e40ab7a0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9dbfff640 1 -- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40aacd0 msgr2=0x7ff9e4154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9db7fe640 1 -- 172.21.15.89:0/1410888919 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697510628 0 0) 0x7ff9cc003530 con 0x7ff9e40ab7a0 2023-12-07T09:59:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9dbfff640 1 --2- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40aacd0 0x7ff9e4154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9dbfff640 1 -- 172.21.15.89:0/1410888919 >> v1:172.21.15.89:6789/0 conn(0x7ff9e40ab7a0 legacy=0x7ff9e406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9dbfff640 1 -- 172.21.15.89:0/1410888919 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4154cf0 con 0x7ff9e40700a0 2023-12-07T09:59:38.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9dbfff640 1 --2- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e41546a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40097c0 tx=0x7ff9d401c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5cc578abe2378 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:38.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9db7fe640 1 -- 172.21.15.89:0/1410888919 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc001a00 con 0x7ff9e40700a0 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9db7fe640 1 -- 172.21.15.89:0/1410888919 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40a7050 con 0x7ff9e40700a0 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.139+0000 7ff9db7fe640 1 -- 172.21.15.89:0/1410888919 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40ab620 con 0x7ff9e40700a0 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 msgr2=0x7ff9e41546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e41546a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40097c0 tx=0x7ff9d401c2e0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/1410888919 shutdown_connections 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e41546a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/1410888919 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40aacd0 0x7ff9e4154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/1410888919 >> 172.21.15.89:0/1410888919 conn(0x7ff9e40c2ad0 msgr2=0x7ff9e40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/1410888919 shutdown_connections 2023-12-07T09:59:38.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/1410888919 wait complete. 2023-12-07T09:59:38.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 Processor -- start 2023-12-07T09:59:38.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- start start 2023-12-07T09:59:38.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e4145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 0x7ff9e41ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40ab7a0 0x7ff9e41eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e4144e40 con 0x7ff9e40aacd0 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41453c0 con 0x7ff9e40700a0 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9eb0ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41473c0 con 0x7ff9e40ab7a0 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 0x7ff9e41ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 0x7ff9e41ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34680/0 (socket says 172.21.15.89:34680) 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 -- 172.21.15.89:0/954278452 learned_addr learned my addr 172.21.15.89:0/954278452 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9e9687640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40ab7a0 0x7ff9e41eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9e8e86640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e4145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 -- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40ab7a0 msgr2=0x7ff9e41eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40ab7a0 0x7ff9e41eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 -- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 msgr2=0x7ff9e4145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e4145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 -- 172.21.15.89:0/954278452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4009420 con 0x7ff9e40aacd0 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9e9687640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40ab7a0 0x7ff9e41eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.143+0000 7ff9dbfff640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 0x7ff9e41ee6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40ae040 tx=0x7ff9d4019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40b4430 con 0x7ff9e40aacd0 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40b45b0 con 0x7ff9e40aacd0 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40b4960 con 0x7ff9e40aacd0 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e4151a20 con 0x7ff9e40aacd0 2023-12-07T09:59:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e4147ac0 con 0x7ff9e40aacd0 2023-12-07T09:59:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e4145570 con 0x7ff9e40aacd0 2023-12-07T09:59:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff9d40b2040 con 0x7ff9e40aacd0 2023-12-07T09:59:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9d97fa640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9d00668d0 0x7ff9d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9d411e300 con 0x7ff9e40aacd0 2023-12-07T09:59:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.147+0000 7ff9e8e86640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9d00668d0 0x7ff9d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.151+0000 7ff9e8e86640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9d00668d0 0x7ff9d0068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40c3200 tx=0x7ff9e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:38.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.151+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9e4145570 con 0x7ff9e40aacd0 2023-12-07T09:59:38.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.363+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7ff9e4145570 con 0x7ff9e40aacd0 2023-12-07T09:59:38.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9d97fa640 1 -- 172.21.15.89:0/954278452 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v50) v1 ==== 162+0+0 (secure 0 0 0) 0x7ff9e4145570 con 0x7ff9e40aacd0 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9d00668d0 msgr2=0x7ff9d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9d00668d0 0x7ff9d0068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40c3200 tx=0x7ff9e0008040 comp rx=0 tx=0).stop 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 msgr2=0x7ff9e41ee6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 0x7ff9e41ee6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40ae040 tx=0x7ff9d4019080 comp rx=0 tx=0).stop 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 shutdown_connections 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9d00668d0 0x7ff9d0068d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9e40ab7a0 0x7ff9e41eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9e40aacd0 0x7ff9e41ee6a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 --2- 172.21.15.89:0/954278452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9e40700a0 0x7ff9e4145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 >> 172.21.15.89:0/954278452 conn(0x7ff9e40c2ad0 msgr2=0x7ff9e41542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:38.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 shutdown_connections 2023-12-07T09:59:38.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.823+0000 7ff9eb0ea640 1 -- 172.21.15.89:0/954278452 wait complete. 2023-12-07T09:59:38.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-07T09:59:38.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.983+0000 7fb148432640 1 Processor -- start 2023-12-07T09:59:38.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb148432640 1 -- start start 2023-12-07T09:59:38.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb148432640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb140151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb148432640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb140151f90 0x7fb14006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:38.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb148432640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14006de00 con 0x7fb1400c0370 2023-12-07T09:59:38.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb148432640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb140070390 con 0x7fb140151f90 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb148432640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14014eed0 con 0x7fb14014eaf0 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1469cf640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb1400c0370 0x7fb14006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41486/0 (socket says 172.21.15.89:41486) 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1469cf640 1 -- 172.21.15.89:0/4259534701 learned_addr learned my addr 172.21.15.89:0/4259534701 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1459cd640 1 --2- 172.21.15.89:0/4259534701 >> v2:172.21.15.97:3300/0 conn(0x7fb140151f90 0x7fb14006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1461ce640 1 --2- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb140151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1451cc640 1 -- 172.21.15.89:0/4259534701 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931736727 0 0) 0x7fb14006de00 con 0x7fb1400c0370 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1451cc640 1 -- 172.21.15.89:0/4259534701 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c003530 con 0x7fb1400c0370 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1459cd640 1 -- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 msgr2=0x7fb140151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1459cd640 1 --2- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb140151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1459cd640 1 -- 172.21.15.89:0/4259534701 >> v1:172.21.15.89:6789/0 conn(0x7fb1400c0370 legacy=0x7fb14006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.987+0000 7fb1459cd640 1 -- 172.21.15.89:0/4259534701 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140151270 con 0x7fb140151f90 2023-12-07T09:59:38.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb1459cd640 1 --2- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb140151f90 0x7fb14006d110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1300097c0 tx=0x7fb13001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f958897e64a9a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:38.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb1451cc640 1 -- 172.21.15.89:0/4259534701 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300ab600 con 0x7fb140151f90 2023-12-07T09:59:38.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb1451cc640 1 -- 172.21.15.89:0/4259534701 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300a7050 con 0x7fb140151f90 2023-12-07T09:59:38.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb1451cc640 1 -- 172.21.15.89:0/4259534701 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300ab980 con 0x7fb140151f90 2023-12-07T09:59:38.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 -- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb140151f90 msgr2=0x7fb14006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 --2- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb140151f90 0x7fb14006d110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1300097c0 tx=0x7fb13001c330 comp rx=0 tx=0).stop 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 -- 172.21.15.89:0/4259534701 shutdown_connections 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 --2- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb140151f90 0x7fb14006d110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 --2- 172.21.15.89:0/4259534701 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb140151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 -- 172.21.15.89:0/4259534701 >> 172.21.15.89:0/4259534701 conn(0x7fb1400c2a60 msgr2=0x7fb1400c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 -- 172.21.15.89:0/4259534701 shutdown_connections 2023-12-07T09:59:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.991+0000 7fb148432640 1 -- 172.21.15.89:0/4259534701 wait complete. 2023-12-07T09:59:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 Processor -- start 2023-12-07T09:59:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- start start 2023-12-07T09:59:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1400c0370 0x7fb1400c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb1400714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 0x7fb14013b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400c3cc0 con 0x7fb1401ebae0 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1401eadf0 con 0x7fb1400c0370 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400c24f0 con 0x7fb14014eaf0 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 0x7fb14013b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 0x7fb14013b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34688/0 (socket says 172.21.15.89:34688) 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 -- 172.21.15.89:0/1848537329 learned_addr learned my addr 172.21.15.89:0/1848537329 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1461ce640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1400c0370 0x7fb1400c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1459cd640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb1400714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 -- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 msgr2=0x7fb1400714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb1400714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 -- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1400c0370 msgr2=0x7fb1400c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1400c0370 0x7fb1400c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 -- 172.21.15.89:0/1848537329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130009420 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1461ce640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1400c0370 0x7fb1400c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb1469cf640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 0x7fb14013b7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb13800caa0 tx=0x7fb13800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800ac00 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800ad60 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138012620 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1400c2210 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1401eb2e0 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.995+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14004e890 con 0x7fb1401ebae0 2023-12-07T09:59:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.999+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb138007070 con 0x7fb1401ebae0 2023-12-07T09:59:39.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.999+0000 7fb136ffd640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb1240668d0 0x7fb124068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.999+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb138084420 con 0x7fb1401ebae0 2023-12-07T09:59:39.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.999+0000 7fb1461ce640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb1240668d0 0x7fb124068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:38.999+0000 7fb1461ce640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb1240668d0 0x7fb124068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb14013e6d0 tx=0x7fb13c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.003+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb138051650 con 0x7fb1401ebae0 2023-12-07T09:59:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.151+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb1400a8d90 con 0x7fb1401ebae0 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.155+0000 7fb136ffd640 1 -- 172.21.15.89:0/1848537329 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb138054c70 con 0x7fb1401ebae0 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb1240668d0 msgr2=0x7fb124068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb1240668d0 0x7fb124068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb14013e6d0 tx=0x7fb13c008040 comp rx=0 tx=0).stop 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 msgr2=0x7fb14013b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 0x7fb14013b7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb13800caa0 tx=0x7fb13800cf60 comp rx=0 tx=0).stop 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 shutdown_connections 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1401ebae0 0x7fb14013b7f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb1240668d0 0x7fb124068d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14014eaf0 0x7fb1400714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 --2- 172.21.15.89:0/1848537329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1400c0370 0x7fb1400c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 >> 172.21.15.89:0/1848537329 conn(0x7fb1400c2a60 msgr2=0x7fb14013fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:39.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 shutdown_connections 2023-12-07T09:59:39.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.159+0000 7fb148432640 1 -- 172.21.15.89:0/1848537329 wait complete. 2023-12-07T09:59:39.184 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T09:59:39.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T09:59:39.270 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T09:59:39.351 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T09:59:39.351 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:59:39.352 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:39.361 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:59:39.361 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:39.412 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T09:59:39.412 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:39.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:39.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 Processor -- start 2023-12-07T09:59:39.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 -- start start 2023-12-07T09:59:39.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340ca610 0x7f94340c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f943406cd90 0x7f94340c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9434155790 con 0x7f94340bd720 2023-12-07T09:59:39.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340c4b00 con 0x7f943406cd90 2023-12-07T09:59:39.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f943a71d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c4de0 con 0x7f94340ca610 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f943406cd90 0x7f94340c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f943406cd90 0x7f94340c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38310/0 (socket says 172.21.15.89:38310) 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 -- 172.21.15.89:0/1457630457 learned_addr learned my addr 172.21.15.89:0/1457630457 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9433fff640 1 --2- 172.21.15.89:0/1457630457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340ca610 0x7f94340c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 -- 172.21.15.89:0/1457630457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340ca610 msgr2=0x7f94340c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 --2- 172.21.15.89:0/1457630457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340ca610 0x7f94340c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 -- 172.21.15.89:0/1457630457 >> v1:172.21.15.97:6789/0 conn(0x7f94340bd720 legacy=0x7f9434158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.639+0000 7f9438cba640 1 -- 172.21.15.89:0/1457630457 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434157e30 con 0x7f943406cd90 2023-12-07T09:59:39.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f9438cba640 1 --2- 172.21.15.89:0/1457630457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f94340c9a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f942c009e50 tx=0x7f942c01c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339c7edd00287b1f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f94337fe640 1 -- 172.21.15.89:0/1457630457 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94340c52d0 con 0x7f943406cd90 2023-12-07T09:59:39.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f94337fe640 1 -- 172.21.15.89:0/1457630457 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0a7050 con 0x7f943406cd90 2023-12-07T09:59:39.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f94337fe640 1 -- 172.21.15.89:0/1457630457 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0ab620 con 0x7f943406cd90 2023-12-07T09:59:39.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 -- 172.21.15.89:0/1457630457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 msgr2=0x7f94340c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 --2- 172.21.15.89:0/1457630457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f94340c9a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f942c009e50 tx=0x7f942c01c5d0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 -- 172.21.15.89:0/1457630457 shutdown_connections 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 --2- 172.21.15.89:0/1457630457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f94340c9a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 --2- 172.21.15.89:0/1457630457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340ca610 0x7f94340c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 -- 172.21.15.89:0/1457630457 >> 172.21.15.89:0/1457630457 conn(0x7f9434071ea0 msgr2=0x7f94340722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 -- 172.21.15.89:0/1457630457 shutdown_connections 2023-12-07T09:59:39.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.643+0000 7f943a71d640 1 -- 172.21.15.89:0/1457630457 wait complete. 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 Processor -- start 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 -- start start 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f943414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340bd720 0x7f9434155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94340ca610 0x7f9434156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94340ac600 con 0x7f943406cd90 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341f1b90 con 0x7f94340ca610 2023-12-07T09:59:39.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943414c190 con 0x7f94340bd720 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f943414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f943414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38316/0 (socket says 172.21.15.89:38316) 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 -- 172.21.15.89:0/1222233016 learned_addr learned my addr 172.21.15.89:0/1222233016 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f942bfff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340bd720 0x7f9434155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9438cba640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94340ca610 0x7f9434156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 -- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340bd720 msgr2=0x7f9434155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340bd720 0x7f9434155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 -- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94340ca610 msgr2=0x7f9434156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94340ca610 0x7f9434156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 -- 172.21.15.89:0/1222233016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009b30 con 0x7f943406cd90 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f942bfff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340bd720 0x7f9434155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f9433fff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f943414bc50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f942400d5f0 tx=0x7f942400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240125f0 con 0x7f943406cd90 2023-12-07T09:59:39.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9424012750 con 0x7f943406cd90 2023-12-07T09:59:39.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9434156a50 con 0x7f943406cd90 2023-12-07T09:59:39.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424012b00 con 0x7f943406cd90 2023-12-07T09:59:39.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.647+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94340ac220 con 0x7f943406cd90 2023-12-07T09:59:39.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.651+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943404e890 con 0x7f943406cd90 2023-12-07T09:59:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.651+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9424012c60 con 0x7f943406cd90 2023-12-07T09:59:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.651+0000 7f94317fa640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f94140668d0 0x7f9414068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.651+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9424084950 con 0x7f943406cd90 2023-12-07T09:59:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.651+0000 7f942bfff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f94140668d0 0x7f9414068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.651+0000 7f942bfff640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f94140668d0 0x7f9414068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f943415fa40 tx=0x7f941c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.655+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9424051b80 con 0x7f943406cd90 2023-12-07T09:59:39.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.803+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9434157210 con 0x7f943406cd90 2023-12-07T09:59:39.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.803+0000 7f94317fa640 1 -- 172.21.15.89:0/1222233016 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f94240551a0 con 0x7f943406cd90 2023-12-07T09:59:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:39.812 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:39.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f94140668d0 msgr2=0x7f9414068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f94140668d0 0x7f9414068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f943415fa40 tx=0x7f941c009040 comp rx=0 tx=0).stop 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 msgr2=0x7f943414bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f943414bc50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f942400d5f0 tx=0x7f942400dab0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 shutdown_connections 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94340ca610 0x7f9434156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f94140668d0 0x7f9414068d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94340bd720 0x7f9434155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 --2- 172.21.15.89:0/1222233016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f943406cd90 0x7f943414bc50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 >> 172.21.15.89:0/1222233016 conn(0x7f9434071ea0 msgr2=0x7f94340adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 shutdown_connections 2023-12-07T09:59:39.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.807+0000 7f943a71d640 1 -- 172.21.15.89:0/1222233016 wait complete. 2023-12-07T09:59:39.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:39.833 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:39.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 Processor -- start 2023-12-07T09:59:39.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 -- start start 2023-12-07T09:59:39.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdeec0c8430 0x7fdeec06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdeec0c7f20 0x7fdeec06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec06cf70 con 0x7fdeec151d80 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec152160 con 0x7fdeec0c7f20 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef2fb8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0c6a30 con 0x7fdeec0c8430 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdeec0c7f20 0x7fdeec06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdeec0c7f20 0x7fdeec06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38320/0 (socket says 172.21.15.89:38320) 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 -- 172.21.15.89:0/625613894 learned_addr learned my addr 172.21.15.89:0/625613894 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdee3fff640 1 --2- 172.21.15.89:0/625613894 >> v2:172.21.15.97:3300/0 conn(0x7fdeec0c8430 0x7fdeec06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 -- 172.21.15.89:0/625613894 >> v2:172.21.15.97:3300/0 conn(0x7fdeec0c8430 msgr2=0x7fdeec06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 --2- 172.21.15.89:0/625613894 >> v2:172.21.15.97:3300/0 conn(0x7fdeec0c8430 0x7fdeec06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 -- 172.21.15.89:0/625613894 >> v1:172.21.15.89:6789/0 conn(0x7fdeec151d80 legacy=0x7fdeec0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.966+0000 7fdef1555640 1 -- 172.21.15.89:0/625613894 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0c72d0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef1555640 1 --2- 172.21.15.89:0/625613894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec06bc60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0c7a40 tx=0x7fdee401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3804866d8219a0e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdee37fe640 1 -- 172.21.15.89:0/625613894 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee40a57d0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdee37fe640 1 -- 172.21.15.89:0/625613894 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee40a5930 con 0x7fdeec0c7f20 2023-12-07T09:59:39.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdee37fe640 1 -- 172.21.15.89:0/625613894 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee40a5cc0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 -- 172.21.15.89:0/625613894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 msgr2=0x7fdeec06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/625613894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec06bc60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0c7a40 tx=0x7fdee401c910 comp rx=0 tx=0).stop 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 -- 172.21.15.89:0/625613894 shutdown_connections 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/625613894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec06bc60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/625613894 >> v2:172.21.15.97:3300/0 conn(0x7fdeec0c8430 0x7fdeec06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 -- 172.21.15.89:0/625613894 >> 172.21.15.89:0/625613894 conn(0x7fdeec0abd00 msgr2=0x7fdeec0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 -- 172.21.15.89:0/625613894 shutdown_connections 2023-12-07T09:59:39.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.970+0000 7fdef2fb8640 1 -- 172.21.15.89:0/625613894 wait complete. 2023-12-07T09:59:39.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 Processor -- start 2023-12-07T09:59:39.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 -- start start 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec0be520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdeec0c8430 0x7fdeec0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdeec151d80 0x7fdeec0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec157fe0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0bea60 con 0x7fdeec151d80 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec14bf90 con 0x7fdeec0c8430 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec0be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec0be520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38334/0 (socket says 172.21.15.89:38334) 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 -- 172.21.15.89:0/932756777 learned_addr learned my addr 172.21.15.89:0/932756777 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdee3fff640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdeec0c8430 0x7fdeec0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef1555640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdeec151d80 0x7fdeec0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 -- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdeec0c8430 msgr2=0x7fdeec0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdeec0c8430 0x7fdeec0c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 -- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdeec151d80 msgr2=0x7fdeec0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdeec151d80 0x7fdeec0c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 -- 172.21.15.89:0/932756777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4009b30 con 0x7fdeec0c7f20 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdee3fff640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdeec0c8430 0x7fdeec0c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef1555640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdeec151d80 0x7fdeec0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef0d54640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec0be520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c480 tx=0x7fdee800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80052d0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8005450 con 0x7fdeec0c7f20 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8012870 con 0x7fdeec0c7f20 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec0bf810 con 0x7fdeec0c7f20 2023-12-07T09:59:39.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.974+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec0bec90 con 0x7fdeec0c7f20 2023-12-07T09:59:39.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.978+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec04e890 con 0x7fdeec0c7f20 2023-12-07T09:59:39.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.978+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdee80129d0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.978+0000 7fdee17fa640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fded80668d0 0x7fded8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:39.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.978+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdee8083ef0 con 0x7fdeec0c7f20 2023-12-07T09:59:39.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.978+0000 7fdee3fff640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fded80668d0 0x7fded8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:39.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.978+0000 7fdee3fff640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fded80668d0 0x7fded8068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0c5bb0 tx=0x7fdedc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:39.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:39.982+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdee80511c0 con 0x7fdeec0c7f20 2023-12-07T09:59:40.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.134+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdeec14f030 con 0x7fdeec0c7f20 2023-12-07T09:59:40.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.134+0000 7fdee17fa640 1 -- 172.21.15.89:0/932756777 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdee80547e0 con 0x7fdeec0c7f20 2023-12-07T09:59:40.143 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fded80668d0 msgr2=0x7fded8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fded80668d0 0x7fded8068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0c5bb0 tx=0x7fdedc008040 comp rx=0 tx=0).stop 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 msgr2=0x7fdeec0be520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec0be520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c480 tx=0x7fdee800c940 comp rx=0 tx=0).stop 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 shutdown_connections 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdeec151d80 0x7fdeec0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fded80668d0 0x7fded8068d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdeec0c8430 0x7fdeec0c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 --2- 172.21.15.89:0/932756777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdeec0c7f20 0x7fdeec0be520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 >> 172.21.15.89:0/932756777 conn(0x7fdeec0abd00 msgr2=0x7fdeec0c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:40.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 shutdown_connections 2023-12-07T09:59:40.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.138+0000 7fdef2fb8640 1 -- 172.21.15.89:0/932756777 wait complete. 2023-12-07T09:59:40.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:40.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f407b8640 1 Processor -- start 2023-12-07T09:59:40.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f407b8640 1 -- start start 2023-12-07T09:59:40.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f407b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f380c11f0 0x7f2f380720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f407b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f38155c40 con 0x7f2f380c17b0 2023-12-07T09:59:40.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f407b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f38073590 con 0x7f2f3806b810 2023-12-07T09:59:40.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f407b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380c60c0 con 0x7f2f380c11f0 2023-12-07T09:59:40.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3ed55640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f380c11f0 0x7f2f380720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3dd53640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2f380c17b0 0x7f2f380719e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34982/0 (socket says 172.21.15.89:34982) 2023-12-07T09:59:40.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3dd53640 1 -- 172.21.15.89:0/1235095873 learned_addr learned my addr 172.21.15.89:0/1235095873 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:40.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3ed55640 1 -- 172.21.15.89:0/1235095873 >> v1:172.21.15.97:6789/0 conn(0x7f2f3806b810 legacy=0x7f2f38156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3ed55640 1 -- 172.21.15.89:0/1235095873 >> v1:172.21.15.89:6789/0 conn(0x7f2f380c17b0 legacy=0x7f2f380719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3ed55640 1 -- 172.21.15.89:0/1235095873 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38073800 con 0x7f2f380c11f0 2023-12-07T09:59:40.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.298+0000 7f2f3d552640 1 -- 172.21.15.89:0/1235095873 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179173294 0 0) 0x7f2f38155c40 con 0x7f2f380c17b0 2023-12-07T09:59:40.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f3ed55640 1 --2- 172.21.15.89:0/1235095873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f380720f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009d90 tx=0x7f2f3001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85b189167eb5f72 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:40.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f3d552640 1 -- 172.21.15.89:0/1235095873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f300a5810 con 0x7f2f380c11f0 2023-12-07T09:59:40.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f3d552640 1 -- 172.21.15.89:0/1235095873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f300a5970 con 0x7f2f380c11f0 2023-12-07T09:59:40.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f3d552640 1 -- 172.21.15.89:0/1235095873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f300a5d00 con 0x7f2f380c11f0 2023-12-07T09:59:40.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 -- 172.21.15.89:0/1235095873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 msgr2=0x7f2f380720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 --2- 172.21.15.89:0/1235095873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f380720f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009d90 tx=0x7f2f3001c950 comp rx=0 tx=0).stop 2023-12-07T09:59:40.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 -- 172.21.15.89:0/1235095873 shutdown_connections 2023-12-07T09:59:40.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 --2- 172.21.15.89:0/1235095873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f380720f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 -- 172.21.15.89:0/1235095873 >> 172.21.15.89:0/1235095873 conn(0x7f2f380c3240 msgr2=0x7f2f380c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:40.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 -- 172.21.15.89:0/1235095873 shutdown_connections 2023-12-07T09:59:40.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 -- 172.21.15.89:0/1235095873 wait complete. 2023-12-07T09:59:40.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.302+0000 7f2f407b8640 1 Processor -- start 2023-12-07T09:59:40.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- start start 2023-12-07T09:59:40.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f3806b810 0x7f2f3806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f38145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f380c17b0 0x7f2f38146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38146c00 con 0x7f2f380c11f0 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f381f1420 con 0x7f2f380c17b0 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38146690 con 0x7f2f3806b810 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f38145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f38145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38350/0 (socket says 172.21.15.89:38350) 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 -- 172.21.15.89:0/3277680474 learned_addr learned my addr 172.21.15.89:0/3277680474 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3ed55640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f380c17b0 0x7f2f38146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3e554640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f3806b810 0x7f2f3806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 -- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f3806b810 msgr2=0x7f2f3806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f3806b810 0x7f2f3806eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 -- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f380c17b0 msgr2=0x7f2f38146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f380c17b0 0x7f2f38146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 -- 172.21.15.89:0/3277680474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30009a70 con 0x7f2f380c11f0 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f3dd53640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f38145c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c4a0 tx=0x7f2f2800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280074e0 con 0x7f2f380c11f0 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28007640 con 0x7f2f380c11f0 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28004a30 con 0x7f2f380c11f0 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3814a5f0 con 0x7f2f380c11f0 2023-12-07T09:59:40.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380a9710 con 0x7f2f380c11f0 2023-12-07T09:59:40.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.306+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380a9570 con 0x7f2f380c11f0 2023-12-07T09:59:40.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.310+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2f28004b90 con 0x7f2f380c11f0 2023-12-07T09:59:40.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.310+0000 7f2f2effd640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2f1c0668d0 0x7f2f1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.310+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f280835a0 con 0x7f2f380c11f0 2023-12-07T09:59:40.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.310+0000 7f2f3e554640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2f1c0668d0 0x7f2f1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.310+0000 7f2f3e554640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2f1c0668d0 0x7f2f1c068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2f34007fd0 tx=0x7f2f34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:40.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.314+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f380a9570 con 0x7f2f380c11f0 2023-12-07T09:59:40.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f381f11f0 con 0x7f2f380c11f0 2023-12-07T09:59:40.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f2effd640 1 -- 172.21.15.89:0/3277680474 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f28018020 con 0x7f2f380c11f0 2023-12-07T09:59:40.473 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:40.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2f1c0668d0 msgr2=0x7f2f1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2f1c0668d0 0x7f2f1c068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2f34007fd0 tx=0x7f2f34009040 comp rx=0 tx=0).stop 2023-12-07T09:59:40.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 msgr2=0x7f2f38145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f38145c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c4a0 tx=0x7f2f2800c960 comp rx=0 tx=0).stop 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 shutdown_connections 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f380c17b0 0x7f2f38146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f380c11f0 0x7f2f38145c10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2f1c0668d0 0x7f2f1c068d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 --2- 172.21.15.89:0/3277680474 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2f3806b810 0x7f2f3806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 >> 172.21.15.89:0/3277680474 conn(0x7f2f380c3240 msgr2=0x7f2f38156160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 shutdown_connections 2023-12-07T09:59:40.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.466+0000 7f2f407b8640 1 -- 172.21.15.89:0/3277680474 wait complete. 2023-12-07T09:59:40.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 Processor -- start 2023-12-07T09:59:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 -- start start 2023-12-07T09:59:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f80a86d0 0x7f63f80a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63f8156600 0x7f63f814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f63f814fb30 0x7f63f80aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f8152d90 con 0x7f63f8156600 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f8152480 con 0x7f63f814fb30 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63fee16640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80a9760 con 0x7f63f80a86d0 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.626+0000 7f63f7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63f8156600 0x7f63f814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63f8156600 0x7f63f814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38358/0 (socket says 172.21.15.89:38358) 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 -- 172.21.15.89:0/717716975 learned_addr learned my addr 172.21.15.89:0/717716975 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63fcbb2640 1 --2- 172.21.15.89:0/717716975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f80a86d0 0x7f63f80a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63fd3b3640 1 --2- 172.21.15.89:0/717716975 >> v2:172.21.15.97:3300/0 conn(0x7f63f814fb30 0x7f63f80aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 -- 172.21.15.89:0/717716975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f80a86d0 msgr2=0x7f63f80a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 --2- 172.21.15.89:0/717716975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f80a86d0 0x7f63f80a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 -- 172.21.15.89:0/717716975 >> v2:172.21.15.97:3300/0 conn(0x7f63f814fb30 msgr2=0x7f63f80aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:40.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 --2- 172.21.15.89:0/717716975 >> v2:172.21.15.97:3300/0 conn(0x7f63f814fb30 0x7f63f80aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 -- 172.21.15.89:0/717716975 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8152740 con 0x7f63f8156600 2023-12-07T09:59:40.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63fd3b3640 1 --2- 172.21.15.89:0/717716975 >> v2:172.21.15.97:3300/0 conn(0x7f63f814fb30 0x7f63f80aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:40.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f7fff640 1 --2- 172.21.15.89:0/717716975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f8156600 0x7f63f814f5f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f63f8074300 tx=0x7f63ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d729e0f7203cd997 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:40.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f77fe640 1 -- 172.21.15.89:0/717716975 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0ab600 con 0x7f63f8156600 2023-12-07T09:59:40.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f77fe640 1 -- 172.21.15.89:0/717716975 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec0a7050 con 0x7f63f8156600 2023-12-07T09:59:40.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63f77fe640 1 -- 172.21.15.89:0/717716975 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0ab980 con 0x7f63f8156600 2023-12-07T09:59:40.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63fee16640 1 -- 172.21.15.89:0/717716975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f8156600 msgr2=0x7f63f814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.630+0000 7f63fee16640 1 --2- 172.21.15.89:0/717716975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f8156600 0x7f63f814f5f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f63f8074300 tx=0x7f63ec01c500 comp rx=0 tx=0).stop 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- 172.21.15.89:0/717716975 shutdown_connections 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 --2- 172.21.15.89:0/717716975 >> v2:172.21.15.97:3300/0 conn(0x7f63f814fb30 0x7f63f80aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 --2- 172.21.15.89:0/717716975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f8156600 0x7f63f814f5f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 --2- 172.21.15.89:0/717716975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f80a86d0 0x7f63f80a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- 172.21.15.89:0/717716975 >> 172.21.15.89:0/717716975 conn(0x7f63f80c2a60 msgr2=0x7f63f80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- 172.21.15.89:0/717716975 shutdown_connections 2023-12-07T09:59:40.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- 172.21.15.89:0/717716975 wait complete. 2023-12-07T09:59:40.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 Processor -- start 2023-12-07T09:59:40.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- start start 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 0x7f63f81edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f814fb30 0x7f63f814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63f8156600 0x7f63f8144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f814ca80 con 0x7f63f80a86d0 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8072400 con 0x7f63f8156600 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fee16640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f81ee0a0 con 0x7f63f814fb30 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 0x7f63f81edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 0x7f63f81edb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38364/0 (socket says 172.21.15.89:38364) 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 -- 172.21.15.89:0/2337739609 learned_addr learned my addr 172.21.15.89:0/2337739609 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63f7fff640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f814fb30 0x7f63f814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fd3b3640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63f8156600 0x7f63f8144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 -- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f814fb30 msgr2=0x7f63f814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f814fb30 0x7f63f814db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 -- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63f8156600 msgr2=0x7f63f8144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63f8156600 0x7f63f8144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 -- 172.21.15.89:0/2337739609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0094d0 con 0x7f63f80a86d0 2023-12-07T09:59:40.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.634+0000 7f63fcbb2640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 0x7f63f81edb60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63e8007ea0 tx=0x7f63e8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8014620 con 0x7f63f80a86d0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8014780 con 0x7f63f80a86d0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8014b30 con 0x7f63f80a86d0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f814e0d0 con 0x7f63f80a86d0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f8071e40 con 0x7f63f80a86d0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f804e890 con 0x7f63f80a86d0 2023-12-07T09:59:40.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63e8014c90 con 0x7f63f80a86d0 2023-12-07T09:59:40.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f57fa640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63e40668d0 0x7f63e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:40.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63e8084d40 con 0x7f63f80a86d0 2023-12-07T09:59:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f7fff640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63e40668d0 0x7f63e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:40.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.638+0000 7f63f7fff640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63e40668d0 0x7f63e4068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0ad000 tx=0x7f63ec0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:40.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.642+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63e8051f90 con 0x7f63f80a86d0 2023-12-07T09:59:40.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:40.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:40.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.790+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63f80ac260 con 0x7f63f80a86d0 2023-12-07T09:59:40.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.790+0000 7f63f57fa640 1 -- 172.21.15.89:0/2337739609 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63e80555b0 con 0x7f63f80a86d0 2023-12-07T09:59:40.799 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:40.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63e40668d0 msgr2=0x7f63e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63e40668d0 0x7f63e4068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0ad000 tx=0x7f63ec0a6000 comp rx=0 tx=0).stop 2023-12-07T09:59:40.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 msgr2=0x7f63f81edb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:40.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 0x7f63f81edb60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63e8007ea0 tx=0x7f63e8007f90 comp rx=0 tx=0).stop 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 shutdown_connections 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63f8156600 0x7f63f8144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63e40668d0 0x7f63e4068d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f63f814fb30 0x7f63f814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 --2- 172.21.15.89:0/2337739609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f80a86d0 0x7f63f81edb60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 >> 172.21.15.89:0/2337739609 conn(0x7f63f80c2a60 msgr2=0x7f63f815c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 shutdown_connections 2023-12-07T09:59:40.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:40.794+0000 7f63fee16640 1 -- 172.21.15.89:0/2337739609 wait complete. 2023-12-07T09:59:40.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T09:59:41.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce10fd1640 1 Processor -- start 2023-12-07T09:59:41.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce10fd1640 1 -- start start 2023-12-07T09:59:41.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce10fd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fce0c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce10fd1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c06d320 con 0x7fce0c070b80 2023-12-07T09:59:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce10fd1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c0721b0 con 0x7fce0c14e9d0 2023-12-07T09:59:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce10fd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c2830 con 0x7fce0c0a8470 2023-12-07T09:59:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce09d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fce0c070b80 0x7fce0c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34994/0 (socket says 172.21.15.89:34994) 2023-12-07T09:59:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce09d9b640 1 -- 172.21.15.89:0/3170803406 learned_addr learned my addr 172.21.15.89:0/3170803406 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fce0c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336928781 0 0) 0x7fce0c06d320 con 0x7fce0c070b80 2023-12-07T09:59:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf4003530 con 0x7fce0c070b80 2023-12-07T09:59:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3813429061 0 0) 0x7fcdf4003530 con 0x7fce0c070b80 2023-12-07T09:59:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 msgr2=0x7fce0c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fce0c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 >> v1:172.21.15.97:6789/0 conn(0x7fce0c14e9d0 legacy=0x7fce0c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c072450 con 0x7fce0c070b80 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fce00001680 con 0x7fce0c070b80 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fce0c151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 >> v1:172.21.15.89:6789/0 conn(0x7fce0c070b80 legacy=0x7fce0c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdf40039b0 0x7fcdf4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fcdf40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf4004d10 0x7fcdf4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c2830 con 0x7fcdf40039b0 2023-12-07T09:59:41.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400dc20 con 0x7fcdf4004d10 2023-12-07T09:59:41.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400dde0 con 0x7fce0c0a8470 2023-12-07T09:59:41.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0a59c640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdf40039b0 0x7fcdf4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf4004d10 0x7fcdf4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce09d9b640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fcdf40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0a59c640 1 -- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 msgr2=0x7fcdf40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0a59c640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0a8470 0x7fcdf40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0a59c640 1 -- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf4004d10 msgr2=0x7fcdf4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0a59c640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf4004d10 0x7fcdf4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0a59c640 1 -- 172.21.15.89:0/3170803406 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009a70 con 0x7fcdf40039b0 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.006+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf4004d10 0x7fcdf4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce0a59c640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdf40039b0 0x7fcdf4003d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001910 tx=0x7fcdfc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d23a00eab53a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0ab600 con 0x7fcdf40039b0 2023-12-07T09:59:41.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0a7050 con 0x7fcdf40039b0 2023-12-07T09:59:41.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce0959a640 1 -- 172.21.15.89:0/3170803406 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0ab9c0 con 0x7fcdf40039b0 2023-12-07T09:59:41.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce10fd1640 1 -- 172.21.15.89:0/3170803406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdf40039b0 msgr2=0x7fcdf4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce10fd1640 1 --2- 172.21.15.89:0/3170803406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdf40039b0 0x7fcdf4003d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001910 tx=0x7fcdfc01c560 comp rx=0 tx=0).stop 2023-12-07T09:59:41.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce0ad9d640 1 -- 172.21.15.89:0/3170803406 reap_dead start 2023-12-07T09:59:41.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce10fd1640 1 -- 172.21.15.89:0/3170803406 shutdown_connections 2023-12-07T09:59:41.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce10fd1640 1 -- 172.21.15.89:0/3170803406 >> 172.21.15.89:0/3170803406 conn(0x7fce0c0c2ad0 msgr2=0x7fce0c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:41.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce10fd1640 1 -- 172.21.15.89:0/3170803406 shutdown_connections 2023-12-07T09:59:41.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.010+0000 7fce10fd1640 1 -- 172.21.15.89:0/3170803406 wait complete. 2023-12-07T09:59:41.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 Processor -- start 2023-12-07T09:59:41.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 -- start start 2023-12-07T09:59:41.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf40039b0 0x7fce0c0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0bfe80 0x7fce0c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 0x7fce0c1f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1ed370 con 0x7fce0c0c4b20 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c149530 con 0x7fcdf40039b0 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c14f3a0 con 0x7fce0c0bfe80 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 0x7fce0c1f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 0x7fce0c1f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38392/0 (socket says 172.21.15.89:38392) 2023-12-07T09:59:41.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 -- 172.21.15.89:0/4023651903 learned_addr learned my addr 172.21.15.89:0/4023651903 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0a59c640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf40039b0 0x7fce0c0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce09d9b640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0bfe80 0x7fce0c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 -- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0bfe80 msgr2=0x7fce0c14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0bfe80 0x7fce0c14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 -- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf40039b0 msgr2=0x7fce0c0a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf40039b0 0x7fce0c0a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 -- 172.21.15.89:0/4023651903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0c3d60 con 0x7fce0c0c4b20 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce0ad9d640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 0x7fce0c1f0500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0c7090 tx=0x7fce040115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400e030 con 0x7fce0c0c4b20 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce04016470 con 0x7fce0c0c4b20 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c0c4040 con 0x7fce0c0c4b20 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04016840 con 0x7fce0c0c4b20 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.014+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c0c4600 con 0x7fce0c0c4b20 2023-12-07T09:59:41.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.018+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c0c4820 con 0x7fce0c0c4b20 2023-12-07T09:59:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.018+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fce040169a0 con 0x7fce0c0c4b20 2023-12-07T09:59:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.018+0000 7fcdfaffd640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcdec0668d0 0x7fcdec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.018+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce0400f070 con 0x7fce0c0c4b20 2023-12-07T09:59:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.018+0000 7fce0a59c640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcdec0668d0 0x7fcdec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.018+0000 7fce0a59c640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcdec0668d0 0x7fcdec068d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ad000 tx=0x7fcdfc001330 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.022+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce04052020 con 0x7fce0c0c4b20 2023-12-07T09:59:41.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.182+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce0c04e890 con 0x7fce0c0c4b20 2023-12-07T09:59:41.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.182+0000 7fcdfaffd640 1 -- 172.21.15.89:0/4023651903 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fce0401a080 con 0x7fce0c0c4b20 2023-12-07T09:59:41.190 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcdec0668d0 msgr2=0x7fcdec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcdec0668d0 0x7fcdec068d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ad000 tx=0x7fcdfc001330 comp rx=0 tx=0).stop 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 msgr2=0x7fce0c1f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 0x7fce0c1f0500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0c7090 tx=0x7fce040115a0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 shutdown_connections 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce0c0c4b20 0x7fce0c1f0500 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcdec0668d0 0x7fcdec068d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fce0c0bfe80 0x7fce0c14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 --2- 172.21.15.89:0/4023651903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcdf40039b0 0x7fce0c0a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 >> 172.21.15.89:0/4023651903 conn(0x7fce0c0c2ad0 msgr2=0x7fce0c151450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:41.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 shutdown_connections 2023-12-07T09:59:41.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.186+0000 7fce10fd1640 1 -- 172.21.15.89:0/4023651903 wait complete. 2023-12-07T09:59:41.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T09:59:41.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:41.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-07T09:59:41.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T09:59:41.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:41.244 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T09:59:41.309 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:59:41.309 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:41.319 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:59:41.320 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:41.370 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T09:59:41.370 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T09:59:41.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:41.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71d094640 1 Processor -- start 2023-12-07T09:59:41.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71d094640 1 -- start start 2023-12-07T09:59:41.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71d094640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb7180bd720 0x7fb718158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71d094640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb718155790 con 0x7fb7180ca610 2023-12-07T09:59:41.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71d094640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180c4b00 con 0x7fb71806cd90 2023-12-07T09:59:41.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71d094640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180c4de0 con 0x7fb7180bd720 2023-12-07T09:59:41.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb716d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb7180ca610 0x7fb7180c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35006/0 (socket says 172.21.15.89:35006) 2023-12-07T09:59:41.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb716d9d640 1 -- 172.21.15.89:0/279854725 learned_addr learned my addr 172.21.15.89:0/279854725 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:41.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb70ffff640 1 --2- 172.21.15.89:0/279854725 >> v2:172.21.15.97:3300/0 conn(0x7fb7180bd720 0x7fb718158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885067435 0 0) 0x7fb718155790 con 0x7fb7180ca610 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb704003530 con 0x7fb7180ca610 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446595815 0 0) 0x7fb7180c4b00 con 0x7fb71806cd90 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb718155790 con 0x7fb71806cd90 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710073411 0 0) 0x7fb704003530 con 0x7fb7180ca610 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 >> v2:172.21.15.97:3300/0 conn(0x7fb7180bd720 msgr2=0x7fb718158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 --2- 172.21.15.89:0/279854725 >> v2:172.21.15.97:3300/0 conn(0x7fb7180bd720 0x7fb718158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 >> v1:172.21.15.97:6789/0 conn(0x7fb71806cd90 legacy=0x7fb7180c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718157e30 con 0x7fb7180ca610 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fb708001680 con 0x7fb7180ca610 2023-12-07T09:59:41.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 >> v1:172.21.15.89:6789/0 conn(0x7fb7180ca610 legacy=0x7fb7180c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb704003b10 0x7fb704003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7040047d0 0x7fb704004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704005200 0x7fb70400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180c4de0 con 0x7fb704003b10 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70400c160 con 0x7fb704005200 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70400c320 con 0x7fb7040047d0 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.558+0000 7fb70ffff640 1 --2- 172.21.15.89:0/279854725 >> v2:172.21.15.97:3300/0 conn(0x7fb7180bd720 0x7fb718158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb704003b10 0x7fb704003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb71759e640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704005200 0x7fb70400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 -- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7040047d0 msgr2=0x7fb704004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb70ffff640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7040047d0 0x7fb704004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7040047d0 0x7fb704004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 -- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704005200 msgr2=0x7fb70400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704005200 0x7fb70400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 -- 172.21.15.89:0/279854725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb704003530 con 0x7fb704003b10 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb71759e640 1 -- 172.21.15.89:0/279854725 reap_dead start 2023-12-07T09:59:41.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb70ffff640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb7040047d0 0x7fb704004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:41.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb716d9d640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb704003b10 0x7fb704003f10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c160 tx=0x7fb70801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b00fa6c6ec85a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180c52d0 con 0x7fb704003b10 2023-12-07T09:59:41.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080a7070 con 0x7fb704003b10 2023-12-07T09:59:41.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.562+0000 7fb71659c640 1 -- 172.21.15.89:0/279854725 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708005d80 con 0x7fb704003b10 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- 172.21.15.89:0/279854725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb704003b10 msgr2=0x7fb704003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb704003b10 0x7fb704003f10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c160 tx=0x7fb70801d300 comp rx=0 tx=0).stop 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- 172.21.15.89:0/279854725 shutdown_connections 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 --2- 172.21.15.89:0/279854725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb704003b10 0x7fb704003f10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- 172.21.15.89:0/279854725 >> 172.21.15.89:0/279854725 conn(0x7fb718071ea0 msgr2=0x7fb7180722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- 172.21.15.89:0/279854725 shutdown_connections 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- 172.21.15.89:0/279854725 wait complete. 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 Processor -- start 2023-12-07T09:59:41.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- start start 2023-12-07T09:59:41.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704003b10 0x7fb7181ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb718149f10 0x7fb7181536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 0x7fb7180abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180aa6e0 con 0x7fb7180abab0 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181532d0 con 0x7fb704003b10 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71d094640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb718152f80 con 0x7fb718149f10 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 0x7fb7180abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 0x7fb7180abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38410/0 (socket says 172.21.15.89:38410) 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 -- 172.21.15.89:0/301113242 learned_addr learned my addr 172.21.15.89:0/301113242 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb716d9d640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704003b10 0x7fb7181ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb70ffff640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb718149f10 0x7fb7181536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 -- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb718149f10 msgr2=0x7fb7181536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb718149f10 0x7fb7181536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 -- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704003b10 msgr2=0x7fb7181ef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704003b10 0x7fb7181ef5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 -- 172.21.15.89:0/301113242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180a9b10 con 0x7fb7180abab0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb70ffff640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb718149f10 0x7fb7181536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.566+0000 7fb71759e640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 0x7fb7180abf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb7180c5f10 tx=0x7fb71000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710006b60 con 0x7fb7180abab0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710006cc0 con 0x7fb7180abab0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710003bc0 con 0x7fb7180abab0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7180a9df0 con 0x7fb7180abab0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7180ac470 con 0x7fb7180abab0 2023-12-07T09:59:41.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718153410 con 0x7fb7180abab0 2023-12-07T09:59:41.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb710003d20 con 0x7fb7180abab0 2023-12-07T09:59:41.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb70f7fe640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6f80668d0 0x7fb6f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb710083a60 con 0x7fb7180abab0 2023-12-07T09:59:41.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb716d9d640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6f80668d0 0x7fb6f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.570+0000 7fb716d9d640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6f80668d0 0x7fb6f8068d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7080a9000 tx=0x7fb708001990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.574+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb718153410 con 0x7fb7180abab0 2023-12-07T09:59:41.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.726+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb718153410 con 0x7fb7180abab0 2023-12-07T09:59:41.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.726+0000 7fb70f7fe640 1 -- 172.21.15.89:0/301113242 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fb718153410 con 0x7fb7180abab0 2023-12-07T09:59:41.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:41.755 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:41.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.726+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6f80668d0 msgr2=0x7fb6f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.726+0000 7fb71d094640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6f80668d0 0x7fb6f8068d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7080a9000 tx=0x7fb708001990 comp rx=0 tx=0).stop 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.726+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 msgr2=0x7fb7180abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.726+0000 7fb71d094640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 0x7fb7180abf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb7180c5f10 tx=0x7fb71000eb90 comp rx=0 tx=0).stop 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 shutdown_connections 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7180abab0 0x7fb7180abf30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6f80668d0 0x7fb6f8068d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb718149f10 0x7fb7181536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 --2- 172.21.15.89:0/301113242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb704003b10 0x7fb7181ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 >> 172.21.15.89:0/301113242 conn(0x7fb718071ea0 msgr2=0x7fb718072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:41.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 shutdown_connections 2023-12-07T09:59:41.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.730+0000 7fb71d094640 1 -- 172.21.15.89:0/301113242 wait complete. 2023-12-07T09:59:41.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:41.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:41.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 Processor -- start 2023-12-07T09:59:41.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 -- start start 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f53ec151f90 0x7f53ec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53ec0c0370 0x7f53ec06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec06de00 con 0x7f53ec0c0370 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec070390 con 0x7f53ec151f90 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f2a5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec06db90 con 0x7f53ec14eaf0 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.894+0000 7f53f0ffc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53ec0c0370 0x7f53ec06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53eb7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f53ec151f90 0x7f53ec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53ec0c0370 0x7f53ec06d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38426/0 (socket says 172.21.15.89:38426) 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 -- 172.21.15.89:0/842120091 learned_addr learned my addr 172.21.15.89:0/842120091 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 -- 172.21.15.89:0/842120091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 msgr2=0x7f53ec151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 --2- 172.21.15.89:0/842120091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 -- 172.21.15.89:0/842120091 >> v2:172.21.15.97:3300/0 conn(0x7f53ec151f90 msgr2=0x7f53ec06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 --2- 172.21.15.89:0/842120091 >> v2:172.21.15.97:3300/0 conn(0x7f53ec151f90 0x7f53ec06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 -- 172.21.15.89:0/842120091 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec14eed0 con 0x7f53ec0c0370 2023-12-07T09:59:41.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53f0ffc640 1 --2- 172.21.15.89:0/842120091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec06d650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0c6f80 tx=0x7f53e401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ca44edf5bf197f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53eaffd640 1 -- 172.21.15.89:0/842120091 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40a5730 con 0x7f53ec0c0370 2023-12-07T09:59:41.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53eaffd640 1 -- 172.21.15.89:0/842120091 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e40a5890 con 0x7f53ec0c0370 2023-12-07T09:59:41.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.898+0000 7f53eaffd640 1 -- 172.21.15.89:0/842120091 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40a5c20 con 0x7f53ec0c0370 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- 172.21.15.89:0/842120091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 msgr2=0x7f53ec06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/842120091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec06d650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0c6f80 tx=0x7f53e401c8b0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- 172.21.15.89:0/842120091 shutdown_connections 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/842120091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec06d650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/842120091 >> v2:172.21.15.97:3300/0 conn(0x7f53ec151f90 0x7f53ec06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/842120091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- 172.21.15.89:0/842120091 >> 172.21.15.89:0/842120091 conn(0x7f53ec0c2a60 msgr2=0x7f53ec0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- 172.21.15.89:0/842120091 shutdown_connections 2023-12-07T09:59:41.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- 172.21.15.89:0/842120091 wait complete. 2023-12-07T09:59:41.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 Processor -- start 2023-12-07T09:59:41.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- start start 2023-12-07T09:59:41.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec13b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53ec13bbc0 0x7f53ec1f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0c5970 con 0x7f53ec0c0370 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec14e310 con 0x7f53ec13bbc0 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f2a5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec14e0a0 con 0x7f53ec14eaf0 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec1411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38432/0 (socket says 172.21.15.89:38432) 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 -- 172.21.15.89:0/828542312 learned_addr learned my addr 172.21.15.89:0/828542312 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53f0ffc640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53ec13bbc0 0x7f53ec1f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53eb7fe640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 -- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 msgr2=0x7f53ec13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 -- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53ec13bbc0 msgr2=0x7f53ec1f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53ec13bbc0 0x7f53ec1f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:41.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.902+0000 7f53ebfff640 1 -- 172.21.15.89:0/828542312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4009b30 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53ebfff640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec1411f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e8e0 tx=0x7f53dc00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00ca00 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00cb60 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc013470 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec154920 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec141730 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec154b10 con 0x7f53ec0c0370 2023-12-07T09:59:41.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53dc0135d0 con 0x7f53ec0c0370 2023-12-07T09:59:41.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53e8ff9640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53d8066900 0x7f53d8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:41.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53dc084650 con 0x7f53ec0c0370 2023-12-07T09:59:41.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.906+0000 7f53eb7fe640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53d8066900 0x7f53d8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:41.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.910+0000 7f53eb7fe640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53d8066900 0x7f53d8068dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53ec14da90 tx=0x7f53e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:41.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:41.910+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53ec154b10 con 0x7f53ec0c0370 2023-12-07T09:59:42.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.062+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53ec154b10 con 0x7f53ec0c0370 2023-12-07T09:59:42.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.062+0000 7f53e8ff9640 1 -- 172.21.15.89:0/828542312 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53ec154b10 con 0x7f53ec0c0370 2023-12-07T09:59:42.070 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:42.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53d8066900 msgr2=0x7f53d8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53d8066900 0x7f53d8068dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53ec14da90 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2023-12-07T09:59:42.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 msgr2=0x7f53ec1411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec1411f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e8e0 tx=0x7f53dc00eda0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 shutdown_connections 2023-12-07T09:59:42.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53ec13bbc0 0x7f53ec1f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53d8066900 0x7f53d8068dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53ec14eaf0 0x7f53ec13b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 --2- 172.21.15.89:0/828542312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53ec0c0370 0x7f53ec1411f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 >> 172.21.15.89:0/828542312 conn(0x7f53ec0c2a60 msgr2=0x7f53ec1428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:42.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 shutdown_connections 2023-12-07T09:59:42.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.066+0000 7f53f2a5f640 1 -- 172.21.15.89:0/828542312 wait complete. 2023-12-07T09:59:42.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 Processor -- start 2023-12-07T09:59:42.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 -- start start 2023-12-07T09:59:42.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc94c06f0d0 0x7fc94c0bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c073710 con 0x7fc94c0c2a60 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c1589f0 con 0x7fc94c06f0d0 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc952a9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1586e0 con 0x7fc94c06b810 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc951039640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc94c0c2a60 0x7fc94c06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35022/0 (socket says 172.21.15.89:35022) 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc951039640 1 -- 172.21.15.89:0/2976770457 learned_addr learned my addr 172.21.15.89:0/2976770457 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94bfff640 1 --2- 172.21.15.89:0/2976770457 >> v2:172.21.15.97:3300/0 conn(0x7fc94c06f0d0 0x7fc94c0bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc950838640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94b7fe640 1 -- 172.21.15.89:0/2976770457 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202228455 0 0) 0x7fc94c073710 con 0x7fc94c0c2a60 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94b7fe640 1 -- 172.21.15.89:0/2976770457 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc93c003530 con 0x7fc94c0c2a60 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94bfff640 1 -- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 msgr2=0x7fc94c0c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:42.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94bfff640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c0c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94bfff640 1 -- 172.21.15.89:0/2976770457 >> v1:172.21.15.89:6789/0 conn(0x7fc94c0c2a60 legacy=0x7fc94c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc94bfff640 1 -- 172.21.15.89:0/2976770457 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0c00b0 con 0x7fc94c06f0d0 2023-12-07T09:59:42.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.226+0000 7fc950838640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:42.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc94bfff640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c06f0d0 0x7fc94c0bfb70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9380097c0 tx=0x7fc93801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e7fa382e19316de server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc94b7fe640 1 -- 172.21.15.89:0/2976770457 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380ab600 con 0x7fc94c06f0d0 2023-12-07T09:59:42.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc94b7fe640 1 -- 172.21.15.89:0/2976770457 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9380a7050 con 0x7fc94c06f0d0 2023-12-07T09:59:42.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc94b7fe640 1 -- 172.21.15.89:0/2976770457 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380ab980 con 0x7fc94c06f0d0 2023-12-07T09:59:42.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 -- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c06f0d0 msgr2=0x7fc94c0bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c06f0d0 0x7fc94c0bfb70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9380097c0 tx=0x7fc93801c480 comp rx=0 tx=0).stop 2023-12-07T09:59:42.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 -- 172.21.15.89:0/2976770457 shutdown_connections 2023-12-07T09:59:42.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c06f0d0 0x7fc94c0bfb70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 --2- 172.21.15.89:0/2976770457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 -- 172.21.15.89:0/2976770457 >> 172.21.15.89:0/2976770457 conn(0x7fc94c0c3240 msgr2=0x7fc94c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:42.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 -- 172.21.15.89:0/2976770457 shutdown_connections 2023-12-07T09:59:42.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.230+0000 7fc952a9c640 1 -- 172.21.15.89:0/2976770457 wait complete. 2023-12-07T09:59:42.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 Processor -- start 2023-12-07T09:59:42.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 -- start start 2023-12-07T09:59:42.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 0x7fc94c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c0c2a60 0x7fc94c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1577a0 con 0x7fc94c06f0d0 2023-12-07T09:59:42.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c149050 con 0x7fc94c0c2a60 2023-12-07T09:59:42.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c148340 con 0x7fc94c06b810 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 0x7fc94c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 0x7fc94c1498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38436/0 (socket says 172.21.15.89:38436) 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 -- 172.21.15.89:0/514794819 learned_addr learned my addr 172.21.15.89:0/514794819 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc950838640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc951039640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c0c2a60 0x7fc94c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 -- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 msgr2=0x7fc94c147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 -- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c0c2a60 msgr2=0x7fc94c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c0c2a60 0x7fc94c0c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 -- 172.21.15.89:0/514794819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940009420 con 0x7fc94c06f0d0 2023-12-07T09:59:42.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc94bfff640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 0x7fc94c1498f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9380ae040 tx=0x7fc938019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b4430 con 0x7fc94c06f0d0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9380b45b0 con 0x7fc94c06f0d0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b4960 con 0x7fc94c06f0d0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc938009420 con 0x7fc94c06f0d0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.234+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c148850 con 0x7fc94c06f0d0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.238+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c04e890 con 0x7fc94c06f0d0 2023-12-07T09:59:42.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.238+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc9380b2040 con 0x7fc94c06f0d0 2023-12-07T09:59:42.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.238+0000 7fc9497fa640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9300668d0 0x7fc930068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.238+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc93811e3d0 con 0x7fc94c06f0d0 2023-12-07T09:59:42.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.238+0000 7fc950838640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9300668d0 0x7fc930068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.238+0000 7fc950838640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9300668d0 0x7fc930068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc940009c80 tx=0x7fc940008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.242+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9380eb600 con 0x7fc94c06f0d0 2023-12-07T09:59:42.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.394+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc94c0734f0 con 0x7fc94c06f0d0 2023-12-07T09:59:42.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.394+0000 7fc9497fa640 1 -- 172.21.15.89:0/514794819 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9380eec20 con 0x7fc94c06f0d0 2023-12-07T09:59:42.403 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:42.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9300668d0 msgr2=0x7fc930068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9300668d0 0x7fc930068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc940009c80 tx=0x7fc940008040 comp rx=0 tx=0).stop 2023-12-07T09:59:42.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 msgr2=0x7fc94c1498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 0x7fc94c1498f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9380ae040 tx=0x7fc938019220 comp rx=0 tx=0).stop 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 shutdown_connections 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc94c0c2a60 0x7fc94c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc94c06f0d0 0x7fc94c1498f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9300668d0 0x7fc930068d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 --2- 172.21.15.89:0/514794819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc94c06b810 0x7fc94c147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 >> 172.21.15.89:0/514794819 conn(0x7fc94c0c3240 msgr2=0x7fc94c15f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:42.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 shutdown_connections 2023-12-07T09:59:42.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.398+0000 7fc952a9c640 1 -- 172.21.15.89:0/514794819 wait complete. 2023-12-07T09:59:42.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:42.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 Processor -- start 2023-12-07T09:59:42.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 -- start start 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f748414eaf0 0x7f7484151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7484151f90 0x7f748406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748406de00 con 0x7f74840c0370 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7484070390 con 0x7f748414eaf0 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f748913e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748414eed0 con 0x7f7484151f90 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f748414eaf0 0x7f7484151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f748414eaf0 0x7f7484151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38438/0 (socket says 172.21.15.89:38438) 2023-12-07T09:59:42.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 -- 172.21.15.89:0/3274404771 learned_addr learned my addr 172.21.15.89:0/3274404771 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:42.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f747bfff640 1 --2- 172.21.15.89:0/3274404771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7484151f90 0x7f748406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 -- 172.21.15.89:0/3274404771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7484151f90 msgr2=0x7f748406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:42.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 --2- 172.21.15.89:0/3274404771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7484151f90 0x7f748406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 -- 172.21.15.89:0/3274404771 >> v1:172.21.15.89:6789/0 conn(0x7f74840c0370 legacy=0x7f748406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.558+0000 7f7482d9d640 1 -- 172.21.15.89:0/3274404771 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484151270 con 0x7f748414eaf0 2023-12-07T09:59:42.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f7482d9d640 1 --2- 172.21.15.89:0/3274404771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748414eaf0 0x7f7484151a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7474009870 tx=0x7f747401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9343e70c510aad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748259c640 1 -- 172.21.15.89:0/3274404771 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740ab5f0 con 0x7f748414eaf0 2023-12-07T09:59:42.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748259c640 1 -- 172.21.15.89:0/3274404771 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74740ab750 con 0x7f748414eaf0 2023-12-07T09:59:42.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748259c640 1 -- 172.21.15.89:0/3274404771 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740abae0 con 0x7f748414eaf0 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 -- 172.21.15.89:0/3274404771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748414eaf0 msgr2=0x7f7484151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 --2- 172.21.15.89:0/3274404771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748414eaf0 0x7f7484151a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7474009870 tx=0x7f747401c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 -- 172.21.15.89:0/3274404771 shutdown_connections 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 --2- 172.21.15.89:0/3274404771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7484151f90 0x7f748406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 --2- 172.21.15.89:0/3274404771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748414eaf0 0x7f7484151a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 -- 172.21.15.89:0/3274404771 >> 172.21.15.89:0/3274404771 conn(0x7f74840c2a60 msgr2=0x7f74840c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 -- 172.21.15.89:0/3274404771 shutdown_connections 2023-12-07T09:59:42.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.562+0000 7f748913e640 1 -- 172.21.15.89:0/3274404771 wait complete. 2023-12-07T09:59:42.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 Processor -- start 2023-12-07T09:59:42.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 -- start start 2023-12-07T09:59:42.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74840c0370 0x7f74841497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748414eaf0 0x7f74841ee960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 0x7f7484144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74841f0fc0 con 0x7f74841f13e0 2023-12-07T09:59:42.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484149cf0 con 0x7f748414eaf0 2023-12-07T09:59:42.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74841eeea0 con 0x7f74840c0370 2023-12-07T09:59:42.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 0x7f7484144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 0x7f7484144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38446/0 (socket says 172.21.15.89:38446) 2023-12-07T09:59:42.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 -- 172.21.15.89:0/3027811252 learned_addr learned my addr 172.21.15.89:0/3027811252 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:42.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f7482d9d640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74840c0370 0x7f74841497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f747bfff640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748414eaf0 0x7f74841ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 -- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74840c0370 msgr2=0x7f74841497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74840c0370 0x7f74841497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 -- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748414eaf0 msgr2=0x7f74841ee960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748414eaf0 0x7f74841ee960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 -- 172.21.15.89:0/3027811252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740094d0 con 0x7f74841f13e0 2023-12-07T09:59:42.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748359e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 0x7f7484144cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c7a0 tx=0x7f747c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c003b80 con 0x7f74841f13e0 2023-12-07T09:59:42.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c003ce0 con 0x7f74841f13e0 2023-12-07T09:59:42.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840c43d0 con 0x7f74841f13e0 2023-12-07T09:59:42.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00aa90 con 0x7f74841f13e0 2023-12-07T09:59:42.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.566+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74841f0be0 con 0x7f74841f13e0 2023-12-07T09:59:42.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.570+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74840c48f0 con 0x7f74841f13e0 2023-12-07T09:59:42.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.570+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f747c00abf0 con 0x7f74841f13e0 2023-12-07T09:59:42.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.570+0000 7f747b7fe640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f74640668d0 0x7f7464068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.570+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f747c084170 con 0x7f74841f13e0 2023-12-07T09:59:42.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.570+0000 7f7482d9d640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f74640668d0 0x7f7464068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.570+0000 7f7482d9d640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f74640668d0 0x7f7464068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74740af000 tx=0x7f74740b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.574+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74840c48f0 con 0x7f74841f13e0 2023-12-07T09:59:42.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.722+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74840c48f0 con 0x7f74841f13e0 2023-12-07T09:59:42.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f747b7fe640 1 -- 172.21.15.89:0/3027811252 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74840c48f0 con 0x7f74841f13e0 2023-12-07T09:59:42.731 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:42.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f74640668d0 msgr2=0x7f7464068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f74640668d0 0x7f7464068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74740af000 tx=0x7f74740b6040 comp rx=0 tx=0).stop 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 msgr2=0x7f7484144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 0x7f7484144cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c7a0 tx=0x7f747c00cc60 comp rx=0 tx=0).stop 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 shutdown_connections 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74841f13e0 0x7f7484144cf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748414eaf0 0x7f74841ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f74640668d0 0x7f7464068d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 --2- 172.21.15.89:0/3027811252 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f74840c0370 0x7f74841497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 >> 172.21.15.89:0/3027811252 conn(0x7f74840c2a60 msgr2=0x7f748414be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 shutdown_connections 2023-12-07T09:59:42.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.726+0000 7f748913e640 1 -- 172.21.15.89:0/3027811252 wait complete. 2023-12-07T09:59:42.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T09:59:42.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.882+0000 7fbc65ddf640 1 Processor -- start 2023-12-07T09:59:42.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.882+0000 7fbc65ddf640 1 -- start start 2023-12-07T09:59:42.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc65ddf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc6006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc65ddf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc600700a0 0x7fbc6006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc65ddf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc60072780 con 0x7fbc600aacd0 2023-12-07T09:59:42.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc65ddf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600ac160 con 0x7fbc600700a0 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc65ddf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600abe80 con 0x7fbc60154870 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc600700a0 0x7fbc6006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc600700a0 0x7fbc6006ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38454/0 (socket says 172.21.15.89:38454) 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 -- 172.21.15.89:0/2365496624 learned_addr learned my addr 172.21.15.89:0/2365496624 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5effd640 1 --2- 172.21.15.89:0/2365496624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc6006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 -- 172.21.15.89:0/2365496624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 msgr2=0x7fbc6006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 --2- 172.21.15.89:0/2365496624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc6006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 -- 172.21.15.89:0/2365496624 >> v1:172.21.15.97:6789/0 conn(0x7fbc600aacd0 legacy=0x7fbc60154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.886+0000 7fbc5ffff640 1 -- 172.21.15.89:0/2365496624 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60154cf0 con 0x7fbc600700a0 2023-12-07T09:59:42.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc5ffff640 1 --2- 172.21.15.89:0/2365496624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600700a0 0x7fbc6006ce90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009e50 tx=0x7fbc5801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0c918a5e1f036 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc5e7fc640 1 -- 172.21.15.89:0/2365496624 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580a5810 con 0x7fbc600700a0 2023-12-07T09:59:42.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc5e7fc640 1 -- 172.21.15.89:0/2365496624 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc580a5970 con 0x7fbc600700a0 2023-12-07T09:59:42.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc5e7fc640 1 -- 172.21.15.89:0/2365496624 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580a5d00 con 0x7fbc600700a0 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 -- 172.21.15.89:0/2365496624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600700a0 msgr2=0x7fbc6006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/2365496624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600700a0 0x7fbc6006ce90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009e50 tx=0x7fbc5801c950 comp rx=0 tx=0).stop 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 -- 172.21.15.89:0/2365496624 shutdown_connections 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/2365496624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600700a0 0x7fbc6006ce90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/2365496624 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc6006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 -- 172.21.15.89:0/2365496624 >> 172.21.15.89:0/2365496624 conn(0x7fbc600c2ad0 msgr2=0x7fbc600c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 -- 172.21.15.89:0/2365496624 shutdown_connections 2023-12-07T09:59:42.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 -- 172.21.15.89:0/2365496624 wait complete. 2023-12-07T09:59:42.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 Processor -- start 2023-12-07T09:59:42.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.890+0000 7fbc65ddf640 1 -- start start 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc600700a0 0x7fbc601515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 0x7fbc60152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc601ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60151030 con 0x7fbc600aacd0 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014a170 con 0x7fbc600700a0 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600c5a00 con 0x7fbc60154870 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 0x7fbc60152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 0x7fbc60152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38462/0 (socket says 172.21.15.89:38462) 2023-12-07T09:59:42.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 -- 172.21.15.89:0/3139551096 learned_addr learned my addr 172.21.15.89:0/3139551096 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:42.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5ffff640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc601ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5f7fe640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc600700a0 0x7fbc601515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 -- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 msgr2=0x7fbc601ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc601ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 -- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc600700a0 msgr2=0x7fbc601515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:42.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc600700a0 0x7fbc601515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:42.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 -- 172.21.15.89:0/3139551096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58009b30 con 0x7fbc600aacd0 2023-12-07T09:59:42.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc5effd640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 0x7fbc60152aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400d830 tx=0x7fbc5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400b6c0 con 0x7fbc600aacd0 2023-12-07T09:59:42.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400b820 con 0x7fbc600aacd0 2023-12-07T09:59:42.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400bb90 con 0x7fbc600aacd0 2023-12-07T09:59:42.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc60150d50 con 0x7fbc600aacd0 2023-12-07T09:59:42.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc60152fe0 con 0x7fbc600aacd0 2023-12-07T09:59:42.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6014a2b0 con 0x7fbc600aacd0 2023-12-07T09:59:42.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.894+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbc5401e460 con 0x7fbc600aacd0 2023-12-07T09:59:42.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.898+0000 7fbc47fff640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbc4c0668d0 0x7fbc4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:42.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.898+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc54084a60 con 0x7fbc600aacd0 2023-12-07T09:59:42.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.898+0000 7fbc5f7fe640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbc4c0668d0 0x7fbc4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:42.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.898+0000 7fbc5f7fe640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbc4c0668d0 0x7fbc4c068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc50007fd0 tx=0x7fbc50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:42.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:42.902+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc6014a2b0 con 0x7fbc600aacd0 2023-12-07T09:59:43.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc6014a2b0 con 0x7fbc600aacd0 2023-12-07T09:59:43.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc47fff640 1 -- 172.21.15.89:0/3139551096 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc6014a2b0 con 0x7fbc600aacd0 2023-12-07T09:59:43.069 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbc4c0668d0 msgr2=0x7fbc4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbc4c0668d0 0x7fbc4c068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc50007fd0 tx=0x7fbc50009040 comp rx=0 tx=0).stop 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 msgr2=0x7fbc60152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 0x7fbc60152aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400d830 tx=0x7fbc5400dcf0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 shutdown_connections 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbc4c0668d0 0x7fbc4c068d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc60154870 0x7fbc601ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc600aacd0 0x7fbc60152aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 --2- 172.21.15.89:0/3139551096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc600700a0 0x7fbc601515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 >> 172.21.15.89:0/3139551096 conn(0x7fbc600c2ad0 msgr2=0x7fbc6015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:43.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 shutdown_connections 2023-12-07T09:59:43.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.062+0000 7fbc65ddf640 1 -- 172.21.15.89:0/3139551096 wait complete. 2023-12-07T09:59:43.090 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T09:59:43.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:43.090 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-07T09:59:43.126 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T09:59:43.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T09:59:43.126 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T09:59:43.185 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-07T09:59:43.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:43.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.314+0000 7fd3f3e5f640 1 Processor -- start 2023-12-07T09:59:43.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.314+0000 7fd3f3e5f640 1 -- start start 2023-12-07T09:59:43.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f3e5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f3e5f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0c19e0 0x7fd3ec0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f3e5f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec06dec0 con 0x7fd3ec14fcc0 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f3e5f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec0aa340 con 0x7fd3ec0c19e0 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f3e5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec156980 con 0x7fd3ec156500 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f23fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0c19e0 0x7fd3ec0c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:44700/0 (socket says 172.21.15.89:44700) 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 -- 172.21.15.89:0/1366244390 learned_addr learned my addr 172.21.15.89:0/1366244390 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 -- 172.21.15.89:0/1366244390 >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0c19e0 msgr2=0x7fd3ec0c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:43.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 --2- 172.21.15.89:0/1366244390 >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0c19e0 0x7fd3ec0c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 -- 172.21.15.89:0/1366244390 >> v1:172.21.15.97:6789/0 conn(0x7fd3ec14fcc0 legacy=0x7fd3ec0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.318+0000 7fd3f13fa640 1 -- 172.21.15.89:0/1366244390 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0ab580 con 0x7fd3ec156500 2023-12-07T09:59:43.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f13fa640 1 --2- 172.21.15.89:0/1366244390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec06d980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55411d33f6c56b14 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:43.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f0bf9640 1 -- 172.21.15.89:0/1366244390 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0ab620 con 0x7fd3ec156500 2023-12-07T09:59:43.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f0bf9640 1 -- 172.21.15.89:0/1366244390 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc0ab780 con 0x7fd3ec156500 2023-12-07T09:59:43.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f0bf9640 1 -- 172.21.15.89:0/1366244390 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0abb10 con 0x7fd3ec156500 2023-12-07T09:59:43.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/1366244390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 msgr2=0x7fd3ec06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/1366244390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec06d980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc01c510 comp rx=0 tx=0).stop 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/1366244390 shutdown_connections 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/1366244390 >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0c19e0 0x7fd3ec0c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/1366244390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec06d980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/1366244390 >> 172.21.15.89:0/1366244390 conn(0x7fd3ec0c2ad0 msgr2=0x7fd3ec0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/1366244390 shutdown_connections 2023-12-07T09:59:43.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/1366244390 wait complete. 2023-12-07T09:59:43.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 Processor -- start 2023-12-07T09:59:43.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- start start 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0c19e0 0x7fd3ec1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 0x7fd3ec1ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec149ef0 con 0x7fd3ec0710f0 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec1edb10 con 0x7fd3ec0c19e0 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.322+0000 7fd3f3e5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec14a190 con 0x7fd3ec156500 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 0x7fd3ec1ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 0x7fd3ec1ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38474/0 (socket says 172.21.15.89:38474) 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 -- 172.21.15.89:0/4133116011 learned_addr learned my addr 172.21.15.89:0/4133116011 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f13fa640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f1bfb640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0c19e0 0x7fd3ec1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 -- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 msgr2=0x7fd3ec070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 -- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0c19e0 msgr2=0x7fd3ec1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0c19e0 0x7fd3ec1520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 -- 172.21.15.89:0/4133116011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0094d0 con 0x7fd3ec0710f0 2023-12-07T09:59:43.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f23fc640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 0x7fd3ec1ecef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400efc0 tx=0x7fd3e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4014480 con 0x7fd3ec0710f0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e400f040 con 0x7fd3ec0710f0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec152620 con 0x7fd3ec0710f0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4014820 con 0x7fd3ec0710f0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec155410 con 0x7fd3ec0710f0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec04e890 con 0x7fd3ec0710f0 2023-12-07T09:59:43.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.326+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd3e4014980 con 0x7fd3ec0710f0 2023-12-07T09:59:43.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.330+0000 7fd3e27fc640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3d00668d0 0x7fd3d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.330+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3e4084e80 con 0x7fd3ec0710f0 2023-12-07T09:59:43.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.330+0000 7fd3f1bfb640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3d00668d0 0x7fd3d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.330+0000 7fd3f1bfb640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3d00668d0 0x7fd3d0068d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8007fd0 tx=0x7fd3e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:43.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.334+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3e4052160 con 0x7fd3ec0710f0 2023-12-07T09:59:43.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3ec14b2c0 con 0x7fd3ec0710f0 2023-12-07T09:59:43.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3e27fc640 1 -- 172.21.15.89:0/4133116011 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fd3e4055780 con 0x7fd3ec0710f0 2023-12-07T09:59:43.521 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:43.521 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:43.522 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3d00668d0 msgr2=0x7fd3d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3d00668d0 0x7fd3d0068d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8007fd0 tx=0x7fd3e8009040 comp rx=0 tx=0).stop 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 msgr2=0x7fd3ec1ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 0x7fd3ec1ecef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400efc0 tx=0x7fd3e400c490 comp rx=0 tx=0).stop 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 shutdown_connections 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3ec0710f0 0x7fd3ec1ecef0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3d00668d0 0x7fd3d0068d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec156500 0x7fd3ec070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 --2- 172.21.15.89:0/4133116011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0c19e0 0x7fd3ec1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 >> 172.21.15.89:0/4133116011 conn(0x7fd3ec0c2ad0 msgr2=0x7fd3ec0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:43.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 shutdown_connections 2023-12-07T09:59:43.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.514+0000 7fd3f3e5f640 1 -- 172.21.15.89:0/4133116011 wait complete. 2023-12-07T09:59:43.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:43.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 Processor -- start 2023-12-07T09:59:43.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 -- start start 2023-12-07T09:59:43.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444151df0 0x7f34440c8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3444158710 0x7f3444154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34441554a0 0x7f34440c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440c57c0 con 0x7f34441554a0 2023-12-07T09:59:43.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34441521d0 con 0x7f3444158710 2023-12-07T09:59:43.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34490c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34440c4c60 con 0x7f3444151df0 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34441554a0 0x7f34440c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34441554a0 0x7f34440c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38490/0 (socket says 172.21.15.89:38490) 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 -- 172.21.15.89:0/1839597835 learned_addr learned my addr 172.21.15.89:0/1839597835 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34437fe640 1 --2- 172.21.15.89:0/1839597835 >> v2:172.21.15.97:3300/0 conn(0x7f3444158710 0x7f3444154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f3443fff640 1 --2- 172.21.15.89:0/1839597835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444151df0 0x7f34440c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 -- 172.21.15.89:0/1839597835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444151df0 msgr2=0x7f34440c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 --2- 172.21.15.89:0/1839597835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444151df0 0x7f34440c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 -- 172.21.15.89:0/1839597835 >> v2:172.21.15.97:3300/0 conn(0x7f3444158710 msgr2=0x7f3444154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 --2- 172.21.15.89:0/1839597835 >> v2:172.21.15.97:3300/0 conn(0x7f3444158710 0x7f3444154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.674+0000 7f34488c7640 1 -- 172.21.15.89:0/1839597835 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440c4f40 con 0x7f34441554a0 2023-12-07T09:59:43.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34488c7640 1 --2- 172.21.15.89:0/1839597835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34441554a0 0x7f34440c68b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f344408bd40 tx=0x7f343c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3c4c449078dbb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:43.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f3442ffd640 1 -- 172.21.15.89:0/1839597835 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0a56a0 con 0x7f34441554a0 2023-12-07T09:59:43.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f3442ffd640 1 -- 172.21.15.89:0/1839597835 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0a5800 con 0x7f34441554a0 2023-12-07T09:59:43.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f3442ffd640 1 -- 172.21.15.89:0/1839597835 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0a5b90 con 0x7f34441554a0 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 -- 172.21.15.89:0/1839597835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34441554a0 msgr2=0x7f34440c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 --2- 172.21.15.89:0/1839597835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34441554a0 0x7f34440c68b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f344408bd40 tx=0x7f343c01c910 comp rx=0 tx=0).stop 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 -- 172.21.15.89:0/1839597835 shutdown_connections 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 --2- 172.21.15.89:0/1839597835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34441554a0 0x7f34440c68b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 --2- 172.21.15.89:0/1839597835 >> v2:172.21.15.97:3300/0 conn(0x7f3444158710 0x7f3444154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 --2- 172.21.15.89:0/1839597835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444151df0 0x7f34440c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 -- 172.21.15.89:0/1839597835 >> 172.21.15.89:0/1839597835 conn(0x7f34440ca140 msgr2=0x7f34440ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:43.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 -- 172.21.15.89:0/1839597835 shutdown_connections 2023-12-07T09:59:43.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 -- 172.21.15.89:0/1839597835 wait complete. 2023-12-07T09:59:43.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 Processor -- start 2023-12-07T09:59:43.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.678+0000 7f34490c8640 1 -- start start 2023-12-07T09:59:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 0x7f34440aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34441554a0 0x7f344414af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444158710 0x7f344414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34440ab5f0 con 0x7f3444151df0 2023-12-07T09:59:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34440c3080 con 0x7f34441554a0 2023-12-07T09:59:43.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344414b9d0 con 0x7f3444158710 2023-12-07T09:59:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 0x7f34440aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 0x7f34440aa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38496/0 (socket says 172.21.15.89:38496) 2023-12-07T09:59:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 -- 172.21.15.89:0/2772033405 learned_addr learned my addr 172.21.15.89:0/2772033405 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34488c7640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444158710 0x7f344414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34437fe640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34441554a0 0x7f344414af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 -- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444158710 msgr2=0x7f344414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444158710 0x7f344414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 -- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34441554a0 msgr2=0x7f344414af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34441554a0 0x7f344414af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 -- 172.21.15.89:0/2772033405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009b30 con 0x7f3444151df0 2023-12-07T09:59:43.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3443fff640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 0x7f34440aa940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f343400d5f0 tx=0x7f343400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34340125f0 con 0x7f3444151df0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434012750 con 0x7f3444151df0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434012ae0 con 0x7f3444151df0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34440c28c0 con 0x7f3444151df0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34440c3820 con 0x7f3444151df0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344404e890 con 0x7f3444151df0 2023-12-07T09:59:43.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.682+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3434012c40 con 0x7f3444151df0 2023-12-07T09:59:43.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.686+0000 7f3440ff9640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3430066900 0x7f3430068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:43.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.686+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34340846f0 con 0x7f3444151df0 2023-12-07T09:59:43.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.686+0000 7f34437fe640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3430066900 0x7f3430068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:43.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.686+0000 7f34437fe640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3430066900 0x7f3430068dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34441f17d0 tx=0x7f3438008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:43.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.690+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3434051a70 con 0x7f3444151df0 2023-12-07T09:59:43.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.842+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f344406cda0 con 0x7f3444151df0 2023-12-07T09:59:43.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.842+0000 7f3440ff9640 1 -- 172.21.15.89:0/2772033405 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f3434004650 con 0x7f3444151df0 2023-12-07T09:59:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:43.850 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.842+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3430066900 msgr2=0x7f3430068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.842+0000 7f34490c8640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3430066900 0x7f3430068dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34441f17d0 tx=0x7f3438008040 comp rx=0 tx=0).stop 2023-12-07T09:59:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.842+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 msgr2=0x7f34440aa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.842+0000 7f34490c8640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 0x7f34440aa940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f343400d5f0 tx=0x7f343400dab0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 shutdown_connections 2023-12-07T09:59:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3430066900 0x7f3430068dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3444158710 0x7f344414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34441554a0 0x7f344414af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 --2- 172.21.15.89:0/2772033405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3444151df0 0x7f34440aa940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 >> 172.21.15.89:0/2772033405 conn(0x7f34440ca140 msgr2=0x7f34440ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 shutdown_connections 2023-12-07T09:59:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:43.846+0000 7f34490c8640 1 -- 172.21.15.89:0/2772033405 wait complete. 2023-12-07T09:59:43.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:10.538633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:11.802832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:43.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:44.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.002+0000 7f1a48cfe640 1 Processor -- start 2023-12-07T09:59:44.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.002+0000 7f1a48cfe640 1 -- start start 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a48cfe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a440c0370 0x7f1a4406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a48cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440a8470 0x7f1a4406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a48cfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4406de00 con 0x7f1a4414eaf0 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a48cfe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a44070390 con 0x7f1a440c0370 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a48cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4406db90 con 0x7f1a440a8470 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a440c0370 0x7f1a4406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a440c0370 0x7f1a4406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38508/0 (socket says 172.21.15.89:38508) 2023-12-07T09:59:44.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3145176802 learned_addr learned my addr 172.21.15.89:0/3145176802 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:44.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a42d9d640 1 --2- 172.21.15.89:0/3145176802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440a8470 0x7f1a4406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3145176802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440a8470 msgr2=0x7f1a4406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:44.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 --2- 172.21.15.89:0/3145176802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440a8470 0x7f1a4406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3145176802 >> v1:172.21.15.97:6789/0 conn(0x7f1a4414eaf0 legacy=0x7f1a44151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.006+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3145176802 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4414eed0 con 0x7f1a440c0370 2023-12-07T09:59:44.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a39d9b640 1 --2- 172.21.15.89:0/3145176802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a4406d110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00d150 tx=0x7f1a2c01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47abd810a73e3662 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a41d9b640 1 -- 172.21.15.89:0/3145176802 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c00b2d0 con 0x7f1a440c0370 2023-12-07T09:59:44.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a41d9b640 1 -- 172.21.15.89:0/3145176802 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c00b430 con 0x7f1a440c0370 2023-12-07T09:59:44.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a41d9b640 1 -- 172.21.15.89:0/3145176802 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0a7c00 con 0x7f1a440c0370 2023-12-07T09:59:44.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3145176802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 msgr2=0x7f1a4406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3145176802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a4406d110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00d150 tx=0x7f1a2c01eaf0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3145176802 shutdown_connections 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3145176802 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a440a8470 0x7f1a4406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3145176802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a4406d110 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3145176802 >> 172.21.15.89:0/3145176802 conn(0x7f1a440c2a60 msgr2=0x7f1a440c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3145176802 shutdown_connections 2023-12-07T09:59:44.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3145176802 wait complete. 2023-12-07T09:59:44.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 Processor -- start 2023-12-07T09:59:44.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- start start 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440a8470 0x7f1a440c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a440aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a4414eaf0 0x7f1a440aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4413b330 con 0x7f1a440c0370 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440c42d0 con 0x7f1a440a8470 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.010+0000 7f1a48cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440c1990 con 0x7f1a4414eaf0 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a440aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a440aa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38524/0 (socket says 172.21.15.89:38524) 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3749225291 learned_addr learned my addr 172.21.15.89:0/3749225291 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:44.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a42d9d640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a4414eaf0 0x7f1a440aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a4259c640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440a8470 0x7f1a440c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a4414eaf0 msgr2=0x7f1a440aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a4414eaf0 0x7f1a440aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440a8470 msgr2=0x7f1a440c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440a8470 0x7f1a440c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 -- 172.21.15.89:0/3749225291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c00bd40 con 0x7f1a440c0370 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a39d9b640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a440aa8a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c01c720 tx=0x7f1a2c01b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0bd070 con 0x7f1a440c0370 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c00b720 con 0x7f1a440c0370 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a440c1c70 con 0x7f1a440c0370 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c009e60 con 0x7f1a440c0370 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a440aa380 con 0x7f1a440c0370 2023-12-07T09:59:44.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a440aa570 con 0x7f1a440c0370 2023-12-07T09:59:44.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.014+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a2c0b9430 con 0x7f1a440c0370 2023-12-07T09:59:44.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.018+0000 7f1a3b7fe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a240668d0 0x7f1a24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.018+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a2c11f6d0 con 0x7f1a440c0370 2023-12-07T09:59:44.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.018+0000 7f1a4259c640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a240668d0 0x7f1a24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.018+0000 7f1a4259c640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a240668d0 0x7f1a24068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a34007fd0 tx=0x7f1a34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.022+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a2c0ecb10 con 0x7f1a440c0370 2023-12-07T09:59:44.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a4404e890 con 0x7f1a440c0370 2023-12-07T09:59:44.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a3b7fe640 1 -- 172.21.15.89:0/3749225291 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a2c0f0130 con 0x7f1a440c0370 2023-12-07T09:59:44.177 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a240668d0 msgr2=0x7f1a24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a240668d0 0x7f1a24068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a34007fd0 tx=0x7f1a34009040 comp rx=0 tx=0).stop 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 msgr2=0x7f1a440aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a440aa8a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c01c720 tx=0x7f1a2c01b890 comp rx=0 tx=0).stop 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 shutdown_connections 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a240668d0 0x7f1a24068d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a4414eaf0 0x7f1a440aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a440c0370 0x7f1a440aa8a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 --2- 172.21.15.89:0/3749225291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a440a8470 0x7f1a440c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 >> 172.21.15.89:0/3749225291 conn(0x7f1a440c2a60 msgr2=0x7f1a4413de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 shutdown_connections 2023-12-07T09:59:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.170+0000 7f1a48cfe640 1 -- 172.21.15.89:0/3749225291 wait complete. 2023-12-07T09:59:44.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T09:59:44.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 Processor -- start 2023-12-07T09:59:44.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 -- start start 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3100a86d0 0x7fd3100a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31014fd00 0x7fd3100aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd310152d90 con 0x7fd310156600 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd310152480 con 0x7fd3100a86d0 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd314f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100a9760 con 0x7fd31014fd00 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd30e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3100a86d0 0x7fd3100a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd305d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd310156600 0x7fd31014f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35036/0 (socket says 172.21.15.89:35036) 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd305d9b640 1 -- 172.21.15.89:0/2056226461 learned_addr learned my addr 172.21.15.89:0/2056226461 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd30ed9d640 1 --2- 172.21.15.89:0/2056226461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31014fd00 0x7fd3100aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd30e59c640 1 -- 172.21.15.89:0/2056226461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31014fd00 msgr2=0x7fd3100aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:44.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd30e59c640 1 --2- 172.21.15.89:0/2056226461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31014fd00 0x7fd3100aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd30e59c640 1 -- 172.21.15.89:0/2056226461 >> v1:172.21.15.89:6789/0 conn(0x7fd310156600 legacy=0x7fd31014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.330+0000 7fd30e59c640 1 -- 172.21.15.89:0/2056226461 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310152740 con 0x7fd3100a86d0 2023-12-07T09:59:44.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd30e59c640 1 --2- 172.21.15.89:0/2056226461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3100a8f30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3000097f0 tx=0x7fd30001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f079a5d3c3086f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd30dd9b640 1 -- 172.21.15.89:0/2056226461 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000ab600 con 0x7fd3100a86d0 2023-12-07T09:59:44.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd30dd9b640 1 -- 172.21.15.89:0/2056226461 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3000a7050 con 0x7fd3100a86d0 2023-12-07T09:59:44.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd30dd9b640 1 -- 172.21.15.89:0/2056226461 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000ab980 con 0x7fd3100a86d0 2023-12-07T09:59:44.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 -- 172.21.15.89:0/2056226461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 msgr2=0x7fd3100a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 --2- 172.21.15.89:0/2056226461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3100a8f30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3000097f0 tx=0x7fd30001c480 comp rx=0 tx=0).stop 2023-12-07T09:59:44.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 -- 172.21.15.89:0/2056226461 shutdown_connections 2023-12-07T09:59:44.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 --2- 172.21.15.89:0/2056226461 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd31014fd00 0x7fd3100aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 --2- 172.21.15.89:0/2056226461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3100a8f30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 -- 172.21.15.89:0/2056226461 >> 172.21.15.89:0/2056226461 conn(0x7fd3100c2a60 msgr2=0x7fd3100c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:44.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 -- 172.21.15.89:0/2056226461 shutdown_connections 2023-12-07T09:59:44.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.334+0000 7fd314f1d640 1 -- 172.21.15.89:0/2056226461 wait complete. 2023-12-07T09:59:44.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 Processor -- start 2023-12-07T09:59:44.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 -- start start 2023-12-07T09:59:44.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3101eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd31014fd00 0x7fd3101537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd310156600 0x7fd31015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31014ce20 con 0x7fd3100a86d0 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101ed5e0 con 0x7fd31014fd00 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101557c0 con 0x7fd310156600 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3101eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3101eda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38542/0 (socket says 172.21.15.89:38542) 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 -- 172.21.15.89:0/29645379 learned_addr learned my addr 172.21.15.89:0/29645379 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30ed9d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd310156600 0x7fd31015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd305d9b640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd31014fd00 0x7fd3101537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 -- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd310156600 msgr2=0x7fd31015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd310156600 0x7fd31015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 -- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd31014fd00 msgr2=0x7fd3101537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd31014fd00 0x7fd3101537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 -- 172.21.15.89:0/29645379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300009420 con 0x7fd3100a86d0 2023-12-07T09:59:44.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd305d9b640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd31014fd00 0x7fd3101537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:44.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd30e59c640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3101eda70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd30001a0b0 tx=0x7fd30001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000b7650 con 0x7fd3100a86d0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3000abe90 con 0x7fd3100a86d0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3101533a0 con 0x7fd3100a86d0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.338+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000b7a10 con 0x7fd3100a86d0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3101ecf90 con 0x7fd3100a86d0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3101484c0 con 0x7fd3100a86d0 2023-12-07T09:59:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd3000b7b70 con 0x7fd3100a86d0 2023-12-07T09:59:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd3077fe640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd2f0066900 0x7fd2f0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd30011ee70 con 0x7fd3100a86d0 2023-12-07T09:59:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd305d9b640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd2f0066900 0x7fd2f0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.342+0000 7fd305d9b640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd2f0066900 0x7fd2f0068dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd310155e80 tx=0x7fd2f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.346+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3000ec1c0 con 0x7fd3100a86d0 2023-12-07T09:59:44.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.506+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3100725d0 con 0x7fd3100a86d0 2023-12-07T09:59:44.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd3077fe640 1 -- 172.21.15.89:0/29645379 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3100725d0 con 0x7fd3100a86d0 2023-12-07T09:59:44.516 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd2f0066900 msgr2=0x7fd2f0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd2f0066900 0x7fd2f0068dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd310155e80 tx=0x7fd2f8009040 comp rx=0 tx=0).stop 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 msgr2=0x7fd3101eda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3101eda70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd30001a0b0 tx=0x7fd30001acc0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 shutdown_connections 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd2f0066900 0x7fd2f0068dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd310156600 0x7fd31015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd31014fd00 0x7fd3101537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 --2- 172.21.15.89:0/29645379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100a86d0 0x7fd3101eda70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 >> 172.21.15.89:0/29645379 conn(0x7fd3100c2a60 msgr2=0x7fd310151280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 shutdown_connections 2023-12-07T09:59:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.510+0000 7fd314f1d640 1 -- 172.21.15.89:0/29645379 wait complete. 2023-12-07T09:59:44.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T09:59:44.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 Processor -- start 2023-12-07T09:59:44.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 -- start start 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7effc4151d80 0x7effc40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effc40c8430 0x7effc406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc406cf70 con 0x7effc40c7f20 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc4152160 con 0x7effc40c8430 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc9df8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc40c6a30 con 0x7effc4151d80 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effc40c8430 0x7effc406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effc40c8430 0x7effc406b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38546/0 (socket says 172.21.15.89:38546) 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 -- 172.21.15.89:0/3641148433 learned_addr learned my addr 172.21.15.89:0/3641148433 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc37fe640 1 --2- 172.21.15.89:0/3641148433 >> v2:172.21.15.97:3300/0 conn(0x7effc4151d80 0x7effc40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 -- 172.21.15.89:0/3641148433 >> v2:172.21.15.97:3300/0 conn(0x7effc4151d80 msgr2=0x7effc40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 --2- 172.21.15.89:0/3641148433 >> v2:172.21.15.97:3300/0 conn(0x7effc4151d80 0x7effc40c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 -- 172.21.15.89:0/3641148433 >> v1:172.21.15.97:6789/0 conn(0x7effc40c7f20 legacy=0x7effc406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.670+0000 7effc2ffd640 1 -- 172.21.15.89:0/3641148433 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40c72d0 con 0x7effc40c8430 2023-12-07T09:59:44.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc2ffd640 1 --2- 172.21.15.89:0/3641148433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc406b720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7effc408b3e0 tx=0x7effb801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d38ae8893b4053c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc27fc640 1 -- 172.21.15.89:0/3641148433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80ab640 con 0x7effc40c8430 2023-12-07T09:59:44.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc27fc640 1 -- 172.21.15.89:0/3641148433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb80a7070 con 0x7effc40c8430 2023-12-07T09:59:44.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc27fc640 1 -- 172.21.15.89:0/3641148433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80ab9c0 con 0x7effc40c8430 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 -- 172.21.15.89:0/3641148433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 msgr2=0x7effc406b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 --2- 172.21.15.89:0/3641148433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc406b720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7effc408b3e0 tx=0x7effb801c440 comp rx=0 tx=0).stop 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 -- 172.21.15.89:0/3641148433 shutdown_connections 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 --2- 172.21.15.89:0/3641148433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc406b720 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 --2- 172.21.15.89:0/3641148433 >> v2:172.21.15.97:3300/0 conn(0x7effc4151d80 0x7effc40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 -- 172.21.15.89:0/3641148433 >> 172.21.15.89:0/3641148433 conn(0x7effc40abd00 msgr2=0x7effc40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 -- 172.21.15.89:0/3641148433 shutdown_connections 2023-12-07T09:59:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 -- 172.21.15.89:0/3641148433 wait complete. 2023-12-07T09:59:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.674+0000 7effc9df8640 1 Processor -- start 2023-12-07T09:59:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- start start 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effc40c7f20 0x7effc4146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc40aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effc4151d80 0x7effc41432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40aae00 con 0x7effc40c8430 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41ece90 con 0x7effc4151d80 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc41ed130 con 0x7effc40c7f20 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc40aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc40aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38548/0 (socket says 172.21.15.89:38548) 2023-12-07T09:59:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 -- 172.21.15.89:0/1834990566 learned_addr learned my addr 172.21.15.89:0/1834990566 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc37fe640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effc40c7f20 0x7effc4146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc3fff640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effc4151d80 0x7effc41432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 -- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effc40c7f20 msgr2=0x7effc4146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effc40c7f20 0x7effc4146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 -- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effc4151d80 msgr2=0x7effc41432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effc4151d80 0x7effc41432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 -- 172.21.15.89:0/1834990566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb80094d0 con 0x7effc40c8430 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc2ffd640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc40aa3b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7effb8019050 tx=0x7effb801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80be3f0 con 0x7effc40c8430 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb80be550 con 0x7effc40c8430 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc41ed410 con 0x7effc40c8430 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80be900 con 0x7effc40c8430 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc41ed9d0 con 0x7effc40c8430 2023-12-07T09:59:44.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.678+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc404e890 con 0x7effc40c8430 2023-12-07T09:59:44.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.682+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7effb80b43f0 con 0x7effc40c8430 2023-12-07T09:59:44.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.682+0000 7effabfff640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effb00668d0 0x7effb0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.682+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effb811ec20 con 0x7effc40c8430 2023-12-07T09:59:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.682+0000 7effc37fe640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effb00668d0 0x7effb0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.682+0000 7effc37fe640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effb00668d0 0x7effb0068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effb4009ac0 tx=0x7effb4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.686+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7effb80ebe70 con 0x7effc40c8430 2023-12-07T09:59:44.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.834+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effc40c76a0 con 0x7effc40c8430 2023-12-07T09:59:44.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.834+0000 7effabfff640 1 -- 172.21.15.89:0/1834990566 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7effb80ef490 con 0x7effc40c8430 2023-12-07T09:59:44.843 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T09:59:44.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effb00668d0 msgr2=0x7effb0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effb00668d0 0x7effb0068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effb4009ac0 tx=0x7effb4009190 comp rx=0 tx=0).stop 2023-12-07T09:59:44.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 msgr2=0x7effc40aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:44.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc40aa3b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7effb8019050 tx=0x7effb801ac80 comp rx=0 tx=0).stop 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 shutdown_connections 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effc4151d80 0x7effc41432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc40c8430 0x7effc40aa3b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7effb00668d0 0x7effb0068d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 --2- 172.21.15.89:0/1834990566 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effc40c7f20 0x7effc4146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 >> 172.21.15.89:0/1834990566 conn(0x7effc40abd00 msgr2=0x7effc414fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 shutdown_connections 2023-12-07T09:59:44.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.838+0000 7effc9df8640 1 -- 172.21.15.89:0/1834990566 wait complete. 2023-12-07T09:59:44.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:45.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b66a32640 1 Processor -- start 2023-12-07T09:59:45.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b66a32640 1 -- start start 2023-12-07T09:59:45.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b66a32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b600a8470 0x7f8b60151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b66a32640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6006d320 con 0x7f8b6014e9d0 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b66a32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600721b0 con 0x7f8b60070b80 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b66a32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600c2830 con 0x7f8b600a8470 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b64fcf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b600a8470 0x7f8b60151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.994+0000 7f8b5ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8b6014e9d0 0x7f8b600c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35044/0 (socket says 172.21.15.89:35044) 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b5ffff640 1 -- 172.21.15.89:0/1280495139 learned_addr learned my addr 172.21.15.89:0/1280495139 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1280495139 >> v1:172.21.15.97:6789/0 conn(0x7f8b60070b80 legacy=0x7f8b6006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b5effd640 1 -- 172.21.15.89:0/1280495139 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667409024 0 0) 0x7f8b6006d320 con 0x7f8b6014e9d0 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1280495139 >> v1:172.21.15.89:6789/0 conn(0x7f8b6014e9d0 legacy=0x7f8b600c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1280495139 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60072450 con 0x7f8b600a8470 2023-12-07T09:59:45.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b64fcf640 1 --2- 172.21.15.89:0/1280495139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b600a8470 0x7f8b60151e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d90 tx=0x7f8b5801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b178af200f2afc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b5effd640 1 -- 172.21.15.89:0/1280495139 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5850 con 0x7f8b600a8470 2023-12-07T09:59:45.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b5effd640 1 -- 172.21.15.89:0/1280495139 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580a59b0 con 0x7f8b600a8470 2023-12-07T09:59:45.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b5effd640 1 -- 172.21.15.89:0/1280495139 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5d40 con 0x7f8b600a8470 2023-12-07T09:59:45.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:44.998+0000 7f8b66a32640 1 -- 172.21.15.89:0/1280495139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b600a8470 msgr2=0x7f8b60151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1280495139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b600a8470 0x7f8b60151e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d90 tx=0x7f8b5801c880 comp rx=0 tx=0).stop 2023-12-07T09:59:45.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- 172.21.15.89:0/1280495139 shutdown_connections 2023-12-07T09:59:45.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1280495139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b600a8470 0x7f8b60151e60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- 172.21.15.89:0/1280495139 >> 172.21.15.89:0/1280495139 conn(0x7f8b600c2ad0 msgr2=0x7f8b600c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:45.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- 172.21.15.89:0/1280495139 shutdown_connections 2023-12-07T09:59:45.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- 172.21.15.89:0/1280495139 wait complete. 2023-12-07T09:59:45.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 Processor -- start 2023-12-07T09:59:45.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- start start 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b60070b80 0x7f8b6014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b600a8470 0x7f8b60148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 0x7f8b60148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60148a90 con 0x7f8b6014e9d0 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60154bd0 con 0x7f8b600a8470 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b66a32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60154eb0 con 0x7f8b60070b80 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 0x7f8b60148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 0x7f8b60148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38580/0 (socket says 172.21.15.89:38580) 2023-12-07T09:59:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1134168155 learned_addr learned my addr 172.21.15.89:0/1134168155 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b5ffff640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b60070b80 0x7f8b6014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b5f7fe640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b600a8470 0x7f8b60148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b60070b80 msgr2=0x7f8b6014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b60070b80 0x7f8b6014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b600a8470 msgr2=0x7f8b60148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b600a8470 0x7f8b60148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 -- 172.21.15.89:0/1134168155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009a70 con 0x7f8b6014e9d0 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b5ffff640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b60070b80 0x7f8b6014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b5f7fe640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b600a8470 0x7f8b60148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.002+0000 7f8b64fcf640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 0x7f8b60148550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b5801a4b0 tx=0x7f8b58019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580ad850 con 0x7f8b6014e9d0 2023-12-07T09:59:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580ad9b0 con 0x7f8b6014e9d0 2023-12-07T09:59:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580add40 con 0x7f8b6014e9d0 2023-12-07T09:59:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600c5550 con 0x7f8b6014e9d0 2023-12-07T09:59:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600c5b10 con 0x7f8b6014e9d0 2023-12-07T09:59:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6004e890 con 0x7f8b6014e9d0 2023-12-07T09:59:45.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8b580b4050 con 0x7f8b6014e9d0 2023-12-07T09:59:45.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5cff9640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b4c0668d0 0x7f8b4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b5811f320 con 0x7f8b6014e9d0 2023-12-07T09:59:45.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5ffff640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b4c0668d0 0x7f8b4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.006+0000 7f8b5ffff640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b4c0668d0 0x7f8b4c068d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b50007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.010+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b580ec610 con 0x7f8b6014e9d0 2023-12-07T09:59:45.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.190+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b60074a10 con 0x7f8b6014e9d0 2023-12-07T09:59:45.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.190+0000 7f8b5cff9640 1 -- 172.21.15.89:0/1134168155 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f8b580efc30 con 0x7f8b6014e9d0 2023-12-07T09:59:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:45.198 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:45.198 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.190+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b4c0668d0 msgr2=0x7f8b4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.190+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b4c0668d0 0x7f8b4c068d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b50007cb0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.190+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 msgr2=0x7f8b60148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.190+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 0x7f8b60148550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b5801a4b0 tx=0x7f8b58019620 comp rx=0 tx=0).stop 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 shutdown_connections 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b6014e9d0 0x7f8b60148550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b600a8470 0x7f8b60148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b4c0668d0 0x7f8b4c068d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 --2- 172.21.15.89:0/1134168155 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b60070b80 0x7f8b6014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 >> 172.21.15.89:0/1134168155 conn(0x7f8b600c2ad0 msgr2=0x7f8b6006be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:45.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 shutdown_connections 2023-12-07T09:59:45.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.194+0000 7f8b66a32640 1 -- 172.21.15.89:0/1134168155 wait complete. 2023-12-07T09:59:45.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 Processor -- start 2023-12-07T09:59:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 -- start start 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c14fc00 0x7f6a0c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a0c0a8470 0x7f6a0c0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6a0c06d5e0 0x7f6a0c06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c1533f0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0aa6e0 con 0x7f6a0c06d5e0 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a11757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0aa9c0 con 0x7f6a0c14fc00 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a0c0a8470 0x7f6a0c0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a0c0a8470 0x7f6a0c0a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38594/0 (socket says 172.21.15.89:38594) 2023-12-07T09:59:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/843117097 learned_addr learned my addr 172.21.15.89:0/843117097 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0b7fe640 1 --2- 172.21.15.89:0/843117097 >> v2:172.21.15.97:3300/0 conn(0x7f6a0c06d5e0 0x7f6a0c06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0affd640 1 --2- 172.21.15.89:0/843117097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c14fc00 0x7f6a0c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/843117097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c14fc00 msgr2=0x7f6a0c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 --2- 172.21.15.89:0/843117097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c14fc00 0x7f6a0c152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/843117097 >> v2:172.21.15.97:3300/0 conn(0x7f6a0c06d5e0 msgr2=0x7f6a0c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 --2- 172.21.15.89:0/843117097 >> v2:172.21.15.97:3300/0 conn(0x7f6a0c06d5e0 0x7f6a0c06da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.354+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/843117097 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0aaca0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a0a7fc640 1 --2- 172.21.15.89:0/843117097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0a88d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0a9d00 tx=0x7f6a0001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6256f572ed202e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a09ffb640 1 -- 172.21.15.89:0/843117097 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000ab600 con 0x7f6a0c0a8470 2023-12-07T09:59:45.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a09ffb640 1 -- 172.21.15.89:0/843117097 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000ab760 con 0x7f6a0c0a8470 2023-12-07T09:59:45.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a09ffb640 1 -- 172.21.15.89:0/843117097 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000abaf0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 -- 172.21.15.89:0/843117097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 msgr2=0x7f6a0c0a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 --2- 172.21.15.89:0/843117097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0a88d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0a9d00 tx=0x7f6a0001c440 comp rx=0 tx=0).stop 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 -- 172.21.15.89:0/843117097 shutdown_connections 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 --2- 172.21.15.89:0/843117097 >> v2:172.21.15.97:3300/0 conn(0x7f6a0c06d5e0 0x7f6a0c06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 --2- 172.21.15.89:0/843117097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0a88d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 --2- 172.21.15.89:0/843117097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c14fc00 0x7f6a0c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 -- 172.21.15.89:0/843117097 >> 172.21.15.89:0/843117097 conn(0x7f6a0c06af50 msgr2=0x7f6a0c0c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 -- 172.21.15.89:0/843117097 shutdown_connections 2023-12-07T09:59:45.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.358+0000 7f6a11757640 1 -- 172.21.15.89:0/843117097 wait complete. 2023-12-07T09:59:45.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 Processor -- start 2023-12-07T09:59:45.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- start start 2023-12-07T09:59:45.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c06d5e0 0x7f6a0c14a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0c0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a0c14fc00 0x7f6a0c145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c141920 con 0x7f6a0c0a8470 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c141b70 con 0x7f6a0c14fc00 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c149bc0 con 0x7f6a0c06d5e0 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c06d5e0 0x7f6a0c14a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0c0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38608/0 (socket says 172.21.15.89:38608) 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/1693833683 learned_addr learned my addr 172.21.15.89:0/1693833683 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0b7fe640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a0c14fc00 0x7f6a0c145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c06d5e0 msgr2=0x7f6a0c14a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c06d5e0 0x7f6a0c14a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a0c14fc00 msgr2=0x7f6a0c145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a0c14fc00 0x7f6a0c145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 -- 172.21.15.89:0/1693833683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a000094d0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a0a7fc640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0c0970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6a0001aaf0 tx=0x7f6a0001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000be5f0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000be750 con 0x7f6a0c0a8470 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000beb00 con 0x7f6a0c0a8470 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c149ea0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0c0eb0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.362+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c14a090 con 0x7f6a0c0a8470 2023-12-07T09:59:45.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.366+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6a000b43f0 con 0x7f6a0c0a8470 2023-12-07T09:59:45.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.366+0000 7f69f37fe640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69f80668d0 0x7f69f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.366+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a0011f230 con 0x7f6a0c0a8470 2023-12-07T09:59:45.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.366+0000 7f6a0affd640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69f80668d0 0x7f69f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.366+0000 7f6a0affd640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69f80668d0 0x7f69f8068d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009ac0 tx=0x7f69fc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.370+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a000ec510 con 0x7f6a0c0a8470 2023-12-07T09:59:45.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.522+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a0c04e890 con 0x7f6a0c0a8470 2023-12-07T09:59:45.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.522+0000 7f69f37fe640 1 -- 172.21.15.89:0/1693833683 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f6a000efb30 con 0x7f6a0c0a8470 2023-12-07T09:59:45.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:45.530 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.522+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69f80668d0 msgr2=0x7f69f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.522+0000 7f6a11757640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69f80668d0 0x7f69f8068d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009ac0 tx=0x7f69fc009190 comp rx=0 tx=0).stop 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 msgr2=0x7f6a0c0c0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0c0970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6a0001aaf0 tx=0x7f6a0001ac80 comp rx=0 tx=0).stop 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 shutdown_connections 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a0c14fc00 0x7f6a0c145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0c0a8470 0x7f6a0c0c0970 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69f80668d0 0x7f69f8068d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 --2- 172.21.15.89:0/1693833683 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a0c06d5e0 0x7f6a0c14a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 >> 172.21.15.89:0/1693833683 conn(0x7f6a0c06af50 msgr2=0x7f6a0c0c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:45.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 shutdown_connections 2023-12-07T09:59:45.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.526+0000 7f6a11757640 1 -- 172.21.15.89:0/1693833683 wait complete. 2023-12-07T09:59:45.551 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-07T09:59:45.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:45.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8716d8d640 1 Processor -- start 2023-12-07T09:59:45.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8716d8d640 1 -- start start 2023-12-07T09:59:45.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8716d8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 0x7f871006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8716d8d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8710072780 con 0x7f87100aacd0 2023-12-07T09:59:45.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8716d8d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87100ac160 con 0x7f87100700a0 2023-12-07T09:59:45.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8716d8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100abe80 con 0x7f8710154870 2023-12-07T09:59:45.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8714b29640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f87100aacd0 0x7f8710154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35056/0 (socket says 172.21.15.89:35056) 2023-12-07T09:59:45.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.682+0000 7f8714b29640 1 -- 172.21.15.89:0/1818079289 learned_addr learned my addr 172.21.15.89:0/1818079289 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8707fff640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 0x7f871006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114599648 0 0) 0x7f8710072780 con 0x7f87100aacd0 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f8003530 con 0x7f87100aacd0 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730067263 0 0) 0x7f86f8003530 con 0x7f87100aacd0 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 msgr2=0x7f871006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 0x7f871006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 >> v1:172.21.15.97:6789/0 conn(0x7f87100700a0 legacy=0x7f871006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710154cf0 con 0x7f87100aacd0 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f870c001680 con 0x7f87100aacd0 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 >> v1:172.21.15.89:6789/0 conn(0x7f87100aacd0 legacy=0x7f8710154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86f80039b0 0x7f86f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 0x7f86f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f8004d10 0x7f86f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100abe80 con 0x7f86f80039b0 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f800ba70 con 0x7f86f8004d10 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f800bc30 con 0x7f8710154870 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8714b29640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86f80039b0 0x7f86f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8707fff640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 0x7f86f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f871532a640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f8004d10 0x7f86f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8714b29640 1 -- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 msgr2=0x7f86f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:45.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8714b29640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8710154870 0x7f86f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8714b29640 1 -- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f8004d10 msgr2=0x7f86f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:45.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8714b29640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f8004d10 0x7f86f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.686+0000 7f8714b29640 1 -- 172.21.15.89:0/1818079289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8003530 con 0x7f86f80039b0 2023-12-07T09:59:45.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8714b29640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86f80039b0 0x7f86f8003d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f870c007c10 tx=0x7f870c01ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ebe8a2a63e2392 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0a7c70 con 0x7f86f80039b0 2023-12-07T09:59:45.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c0a7dd0 con 0x7f86f80039b0 2023-12-07T09:59:45.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f87077fe640 1 -- 172.21.15.89:0/1818079289 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c005b20 con 0x7f86f80039b0 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 -- 172.21.15.89:0/1818079289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86f80039b0 msgr2=0x7f86f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 --2- 172.21.15.89:0/1818079289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86f80039b0 0x7f86f8003d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f870c007c10 tx=0x7f870c01ee00 comp rx=0 tx=0).stop 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f871532a640 1 -- 172.21.15.89:0/1818079289 reap_dead start 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 -- 172.21.15.89:0/1818079289 shutdown_connections 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 -- 172.21.15.89:0/1818079289 >> 172.21.15.89:0/1818079289 conn(0x7f87100c2ad0 msgr2=0x7f87100c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 -- 172.21.15.89:0/1818079289 shutdown_connections 2023-12-07T09:59:45.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 -- 172.21.15.89:0/1818079289 wait complete. 2023-12-07T09:59:45.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 Processor -- start 2023-12-07T09:59:45.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.690+0000 7f8716d8d640 1 -- start start 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80039b0 0x7f87101569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 0x7f8710144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f871014a670 0x7f871014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87101452c0 con 0x7f87101f00f0 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8710155a70 con 0x7f86f80039b0 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87101f0570 con 0x7f871014a670 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 0x7f8710144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 0x7f8710144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38640/0 (socket says 172.21.15.89:38640) 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 -- 172.21.15.89:0/3010569525 learned_addr learned my addr 172.21.15.89:0/3010569525 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8714b29640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80039b0 0x7f87101569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f871532a640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f871014a670 0x7f871014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 -- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f871014a670 msgr2=0x7f871014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f871014a670 0x7f871014b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 -- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80039b0 msgr2=0x7f87101569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80039b0 0x7f87101569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 -- 172.21.15.89:0/3010569525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710149a40 con 0x7f87101f00f0 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f871532a640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f871014a670 0x7f871014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8707fff640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 0x7f8710144d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f87000119d0 tx=0x7f8700011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000fb50 con 0x7f87101f00f0 2023-12-07T09:59:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870000fcb0 con 0x7f87101f00f0 2023-12-07T09:59:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8710148e80 con 0x7f87101f00f0 2023-12-07T09:59:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700014440 con 0x7f87101f00f0 2023-12-07T09:59:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8710149160 con 0x7f87101f00f0 2023-12-07T09:59:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871004e890 con 0x7f87101f00f0 2023-12-07T09:59:45.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.694+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f87000145a0 con 0x7f87101f00f0 2023-12-07T09:59:45.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.698+0000 7f87057fa640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f86fc0668d0 0x7f86fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:45.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.698+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8700084ae0 con 0x7f87101f00f0 2023-12-07T09:59:45.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.698+0000 7f8714b29640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f86fc0668d0 0x7f86fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:45.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.698+0000 7f8714b29640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f86fc0668d0 0x7f86fc068d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f870c0ad000 tx=0x7f870c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:45.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.702+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8700051e70 con 0x7f87101f00f0 2023-12-07T09:59:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.882+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87101e29a0 con 0x7f87101f00f0 2023-12-07T09:59:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f87057fa640 1 -- 172.21.15.89:0/3010569525 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f8700022020 con 0x7f87101f00f0 2023-12-07T09:59:45.892 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:45.892 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:45.892 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f86fc0668d0 msgr2=0x7f86fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f86fc0668d0 0x7f86fc068d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f870c0ad000 tx=0x7f870c0b3040 comp rx=0 tx=0).stop 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 msgr2=0x7f8710144d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 0x7f8710144d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f87000119d0 tx=0x7f8700011e90 comp rx=0 tx=0).stop 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 shutdown_connections 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f86fc0668d0 0x7f86fc068d90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f871014a670 0x7f871014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87101f00f0 0x7f8710144d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 --2- 172.21.15.89:0/3010569525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86f80039b0 0x7f87101569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 >> 172.21.15.89:0/3010569525 conn(0x7f87100c2ad0 msgr2=0x7f87100717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:45.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 shutdown_connections 2023-12-07T09:59:45.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:45.886+0000 7f8716d8d640 1 -- 172.21.15.89:0/3010569525 wait complete. 2023-12-07T09:59:45.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T09:59:46.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c34c9640 1 Processor -- start 2023-12-07T09:59:46.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c34c9640 1 -- start start 2023-12-07T09:59:46.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c34c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25bc156500 0x7f25bc06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c34c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc06dec0 con 0x7f25bc14fcc0 2023-12-07T09:59:46.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c34c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc156980 con 0x7f25bc0c19e0 2023-12-07T09:59:46.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c34c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc0aa340 con 0x7f25bc156500 2023-12-07T09:59:46.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c1265640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f25bc14fcc0 0x7f25bc0aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35060/0 (socket says 172.21.15.89:35060) 2023-12-07T09:59:46.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c1265640 1 -- 172.21.15.89:0/1116204355 learned_addr learned my addr 172.21.15.89:0/1116204355 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:46.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.042+0000 7f25c0a64640 1 --2- 172.21.15.89:0/1116204355 >> v2:172.21.15.97:3300/0 conn(0x7f25bc156500 0x7f25bc06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25b3fff640 1 -- 172.21.15.89:0/1116204355 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552411439 0 0) 0x7f25bc06dec0 con 0x7f25bc14fcc0 2023-12-07T09:59:46.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25b3fff640 1 -- 172.21.15.89:0/1116204355 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a8003530 con 0x7f25bc14fcc0 2023-12-07T09:59:46.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25c0a64640 1 -- 172.21.15.89:0/1116204355 >> v1:172.21.15.97:6789/0 conn(0x7f25bc0c19e0 legacy=0x7f25bc0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25c0a64640 1 -- 172.21.15.89:0/1116204355 >> v1:172.21.15.89:6789/0 conn(0x7f25bc14fcc0 legacy=0x7f25bc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25c0a64640 1 -- 172.21.15.89:0/1116204355 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0ab580 con 0x7f25bc156500 2023-12-07T09:59:46.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25c0a64640 1 --2- 172.21.15.89:0/1116204355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc156500 0x7f25bc06d980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0097c0 tx=0x7f25ac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=486987086e9bb2d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25b3fff640 1 -- 172.21.15.89:0/1116204355 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0ab650 con 0x7f25bc156500 2023-12-07T09:59:46.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25b3fff640 1 -- 172.21.15.89:0/1116204355 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0ab7b0 con 0x7f25bc156500 2023-12-07T09:59:46.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.046+0000 7f25b3fff640 1 -- 172.21.15.89:0/1116204355 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0abb20 con 0x7f25bc156500 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- 172.21.15.89:0/1116204355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc156500 msgr2=0x7f25bc06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 --2- 172.21.15.89:0/1116204355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc156500 0x7f25bc06d980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0097c0 tx=0x7f25ac01c450 comp rx=0 tx=0).stop 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- 172.21.15.89:0/1116204355 shutdown_connections 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 --2- 172.21.15.89:0/1116204355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc156500 0x7f25bc06d980 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- 172.21.15.89:0/1116204355 >> 172.21.15.89:0/1116204355 conn(0x7f25bc0c2ad0 msgr2=0x7f25bc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- 172.21.15.89:0/1116204355 shutdown_connections 2023-12-07T09:59:46.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- 172.21.15.89:0/1116204355 wait complete. 2023-12-07T09:59:46.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 Processor -- start 2023-12-07T09:59:46.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- start start 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc0c19e0 0x7f25bc0a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25bc156500 0x7f25bc071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 0x7f25bc14a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc151cc0 con 0x7f25bc1f0120 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc1504d0 con 0x7f25bc0c19e0 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c34c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc1f0620 con 0x7f25bc156500 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c1a66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 0x7f25bc14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c1a66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 0x7f25bc14a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38648/0 (socket says 172.21.15.89:38648) 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c1a66640 1 -- 172.21.15.89:0/3161965797 learned_addr learned my addr 172.21.15.89:0/3161965797 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:46.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c1265640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc0c19e0 0x7f25bc0a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.050+0000 7f25c0a64640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25bc156500 0x7f25bc071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c1a66640 1 -- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25bc156500 msgr2=0x7f25bc071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c1a66640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25bc156500 0x7f25bc071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c1a66640 1 -- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc0c19e0 msgr2=0x7f25bc0a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c1a66640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc0c19e0 0x7f25bc0a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c1a66640 1 -- 172.21.15.89:0/3161965797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac009420 con 0x7f25bc1f0120 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c0a64640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25bc156500 0x7f25bc071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c1a66640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 0x7f25bc14a850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c770 tx=0x7f25b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003b80 con 0x7f25bc1f0120 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4003ce0 con 0x7f25bc1f0120 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400aa90 con 0x7f25bc1f0120 2023-12-07T09:59:46.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc1f0900 con 0x7f25bc1f0120 2023-12-07T09:59:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc1f0ec0 con 0x7f25bc1f0120 2023-12-07T09:59:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc04e890 con 0x7f25bc1f0120 2023-12-07T09:59:46.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25b400abf0 con 0x7f25bc1f0120 2023-12-07T09:59:46.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25b1ffb640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25a00668d0 0x7f25a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.054+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b40840d0 con 0x7f25bc1f0120 2023-12-07T09:59:46.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.058+0000 7f25c1265640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25a00668d0 0x7f25a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.058+0000 7f25c1265640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25a00668d0 0x7f25a0068d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25b80011f0 tx=0x7f25b8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.058+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25b4051300 con 0x7f25bc1f0120 2023-12-07T09:59:46.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.238+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25bc156980 con 0x7f25bc1f0120 2023-12-07T09:59:46.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.238+0000 7f25b1ffb640 1 -- 172.21.15.89:0/3161965797 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f25bc156980 con 0x7f25bc1f0120 2023-12-07T09:59:46.247 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:46.247 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2385507414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2385507414},{"type":"v1","addr":"172.21.15.89:6837","nonce":2385507414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/1870697299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1870697299},{"type":"v1","addr":"172.21.15.97:6834","nonce":1870697299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1556974177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1556974177},{"type":"v1","addr":"172.21.15.89:6835","nonce":1556974177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:12.803446+0000","modified":"2023-12-07T09:59:15.812452+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/351680850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":351680850},{"type":"v1","addr":"172.21.15.97:6835","nonce":351680850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T09:59:46.248 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 8 2023-12-07T09:59:46.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25a00668d0 msgr2=0x7f25a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25a00668d0 0x7f25a0068d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25b80011f0 tx=0x7f25b8007d40 comp rx=0 tx=0).stop 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 msgr2=0x7f25bc14a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 0x7f25bc14a850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c770 tx=0x7f25b400cc30 comp rx=0 tx=0).stop 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 shutdown_connections 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25bc1f0120 0x7f25bc14a850 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25a00668d0 0x7f25a0068d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25bc156500 0x7f25bc071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 --2- 172.21.15.89:0/3161965797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25bc0c19e0 0x7f25bc0a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 >> 172.21.15.89:0/3161965797 conn(0x7f25bc0c2ad0 msgr2=0x7f25bc14ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 shutdown_connections 2023-12-07T09:59:46.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.242+0000 7f25c34c9640 1 -- 172.21.15.89:0/3161965797 wait complete. 2023-12-07T09:59:46.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 Processor -- start 2023-12-07T09:59:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 -- start start 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9cdc14ea80 0x7f9cdc06e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9cdc06ed60 0x7f9cdc154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc158b70 con 0x7f9cdc06b710 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc072050 con 0x7f9cdc14ea80 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce29b4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc157db0 con 0x7f9cdc06ed60 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce19b2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9cdc14ea80 0x7f9cdc06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce19b2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9cdc14ea80 0x7f9cdc06e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38658/0 (socket says 172.21.15.89:38658) 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce19b2640 1 -- 172.21.15.89:0/1822262998 learned_addr learned my addr 172.21.15.89:0/1822262998 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.398+0000 7f9ce21b3640 1 --2- 172.21.15.89:0/1822262998 >> v2:172.21.15.97:3300/0 conn(0x7f9cdc06ed60 0x7f9cdc154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce19b2640 1 -- 172.21.15.89:0/1822262998 >> v2:172.21.15.97:3300/0 conn(0x7f9cdc06ed60 msgr2=0x7f9cdc154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce19b2640 1 --2- 172.21.15.89:0/1822262998 >> v2:172.21.15.97:3300/0 conn(0x7f9cdc06ed60 0x7f9cdc154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce19b2640 1 -- 172.21.15.89:0/1822262998 >> v1:172.21.15.97:6789/0 conn(0x7f9cdc06b710 legacy=0x7f9cdc154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce19b2640 1 -- 172.21.15.89:0/1822262998 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc158090 con 0x7f9cdc14ea80 2023-12-07T09:59:46.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce19b2640 1 --2- 172.21.15.89:0/1822262998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc06e820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc06b140 tx=0x7f9cd801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c48ba94a48716d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce09b0640 1 -- 172.21.15.89:0/1822262998 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80ab5f0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce09b0640 1 -- 172.21.15.89:0/1822262998 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80ab750 con 0x7f9cdc14ea80 2023-12-07T09:59:46.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce09b0640 1 -- 172.21.15.89:0/1822262998 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80abae0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce29b4640 1 -- 172.21.15.89:0/1822262998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 msgr2=0x7f9cdc06e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/1822262998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc06e820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc06b140 tx=0x7f9cd801c500 comp rx=0 tx=0).stop 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce29b4640 1 -- 172.21.15.89:0/1822262998 shutdown_connections 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/1822262998 >> v2:172.21.15.97:3300/0 conn(0x7f9cdc06ed60 0x7f9cdc154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/1822262998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc06e820 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.402+0000 7f9ce29b4640 1 -- 172.21.15.89:0/1822262998 >> 172.21.15.89:0/1822262998 conn(0x7f9cdc06a5a0 msgr2=0x7f9cdc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- 172.21.15.89:0/1822262998 shutdown_connections 2023-12-07T09:59:46.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- 172.21.15.89:0/1822262998 wait complete. 2023-12-07T09:59:46.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 Processor -- start 2023-12-07T09:59:46.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- start start 2023-12-07T09:59:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9cdc06b710 0x7f9cdc147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9cdc06ed60 0x7f9cdc13e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc13e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1535a0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1ecd80 con 0x7f9cdc06ed60 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1edd50 con 0x7f9cdc06b710 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc13e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc13e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38668/0 (socket says 172.21.15.89:38668) 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 -- 172.21.15.89:0/3917302077 learned_addr learned my addr 172.21.15.89:0/3917302077 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce19b2640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9cdc06b710 0x7f9cdc147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce11b1640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9cdc06ed60 0x7f9cdc13e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 -- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9cdc06b710 msgr2=0x7f9cdc147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9cdc06b710 0x7f9cdc147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 -- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9cdc06ed60 msgr2=0x7f9cdc13e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9cdc06ed60 0x7f9cdc13e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 -- 172.21.15.89:0/3917302077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80094d0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce11b1640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9cdc06ed60 0x7f9cdc13e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce19b2640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9cdc06b710 0x7f9cdc147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce21b3640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc13e880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400efc0 tx=0x7f9cd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4014480 con 0x7f9cdc14ea80 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd400f040 con 0x7f9cdc14ea80 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc1ecf90 con 0x7f9cdc14ea80 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4014820 con 0x7f9cdc14ea80 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.406+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc1ed550 con 0x7f9cdc14ea80 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.410+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc04e890 con 0x7f9cdc14ea80 2023-12-07T09:59:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.410+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9cd4014980 con 0x7f9cdc14ea80 2023-12-07T09:59:46.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.410+0000 7f9cd27fc640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc0066900 0x7f9cc0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.410+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cd4085300 con 0x7f9cdc14ea80 2023-12-07T09:59:46.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.410+0000 7f9ce19b2640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc0066900 0x7f9cc0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.410+0000 7f9ce19b2640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc0066900 0x7f9cc0068dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80af000 tx=0x7f9cd80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.414+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cd40524a0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cdc06b1e0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9cd27fc640 1 -- 172.21.15.89:0/3917302077 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f9cd4055ac0 con 0x7f9cdc14ea80 2023-12-07T09:59:46.573 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:46.573 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:14.199908+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:10.538633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:11.802832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:46.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc0066900 msgr2=0x7f9cc0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc0066900 0x7f9cc0068dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80af000 tx=0x7f9cd80a7000 comp rx=0 tx=0).stop 2023-12-07T09:59:46.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 msgr2=0x7f9cdc13e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc13e880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400efc0 tx=0x7f9cd400c490 comp rx=0 tx=0).stop 2023-12-07T09:59:46.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 shutdown_connections 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cdc14ea80 0x7f9cdc13e880 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9cdc06ed60 0x7f9cdc13e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc0066900 0x7f9cc0068dc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 --2- 172.21.15.89:0/3917302077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9cdc06b710 0x7f9cdc147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 >> 172.21.15.89:0/3917302077 conn(0x7f9cdc06a5a0 msgr2=0x7f9cdc155590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 shutdown_connections 2023-12-07T09:59:46.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.566+0000 7f9ce29b4640 1 -- 172.21.15.89:0/3917302077 wait complete. 2023-12-07T09:59:46.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-07T09:59:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e7454640 1 Processor -- start 2023-12-07T09:59:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e7454640 1 -- start start 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e7454640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e014e9d0 0x7f30e0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e7454640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e006d320 con 0x7f30e00a8470 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e7454640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e00721b0 con 0x7f30e0070b80 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e7454640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00c2830 con 0x7f30e014e9d0 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e59f1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f30e00a8470 0x7f30e006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35062/0 (socket says 172.21.15.89:35062) 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e59f1640 1 -- 172.21.15.89:0/2360288166 learned_addr learned my addr 172.21.15.89:0/2360288166 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:46.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e51f0640 1 --2- 172.21.15.89:0/2360288166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e014e9d0 0x7f30e0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344643155 0 0) 0x7f30e006d320 con 0x7f30e00a8470 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30cc003530 con 0x7f30e00a8470 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371558396 0 0) 0x7f30e00721b0 con 0x7f30e0070b80 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e006d320 con 0x7f30e0070b80 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e51f0640 1 -- 172.21.15.89:0/2360288166 >> v1:172.21.15.97:6789/0 conn(0x7f30e0070b80 legacy=0x7f30e00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110755607 0 0) 0x7f30cc003530 con 0x7f30e00a8470 2023-12-07T09:59:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e51f0640 1 -- 172.21.15.89:0/2360288166 >> v1:172.21.15.89:6789/0 conn(0x7f30e00a8470 legacy=0x7f30e006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.726+0000 7f30e51f0640 1 -- 172.21.15.89:0/2360288166 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0072450 con 0x7f30e014e9d0 2023-12-07T09:59:46.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e51f0640 1 --2- 172.21.15.89:0/2360288166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e014e9d0 0x7f30e0151e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0097f0 tx=0x7f30dc01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a535c4c2479d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8001a00 con 0x7f30e014e9d0 2023-12-07T09:59:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc0a7050 con 0x7f30e014e9d0 2023-12-07T09:59:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30d7fff640 1 -- 172.21.15.89:0/2360288166 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0ab600 con 0x7f30e014e9d0 2023-12-07T09:59:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 -- 172.21.15.89:0/2360288166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e014e9d0 msgr2=0x7f30e0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 --2- 172.21.15.89:0/2360288166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e014e9d0 0x7f30e0151e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0097f0 tx=0x7f30dc01c350 comp rx=0 tx=0).stop 2023-12-07T09:59:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 -- 172.21.15.89:0/2360288166 shutdown_connections 2023-12-07T09:59:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 --2- 172.21.15.89:0/2360288166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e014e9d0 0x7f30e0151e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 -- 172.21.15.89:0/2360288166 >> 172.21.15.89:0/2360288166 conn(0x7f30e00c2ad0 msgr2=0x7f30e00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 -- 172.21.15.89:0/2360288166 shutdown_connections 2023-12-07T09:59:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.730+0000 7f30e7454640 1 -- 172.21.15.89:0/2360288166 wait complete. 2023-12-07T09:59:46.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 Processor -- start 2023-12-07T09:59:46.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 -- start start 2023-12-07T09:59:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30e0070b80 0x7f30e0142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e00a8470 0x7f30e0154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 0x7f30e0154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0153e20 con 0x7f30e014e9d0 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e01510f0 con 0x7f30e0070b80 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0151390 con 0x7f30e00a8470 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 0x7f30e0154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 0x7f30e0154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38678/0 (socket says 172.21.15.89:38678) 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 -- 172.21.15.89:0/1786482053 learned_addr learned my addr 172.21.15.89:0/1786482053 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e51f0640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30e0070b80 0x7f30e0142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e49ef640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e00a8470 0x7f30e0154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 -- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e00a8470 msgr2=0x7f30e0154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e00a8470 0x7f30e0154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 -- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30e0070b80 msgr2=0x7f30e0142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30e0070b80 0x7f30e0142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 -- 172.21.15.89:0/1786482053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc009420 con 0x7f30e014e9d0 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e49ef640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e00a8470 0x7f30e0154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e59f1640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 0x7f30e0154ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30d8001f00 tx=0x7f30d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8002110 con 0x7f30e014e9d0 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d8012400 con 0x7f30e014e9d0 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e0152690 con 0x7f30e014e9d0 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d80127b0 con 0x7f30e014e9d0 2023-12-07T09:59:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.734+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e0152c50 con 0x7f30e014e9d0 2023-12-07T09:59:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.738+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e0067a40 con 0x7f30e014e9d0 2023-12-07T09:59:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.738+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f30d8012910 con 0x7f30e014e9d0 2023-12-07T09:59:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.738+0000 7f30d5ffb640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f30c4066900 0x7f30c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.738+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30d8084b30 con 0x7f30e014e9d0 2023-12-07T09:59:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.738+0000 7f30e51f0640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f30c4066900 0x7f30c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.738+0000 7f30e51f0640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f30c4066900 0x7f30c4068dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0ad000 tx=0x7f30dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.742+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30d8051d60 con 0x7f30e014e9d0 2023-12-07T09:59:46.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.926+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f30e004e890 con 0x7f30e014e9d0 2023-12-07T09:59:46.933 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T09:59:46.926+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T09:59:46.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.926+0000 7f30d5ffb640 1 -- 172.21.15.89:0/1786482053 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f30d8055380 con 0x7f30e014e9d0 2023-12-07T09:59:46.935 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f30c4066900 msgr2=0x7f30c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f30c4066900 0x7f30c4068dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0ad000 tx=0x7f30dc008040 comp rx=0 tx=0).stop 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 msgr2=0x7f30e0154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 0x7f30e0154ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30d8001f00 tx=0x7f30d800a430 comp rx=0 tx=0).stop 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 shutdown_connections 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30e014e9d0 0x7f30e0154ab0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f30c4066900 0x7f30c4068dc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30e00a8470 0x7f30e0154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 --2- 172.21.15.89:0/1786482053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30e0070b80 0x7f30e0142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:46.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 >> 172.21.15.89:0/1786482053 conn(0x7f30e00c2ad0 msgr2=0x7f30e00c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:46.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 shutdown_connections 2023-12-07T09:59:46.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:46.930+0000 7f30e7454640 1 -- 172.21.15.89:0/1786482053 wait complete. 2023-12-07T09:59:46.948 INFO:tasks.ceph.mds.b.smithi097.stderr: -5371> 2023-12-07T09:59:16.917+0000 7f4dd67e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T09:59:46.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-07T09:59:46.999 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2023-12-07T09:59:47.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 Processor -- start 2023-12-07T09:59:47.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 -- start start 2023-12-07T09:59:47.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09e80c0370 0x7f09e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:47.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09e80a8470 0x7f09e806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:47.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e806de00 con 0x7f09e814eaf0 2023-12-07T09:59:47.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e8070390 con 0x7f09e80c0370 2023-12-07T09:59:47.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ee580640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e806db90 con 0x7f09e80a8470 2023-12-07T09:59:47.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09e80c0370 0x7f09e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:47.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09e80c0370 0x7f09e806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38694/0 (socket says 172.21.15.89:38694) 2023-12-07T09:59:47.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 -- 172.21.15.89:0/3764506810 learned_addr learned my addr 172.21.15.89:0/3764506810 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:47.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ecb1d640 1 --2- 172.21.15.89:0/3764506810 >> v2:172.21.15.97:3300/0 conn(0x7f09e80a8470 0x7f09e806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:47.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 -- 172.21.15.89:0/3764506810 >> v2:172.21.15.97:3300/0 conn(0x7f09e80a8470 msgr2=0x7f09e806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:47.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 --2- 172.21.15.89:0/3764506810 >> v2:172.21.15.97:3300/0 conn(0x7f09e80a8470 0x7f09e806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 -- 172.21.15.89:0/3764506810 >> v1:172.21.15.97:6789/0 conn(0x7f09e814eaf0 legacy=0x7f09e8151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:47.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09e77fe640 1 -- 172.21.15.89:0/3764506810 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e814eed0 con 0x7f09e80c0370 2023-12-07T09:59:47.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.090+0000 7f09ecb1d640 1 --2- 172.21.15.89:0/3764506810 >> v2:172.21.15.97:3300/0 conn(0x7f09e80a8470 0x7f09e806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:47.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09e77fe640 1 --2- 172.21.15.89:0/3764506810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e80c0370 0x7f09e806d110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f09e80c3910 tx=0x7f09dc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ace1618d4e1dd6f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:47.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09e6ffd640 1 -- 172.21.15.89:0/3764506810 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0ab600 con 0x7f09e80c0370 2023-12-07T09:59:47.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09e6ffd640 1 -- 172.21.15.89:0/3764506810 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc0ab760 con 0x7f09e80c0370 2023-12-07T09:59:47.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09e6ffd640 1 -- 172.21.15.89:0/3764506810 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0abaf0 con 0x7f09e80c0370 2023-12-07T09:59:47.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 -- 172.21.15.89:0/3764506810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e80c0370 msgr2=0x7f09e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:47.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 --2- 172.21.15.89:0/3764506810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e80c0370 0x7f09e806d110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f09e80c3910 tx=0x7f09dc01c3e0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 -- 172.21.15.89:0/3764506810 shutdown_connections 2023-12-07T09:59:47.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 --2- 172.21.15.89:0/3764506810 >> v2:172.21.15.97:3300/0 conn(0x7f09e80a8470 0x7f09e806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 --2- 172.21.15.89:0/3764506810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e80c0370 0x7f09e806d110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 -- 172.21.15.89:0/3764506810 >> 172.21.15.89:0/3764506810 conn(0x7f09e80c2a60 msgr2=0x7f09e80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:47.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 -- 172.21.15.89:0/3764506810 shutdown_connections 2023-12-07T09:59:47.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.094+0000 7f09ee580640 1 -- 172.21.15.89:0/3764506810 wait complete. 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 Processor -- start 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- start start 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e80a8470 0x7f09e8140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e80c0370 0x7f09e80c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 0x7f09e80c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e814a0a0 con 0x7f09e814eaf0 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80c49f0 con 0x7f09e80c0370 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e8149770 con 0x7f09e80a8470 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 0x7f09e80c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 0x7f09e80c0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38704/0 (socket says 172.21.15.89:38704) 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 -- 172.21.15.89:0/1122185187 learned_addr learned my addr 172.21.15.89:0/1122185187 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09e7fff640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e80a8470 0x7f09e8140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:47.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09e77fe640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e80c0370 0x7f09e80c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 -- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e80a8470 msgr2=0x7f09e8140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e80a8470 0x7f09e8140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 -- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e80c0370 msgr2=0x7f09e80c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e80c0370 0x7f09e80c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 -- 172.21.15.89:0/1122185187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0094d0 con 0x7f09e814eaf0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ecb1d640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 0x7f09e80c0f30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f09e0007e70 tx=0x7f09e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0015600 con 0x7f09e814eaf0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000f040 con 0x7f09e814eaf0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e00159a0 con 0x7f09e814eaf0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e8149a50 con 0x7f09e814eaf0 2023-12-07T09:59:47.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e814a530 con 0x7f09e814eaf0 2023-12-07T09:59:47.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.098+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e814a210 con 0x7f09e814eaf0 2023-12-07T09:59:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.102+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f09e001e3b0 con 0x7f09e814eaf0 2023-12-07T09:59:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.102+0000 7f09e4ff9640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09d40668d0 0x7f09d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.102+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f09e0084840 con 0x7f09e814eaf0 2023-12-07T09:59:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.102+0000 7f09e7fff640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09d40668d0 0x7f09d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.102+0000 7f09e7fff640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09d40668d0 0x7f09d4068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09e8070b80 tx=0x7f09d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:47.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.106+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09e0051a40 con 0x7f09e814eaf0 2023-12-07T09:59:47.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.290+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09e804e890 con 0x7f09e814eaf0 2023-12-07T09:59:47.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09e4ff9640 1 -- 172.21.15.89:0/1122185187 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09e0055060 con 0x7f09e814eaf0 2023-12-07T09:59:47.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09d40668d0 msgr2=0x7f09d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:47.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09d40668d0 0x7f09d4068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09e8070b80 tx=0x7f09d8009040 comp rx=0 tx=0).stop 2023-12-07T09:59:47.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 msgr2=0x7f09e80c0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 0x7f09e80c0f30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f09e0007e70 tx=0x7f09e000d4a0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 shutdown_connections 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e814eaf0 0x7f09e80c0f30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e80c0370 0x7f09e80c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09d40668d0 0x7f09d4068d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 --2- 172.21.15.89:0/1122185187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e80a8470 0x7f09e8140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.930+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 >> 172.21.15.89:0/1122185187 conn(0x7f09e80c2a60 msgr2=0x7f09e80bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.934+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 shutdown_connections 2023-12-07T09:59:47.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:47.934+0000 7f09ee580640 1 -- 172.21.15.89:0/1122185187 wait complete. 2023-12-07T09:59:47.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-07T09:59:48.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 Processor -- start 2023-12-07T09:59:48.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 -- start start 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee40aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efee40a5140 0x7efee40c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40a55d0 con 0x7efee40726a0 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee4153250 con 0x7efee40a5140 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee9879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee4152640 con 0x7efee40a4d60 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efee40a5140 0x7efee40c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:48.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efee40a5140 0x7efee40c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38708/0 (socket says 172.21.15.89:38708) 2023-12-07T09:59:48.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 -- 172.21.15.89:0/290090603 learned_addr learned my addr 172.21.15.89:0/290090603 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:48.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efedbfff640 1 --1- 172.21.15.89:0/290090603 >> v1:172.21.15.89:6789/0 conn(0x7efee40726a0 0x7efee40c3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35074/0 (socket says 172.21.15.89:35074) 2023-12-07T09:59:48.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee2ffd640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee40aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:48.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 -- 172.21.15.89:0/290090603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 msgr2=0x7efee40aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:48.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee40aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 -- 172.21.15.89:0/290090603 >> v1:172.21.15.89:6789/0 conn(0x7efee40726a0 legacy=0x7efee40c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:48.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee37fe640 1 -- 172.21.15.89:0/290090603 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4152920 con 0x7efee40a5140 2023-12-07T09:59:48.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee27fc640 1 -- 172.21.15.89:0/290090603 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076854965 0 0) 0x7efecc001120 con 0x7efee40726a0 2023-12-07T09:59:48.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.098+0000 7efee2ffd640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee40aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:48.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee37fe640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40a5140 0x7efee40c4260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efedc009e50 tx=0x7efedc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd06ae4f8f3d022 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:48.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee27fc640 1 -- 172.21.15.89:0/290090603 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0a5720 con 0x7efee40a5140 2023-12-07T09:59:48.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee27fc640 1 -- 172.21.15.89:0/290090603 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc0a5880 con 0x7efee40a5140 2023-12-07T09:59:48.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee27fc640 1 -- 172.21.15.89:0/290090603 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0a5c10 con 0x7efee40a5140 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 -- 172.21.15.89:0/290090603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40a5140 msgr2=0x7efee40c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40a5140 0x7efee40c4260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efedc009e50 tx=0x7efedc01c950 comp rx=0 tx=0).stop 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 -- 172.21.15.89:0/290090603 shutdown_connections 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40a5140 0x7efee40c4260 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 --2- 172.21.15.89:0/290090603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee40aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 -- 172.21.15.89:0/290090603 >> 172.21.15.89:0/290090603 conn(0x7efee40c5b70 msgr2=0x7efee40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 -- 172.21.15.89:0/290090603 shutdown_connections 2023-12-07T09:59:48.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 -- 172.21.15.89:0/290090603 wait complete. 2023-12-07T09:59:48.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 Processor -- start 2023-12-07T09:59:48.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.102+0000 7efee9879640 1 -- start start 2023-12-07T09:59:48.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 0x7efee41f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:48.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee41475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:48.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efee40a5140 0x7efee40c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:48.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee414abd0 con 0x7efee40726a0 2023-12-07T09:59:48.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4072370 con 0x7efee40a5140 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee4071760 con 0x7efee40a4d60 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 0x7efee41f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 0x7efee41f0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38718/0 (socket says 172.21.15.89:38718) 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 -- 172.21.15.89:0/1504954414 learned_addr learned my addr 172.21.15.89:0/1504954414 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efedbfff640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee41475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee37fe640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efee40a5140 0x7efee40c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 -- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 msgr2=0x7efee41475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee41475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 -- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efee40a5140 msgr2=0x7efee40c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efee40a5140 0x7efee40c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 -- 172.21.15.89:0/1504954414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc009b30 con 0x7efee40726a0 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee37fe640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efee40a5140 0x7efee40c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:48.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efedbfff640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee41475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:48.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee2ffd640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 0x7efee41f0cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efed400c820 tx=0x7efed400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:48.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4007a30 con 0x7efee40726a0 2023-12-07T09:59:48.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed4007b90 con 0x7efee40726a0 2023-12-07T09:59:48.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400ce10 con 0x7efee40726a0 2023-12-07T09:59:48.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee4071a40 con 0x7efee40726a0 2023-12-07T09:59:48.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee4072000 con 0x7efee40726a0 2023-12-07T09:59:48.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.106+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee404e890 con 0x7efee40726a0 2023-12-07T09:59:48.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.110+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efed40113f0 con 0x7efee40726a0 2023-12-07T09:59:48.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.110+0000 7efee0ff9640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efec40668d0 0x7efec4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:48.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.110+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efed4084690 con 0x7efee40726a0 2023-12-07T09:59:48.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.110+0000 7efedbfff640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efec40668d0 0x7efec4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:48.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.110+0000 7efedbfff640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efec40668d0 0x7efec4068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efee40bfaf0 tx=0x7efecc007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:48.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.114+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efed40517e0 con 0x7efee40726a0 2023-12-07T09:59:48.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.266+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efee40724b0 con 0x7efee40726a0 2023-12-07T09:59:48.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.934+0000 7efee0ff9640 1 -- 172.21.15.89:0/1504954414 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7efed4054e00 con 0x7efee40726a0 2023-12-07T09:59:48.943 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2023-12-07T09:59:48.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efec40668d0 msgr2=0x7efec4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:48.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efec40668d0 0x7efec4068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efee40bfaf0 tx=0x7efecc007cd0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 msgr2=0x7efee41f0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:48.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 0x7efee41f0cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efed400c820 tx=0x7efed400cce0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 shutdown_connections 2023-12-07T09:59:48.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efee40a5140 0x7efee40c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efec40668d0 0x7efec4068d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efee40a4d60 0x7efee41475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 --2- 172.21.15.89:0/1504954414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efee40726a0 0x7efee41f0cd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:48.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 >> 172.21.15.89:0/1504954414 conn(0x7efee40c5b70 msgr2=0x7efee414f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:48.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 shutdown_connections 2023-12-07T09:59:48.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:48.938+0000 7efee9879640 1 -- 172.21.15.89:0/1504954414 wait complete. 2023-12-07T09:59:48.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-07T09:59:49.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.102+0000 7f62f0817640 1 Processor -- start 2023-12-07T09:59:49.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.102+0000 7f62f0817640 1 -- start start 2023-12-07T09:59:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62f0817640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f62ec0ac280 0x7f62ec0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62f0817640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec151870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62f0817640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec0c5410 con 0x7f62ec0c4920 2023-12-07T09:59:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62f0817640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec0c83e0 con 0x7f62ec0ac280 2023-12-07T09:59:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62f0817640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0c4e50 con 0x7f62ec1586f0 2023-12-07T09:59:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eaffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f62ec0c4920 0x7f62ec1551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35080/0 (socket says 172.21.15.89:35080) 2023-12-07T09:59:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eaffd640 1 -- 172.21.15.89:0/4089775483 learned_addr learned my addr 172.21.15.89:0/4089775483 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/4089775483 >> v2:172.21.15.97:3300/0 conn(0x7f62ec0ac280 0x7f62ec0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62ebfff640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62ea7fc640 1 -- 172.21.15.89:0/4089775483 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633055749 0 0) 0x7f62e0001120 con 0x7f62ec0c4920 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62ea7fc640 1 -- 172.21.15.89:0/4089775483 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d4003530 con 0x7f62ec0c4920 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eb7fe640 1 -- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 msgr2=0x7f62ec151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eb7fe640 1 -- 172.21.15.89:0/4089775483 >> v1:172.21.15.89:6789/0 conn(0x7f62ec0c4920 legacy=0x7f62ec1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62eb7fe640 1 -- 172.21.15.89:0/4089775483 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0c5130 con 0x7f62ec0ac280 2023-12-07T09:59:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.106+0000 7f62ebfff640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:49.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec0c7ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca84434c38ae34f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:49.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62ea7fc640 1 -- 172.21.15.89:0/4089775483 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ab600 con 0x7f62ec0ac280 2023-12-07T09:59:49.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62ea7fc640 1 -- 172.21.15.89:0/4089775483 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0a7050 con 0x7f62ec0ac280 2023-12-07T09:59:49.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62ea7fc640 1 -- 172.21.15.89:0/4089775483 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ab980 con 0x7f62ec0ac280 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 -- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 msgr2=0x7f62ec0c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec0c7ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 -- 172.21.15.89:0/4089775483 shutdown_connections 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 --2- 172.21.15.89:0/4089775483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec0c7ea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 -- 172.21.15.89:0/4089775483 >> 172.21.15.89:0/4089775483 conn(0x7f62ec0720d0 msgr2=0x7f62ec0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 -- 172.21.15.89:0/4089775483 shutdown_connections 2023-12-07T09:59:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 -- 172.21.15.89:0/4089775483 wait complete. 2023-12-07T09:59:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.110+0000 7f62f0817640 1 Processor -- start 2023-12-07T09:59:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- start start 2023-12-07T09:59:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 0x7f62ec154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec0aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec154760 con 0x7f62ec0c4920 2023-12-07T09:59:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0c13a0 con 0x7f62ec0ac280 2023-12-07T09:59:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec155b50 con 0x7f62ec1586f0 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 0x7f62ec154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 0x7f62ec154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38730/0 (socket says 172.21.15.89:38730) 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 -- 172.21.15.89:0/3253741284 learned_addr learned my addr 172.21.15.89:0/3253741284 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62ebfff640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec0aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 -- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 msgr2=0x7f62ec0aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec0aa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 -- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 msgr2=0x7f62ec145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 -- 172.21.15.89:0/3253741284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009a70 con 0x7f62ec0c4920 2023-12-07T09:59:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62eaffd640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 0x7f62ec154220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c730 tx=0x7f62e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:49.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0005ac0 con 0x7f62ec0c4920 2023-12-07T09:59:49.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0005c20 con 0x7f62ec0c4920 2023-12-07T09:59:49.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc009420 con 0x7f62ec0c4920 2023-12-07T09:59:49.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0007070 con 0x7f62ec0c4920 2023-12-07T09:59:49.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec156110 con 0x7f62ec0c4920 2023-12-07T09:59:49.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.114+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec04e890 con 0x7f62ec0c4920 2023-12-07T09:59:49.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.118+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f62e00071d0 con 0x7f62ec0c4920 2023-12-07T09:59:49.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.118+0000 7f62d3fff640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f62d80668d0 0x7f62d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:49.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.118+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f62e00836c0 con 0x7f62ec0c4920 2023-12-07T09:59:49.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.118+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f62d80668d0 0x7f62d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:49.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.118+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f62d80668d0 0x7f62d8068d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ad000 tx=0x7f62dc0a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:49.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.122+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62e0050a70 con 0x7f62ec0c4920 2023-12-07T09:59:49.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.294+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62ec0c5410 con 0x7f62ec0c4920 2023-12-07T09:59:49.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.938+0000 7f62d3fff640 1 -- 172.21.15.89:0/3253741284 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f62ec0c5410 con 0x7f62ec0c4920 2023-12-07T09:59:49.945 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2023-12-07T09:59:49.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.938+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f62d80668d0 msgr2=0x7f62d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:49.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.938+0000 7f62f0817640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f62d80668d0 0x7f62d8068d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ad000 tx=0x7f62dc0a4f90 comp rx=0 tx=0).stop 2023-12-07T09:59:49.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.938+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 msgr2=0x7f62ec154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:49.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.938+0000 7f62f0817640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 0x7f62ec154220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c730 tx=0x7f62e000cbf0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 shutdown_connections 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f62d80668d0 0x7f62d8068d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62ec1586f0 0x7f62ec0aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62ec0c4920 0x7f62ec154220 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 --2- 172.21.15.89:0/3253741284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62ec0ac280 0x7f62ec145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 >> 172.21.15.89:0/3253741284 conn(0x7f62ec0720d0 msgr2=0x7f62ec15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:49.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 shutdown_connections 2023-12-07T09:59:49.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:49.942+0000 7f62f0817640 1 -- 172.21.15.89:0/3253741284 wait complete. 2023-12-07T09:59:49.973 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-07T09:59:49.974 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-07T09:59:49.974 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-07T09:59:49.974 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T09:59:49.974 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-07T09:59:49.974 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-07T09:59:49.974 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-07T09:59:49.974 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T09:59:49.975 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-07T09:59:49.975 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-07T09:59:49.975 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-07T09:59:49.975 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T09:59:49.975 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-07T09:59:49.975 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-07T09:59:49.975 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-07T09:59:49.976 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T09:59:49.988 INFO:tasks.ceph.mds.a:Stopped 2023-12-07T09:59:49.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-07T09:59:49.989 INFO:tasks.ceph.mds.c:Stopped 2023-12-07T09:59:49.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-07T09:59:49.994 INFO:tasks.ceph.mds.b:Stopped 2023-12-07T09:59:49.995 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-07T09:59:49.997 INFO:tasks.ceph.mds.d:Stopped 2023-12-07T09:59:49.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-07T09:59:50.034 INFO:tasks.ceph.mds.a:Started 2023-12-07T09:59:50.035 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:50.036 INFO:tasks.ceph.mds.c:Started 2023-12-07T09:59:50.037 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:50.039 INFO:tasks.ceph.mds.b:Started 2023-12-07T09:59:50.040 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:50.043 INFO:tasks.ceph.mds.d:Started 2023-12-07T09:59:50.043 DEBUG:teuthology.parallel:result is None 2023-12-07T09:59:50.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-07T09:59:50.122 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T09:59:50.124 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-12-07T09:59:50.144 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2023-12-07T09:59:50.145 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2023-12-07T09:59:50.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.182+0000 7f4fb05a1640 1 Processor -- start 2023-12-07T09:59:50.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.182+0000 7f4fb05a1640 1 -- start start 2023-12-07T09:59:50.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.182+0000 7f4fb05a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa8070b80 0x7f4fa8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:50.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.182+0000 7f4fb05a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa806d320 con 0x7f4fa80a8470 2023-12-07T09:59:50.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.182+0000 7f4fb05a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa80721b0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.182+0000 7f4fb05a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c2830 con 0x7f4fa8070b80 2023-12-07T09:59:50.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4faeb3e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4fa80a8470 0x7f4fa806d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42672/0 (socket says 172.21.15.89:42672) 2023-12-07T09:59:50.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fadb3c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa8070b80 0x7f4fa8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:50.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fae33d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4fa814e9d0 0x7f4fa80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:56672/0 (socket says 172.21.15.89:56672) 2023-12-07T09:59:50.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4faeb3e640 1 -- 172.21.15.89:0/2697862687 learned_addr learned my addr 172.21.15.89:0/2697862687 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:50.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fad33b640 1 -- 172.21.15.89:0/2697862687 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394490653 0 0) 0x7f4fa806d320 con 0x7f4fa80a8470 2023-12-07T09:59:50.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fad33b640 1 -- 172.21.15.89:0/2697862687 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f94003530 con 0x7f4fa80a8470 2023-12-07T09:59:50.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fad33b640 1 -- 172.21.15.89:0/2697862687 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046304890 0 0) 0x7f4fa80721b0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fadb3c640 1 -- 172.21.15.89:0/2697862687 >> v1:172.21.15.97:6789/0 conn(0x7f4fa814e9d0 legacy=0x7f4fa80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fadb3c640 1 -- 172.21.15.89:0/2697862687 >> v1:172.21.15.89:6789/0 conn(0x7f4fa80a8470 legacy=0x7f4fa806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fadb3c640 1 -- 172.21.15.89:0/2697862687 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8072450 con 0x7f4fa8070b80 2023-12-07T09:59:50.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fadb3c640 1 --2- 172.21.15.89:0/2697862687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa8070b80 0x7f4fa8151e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f980097f0 tx=0x7f4f9801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de37125e6a551f3e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:50.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fad33b640 1 -- 172.21.15.89:0/2697862687 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ab600 con 0x7f4fa8070b80 2023-12-07T09:59:50.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fad33b640 1 -- 172.21.15.89:0/2697862687 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980a7050 con 0x7f4fa8070b80 2023-12-07T09:59:50.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.186+0000 7f4fad33b640 1 -- 172.21.15.89:0/2697862687 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ab980 con 0x7f4fa8070b80 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2697862687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa8070b80 msgr2=0x7f4fa8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2697862687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa8070b80 0x7f4fa8151e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f980097f0 tx=0x7f4f9801c430 comp rx=0 tx=0).stop 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2697862687 shutdown_connections 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2697862687 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa8070b80 0x7f4fa8151e60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2697862687 >> 172.21.15.89:0/2697862687 conn(0x7f4fa80c2ad0 msgr2=0x7f4fa80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2697862687 shutdown_connections 2023-12-07T09:59:50.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2697862687 wait complete. 2023-12-07T09:59:50.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 Processor -- start 2023-12-07T09:59:50.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- start start 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fa8070b80 0x7f4fa80c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa80a8470 0x7f4fa8151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 0x7f4fa8150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa8148ff0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81edbc0 con 0x7f4fa8070b80 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fb05a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c5b40 con 0x7f4fa80a8470 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 0x7f4fa8150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 0x7f4fa8150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34470/0 (socket says 172.21.15.89:34470) 2023-12-07T09:59:50.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 -- 172.21.15.89:0/2302231466 learned_addr learned my addr 172.21.15.89:0/2302231466 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fae33d640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fa8070b80 0x7f4fa80c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fadb3c640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa80a8470 0x7f4fa8151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 -- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa80a8470 msgr2=0x7f4fa8151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa80a8470 0x7f4fa8151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 -- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fa8070b80 msgr2=0x7f4fa80c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fa8070b80 0x7f4fa80c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4faeb3e640 1 -- 172.21.15.89:0/2302231466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009420 con 0x7f4fa814e9d0 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fae33d640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fa8070b80 0x7f4fa80c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.190+0000 7f4fadb3c640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa80a8470 0x7f4fa8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4faeb3e640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 0x7f4fa8150c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000cbb0 tx=0x7f4fa000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000ace0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000ae40 con 0x7f4fa814e9d0 2023-12-07T09:59:50.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa80c5860 con 0x7f4fa814e9d0 2023-12-07T09:59:50.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0012600 con 0x7f4fa814e9d0 2023-12-07T09:59:50.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa80c40c0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa804e890 con 0x7f4fa814e9d0 2023-12-07T09:59:50.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4fa0012820 con 0x7f4fa814e9d0 2023-12-07T09:59:50.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4f9effd640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f8c0668d0 0x7f4f8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:50.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4fa0083ff0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.194+0000 7f4fae33d640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f8c0668d0 0x7f4f8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:50.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.198+0000 7f4fae33d640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f8c0668d0 0x7f4f8c068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40016e0 tx=0x7f4fa4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:50.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.198+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fa00515d0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.362+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4fa80700a0 con 0x7f4fa814e9d0 2023-12-07T09:59:50.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.962+0000 7f4f9effd640 1 -- 172.21.15.89:0/2302231466 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4fa0017080 con 0x7f4fa814e9d0 2023-12-07T09:59:50.970 INFO:teuthology.orchestra.run.smithi089.stderr: removed all blocklist entries 2023-12-07T09:59:50.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f8c0668d0 msgr2=0x7f4f8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f8c0668d0 0x7f4f8c068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40016e0 tx=0x7f4fa4009040 comp rx=0 tx=0).stop 2023-12-07T09:59:50.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 msgr2=0x7f4fa8150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:50.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 0x7f4fa8150c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000cbb0 tx=0x7f4fa000a430 comp rx=0 tx=0).stop 2023-12-07T09:59:50.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 shutdown_connections 2023-12-07T09:59:50.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa814e9d0 0x7f4fa8150c00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f8c0668d0 0x7f4f8c068d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fa80a8470 0x7f4fa8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 --2- 172.21.15.89:0/2302231466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fa8070b80 0x7f4fa80c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:50.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 >> 172.21.15.89:0/2302231466 conn(0x7f4fa80c2ad0 msgr2=0x7f4fa815c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:50.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 shutdown_connections 2023-12-07T09:59:50.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:50.966+0000 7f4fb05a1640 1 -- 172.21.15.89:0/2302231466 wait complete. 2023-12-07T09:59:50.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-07T09:59:51.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 Processor -- start 2023-12-07T09:59:51.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 -- start start 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff79414ea60 0x7ff794155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff79406bd00 0x7ff7940700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79406c440 con 0x7ff7940bf400 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff794154790 con 0x7ff79414ea60 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff798c79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79406c6e0 con 0x7ff79406bd00 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff79259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff79414ea60 0x7ff794155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff792d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff7940bf400 0x7ff7940c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42676/0 (socket says 172.21.15.89:42676) 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.126+0000 7ff792d9d640 1 -- 172.21.15.89:0/3640827903 learned_addr learned my addr 172.21.15.89:0/3640827903 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff791d9b640 1 --2- 172.21.15.89:0/3640827903 >> v2:172.21.15.97:3300/0 conn(0x7ff79406bd00 0x7ff7940700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79259c640 1 -- 172.21.15.89:0/3640827903 >> v2:172.21.15.97:3300/0 conn(0x7ff79406bd00 msgr2=0x7ff7940700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79259c640 1 --2- 172.21.15.89:0/3640827903 >> v2:172.21.15.97:3300/0 conn(0x7ff79406bd00 0x7ff7940700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79259c640 1 -- 172.21.15.89:0/3640827903 >> v1:172.21.15.89:6789/0 conn(0x7ff7940bf400 legacy=0x7ff7940c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79259c640 1 -- 172.21.15.89:0/3640827903 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794154a50 con 0x7ff79414ea60 2023-12-07T09:59:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79159a640 1 -- 172.21.15.89:0/3640827903 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709383650 0 0) 0x7ff79406c440 con 0x7ff7940bf400 2023-12-07T09:59:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79259c640 1 --2- 172.21.15.89:0/3640827903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79414ea60 0x7ff794155250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff79406b370 tx=0x7ff78401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544a6bcaf2ad66bd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79159a640 1 -- 172.21.15.89:0/3640827903 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840a5860 con 0x7ff79414ea60 2023-12-07T09:59:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79159a640 1 -- 172.21.15.89:0/3640827903 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840a59c0 con 0x7ff79414ea60 2023-12-07T09:59:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.130+0000 7ff79159a640 1 -- 172.21.15.89:0/3640827903 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840a5d50 con 0x7ff79414ea60 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- 172.21.15.89:0/3640827903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79414ea60 msgr2=0x7ff794155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 --2- 172.21.15.89:0/3640827903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79414ea60 0x7ff794155250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff79406b370 tx=0x7ff78401c7c0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- 172.21.15.89:0/3640827903 shutdown_connections 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 --2- 172.21.15.89:0/3640827903 >> v2:172.21.15.97:3300/0 conn(0x7ff79406bd00 0x7ff7940700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 --2- 172.21.15.89:0/3640827903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79414ea60 0x7ff794155250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- 172.21.15.89:0/3640827903 >> 172.21.15.89:0/3640827903 conn(0x7ff7940c2ad0 msgr2=0x7ff7940c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- 172.21.15.89:0/3640827903 shutdown_connections 2023-12-07T09:59:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- 172.21.15.89:0/3640827903 wait complete. 2023-12-07T09:59:51.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 Processor -- start 2023-12-07T09:59:51.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- start start 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 0x7ff7941523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7940bf400 0x7ff794143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff79414ea60 0x7ff794156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff794148c50 con 0x7ff79406bd00 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79414a410 con 0x7ff79414ea60 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff798c79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff794157090 con 0x7ff7940bf400 2023-12-07T09:59:51.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 0x7ff7941523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 0x7ff7941523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34496/0 (socket says 172.21.15.89:34496) 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 -- 172.21.15.89:0/363676892 learned_addr learned my addr 172.21.15.89:0/363676892 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 -- 172.21.15.89:0/363676892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7940bf400 msgr2=0x7ff794143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7940bf400 0x7ff794143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 -- 172.21.15.89:0/363676892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff79414ea60 msgr2=0x7ff794156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff79414ea60 0x7ff794156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.134+0000 7ff79259c640 1 -- 172.21.15.89:0/363676892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009a70 con 0x7ff79406bd00 2023-12-07T09:59:51.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff79259c640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 0x7ff7941523d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff7840b0040 tx=0x7ff784019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840ad850 con 0x7ff79406bd00 2023-12-07T09:59:51.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840ad9d0 con 0x7ff79406bd00 2023-12-07T09:59:51.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff794158860 con 0x7ff79406bd00 2023-12-07T09:59:51.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840add80 con 0x7ff79406bd00 2023-12-07T09:59:51.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7941ed7a0 con 0x7ff79406bd00 2023-12-07T09:59:51.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79404e890 con 0x7ff79406bd00 2023-12-07T09:59:51.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff7840b4050 con 0x7ff79406bd00 2023-12-07T09:59:51.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff782ffd640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7740668d0 0x7ff774068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff78411efe0 con 0x7ff79406bd00 2023-12-07T09:59:51.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.138+0000 7ff791d9b640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7740668d0 0x7ff774068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.142+0000 7ff791d9b640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7740668d0 0x7ff774068d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff7941444c0 tx=0x7ff788008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.142+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7840ec700 con 0x7ff79406bd00 2023-12-07T09:59:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.366+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff79406b5b0 con 0x7ff79406bd00 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff782ffd640 1 -- 172.21.15.89:0/363676892 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7ff7840b2090 con 0x7ff79406bd00 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_dump": [ 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.a", 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3Flf1wcOhAACzyi07iCb6OeVrox4hSSoQ==", 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T09:59:51.376 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.b", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlNmS9ChAAKeb6oUGcE358orATMWlpig==", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.c", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3Fl8di0BRAA6GZD2xbIkzOykVG6rHfqew==", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.d", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3Fl/RH+ERAAAUPU8qglPPkntimRXcvGwg==", 2023-12-07T09:59:51.378 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.0", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA4l3Fl/Z3VIBAASvuI7XuDpc3FH9/P7lhsww==", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.1", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA7l3FlC/M1KBAAjwhtKGKQ/HZ6yhpOCXV0kw==", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.2", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA+l3Fl/y6sLxAAm8pKF8kx9qUmFNUmMbFBMw==", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.380 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.3", 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBBl3Fl+0hCNxAAIVwKiVgagVbLZsm7QcynUQ==", 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.4", 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBIl3FlwbtwDBAAk6YFzxYayyMbAudT72sxGA==", 2023-12-07T09:59:51.381 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.5", 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBLl3Flwt1OFBAAoLwAtcuFIt/FW7gisMaV/w==", 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.6", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBOl3FlXhU/GhAA/4dl8x5v2OapJqCTPbYFwA==", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.7", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBRl3FlTTKFIBAAUuR+A3irHtSU67nIRnoFug==", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T09:59:51.383 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.0", 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg==", 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow r", 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow rw", 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rwx" 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.384 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.1", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA==", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow r", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow rw", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rwx" 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.admin", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3Fl9gGkHRAABCgzAlOwroY6GO3tuPbihQ==", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T09:59:51.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-mds", 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBXl3FluzZ2FRAAKfjeI9aZNZTgKZrDSWNlvg==", 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-mds" 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-mgr", 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBXl3FltUB2FRAAZ+mnrie6TN1UGOxbKPfAQg==", 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.386 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-osd", 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBXl3FlVkl2FRAAuKzZZAm2J4fgHRvNEBYJcg==", 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-osd" 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-rbd", 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBXl3FlkFF2FRAAhg5gWNcOjA/NZ8SYpz94rQ==", 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-07T09:59:51.387 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBXl3Flllx2FRAA+tBJqtJH/cm/Sjrxf2D7uw==", 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-rgw", 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBXl3FlXWV2FRAAMmLr6774zrCKgZBUMwWQLA==", 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.x", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3FlefecNRAAaSFdy4bxWI1FH6tFc84Hqg==", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.y", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3FluC/UMRAA6hAJrSbSRn3I/3XeHlIBCQ==", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T09:59:51.389 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-12-07T09:59:51.390 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T09:59:51.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:51.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2023-12-07T09:59:51.390 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7740668d0 msgr2=0x7ff774068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7740668d0 0x7ff774068d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff7941444c0 tx=0x7ff788008040 comp rx=0 tx=0).stop 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 msgr2=0x7ff7941523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 0x7ff7941523d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff7840b0040 tx=0x7ff784019560 comp rx=0 tx=0).stop 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 shutdown_connections 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff79414ea60 0x7ff794156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7740668d0 0x7ff774068d90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7940bf400 0x7ff794143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 --2- 172.21.15.89:0/363676892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff79406bd00 0x7ff7941523d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 >> 172.21.15.89:0/363676892 conn(0x7ff7940c2ad0 msgr2=0x7ff794152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 shutdown_connections 2023-12-07T09:59:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.370+0000 7ff798c79640 1 -- 172.21.15.89:0/363676892 wait complete. 2023-12-07T09:59:51.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-07T09:59:51.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.526+0000 7f93cf679640 1 Processor -- start 2023-12-07T09:59:51.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.526+0000 7f93cf679640 1 -- start start 2023-12-07T09:59:51.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cf679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93c806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cf679640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c806bea0 con 0x7f93c806d100 2023-12-07T09:59:51.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cf679640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c8159550 con 0x7f93c806db80 2023-12-07T09:59:51.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cf679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8159b10 con 0x7f93c8152ce0 2023-12-07T09:59:51.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cdc16640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f93c806d100 0x7f93c80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42686/0 (socket says 172.21.15.89:42686) 2023-12-07T09:59:51.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cdc16640 1 -- 172.21.15.89:0/93968747 learned_addr learned my addr 172.21.15.89:0/93968747 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93c806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161911622 0 0) 0x7f93c806bea0 con 0x7f93c806d100 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b4003530 con 0x7f93c806d100 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762489238 0 0) 0x7f93b4003530 con 0x7f93c806d100 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 msgr2=0x7f93c806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93c806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 >> v1:172.21.15.97:6789/0 conn(0x7f93c806db80 legacy=0x7f93c80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8159830 con 0x7f93c806d100 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f93c0001a00 con 0x7f93c806d100 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 >> v1:172.21.15.89:6789/0 conn(0x7f93c806d100 legacy=0x7f93c80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93b4003f30 0x7f93b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b4004d10 0x7f93b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8159b10 con 0x7f93b4004d10 2023-12-07T09:59:51.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b400bb20 con 0x7f93b4003f30 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b400bce0 con 0x7f93c8152ce0 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cdc16640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b4004d10 0x7f93b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93ccc14640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93b4003f30 0x7f93b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 -- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93b4003f30 msgr2=0x7f93b40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93b4003f30 0x7f93b40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 -- 172.21.15.89:0/93968747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b4004d10 msgr2=0x7f93b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b4004d10 0x7f93b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cd415640 1 -- 172.21.15.89:0/93968747 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4003530 con 0x7f93c8152ce0 2023-12-07T09:59:51.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.530+0000 7f93cdc16640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b4004d10 0x7f93b4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:51.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cd415640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93b40039b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009b10 tx=0x7f93c401ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a60ac95185f791 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40a5680 con 0x7f93c8152ce0 2023-12-07T09:59:51.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c40a57e0 con 0x7f93c8152ce0 2023-12-07T09:59:51.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93bffff640 1 -- 172.21.15.89:0/93968747 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40a5990 con 0x7f93c8152ce0 2023-12-07T09:59:51.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cf679640 1 -- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 msgr2=0x7f93b40039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cf679640 1 --2- 172.21.15.89:0/93968747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c8152ce0 0x7f93b40039b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009b10 tx=0x7f93c401ca90 comp rx=0 tx=0).stop 2023-12-07T09:59:51.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cdc16640 1 -- 172.21.15.89:0/93968747 reap_dead start 2023-12-07T09:59:51.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cf679640 1 -- 172.21.15.89:0/93968747 shutdown_connections 2023-12-07T09:59:51.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cf679640 1 -- 172.21.15.89:0/93968747 >> 172.21.15.89:0/93968747 conn(0x7f93c80c2ad0 msgr2=0x7f93c80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:51.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cf679640 1 -- 172.21.15.89:0/93968747 shutdown_connections 2023-12-07T09:59:51.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.534+0000 7f93cf679640 1 -- 172.21.15.89:0/93968747 wait complete. 2023-12-07T09:59:51.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 Processor -- start 2023-12-07T09:59:51.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- start start 2023-12-07T09:59:51.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 0x7f93c81e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c814a620 0x7f93c80c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93c80c4a30 0x7f93c81e29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80c52d0 con 0x7f93c8152ce0 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c815c850 con 0x7f93c80c4a30 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c815caa0 con 0x7f93c814a620 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 0x7f93c81e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 0x7f93c81e46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34516/0 (socket says 172.21.15.89:34516) 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 -- 172.21.15.89:0/3955638939 learned_addr learned my addr 172.21.15.89:0/3955638939 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93ccc14640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c814a620 0x7f93c80c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cdc16640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93c80c4a30 0x7f93c81e29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 -- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c814a620 msgr2=0x7f93c80c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c814a620 0x7f93c80c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 -- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93c80c4a30 msgr2=0x7f93c81e29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93c80c4a30 0x7f93c81e29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 -- 172.21.15.89:0/3955638939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c815cd80 con 0x7f93c8152ce0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cdc16640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93c80c4a30 0x7f93c81e29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cd415640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 0x7f93c81e46b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f93c401c8c0 tx=0x7f93b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4004220 con 0x7f93c8152ce0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c4004380 con 0x7f93c8152ce0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40ad850 con 0x7f93c8152ce0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c80c4ef0 con 0x7f93c8152ce0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c80c5c90 con 0x7f93c8152ce0 2023-12-07T09:59:51.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.538+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c814aa00 con 0x7f93c8152ce0 2023-12-07T09:59:51.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.542+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f93c40b4040 con 0x7f93c8152ce0 2023-12-07T09:59:51.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.542+0000 7f93bdffb640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93ac066900 0x7f93ac068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.542+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93c411e390 con 0x7f93c8152ce0 2023-12-07T09:59:51.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.542+0000 7f93ccc14640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93ac066900 0x7f93ac068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.542+0000 7f93ccc14640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93ac066900 0x7f93ac068dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000c10 tx=0x7f93b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.546+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93c814aa00 con 0x7f93c8152ce0 2023-12-07T09:59:51.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.746+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f93c814aa00 con 0x7f93c8152ce0 2023-12-07T09:59:51.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93bdffb640 1 -- 172.21.15.89:0/3955638939 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f93c814aa00 con 0x7f93c8152ce0 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93ac066900 msgr2=0x7f93ac068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93ac066900 0x7f93ac068dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000c10 tx=0x7f93b8009040 comp rx=0 tx=0).stop 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 msgr2=0x7f93c81e46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 0x7f93c81e46b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f93c401c8c0 tx=0x7f93b4005800 comp rx=0 tx=0).stop 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 shutdown_connections 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93c80c4a30 0x7f93c81e29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93ac066900 0x7f93ac068dc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93c814a620 0x7f93c80c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 --2- 172.21.15.89:0/3955638939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93c8152ce0 0x7f93c81e46b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 >> 172.21.15.89:0/3955638939 conn(0x7f93c80c2ad0 msgr2=0x7f93c80c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 shutdown_connections 2023-12-07T09:59:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.750+0000 7f93cf679640 1 -- 172.21.15.89:0/3955638939 wait complete. 2023-12-07T09:59:51.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-07T09:59:51.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.906+0000 7efc5b59e640 1 Processor -- start 2023-12-07T09:59:51.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.906+0000 7efc5b59e640 1 -- start start 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc5c0af6b0 0x7efc5c0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5b59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0c48b0 0x7efc5c0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5b59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c0afa90 con 0x7efc5c0cab80 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0c4dc0 con 0x7efc5c0af6b0 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5b59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c5080 con 0x7efc5c0c48b0 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc5c0af6b0 0x7efc5c0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc5c0af6b0 0x7efc5c0ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34524/0 (socket says 172.21.15.89:34524) 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 -- 172.21.15.89:0/2169876457 learned_addr learned my addr 172.21.15.89:0/2169876457 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc51d9b640 1 --2- 172.21.15.89:0/2169876457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0c48b0 0x7efc5c0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 -- 172.21.15.89:0/2169876457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0c48b0 msgr2=0x7efc5c0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 --2- 172.21.15.89:0/2169876457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0c48b0 0x7efc5c0c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 -- 172.21.15.89:0/2169876457 >> v1:172.21.15.97:6789/0 conn(0x7efc5c0cab80 legacy=0x7efc5c0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc59d9b640 1 -- 172.21.15.89:0/2169876457 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59679101 0 0) 0x7efc5c0afa90 con 0x7efc5c0cab80 2023-12-07T09:59:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.910+0000 7efc5a59c640 1 -- 172.21.15.89:0/2169876457 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c158a30 con 0x7efc5c0af6b0 2023-12-07T09:59:51.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5a59c640 1 --2- 172.21.15.89:0/2169876457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c0ca640 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc4401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0ca390bd5d9c16 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc59d9b640 1 -- 172.21.15.89:0/2169876457 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440ab600 con 0x7efc5c0af6b0 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc59d9b640 1 -- 172.21.15.89:0/2169876457 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440a7050 con 0x7efc5c0af6b0 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc59d9b640 1 -- 172.21.15.89:0/2169876457 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440ab980 con 0x7efc5c0af6b0 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 -- 172.21.15.89:0/2169876457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 msgr2=0x7efc5c0ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 --2- 172.21.15.89:0/2169876457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c0ca640 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc4401c540 comp rx=0 tx=0).stop 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 -- 172.21.15.89:0/2169876457 shutdown_connections 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 --2- 172.21.15.89:0/2169876457 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0c48b0 0x7efc5c0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 --2- 172.21.15.89:0/2169876457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c0ca640 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 -- 172.21.15.89:0/2169876457 >> 172.21.15.89:0/2169876457 conn(0x7efc5c0ac0c0 msgr2=0x7efc5c0c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 -- 172.21.15.89:0/2169876457 shutdown_connections 2023-12-07T09:59:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 -- 172.21.15.89:0/2169876457 wait complete. 2023-12-07T09:59:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 Processor -- start 2023-12-07T09:59:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.914+0000 7efc5b59e640 1 -- start start 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c1ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc5c0c48b0 0x7efc5c154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0cab80 0x7efc5c0c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c155310 con 0x7efc5c0af6b0 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c1110 con 0x7efc5c0c48b0 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c13f0 con 0x7efc5c0cab80 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c1ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c1ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34538/0 (socket says 172.21.15.89:34538) 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 -- 172.21.15.89:0/173564640 learned_addr learned my addr 172.21.15.89:0/173564640 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5ad9d640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0cab80 0x7efc5c0c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc51d9b640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc5c0c48b0 0x7efc5c154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 -- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0cab80 msgr2=0x7efc5c0c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0cab80 0x7efc5c0c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 -- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc5c0c48b0 msgr2=0x7efc5c154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc5c0c48b0 0x7efc5c154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 -- 172.21.15.89:0/173564640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440094d0 con 0x7efc5c0af6b0 2023-12-07T09:59:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5a59c640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c1ece90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efc4401abf0 tx=0x7efc4401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44004030 con 0x7efc5c0af6b0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc44004190 con 0x7efc5c0af6b0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c0c16d0 con 0x7efc5c0af6b0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44004500 con 0x7efc5c0af6b0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c0c1c90 con 0x7efc5c0af6b0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c0c1e80 con 0x7efc5c0af6b0 2023-12-07T09:59:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.918+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc440b2040 con 0x7efc5c0af6b0 2023-12-07T09:59:51.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.922+0000 7efc537fe640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efc3c0668d0 0x7efc3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:51.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.922+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc4411dcf0 con 0x7efc5c0af6b0 2023-12-07T09:59:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.922+0000 7efc51d9b640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efc3c0668d0 0x7efc3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.922+0000 7efc51d9b640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efc3c0668d0 0x7efc3c068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc5c1eacd0 tx=0x7efc4c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:51.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:51.926+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc440eb440 con 0x7efc5c0af6b0 2023-12-07T09:59:52.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.130+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7efc5c04e890 con 0x7efc5c0af6b0 2023-12-07T09:59:52.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc537fe640 1 -- 172.21.15.89:0/173564640 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7efc440eea60 con 0x7efc5c0af6b0 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efc3c0668d0 msgr2=0x7efc3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efc3c0668d0 0x7efc3c068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc5c1eacd0 tx=0x7efc4c009190 comp rx=0 tx=0).stop 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 msgr2=0x7efc5c1ece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c1ece90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efc4401abf0 tx=0x7efc4401ad80 comp rx=0 tx=0).stop 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 shutdown_connections 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efc3c0668d0 0x7efc3c068d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efc5c0cab80 0x7efc5c0c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc5c0c48b0 0x7efc5c154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 --2- 172.21.15.89:0/173564640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc5c0af6b0 0x7efc5c1ece90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 >> 172.21.15.89:0/173564640 conn(0x7efc5c0ac0c0 msgr2=0x7efc5c0c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 shutdown_connections 2023-12-07T09:59:52.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.134+0000 7efc5b59e640 1 -- 172.21.15.89:0/173564640 wait complete. 2023-12-07T09:59:52.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-07T09:59:52.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 Processor -- start 2023-12-07T09:59:52.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 -- start start 2023-12-07T09:59:52.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8fe006b100 0x7f8fe006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8fe00c93c0 0x7f8fe015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe01559f0 con 0x7f8fe00bd5e0 2023-12-07T09:59:52.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe0157930 con 0x7f8fe00c93c0 2023-12-07T09:59:52.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe67d0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe00c9870 con 0x7f8fe006b100 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe5fcf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8fe00c93c0 0x7f8fe015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe4fcd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8fe00bd5e0 0x7f8fe00c8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42698/0 (socket says 172.21.15.89:42698) 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe4fcd640 1 -- 172.21.15.89:0/3169163135 learned_addr learned my addr 172.21.15.89:0/3169163135 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe57ce640 1 --2- 172.21.15.89:0/3169163135 >> v2:172.21.15.97:3300/0 conn(0x7f8fe006b100 0x7f8fe006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/3169163135 >> v2:172.21.15.97:3300/0 conn(0x7f8fe006b100 msgr2=0x7f8fe006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe5fcf640 1 --2- 172.21.15.89:0/3169163135 >> v2:172.21.15.97:3300/0 conn(0x7f8fe006b100 0x7f8fe006b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/3169163135 >> v1:172.21.15.89:6789/0 conn(0x7f8fe00bd5e0 legacy=0x7f8fe00c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/3169163135 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00aff20 con 0x7f8fe00c93c0 2023-12-07T09:59:52.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fe57ce640 1 --2- 172.21.15.89:0/3169163135 >> v2:172.21.15.97:3300/0 conn(0x7f8fe006b100 0x7f8fe006b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:52.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.294+0000 7f8fd7fff640 1 -- 172.21.15.89:0/3169163135 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580843472 0 0) 0x7f8fe01559f0 con 0x7f8fe00bd5e0 2023-12-07T09:59:52.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe5fcf640 1 --2- 172.21.15.89:0/3169163135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe015ee80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fe008bd10 tx=0x7f8fd801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6e233c29e14480 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:52.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fd7fff640 1 -- 172.21.15.89:0/3169163135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80a57d0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fd7fff640 1 -- 172.21.15.89:0/3169163135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd80a5930 con 0x7f8fe00c93c0 2023-12-07T09:59:52.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fd7fff640 1 -- 172.21.15.89:0/3169163135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80a5cc0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 -- 172.21.15.89:0/3169163135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 msgr2=0x7f8fe015ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/3169163135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe015ee80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fe008bd10 tx=0x7f8fd801c910 comp rx=0 tx=0).stop 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 -- 172.21.15.89:0/3169163135 shutdown_connections 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/3169163135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe015ee80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/3169163135 >> v2:172.21.15.97:3300/0 conn(0x7f8fe006b100 0x7f8fe006b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 -- 172.21.15.89:0/3169163135 >> 172.21.15.89:0/3169163135 conn(0x7f8fe00ca550 msgr2=0x7f8fe00abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 -- 172.21.15.89:0/3169163135 shutdown_connections 2023-12-07T09:59:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.298+0000 7f8fe67d0640 1 -- 172.21.15.89:0/3169163135 wait complete. 2023-12-07T09:59:52.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 Processor -- start 2023-12-07T09:59:52.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 -- start start 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe006b100 0x7f8fe014d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fe00bd5e0 0x7f8fe00c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe01f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f13d0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f10f0 con 0x7f8fe006b100 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00c5920 con 0x7f8fe00bd5e0 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe01f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe01f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34558/0 (socket says 172.21.15.89:34558) 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/1477200953 learned_addr learned my addr 172.21.15.89:0/1477200953 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe4fcd640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fe00bd5e0 0x7f8fe00c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe57ce640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe006b100 0x7f8fe014d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fe00bd5e0 msgr2=0x7f8fe00c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fe00bd5e0 0x7f8fe00c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe006b100 msgr2=0x7f8fe014d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe006b100 0x7f8fe014d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 -- 172.21.15.89:0/1477200953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd8009a70 con 0x7f8fe00c93c0 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe57ce640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe006b100 0x7f8fe014d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe4fcd640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fe00bd5e0 0x7f8fe00c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe5fcf640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe01f06f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8019520 tx=0x7f8fd80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80ad640 con 0x7f8fe00c93c0 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd80ad7a0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe00c5c00 con 0x7f8fe00c93c0 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80adb50 con 0x7f8fe00c93c0 2023-12-07T09:59:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.302+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00afb10 con 0x7f8fe00c93c0 2023-12-07T09:59:52.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.306+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe00c5df0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.306+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8fd80b4050 con 0x7f8fe00c93c0 2023-12-07T09:59:52.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.306+0000 7f8fd5ffb640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8fc40668d0 0x7f8fc4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.306+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8fd811f460 con 0x7f8fe00c93c0 2023-12-07T09:59:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.306+0000 7f8fe57ce640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8fc40668d0 0x7f8fc4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.306+0000 7f8fe57ce640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8fc40668d0 0x7f8fc4068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009980 tx=0x7f8fdc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:52.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.310+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fd80ecba0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.518+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8fe004e890 con 0x7f8fe00c93c0 2023-12-07T09:59:52.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fd5ffb640 1 -- 172.21.15.89:0/1477200953 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8fd80f01c0 con 0x7f8fe00c93c0 2023-12-07T09:59:52.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8fc40668d0 msgr2=0x7f8fc4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8fc40668d0 0x7f8fc4068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009980 tx=0x7f8fdc008040 comp rx=0 tx=0).stop 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 msgr2=0x7f8fe01f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe01f06f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8019520 tx=0x7f8fd80196b0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 shutdown_connections 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fe00c93c0 0x7f8fe01f06f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8fc40668d0 0x7f8fc4068d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fe00bd5e0 0x7f8fe00c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 --2- 172.21.15.89:0/1477200953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fe006b100 0x7f8fe014d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 >> 172.21.15.89:0/1477200953 conn(0x7f8fe00ca550 msgr2=0x7f8fe014a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 shutdown_connections 2023-12-07T09:59:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.522+0000 7f8fe67d0640 1 -- 172.21.15.89:0/1477200953 wait complete. 2023-12-07T09:59:52.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-07T09:59:52.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a95a9c640 1 Processor -- start 2023-12-07T09:59:52.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a95a9c640 1 -- start start 2023-12-07T09:59:52.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a95a9c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a9014e9d0 0x7f3a90151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a95a9c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9006d320 con 0x7f3a900a8470 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a95a9c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900721b0 con 0x7f3a90070b80 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a95a9c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900c2830 con 0x7f3a9014e9d0 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a9014e9d0 0x7f3a90151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3a900a8470 0x7f3a9006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42708/0 (socket says 172.21.15.89:42708) 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a9014e9d0 0x7f3a90151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34568/0 (socket says 172.21.15.89:34568) 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8ffff640 1 -- 172.21.15.89:0/2982609435 learned_addr learned my addr 172.21.15.89:0/2982609435 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8f7fe640 1 -- 172.21.15.89:0/2982609435 >> v1:172.21.15.97:6789/0 conn(0x7f3a90070b80 legacy=0x7f3a900c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8f7fe640 1 -- 172.21.15.89:0/2982609435 >> v1:172.21.15.89:6789/0 conn(0x7f3a900a8470 legacy=0x7f3a9006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.682+0000 7f3a8f7fe640 1 -- 172.21.15.89:0/2982609435 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90072450 con 0x7f3a9014e9d0 2023-12-07T09:59:52.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a8f7fe640 1 --2- 172.21.15.89:0/2982609435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a90151e60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a800097c0 tx=0x7f3a8001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c66a36f5b52dcf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:52.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a8effd640 1 -- 172.21.15.89:0/2982609435 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800ab600 con 0x7f3a9014e9d0 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a8effd640 1 -- 172.21.15.89:0/2982609435 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a800a7050 con 0x7f3a9014e9d0 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a8effd640 1 -- 172.21.15.89:0/2982609435 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800ab980 con 0x7f3a9014e9d0 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 -- 172.21.15.89:0/2982609435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 msgr2=0x7f3a90151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/2982609435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a90151e60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a800097c0 tx=0x7f3a8001c3b0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 -- 172.21.15.89:0/2982609435 shutdown_connections 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/2982609435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a90151e60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 -- 172.21.15.89:0/2982609435 >> 172.21.15.89:0/2982609435 conn(0x7f3a900c2ad0 msgr2=0x7f3a900c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 -- 172.21.15.89:0/2982609435 shutdown_connections 2023-12-07T09:59:52.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 -- 172.21.15.89:0/2982609435 wait complete. 2023-12-07T09:59:52.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 Processor -- start 2023-12-07T09:59:52.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.686+0000 7f3a95a9c640 1 -- start start 2023-12-07T09:59:52.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a90070b80 0x7f3a90154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a900a8470 0x7f3a90152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a900bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90151230 con 0x7f3a9014e9d0 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900c5d90 con 0x7f3a90070b80 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900c57d0 con 0x7f3a900a8470 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a900bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a900bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34582/0 (socket says 172.21.15.89:34582) 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 -- 172.21.15.89:0/1248738300 learned_addr learned my addr 172.21.15.89:0/1248738300 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 -- 172.21.15.89:0/1248738300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a900a8470 msgr2=0x7f3a90152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a900a8470 0x7f3a90152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 -- 172.21.15.89:0/1248738300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a90070b80 msgr2=0x7f3a90154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a90070b80 0x7f3a90154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 -- 172.21.15.89:0/1248738300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80009420 con 0x7f3a9014e9d0 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8ffff640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a900bf660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800cb20 tx=0x7f3a8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800aca0 con 0x7f3a9014e9d0 2023-12-07T09:59:52.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800ae00 con 0x7f3a9014e9d0 2023-12-07T09:59:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a900c5ab0 con 0x7f3a9014e9d0 2023-12-07T09:59:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88012600 con 0x7f3a9014e9d0 2023-12-07T09:59:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a90154420 con 0x7f3a9014e9d0 2023-12-07T09:59:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a90067a40 con 0x7f3a9014e9d0 2023-12-07T09:59:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.690+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a88012760 con 0x7f3a9014e9d0 2023-12-07T09:59:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.694+0000 7f3a8cff9640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a700668d0 0x7f3a70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:52.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.694+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a88083ef0 con 0x7f3a9014e9d0 2023-12-07T09:59:52.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.694+0000 7f3a8f7fe640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a700668d0 0x7f3a70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:52.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.694+0000 7f3a8f7fe640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a700668d0 0x7f3a70068d90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a800ad000 tx=0x7f3a80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:52.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.698+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a88051520 con 0x7f3a9014e9d0 2023-12-07T09:59:52.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.898+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3a90153fa0 con 0x7f3a9014e9d0 2023-12-07T09:59:52.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a8cff9640 1 -- 172.21.15.89:0/1248738300 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3a90153fa0 con 0x7f3a9014e9d0 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a700668d0 msgr2=0x7f3a70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a700668d0 0x7f3a70068d90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a800ad000 tx=0x7f3a80008040 comp rx=0 tx=0).stop 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 msgr2=0x7f3a900bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a900bf660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800cb20 tx=0x7f3a8800a060 comp rx=0 tx=0).stop 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 shutdown_connections 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a9014e9d0 0x7f3a900bf660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a700668d0 0x7f3a70068d90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a900a8470 0x7f3a90152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 --2- 172.21.15.89:0/1248738300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a90070b80 0x7f3a90154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 >> 172.21.15.89:0/1248738300 conn(0x7f3a900c2ad0 msgr2=0x7f3a900abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:52.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 shutdown_connections 2023-12-07T09:59:52.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:52.902+0000 7f3a95a9c640 1 -- 172.21.15.89:0/1248738300 wait complete. 2023-12-07T09:59:52.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-07T09:59:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.058+0000 7f5841157640 1 Processor -- start 2023-12-07T09:59:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f5841157640 1 -- start start 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f5841157640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f583c070b80 0x7f583c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f5841157640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c06d320 con 0x7f583c14e9d0 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f5841157640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0721b0 con 0x7f583c0a8470 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f5841157640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c0c2830 con 0x7f583c070b80 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583ad9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f583c14e9d0 0x7f583c0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42724/0 (socket says 172.21.15.89:42724) 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583ad9d640 1 -- 172.21.15.89:0/164735074 learned_addr learned my addr 172.21.15.89:0/164735074 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 --2- 172.21.15.89:0/164735074 >> v2:172.21.15.97:3300/0 conn(0x7f583c070b80 0x7f583c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824356920 0 0) 0x7f583c06d320 con 0x7f583c14e9d0 2023-12-07T09:59:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5828003530 con 0x7f583c14e9d0 2023-12-07T09:59:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3172683935 0 0) 0x7f5828003530 con 0x7f583c14e9d0 2023-12-07T09:59:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 >> v2:172.21.15.97:3300/0 conn(0x7f583c070b80 msgr2=0x7f583c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 --2- 172.21.15.89:0/164735074 >> v2:172.21.15.97:3300/0 conn(0x7f583c070b80 0x7f583c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 >> v1:172.21.15.97:6789/0 conn(0x7f583c0a8470 legacy=0x7f583c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c072450 con 0x7f583c14e9d0 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f582c001a00 con 0x7f583c14e9d0 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 >> v1:172.21.15.89:6789/0 conn(0x7f583c14e9d0 legacy=0x7f583c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5828003980 0x7f5828003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f5828004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58280050f0 0x7f582800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c2830 con 0x7f5828004380 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582800c030 con 0x7f5828003980 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582800c1f0 con 0x7f58280050f0 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f5828004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583ad9d640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5828003980 0x7f5828003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583b59e640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58280050f0 0x7f582800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 -- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58280050f0 msgr2=0x7f582800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f58280050f0 0x7f582800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 -- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5828003980 msgr2=0x7f5828003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5828003980 0x7f5828003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583259c640 1 -- 172.21.15.89:0/164735074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828003530 con 0x7f5828004380 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.062+0000 7f583b59e640 1 -- 172.21.15.89:0/164735074 reap_dead start 2023-12-07T09:59:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f583259c640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f5828004850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5824009670 tx=0x7f582401ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d8f59ce269d096 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240a7840 con 0x7f5828004380 2023-12-07T09:59:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58240a79a0 con 0x7f5828004380 2023-12-07T09:59:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f583a59c640 1 -- 172.21.15.89:0/164735074 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240a7d50 con 0x7f5828004380 2023-12-07T09:59:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 -- 172.21.15.89:0/164735074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 msgr2=0x7f5828004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f5828004850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5824009670 tx=0x7f582401ec40 comp rx=0 tx=0).stop 2023-12-07T09:59:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 -- 172.21.15.89:0/164735074 shutdown_connections 2023-12-07T09:59:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 --2- 172.21.15.89:0/164735074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f5828004850 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 -- 172.21.15.89:0/164735074 >> 172.21.15.89:0/164735074 conn(0x7f583c0c2ad0 msgr2=0x7f583c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 -- 172.21.15.89:0/164735074 shutdown_connections 2023-12-07T09:59:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.066+0000 7f5841157640 1 -- 172.21.15.89:0/164735074 wait complete. 2023-12-07T09:59:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 Processor -- start 2023-12-07T09:59:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 -- start start 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f583c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f583c1479b0 0x7f583c143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f583c143db0 0x7f583c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c144230 con 0x7f5828004380 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c155900 con 0x7f583c1479b0 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c148080 con 0x7f583c143db0 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f583c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f583c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34594/0 (socket says 172.21.15.89:34594) 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 -- 172.21.15.89:0/2481163951 learned_addr learned my addr 172.21.15.89:0/2481163951 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583259c640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f583c1479b0 0x7f583c143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583b59e640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f583c143db0 0x7f583c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 -- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f583c143db0 msgr2=0x7f583c1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f583c143db0 0x7f583c1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 -- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f583c1479b0 msgr2=0x7f583c143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f583c1479b0 0x7f583c143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 -- 172.21.15.89:0/2481163951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c155620 con 0x7f5828004380 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583259c640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f583c1479b0 0x7f583c143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583b59e640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f583c143db0 0x7f583c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f583ad9d640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f583c14d9f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f582c001e70 tx=0x7f582c00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00adb0 con 0x7f5828004380 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c0133f0 con 0x7f5828004380 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c152600 con 0x7f5828004380 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c0137a0 con 0x7f5828004380 2023-12-07T09:59:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.070+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c152b20 con 0x7f5828004380 2023-12-07T09:59:53.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.074+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c067a40 con 0x7f5828004380 2023-12-07T09:59:53.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.074+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f582c013900 con 0x7f5828004380 2023-12-07T09:59:53.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.074+0000 7f5833fff640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f581c0668d0 0x7f581c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.074+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f582c084ce0 con 0x7f5828004380 2023-12-07T09:59:53.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.074+0000 7f583259c640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f581c0668d0 0x7f581c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.074+0000 7f583259c640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f581c0668d0 0x7f581c068d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f58240b1000 tx=0x7f5824010040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.078+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f582c052260 con 0x7f5828004380 2023-12-07T09:59:53.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.282+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f583c04e890 con 0x7f5828004380 2023-12-07T09:59:53.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5833fff640 1 -- 172.21.15.89:0/2481163951 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f582c017020 con 0x7f5828004380 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f581c0668d0 msgr2=0x7f581c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f581c0668d0 0x7f581c068d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f58240b1000 tx=0x7f5824010040 comp rx=0 tx=0).stop 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 msgr2=0x7f583c14d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f583c14d9f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f582c001e70 tx=0x7f582c00a6a0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 shutdown_connections 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f581c0668d0 0x7f581c068d90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f583c143db0 0x7f583c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f583c1479b0 0x7f583c143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 --2- 172.21.15.89:0/2481163951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5828004380 0x7f583c14d9f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.286+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 >> 172.21.15.89:0/2481163951 conn(0x7f583c0c2ad0 msgr2=0x7f583c148d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:53.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.290+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 shutdown_connections 2023-12-07T09:59:53.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.290+0000 7f5841157640 1 -- 172.21.15.89:0/2481163951 wait complete. 2023-12-07T09:59:53.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-07T09:59:53.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 Processor -- start 2023-12-07T09:59:53.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 -- start start 2023-12-07T09:59:53.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f1350154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13500ab7a0 0x7f13501546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1350072780 con 0x7f13500700a0 2023-12-07T09:59:53.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500ac160 con 0x7f13500ab7a0 2023-12-07T09:59:53.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f13566c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13500abe80 con 0x7f13500aacd0 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13500ab7a0 0x7f13501546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13500ab7a0 0x7f13501546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34604/0 (socket says 172.21.15.89:34604) 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 -- 172.21.15.89:0/1096163438 learned_addr learned my addr 172.21.15.89:0/1096163438 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f134ffff640 1 --2- 172.21.15.89:0/1096163438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f1350154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 -- 172.21.15.89:0/1096163438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 msgr2=0x7f1350154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 --2- 172.21.15.89:0/1096163438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f1350154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 -- 172.21.15.89:0/1096163438 >> v1:172.21.15.97:6789/0 conn(0x7f13500700a0 legacy=0x7f135006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.446+0000 7f1354c66640 1 -- 172.21.15.89:0/1096163438 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350154cf0 con 0x7f13500ab7a0 2023-12-07T09:59:53.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f1354c66640 1 --2- 172.21.15.89:0/1096163438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500ab7a0 0x7f13501546a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1348009e50 tx=0x7f134801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc9e4cf2275c572 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f134effd640 1 -- 172.21.15.89:0/1096163438 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480a7a30 con 0x7f13500ab7a0 2023-12-07T09:59:53.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f134effd640 1 -- 172.21.15.89:0/1096163438 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480a7b90 con 0x7f13500ab7a0 2023-12-07T09:59:53.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f134effd640 1 -- 172.21.15.89:0/1096163438 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480af3f0 con 0x7f13500ab7a0 2023-12-07T09:59:53.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 -- 172.21.15.89:0/1096163438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500ab7a0 msgr2=0x7f13501546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 --2- 172.21.15.89:0/1096163438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500ab7a0 0x7f13501546a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1348009e50 tx=0x7f134801eb60 comp rx=0 tx=0).stop 2023-12-07T09:59:53.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 -- 172.21.15.89:0/1096163438 shutdown_connections 2023-12-07T09:59:53.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 --2- 172.21.15.89:0/1096163438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500ab7a0 0x7f13501546a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 --2- 172.21.15.89:0/1096163438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f1350154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 -- 172.21.15.89:0/1096163438 >> 172.21.15.89:0/1096163438 conn(0x7f13500c2ad0 msgr2=0x7f13500c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:53.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 -- 172.21.15.89:0/1096163438 shutdown_connections 2023-12-07T09:59:53.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.450+0000 7f13566c9640 1 -- 172.21.15.89:0/1096163438 wait complete. 2023-12-07T09:59:53.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 Processor -- start 2023-12-07T09:59:53.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 -- start start 2023-12-07T09:59:53.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 0x7f135014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f135014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13500ab7a0 0x7f13501439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350151cf0 con 0x7f13500700a0 2023-12-07T09:59:53.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350152bb0 con 0x7f13500ab7a0 2023-12-07T09:59:53.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1350151fb0 con 0x7f13500aacd0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 0x7f135014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 0x7f135014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34608/0 (socket says 172.21.15.89:34608) 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 -- 172.21.15.89:0/3181688934 learned_addr learned my addr 172.21.15.89:0/3181688934 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f1354c66640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13500ab7a0 0x7f13501439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134f7fe640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f135014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 -- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 msgr2=0x7f135014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f135014c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 -- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13500ab7a0 msgr2=0x7f13501439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13500ab7a0 0x7f13501439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 -- 172.21.15.89:0/3181688934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348009b30 con 0x7f13500700a0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f1354c66640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13500ab7a0 0x7f13501439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134ffff640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 0x7f135014c200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f134000d6d0 tx=0x7f134000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340007900 con 0x7f13500700a0 2023-12-07T09:59:53.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340007a60 con 0x7f13500700a0 2023-12-07T09:59:53.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340007df0 con 0x7f13500700a0 2023-12-07T09:59:53.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350152290 con 0x7f13500700a0 2023-12-07T09:59:53.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.454+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13500bfd40 con 0x7f13500700a0 2023-12-07T09:59:53.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.458+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350154410 con 0x7f13500700a0 2023-12-07T09:59:53.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.458+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1340011460 con 0x7f13500700a0 2023-12-07T09:59:53.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.458+0000 7f134cff9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f133c0668d0 0x7f133c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.458+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1340084350 con 0x7f13500700a0 2023-12-07T09:59:53.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.458+0000 7f134f7fe640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f133c0668d0 0x7f133c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.458+0000 7f134f7fe640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f133c0668d0 0x7f133c068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f13501eae70 tx=0x7f1344009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.462+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13400518e0 con 0x7f13500700a0 2023-12-07T09:59:53.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.662+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f135004e890 con 0x7f13500700a0 2023-12-07T09:59:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.666+0000 7f134cff9640 1 -- 172.21.15.89:0/3181688934 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f134000b040 con 0x7f13500700a0 2023-12-07T09:59:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f133c0668d0 msgr2=0x7f133c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f133c0668d0 0x7f133c068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f13501eae70 tx=0x7f1344009040 comp rx=0 tx=0).stop 2023-12-07T09:59:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 msgr2=0x7f135014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 0x7f135014c200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f134000d6d0 tx=0x7f134000db90 comp rx=0 tx=0).stop 2023-12-07T09:59:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 shutdown_connections 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13500ab7a0 0x7f13501439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f133c0668d0 0x7f133c068d90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f13500aacd0 0x7f135014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 --2- 172.21.15.89:0/3181688934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13500700a0 0x7f135014c200 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 >> 172.21.15.89:0/3181688934 conn(0x7f13500c2ad0 msgr2=0x7f135014db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 shutdown_connections 2023-12-07T09:59:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.670+0000 7f13566c9640 1 -- 172.21.15.89:0/3181688934 wait complete. 2023-12-07T09:59:53.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:53.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 Processor -- start 2023-12-07T09:59:53.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 -- start start 2023-12-07T09:59:53.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5bc0bf320 0x7fb5bc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5bc0bf700 0x7fb5bc15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc0c0650 con 0x7fb5bc072260 2023-12-07T09:59:53.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc0c0410 con 0x7fb5bc0bf320 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c34e3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc06d6b0 con 0x7fb5bc0bf700 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5bc0bf320 0x7fb5bc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5bc0bf320 0x7fb5bc154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34618/0 (socket says 172.21.15.89:34618) 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 -- 172.21.15.89:0/2477474780 learned_addr learned my addr 172.21.15.89:0/2477474780 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c0a7e640 1 --1- 172.21.15.89:0/2477474780 >> v1:172.21.15.89:6789/0 conn(0x7fb5bc072260 0x7fb5bc06cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42740/0 (socket says 172.21.15.89:42740) 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c1a80640 1 --2- 172.21.15.89:0/2477474780 >> v2:172.21.15.97:3300/0 conn(0x7fb5bc0bf700 0x7fb5bc15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 -- 172.21.15.89:0/2477474780 >> v2:172.21.15.97:3300/0 conn(0x7fb5bc0bf700 msgr2=0x7fb5bc15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 --2- 172.21.15.89:0/2477474780 >> v2:172.21.15.97:3300/0 conn(0x7fb5bc0bf700 0x7fb5bc15ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 -- 172.21.15.89:0/2477474780 >> v1:172.21.15.89:6789/0 conn(0x7fb5bc072260 legacy=0x7fb5bc06cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.826+0000 7fb5c127f640 1 -- 172.21.15.89:0/2477474780 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc154490 con 0x7fb5bc0bf320 2023-12-07T09:59:53.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c127f640 1 --2- 172.21.15.89:0/2477474780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc154f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc14eae0 tx=0x7fb5b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a334963b1a0414 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5b3fff640 1 -- 172.21.15.89:0/2477474780 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80ab610 con 0x7fb5bc0bf320 2023-12-07T09:59:53.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5b3fff640 1 -- 172.21.15.89:0/2477474780 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b80ab770 con 0x7fb5bc0bf320 2023-12-07T09:59:53.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5b3fff640 1 -- 172.21.15.89:0/2477474780 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80abb00 con 0x7fb5bc0bf320 2023-12-07T09:59:53.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 -- 172.21.15.89:0/2477474780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf320 msgr2=0x7fb5bc154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/2477474780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc154f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc14eae0 tx=0x7fb5b801c500 comp rx=0 tx=0).stop 2023-12-07T09:59:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 -- 172.21.15.89:0/2477474780 shutdown_connections 2023-12-07T09:59:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/2477474780 >> v2:172.21.15.97:3300/0 conn(0x7fb5bc0bf700 0x7fb5bc15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/2477474780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc154f50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 -- 172.21.15.89:0/2477474780 >> 172.21.15.89:0/2477474780 conn(0x7fb5bc0c5f60 msgr2=0x7fb5bc0c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 -- 172.21.15.89:0/2477474780 shutdown_connections 2023-12-07T09:59:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.830+0000 7fb5c34e3640 1 -- 172.21.15.89:0/2477474780 wait complete. 2023-12-07T09:59:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 Processor -- start 2023-12-07T09:59:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 -- start start 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc072260 0x7fb5bc1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc1f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 0x7fb5bc1f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1f11c0 con 0x7fb5bc0bf700 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1f02b0 con 0x7fb5bc0bf320 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0a8470 con 0x7fb5bc072260 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 0x7fb5bc1f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 0x7fb5bc1f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34622/0 (socket says 172.21.15.89:34622) 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 -- 172.21.15.89:0/1848464640 learned_addr learned my addr 172.21.15.89:0/1848464640 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c127f640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc072260 0x7fb5bc1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c0a7e640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc1f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 -- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc072260 msgr2=0x7fb5bc1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc072260 0x7fb5bc1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 -- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc0bf320 msgr2=0x7fb5bc1f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:53.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc1f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:53.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 -- 172.21.15.89:0/1848464640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80094d0 con 0x7fb5bc0bf700 2023-12-07T09:59:53.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c1a80640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 0x7fb5bc1f0c80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4007e40 tx=0x7fb5b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4014620 con 0x7fb5bc0bf700 2023-12-07T09:59:53.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400ee90 con 0x7fb5bc0bf700 2023-12-07T09:59:53.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc1ed240 con 0x7fb5bc0bf700 2023-12-07T09:59:53.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.834+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40149e0 con 0x7fb5bc0bf700 2023-12-07T09:59:53.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc1ed800 con 0x7fb5bc0bf700 2023-12-07T09:59:53.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc0abaa0 con 0x7fb5bc0bf700 2023-12-07T09:59:53.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb5b4014b40 con 0x7fb5bc0bf700 2023-12-07T09:59:53.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5b1ffb640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a0066900 0x7fb5a0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:53.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5b4084ac0 con 0x7fb5bc0bf700 2023-12-07T09:59:53.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5c127f640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a0066900 0x7fb5a0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:53.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.838+0000 7fb5c127f640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a0066900 0x7fb5a0068dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80af000 tx=0x7fb5b80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:53.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.842+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5bc0abaa0 con 0x7fb5bc0bf700 2023-12-07T09:59:54.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5bc0abaa0 con 0x7fb5bc0bf700 2023-12-07T09:59:54.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5b1ffb640 1 -- 172.21.15.89:0/1848464640 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fb5bc0abaa0 con 0x7fb5bc0bf700 2023-12-07T09:59:54.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:54.002 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":27,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:50.981424+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a0066900 msgr2=0x7fb5a0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a0066900 0x7fb5a0068dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80af000 tx=0x7fb5b80a7000 comp rx=0 tx=0).stop 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 msgr2=0x7fb5bc1f0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 0x7fb5bc1f0c80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4007e40 tx=0x7fb5b400e4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 shutdown_connections 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.994+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc0bf700 0x7fb5bc1f0c80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.998+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc0bf320 0x7fb5bc1f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.998+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a0066900 0x7fb5a0068dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.998+0000 7fb5c34e3640 1 --2- 172.21.15.89:0/1848464640 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc072260 0x7fb5bc1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.998+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 >> 172.21.15.89:0/1848464640 conn(0x7fb5bc0c5f60 msgr2=0x7fb5bc06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:54.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.998+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 shutdown_connections 2023-12-07T09:59:54.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:53.998+0000 7fb5c34e3640 1 -- 172.21.15.89:0/1848464640 wait complete. 2023-12-07T09:59:54.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T09:59:54.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T09:59:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 Processor -- start 2023-12-07T09:59:54.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 -- start start 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9a240a86d0 0x7f9a240a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a24156600 0x7f9a2414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a24152d90 con 0x7f9a2414fb30 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a24152480 con 0x7f9a240a86d0 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a2a679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240a9760 con 0x7f9a24156600 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a28c16640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9a2414fb30 0x7f9a240aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42746/0 (socket says 172.21.15.89:42746) 2023-12-07T09:59:54.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a28c16640 1 -- 172.21.15.89:0/3334319311 learned_addr learned my addr 172.21.15.89:0/3334319311 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:54.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a237fe640 1 --2- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a24156600 0x7f9a2414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a23fff640 1 --2- 172.21.15.89:0/3334319311 >> v2:172.21.15.97:3300/0 conn(0x7f9a240a86d0 0x7f9a240a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a22ffd640 1 -- 172.21.15.89:0/3334319311 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098927487 0 0) 0x7f9a24152d90 con 0x7f9a2414fb30 2023-12-07T09:59:54.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a22ffd640 1 -- 172.21.15.89:0/3334319311 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a0c003530 con 0x7f9a2414fb30 2023-12-07T09:59:54.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a23fff640 1 -- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a24156600 msgr2=0x7f9a2414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:54.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a23fff640 1 --2- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a24156600 0x7f9a2414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a23fff640 1 -- 172.21.15.89:0/3334319311 >> v1:172.21.15.89:6789/0 conn(0x7f9a2414fb30 legacy=0x7f9a240aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.158+0000 7f9a23fff640 1 -- 172.21.15.89:0/3334319311 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24152740 con 0x7f9a240a86d0 2023-12-07T09:59:54.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a23fff640 1 --2- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240a86d0 0x7f9a240a8f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a140097c0 tx=0x7f9a1401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d53cdc1ec83ee92e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a22ffd640 1 -- 172.21.15.89:0/3334319311 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140ab600 con 0x7f9a240a86d0 2023-12-07T09:59:54.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a22ffd640 1 -- 172.21.15.89:0/3334319311 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a140a7050 con 0x7f9a240a86d0 2023-12-07T09:59:54.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a22ffd640 1 -- 172.21.15.89:0/3334319311 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140ab980 con 0x7f9a240a86d0 2023-12-07T09:59:54.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 -- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240a86d0 msgr2=0x7f9a240a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 --2- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240a86d0 0x7f9a240a8f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a140097c0 tx=0x7f9a1401c480 comp rx=0 tx=0).stop 2023-12-07T09:59:54.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 -- 172.21.15.89:0/3334319311 shutdown_connections 2023-12-07T09:59:54.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 --2- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a24156600 0x7f9a2414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 --2- 172.21.15.89:0/3334319311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240a86d0 0x7f9a240a8f30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 -- 172.21.15.89:0/3334319311 >> 172.21.15.89:0/3334319311 conn(0x7f9a240c2a60 msgr2=0x7f9a240c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:54.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 -- 172.21.15.89:0/3334319311 shutdown_connections 2023-12-07T09:59:54.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.162+0000 7f9a2a679640 1 -- 172.21.15.89:0/3334319311 wait complete. 2023-12-07T09:59:54.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 Processor -- start 2023-12-07T09:59:54.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 -- start start 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a240a86d0 0x7f9a24070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a2414fb30 0x7f9a24155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 0x7f9a241557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2414ca80 con 0x7f9a24156600 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2414a860 con 0x7f9a2414fb30 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24155d00 con 0x7f9a240a86d0 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 0x7f9a241557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 0x7f9a241557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34632/0 (socket says 172.21.15.89:34632) 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 -- 172.21.15.89:0/4198752223 learned_addr learned my addr 172.21.15.89:0/4198752223 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a23fff640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a240a86d0 0x7f9a24070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a237fe640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a2414fb30 0x7f9a24155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 -- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a240a86d0 msgr2=0x7f9a24070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a240a86d0 0x7f9a24070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 -- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a2414fb30 msgr2=0x7f9a24155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a2414fb30 0x7f9a24155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 -- 172.21.15.89:0/4198752223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14009420 con 0x7f9a24156600 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a28c16640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 0x7f9a241557c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00cb40 tx=0x7f9a1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00aca0 con 0x7f9a24156600 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00ae00 con 0x7f9a24156600 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2414a580 con 0x7f9a24156600 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c012620 con 0x7f9a24156600 2023-12-07T09:59:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.166+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a24070570 con 0x7f9a24156600 2023-12-07T09:59:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.170+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a240700f0 con 0x7f9a24156600 2023-12-07T09:59:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.170+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9a1c007070 con 0x7f9a24156600 2023-12-07T09:59:54.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.170+0000 7f9a20ff9640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a100668d0 0x7f9a10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.170+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a1c0840b0 con 0x7f9a24156600 2023-12-07T09:59:54.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.170+0000 7f9a23fff640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a100668d0 0x7f9a10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.170+0000 7f9a23fff640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a100668d0 0x7f9a10068d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a140ad000 tx=0x7f9a14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.174+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a240700f0 con 0x7f9a24156600 2023-12-07T09:59:54.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a240700f0 con 0x7f9a24156600 2023-12-07T09:59:54.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a20ff9640 1 -- 172.21.15.89:0/4198752223 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a240700f0 con 0x7f9a24156600 2023-12-07T09:59:54.333 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a100668d0 msgr2=0x7f9a10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a100668d0 0x7f9a10068d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a140ad000 tx=0x7f9a14008040 comp rx=0 tx=0).stop 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 msgr2=0x7f9a241557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 0x7f9a241557c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00cb40 tx=0x7f9a1c00a060 comp rx=0 tx=0).stop 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 shutdown_connections 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24156600 0x7f9a241557c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a2414fb30 0x7f9a24155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a100668d0 0x7f9a10068d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 --2- 172.21.15.89:0/4198752223 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a240a86d0 0x7f9a24070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 >> 172.21.15.89:0/4198752223 conn(0x7f9a240c2a60 msgr2=0x7f9a240c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 shutdown_connections 2023-12-07T09:59:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.326+0000 7f9a2a679640 1 -- 172.21.15.89:0/4198752223 wait complete. 2023-12-07T09:59:54.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T09:59:54.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 Processor -- start 2023-12-07T09:59:54.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 -- start start 2023-12-07T09:59:54.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6580ca610 0x7fe6580c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6580bd720 0x7fe6580c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe65806cd90 0x7fe658158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe658155790 con 0x7fe6580ca610 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580c4b00 con 0x7fe6580bd720 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65d165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580c4de0 con 0x7fe65806cd90 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6580ca610 0x7fe6580c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6580ca610 0x7fe6580c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34634/0 (socket says 172.21.15.89:34634) 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 -- 172.21.15.89:0/1300390841 learned_addr learned my addr 172.21.15.89:0/1300390841 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe64ffff640 1 --2- 172.21.15.89:0/1300390841 >> v2:172.21.15.97:3300/0 conn(0x7fe6580bd720 0x7fe6580c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65759e640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe65806cd90 0x7fe658158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 -- 172.21.15.89:0/1300390841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe65806cd90 msgr2=0x7fe658158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe65806cd90 0x7fe658158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 -- 172.21.15.89:0/1300390841 >> v2:172.21.15.97:3300/0 conn(0x7fe6580bd720 msgr2=0x7fe6580c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 --2- 172.21.15.89:0/1300390841 >> v2:172.21.15.97:3300/0 conn(0x7fe6580bd720 0x7fe6580c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe656d9d640 1 -- 172.21.15.89:0/1300390841 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658157e30 con 0x7fe6580ca610 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe64ffff640 1 --2- 172.21.15.89:0/1300390841 >> v2:172.21.15.97:3300/0 conn(0x7fe6580bd720 0x7fe6580c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:54.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.486+0000 7fe65759e640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe65806cd90 0x7fe658158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:54.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe656d9d640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6580ca610 0x7fe6580c94c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6580ca380 tx=0x7fe64801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52e87dc8efcd875 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65659c640 1 -- 172.21.15.89:0/1300390841 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580c52d0 con 0x7fe6580ca610 2023-12-07T09:59:54.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65659c640 1 -- 172.21.15.89:0/1300390841 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480a4880 con 0x7fe6580ca610 2023-12-07T09:59:54.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65659c640 1 -- 172.21.15.89:0/1300390841 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480a4c10 con 0x7fe6580ca610 2023-12-07T09:59:54.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 -- 172.21.15.89:0/1300390841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6580ca610 msgr2=0x7fe6580c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6580ca610 0x7fe6580c94c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6580ca380 tx=0x7fe64801c0c0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 -- 172.21.15.89:0/1300390841 shutdown_connections 2023-12-07T09:59:54.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe65806cd90 0x7fe658158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 --2- 172.21.15.89:0/1300390841 >> v2:172.21.15.97:3300/0 conn(0x7fe6580bd720 0x7fe6580c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 --2- 172.21.15.89:0/1300390841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6580ca610 0x7fe6580c94c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 -- 172.21.15.89:0/1300390841 >> 172.21.15.89:0/1300390841 conn(0x7fe658071ea0 msgr2=0x7fe6580722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:54.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 -- 172.21.15.89:0/1300390841 shutdown_connections 2023-12-07T09:59:54.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.490+0000 7fe65d165640 1 -- 172.21.15.89:0/1300390841 wait complete. 2023-12-07T09:59:54.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 Processor -- start 2023-12-07T09:59:54.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 -- start start 2023-12-07T09:59:54.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 0x7fe658153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6580bd720 0x7fe6581453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6580ca610 0x7fe658145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe658145e50 con 0x7fe65806cd90 2023-12-07T09:59:54.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580a9a70 con 0x7fe6580ca610 2023-12-07T09:59:54.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580abfc0 con 0x7fe6580bd720 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 0x7fe658153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 0x7fe658153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34644/0 (socket says 172.21.15.89:34644) 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 -- 172.21.15.89:0/1273086988 learned_addr learned my addr 172.21.15.89:0/1273086988 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65759e640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6580ca610 0x7fe658145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe64ffff640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6580bd720 0x7fe6581453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 -- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6580bd720 msgr2=0x7fe6581453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6580bd720 0x7fe6581453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 -- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6580ca610 msgr2=0x7fe658145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6580ca610 0x7fe658145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 -- 172.21.15.89:0/1273086988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480094d0 con 0x7fe65806cd90 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65759e640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6580ca610 0x7fe658145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe64ffff640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6580bd720 0x7fe6581453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe656d9d640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 0x7fe658153560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe6480af040 tx=0x7fe648019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480ac700 con 0x7fe65806cd90 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480ac880 con 0x7fe65806cd90 2023-12-07T09:59:54.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6580ac2a0 con 0x7fe65806cd90 2023-12-07T09:59:54.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480acc30 con 0x7fe65806cd90 2023-12-07T09:59:54.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.494+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6580ac860 con 0x7fe65806cd90 2023-12-07T09:59:54.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.498+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6580aca50 con 0x7fe65806cd90 2023-12-07T09:59:54.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.498+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe6480b3070 con 0x7fe65806cd90 2023-12-07T09:59:54.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.498+0000 7fe64f7fe640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe638066900 0x7fe638068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.498+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6580cac00 con 0x7fe65806cd90 2023-12-07T09:59:54.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.498+0000 7fe64ffff640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe638066900 0x7fe638068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.498+0000 7fe64ffff640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe638066900 0x7fe638068dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe658149150 tx=0x7fe640008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.502+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6480eb280 con 0x7fe65806cd90 2023-12-07T09:59:54.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe65804e890 con 0x7fe65806cd90 2023-12-07T09:59:54.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe64f7fe640 1 -- 172.21.15.89:0/1273086988 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe6480b1090 con 0x7fe65806cd90 2023-12-07T09:59:54.661 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:54.661 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T09:59:54.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T09:59:54.662 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T09:59:54.662 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T09:59:54.662 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T09:59:54.662 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T09:59:54.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe638066900 msgr2=0x7fe638068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe638066900 0x7fe638068dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe658149150 tx=0x7fe640008040 comp rx=0 tx=0).stop 2023-12-07T09:59:54.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 msgr2=0x7fe658153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 0x7fe658153560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe6480af040 tx=0x7fe648019180 comp rx=0 tx=0).stop 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 shutdown_connections 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6580ca610 0x7fe658145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe638066900 0x7fe638068dc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6580bd720 0x7fe6581453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 --2- 172.21.15.89:0/1273086988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe65806cd90 0x7fe658153560 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 >> 172.21.15.89:0/1273086988 conn(0x7fe658071ea0 msgr2=0x7fe6580663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 shutdown_connections 2023-12-07T09:59:54.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.654+0000 7fe65d165640 1 -- 172.21.15.89:0/1273086988 wait complete. 2023-12-07T09:59:54.682 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-07T09:59:54.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-07T09:59:54.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.814+0000 7f603e69c640 1 Processor -- start 2023-12-07T09:59:54.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603e69c640 1 -- start start 2023-12-07T09:59:54.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603e69c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6038072010 0x7f60381589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603e69c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6038158f10 con 0x7f6038156080 2023-12-07T09:59:54.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603e69c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380725d0 con 0x7f60380c5680 2023-12-07T09:59:54.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603e69c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380c0570 con 0x7f6038072010 2023-12-07T09:59:54.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603d69a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6038156080 0x7f60380aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42754/0 (socket says 172.21.15.89:42754) 2023-12-07T09:59:54.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603d69a640 1 -- 172.21.15.89:0/1056125244 learned_addr learned my addr 172.21.15.89:0/1056125244 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:54.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603de9b640 1 --2- 172.21.15.89:0/1056125244 >> v2:172.21.15.97:3300/0 conn(0x7f6038072010 0x7f60381589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160509445 0 0) 0x7f6038158f10 con 0x7f6038156080 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6024003530 con 0x7f6038156080 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588238657 0 0) 0x7f60380725d0 con 0x7f60380c5680 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6038158f10 con 0x7f60380c5680 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603de9b640 1 -- 172.21.15.89:0/1056125244 >> v1:172.21.15.97:6789/0 conn(0x7f60380c5680 legacy=0x7f60380a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603de9b640 1 -- 172.21.15.89:0/1056125244 >> v1:172.21.15.89:6789/0 conn(0x7f6038156080 legacy=0x7f60380aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 28873749 0 0) 0x7f6024003530 con 0x7f6038156080 2023-12-07T09:59:54.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.818+0000 7f603de9b640 1 -- 172.21.15.89:0/1056125244 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038156460 con 0x7f6038072010 2023-12-07T09:59:54.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603de9b640 1 --2- 172.21.15.89:0/1056125244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f60381589d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6030009d90 tx=0x7f603001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e4086bba3a0a4d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034001680 con 0x7f6038072010 2023-12-07T09:59:54.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300a6430 con 0x7f6038072010 2023-12-07T09:59:54.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f602ffff640 1 -- 172.21.15.89:0/1056125244 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300a67c0 con 0x7f6038072010 2023-12-07T09:59:54.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 -- 172.21.15.89:0/1056125244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 msgr2=0x7f60381589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 --2- 172.21.15.89:0/1056125244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f60381589d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6030009d90 tx=0x7f603001c7e0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 -- 172.21.15.89:0/1056125244 shutdown_connections 2023-12-07T09:59:54.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 --2- 172.21.15.89:0/1056125244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f60381589d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 -- 172.21.15.89:0/1056125244 >> 172.21.15.89:0/1056125244 conn(0x7f60380c5b70 msgr2=0x7f60380c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:54.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 -- 172.21.15.89:0/1056125244 shutdown_connections 2023-12-07T09:59:54.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.822+0000 7f603e69c640 1 -- 172.21.15.89:0/1056125244 wait complete. 2023-12-07T09:59:54.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 Processor -- start 2023-12-07T09:59:54.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- start start 2023-12-07T09:59:54.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f6038150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 0x7f603814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6038156080 0x7f603815b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6038159b80 con 0x7f60380c5680 2023-12-07T09:59:54.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603814b3d0 con 0x7f6038072010 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60381f1b00 con 0x7f6038156080 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 0x7f603814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 0x7f603814e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34660/0 (socket says 172.21.15.89:34660) 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 -- 172.21.15.89:0/4207499306 learned_addr learned my addr 172.21.15.89:0/4207499306 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603de9b640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6038156080 0x7f603815b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603d69a640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f6038150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 -- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6038156080 msgr2=0x7f603815b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6038156080 0x7f603815b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 -- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 msgr2=0x7f6038150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f6038150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 -- 172.21.15.89:0/4207499306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009a70 con 0x7f60380c5680 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603d69a640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f6038150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603ce99640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 0x7f603814e4f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f602800c500 tx=0x7f602800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280052d0 con 0x7f60380c5680 2023-12-07T09:59:54.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6028005450 con 0x7f60380c5680 2023-12-07T09:59:54.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028012870 con 0x7f60380c5680 2023-12-07T09:59:54.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60381f1de0 con 0x7f60380c5680 2023-12-07T09:59:54.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603814ea30 con 0x7f60380c5680 2023-12-07T09:59:54.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.826+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6038159cf0 con 0x7f60380c5680 2023-12-07T09:59:54.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.830+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60280129d0 con 0x7f60380c5680 2023-12-07T09:59:54.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.830+0000 7f602dffb640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f601c0668d0 0x7f601c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:54.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.830+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6028083d40 con 0x7f60380c5680 2023-12-07T09:59:54.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.830+0000 7f603d69a640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f601c0668d0 0x7f601c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:54.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.830+0000 7f603d69a640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f601c0668d0 0x7f601c068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6034001ec0 tx=0x7f6034009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:54.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.834+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6028051240 con 0x7f60380c5680 2023-12-07T09:59:54.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:54.982+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f603804e890 con 0x7f60380c5680 2023-12-07T09:59:55.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.210+0000 7f602dffb640 1 -- 172.21.15.89:0/4207499306 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6028054860 con 0x7f60380c5680 2023-12-07T09:59:55.220 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2023-12-07T09:59:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f601c0668d0 msgr2=0x7f601c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f601c0668d0 0x7f601c068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6034001ec0 tx=0x7f6034009040 comp rx=0 tx=0).stop 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 msgr2=0x7f603814e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 0x7f603814e4f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f602800c500 tx=0x7f602800c9c0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 shutdown_connections 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f601c0668d0 0x7f601c068d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6038156080 0x7f603815b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60380c5680 0x7f603814e4f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 --2- 172.21.15.89:0/4207499306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6038072010 0x7f6038150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 >> 172.21.15.89:0/4207499306 conn(0x7f60380c5b70 msgr2=0x7f6038164a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 shutdown_connections 2023-12-07T09:59:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.214+0000 7f603e69c640 1 -- 172.21.15.89:0/4207499306 wait complete. 2023-12-07T09:59:55.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T09:59:55.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 Processor -- start 2023-12-07T09:59:55.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 -- start start 2023-12-07T09:59:55.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f806b810 0x7f93f8156300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93f80c17b0 0x7f93f80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93f8156840 0x7f93f8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f8155c40 con 0x7f93f80c17b0 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f8073590 con 0x7f93f8156840 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fee5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80c60c0 con 0x7f93f806b810 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93f80c17b0 0x7f93f80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93f80c17b0 0x7f93f80719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34668/0 (socket says 172.21.15.89:34668) 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 -- 172.21.15.89:0/4000706289 learned_addr learned my addr 172.21.15.89:0/4000706289 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fcbf6640 1 --2- 172.21.15.89:0/4000706289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f806b810 0x7f93f8156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93fd3f7640 1 --2- 172.21.15.89:0/4000706289 >> v2:172.21.15.97:3300/0 conn(0x7f93f8156840 0x7f93f8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 -- 172.21.15.89:0/4000706289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f806b810 msgr2=0x7f93f8156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 --2- 172.21.15.89:0/4000706289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f806b810 0x7f93f8156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 -- 172.21.15.89:0/4000706289 >> v2:172.21.15.97:3300/0 conn(0x7f93f8156840 msgr2=0x7f93f8071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 --2- 172.21.15.89:0/4000706289 >> v2:172.21.15.97:3300/0 conn(0x7f93f8156840 0x7f93f8071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.386+0000 7f93effff640 1 -- 172.21.15.89:0/4000706289 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8073800 con 0x7f93f80c17b0 2023-12-07T09:59:55.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93effff640 1 --2- 172.21.15.89:0/4000706289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f80c17b0 0x7f93f80719e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f93f8070960 tx=0x7f93e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cced53b6b21070 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:55.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93ef7fe640 1 -- 172.21.15.89:0/4000706289 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ab600 con 0x7f93f80c17b0 2023-12-07T09:59:55.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93ef7fe640 1 -- 172.21.15.89:0/4000706289 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e80a7050 con 0x7f93f80c17b0 2023-12-07T09:59:55.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93ef7fe640 1 -- 172.21.15.89:0/4000706289 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ab980 con 0x7f93f80c17b0 2023-12-07T09:59:55.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 -- 172.21.15.89:0/4000706289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f80c17b0 msgr2=0x7f93f80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:55.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 --2- 172.21.15.89:0/4000706289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f80c17b0 0x7f93f80719e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f93f8070960 tx=0x7f93e801c500 comp rx=0 tx=0).stop 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 -- 172.21.15.89:0/4000706289 shutdown_connections 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 --2- 172.21.15.89:0/4000706289 >> v2:172.21.15.97:3300/0 conn(0x7f93f8156840 0x7f93f8071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 --2- 172.21.15.89:0/4000706289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f80c17b0 0x7f93f80719e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 --2- 172.21.15.89:0/4000706289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f806b810 0x7f93f8156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 -- 172.21.15.89:0/4000706289 >> 172.21.15.89:0/4000706289 conn(0x7f93f80c3240 msgr2=0x7f93f80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 -- 172.21.15.89:0/4000706289 shutdown_connections 2023-12-07T09:59:55.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.390+0000 7f93fee5a640 1 -- 172.21.15.89:0/4000706289 wait complete. 2023-12-07T09:59:55.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 Processor -- start 2023-12-07T09:59:55.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- start start 2023-12-07T09:59:55.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93f806b810 0x7f93f8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f80c17b0 0x7f93f815b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 0x7f93f81ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81ece20 con 0x7f93f8156840 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8148cb0 con 0x7f93f806b810 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8153420 con 0x7f93f80c17b0 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 0x7f93f81ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 0x7f93f81ed270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34670/0 (socket says 172.21.15.89:34670) 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 -- 172.21.15.89:0/636756659 learned_addr learned my addr 172.21.15.89:0/636756659 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93effff640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f80c17b0 0x7f93f815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fcbf6640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93f806b810 0x7f93f8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 -- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f80c17b0 msgr2=0x7f93f815b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f80c17b0 0x7f93f815b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 -- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93f806b810 msgr2=0x7f93f8147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93f806b810 0x7f93f8147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 -- 172.21.15.89:0/636756659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80094d0 con 0x7f93f8156840 2023-12-07T09:59:55.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fd3f7640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 0x7f93f81ed270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93f000d800 tx=0x7f93f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:55.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000b6c0 con 0x7f93f8156840 2023-12-07T09:59:55.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f000b820 con 0x7f93f8156840 2023-12-07T09:59:55.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000bbd0 con 0x7f93f8156840 2023-12-07T09:59:55.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f8147e50 con 0x7f93f8156840 2023-12-07T09:59:55.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f81480a0 con 0x7f93f8156840 2023-12-07T09:59:55.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.394+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f804e890 con 0x7f93f8156840 2023-12-07T09:59:55.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.398+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f93f000bd30 con 0x7f93f8156840 2023-12-07T09:59:55.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.398+0000 7f93ed7fa640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93e40668d0 0x7f93e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:55.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.398+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f93f0085220 con 0x7f93f8156840 2023-12-07T09:59:55.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.398+0000 7f93fcbf6640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93e40668d0 0x7f93e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:55.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.398+0000 7f93fcbf6640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93e40668d0 0x7f93e4068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93f4003fd0 tx=0x7f93f40039c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:55.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.402+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93f00526a0 con 0x7f93f8156840 2023-12-07T09:59:55.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:55.554+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f93f80c0e20 con 0x7f93f8156840 2023-12-07T09:59:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.214+0000 7f93ed7fa640 1 -- 172.21.15.89:0/636756659 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f93f0055cc0 con 0x7f93f8156840 2023-12-07T09:59:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93e40668d0 msgr2=0x7f93e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93e40668d0 0x7f93e4068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93f4003fd0 tx=0x7f93f40039c0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 msgr2=0x7f93f81ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 0x7f93f81ed270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93f000d800 tx=0x7f93f000dcc0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 shutdown_connections 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8156840 0x7f93f81ed270 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93e40668d0 0x7f93e4068d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f93f80c17b0 0x7f93f815b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 --2- 172.21.15.89:0/636756659 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93f806b810 0x7f93f8147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 >> 172.21.15.89:0/636756659 conn(0x7f93f80c3240 msgr2=0x7f93f80ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 shutdown_connections 2023-12-07T09:59:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.218+0000 7f93fee5a640 1 -- 172.21.15.89:0/636756659 wait complete. 2023-12-07T09:59:56.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-07T09:59:56.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 Processor -- start 2023-12-07T09:59:56.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 -- start start 2023-12-07T09:59:56.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd564156600 0x7fd56414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:56.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd56414fb30 0x7fd5640aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:56.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd564152d90 con 0x7fd5640a86d0 2023-12-07T09:59:56.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56414ffa0 con 0x7fd564156600 2023-12-07T09:59:56.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd56b9b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd564152480 con 0x7fd56414fb30 2023-12-07T09:59:56.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd569754640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd5640a86d0 0x7fd5640a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42762/0 (socket says 172.21.15.89:42762) 2023-12-07T09:59:56.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd569754640 1 -- 172.21.15.89:0/1406644429 learned_addr learned my addr 172.21.15.89:0/1406644429 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:56.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd568f53640 1 --2- 172.21.15.89:0/1406644429 >> v2:172.21.15.89:3300/0 conn(0x7fd564156600 0x7fd56414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd569f55640 1 --2- 172.21.15.89:0/1406644429 >> v2:172.21.15.97:3300/0 conn(0x7fd56414fb30 0x7fd5640aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd55bfff640 1 -- 172.21.15.89:0/1406644429 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346330818 0 0) 0x7fd564152d90 con 0x7fd5640a86d0 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd55bfff640 1 -- 172.21.15.89:0/1406644429 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd550003530 con 0x7fd5640a86d0 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd568f53640 1 -- 172.21.15.89:0/1406644429 >> v2:172.21.15.97:3300/0 conn(0x7fd56414fb30 msgr2=0x7fd5640aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd568f53640 1 --2- 172.21.15.89:0/1406644429 >> v2:172.21.15.97:3300/0 conn(0x7fd56414fb30 0x7fd5640aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd568f53640 1 -- 172.21.15.89:0/1406644429 >> v1:172.21.15.89:6789/0 conn(0x7fd5640a86d0 legacy=0x7fd5640a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:56.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.406+0000 7fd568f53640 1 -- 172.21.15.89:0/1406644429 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640a9760 con 0x7fd564156600 2023-12-07T09:59:56.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd568f53640 1 --2- 172.21.15.89:0/1406644429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd564156600 0x7fd56414f5f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097c0 tx=0x7fd55401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddc851439dac55e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:56.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd55bfff640 1 -- 172.21.15.89:0/1406644429 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540ab600 con 0x7fd564156600 2023-12-07T09:59:56.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd55bfff640 1 -- 172.21.15.89:0/1406644429 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5540a7050 con 0x7fd564156600 2023-12-07T09:59:56.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd55bfff640 1 -- 172.21.15.89:0/1406644429 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540ab980 con 0x7fd564156600 2023-12-07T09:59:56.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 -- 172.21.15.89:0/1406644429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd564156600 msgr2=0x7fd56414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:56.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/1406644429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd564156600 0x7fd56414f5f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097c0 tx=0x7fd55401c440 comp rx=0 tx=0).stop 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 -- 172.21.15.89:0/1406644429 shutdown_connections 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/1406644429 >> v2:172.21.15.97:3300/0 conn(0x7fd56414fb30 0x7fd5640aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/1406644429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd564156600 0x7fd56414f5f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 -- 172.21.15.89:0/1406644429 >> 172.21.15.89:0/1406644429 conn(0x7fd5640c2a60 msgr2=0x7fd5640c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 -- 172.21.15.89:0/1406644429 shutdown_connections 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.410+0000 7fd56b9b8640 1 -- 172.21.15.89:0/1406644429 wait complete. 2023-12-07T09:59:56.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 Processor -- start 2023-12-07T09:59:56.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- start start 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5640a86d0 0x7fd56414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 0x7fd56414b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd564156600 0x7fd5641ecb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56414aa80 con 0x7fd56414fb30 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640705d0 con 0x7fd564156600 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640708b0 con 0x7fd5640a86d0 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 0x7fd56414b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 0x7fd56414b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34698/0 (socket says 172.21.15.89:34698) 2023-12-07T09:59:56.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 -- 172.21.15.89:0/283201212 learned_addr learned my addr 172.21.15.89:0/283201212 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd569f55640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd564156600 0x7fd5641ecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd569754640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5640a86d0 0x7fd56414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 -- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5640a86d0 msgr2=0x7fd56414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5640a86d0 0x7fd56414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 -- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd564156600 msgr2=0x7fd5641ecb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd564156600 0x7fd5641ecb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 -- 172.21.15.89:0/283201212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009420 con 0x7fd56414fb30 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd568f53640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 0x7fd56414b700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5540ae040 tx=0x7fd5540191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540b4410 con 0x7fd56414fb30 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5540b4570 con 0x7fd56414fb30 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540b4920 con 0x7fd56414fb30 2023-12-07T09:59:56.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56414a6a0 con 0x7fd56414fb30 2023-12-07T09:59:56.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd564070b90 con 0x7fd56414fb30 2023-12-07T09:59:56.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.414+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56414a830 con 0x7fd56414fb30 2023-12-07T09:59:56.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.418+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd5540b2040 con 0x7fd56414fb30 2023-12-07T09:59:56.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.418+0000 7fd559ffb640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5480668d0 0x7fd548068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:56.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.418+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd55411e300 con 0x7fd56414fb30 2023-12-07T09:59:56.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.418+0000 7fd569754640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5480668d0 0x7fd548068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:56.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.418+0000 7fd569754640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5480668d0 0x7fd548068d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5600011f0 tx=0x7fd560007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:56.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.422+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5540eb640 con 0x7fd56414fb30 2023-12-07T09:59:56.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:56.602+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5640709f0 con 0x7fd56414fb30 2023-12-07T09:59:57.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd559ffb640 1 -- 172.21.15.89:0/283201212 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd5640709f0 con 0x7fd56414fb30 2023-12-07T09:59:57.249 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 4 and data pool 5 2023-12-07T09:59:57.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5480668d0 msgr2=0x7fd548068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5480668d0 0x7fd548068d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5600011f0 tx=0x7fd560007d40 comp rx=0 tx=0).stop 2023-12-07T09:59:57.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 msgr2=0x7fd56414b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 0x7fd56414b700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5540ae040 tx=0x7fd5540191e0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 shutdown_connections 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd564156600 0x7fd5641ecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56414fb30 0x7fd56414b700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5480668d0 0x7fd548068d90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 --2- 172.21.15.89:0/283201212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5640a86d0 0x7fd56414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 >> 172.21.15.89:0/283201212 conn(0x7fd5640c2a60 msgr2=0x7fd56414ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 shutdown_connections 2023-12-07T09:59:57.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.242+0000 7fd56b9b8640 1 -- 172.21.15.89:0/283201212 wait complete. 2023-12-07T09:59:57.277 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:57.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.406+0000 7fe62e1c4640 1 Processor -- start 2023-12-07T09:59:57.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.406+0000 7fe62e1c4640 1 -- start start 2023-12-07T09:59:57.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe62e1c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe628070b80 0x7fe628151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe62e1c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6280a8470 0x7fe62806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe62e1c4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62806d320 con 0x7fe62814e9d0 2023-12-07T09:59:57.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe62e1c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280721b0 con 0x7fe628070b80 2023-12-07T09:59:57.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe62e1c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c2830 con 0x7fe6280a8470 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe628070b80 0x7fe628151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe628070b80 0x7fe628151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:55396/0 (socket says 172.21.15.89:55396) 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe627fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6280a8470 0x7fe62806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 -- 172.21.15.89:0/2958381147 learned_addr learned my addr 172.21.15.89:0/2958381147 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 -- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6280a8470 msgr2=0x7fe62806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 --2- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6280a8470 0x7fe62806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 -- 172.21.15.89:0/2958381147 >> v1:172.21.15.97:6789/0 conn(0x7fe62814e9d0 legacy=0x7fe6280c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe61ffff640 1 -- 172.21.15.89:0/2958381147 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628072450 con 0x7fe628070b80 2023-12-07T09:59:57.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.410+0000 7fe627fff640 1 --2- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6280a8470 0x7fe62806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:57.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe61ffff640 1 --2- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe628070b80 0x7fe628151e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16d97f39e72ee32 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:57.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe626ffd640 1 -- 172.21.15.89:0/2958381147 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100ac620 con 0x7fe628070b80 2023-12-07T09:59:57.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe626ffd640 1 -- 172.21.15.89:0/2958381147 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6100ac780 con 0x7fe628070b80 2023-12-07T09:59:57.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe626ffd640 1 -- 172.21.15.89:0/2958381147 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100acb10 con 0x7fe628070b80 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe628070b80 msgr2=0x7fe628151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe628070b80 0x7fe628151e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61001c4b0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- 172.21.15.89:0/2958381147 shutdown_connections 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6280a8470 0x7fe62806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/2958381147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe628070b80 0x7fe628151e60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- 172.21.15.89:0/2958381147 >> 172.21.15.89:0/2958381147 conn(0x7fe6280c2ad0 msgr2=0x7fe6280c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- 172.21.15.89:0/2958381147 shutdown_connections 2023-12-07T09:59:57.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- 172.21.15.89:0/2958381147 wait complete. 2023-12-07T09:59:57.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 Processor -- start 2023-12-07T09:59:57.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- start start 2023-12-07T09:59:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe628070b80 0x7fe6281e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6280a8470 0x7fe628153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 0x7fe62814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814f250 con 0x7fe62814e9d0 2023-12-07T09:59:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281e99c0 con 0x7fe6280a8470 2023-12-07T09:59:57.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe62e1c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814f7d0 con 0x7fe628070b80 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.414+0000 7fe627fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 0x7fe62814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 0x7fe62814fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34712/0 (socket says 172.21.15.89:34712) 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 -- 172.21.15.89:0/3050644674 learned_addr learned my addr 172.21.15.89:0/3050644674 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe61ffff640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6280a8470 0x7fe628153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe6277fe640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe628070b80 0x7fe6281e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 -- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe628070b80 msgr2=0x7fe6281e9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe628070b80 0x7fe6281e9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 -- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6280a8470 msgr2=0x7fe628153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6280a8470 0x7fe628153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 -- 172.21.15.89:0/3050644674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009a70 con 0x7fe62814e9d0 2023-12-07T09:59:57.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe627fff640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 0x7fe62814fc60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe62000ef90 tx=0x7fe620009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620009d70 con 0x7fe62814e9d0 2023-12-07T09:59:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000f040 con 0x7fe62814e9d0 2023-12-07T09:59:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200146c0 con 0x7fe62814e9d0 2023-12-07T09:59:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6100094d0 con 0x7fe62814e9d0 2023-12-07T09:59:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe628151150 con 0x7fe62814e9d0 2023-12-07T09:59:57.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe628072020 con 0x7fe62814e9d0 2023-12-07T09:59:57.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.418+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe620014820 con 0x7fe62814e9d0 2023-12-07T09:59:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.422+0000 7fe624ff9640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe608066900 0x7fe608068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.422+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe620085310 con 0x7fe62814e9d0 2023-12-07T09:59:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.422+0000 7fe6277fe640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe608066900 0x7fe608068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.422+0000 7fe6277fe640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe608066900 0x7fe608068dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe618007fd0 tx=0x7fe618009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:57.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.426+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe620052560 con 0x7fe62814e9d0 2023-12-07T09:59:57.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.574+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe62814f940 con 0x7fe62814e9d0 2023-12-07T09:59:57.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.574+0000 7fe624ff9640 1 -- 172.21.15.89:0/3050644674 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16522 (secure 0 0 0) 0x7fe620055b80 con 0x7fe62814e9d0 2023-12-07T09:59:57.583 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:57.583 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":30,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:56.607592+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe608066900 msgr2=0x7fe608068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe608066900 0x7fe608068dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe618007fd0 tx=0x7fe618009040 comp rx=0 tx=0).stop 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 msgr2=0x7fe62814fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 0x7fe62814fc60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe62000ef90 tx=0x7fe620009f90 comp rx=0 tx=0).stop 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 shutdown_connections 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe62814e9d0 0x7fe62814fc60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6280a8470 0x7fe628153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe608066900 0x7fe608068dc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 --2- 172.21.15.89:0/3050644674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe628070b80 0x7fe6281e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 >> 172.21.15.89:0/3050644674 conn(0x7fe6280c2ad0 msgr2=0x7fe628149940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 shutdown_connections 2023-12-07T09:59:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.578+0000 7fe62e1c4640 1 -- 172.21.15.89:0/3050644674 wait complete. 2023-12-07T09:59:57.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T09:59:57.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 Processor -- start 2023-12-07T09:59:57.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 -- start start 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49a0070b80 0x7f49a0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49a00a8470 0x7f49a006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a006d320 con 0x7f49a014e9d0 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a00721b0 con 0x7f49a00a8470 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f49a6032640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a00c2830 con 0x7f49a0070b80 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49a00a8470 0x7f49a006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49a00a8470 0x7f49a006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34722/0 (socket says 172.21.15.89:34722) 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 -- 172.21.15.89:0/1754896664 learned_addr learned my addr 172.21.15.89:0/1754896664 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499effd640 1 --2- 172.21.15.89:0/1754896664 >> v2:172.21.15.97:3300/0 conn(0x7f49a0070b80 0x7f49a0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 -- 172.21.15.89:0/1754896664 >> v2:172.21.15.97:3300/0 conn(0x7f49a0070b80 msgr2=0x7f49a0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 --2- 172.21.15.89:0/1754896664 >> v2:172.21.15.97:3300/0 conn(0x7f49a0070b80 0x7f49a0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 -- 172.21.15.89:0/1754896664 >> v1:172.21.15.97:6789/0 conn(0x7f49a014e9d0 legacy=0x7f49a00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:57.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499ffff640 1 -- 172.21.15.89:0/1754896664 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a0072450 con 0x7f49a00a8470 2023-12-07T09:59:57.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.734+0000 7f499effd640 1 --2- 172.21.15.89:0/1754896664 >> v2:172.21.15.97:3300/0 conn(0x7f49a0070b80 0x7f49a0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:57.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f499ffff640 1 --2- 172.21.15.89:0/1754896664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a006d7b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f49a006e420 tx=0x7f499801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f688c13941a23c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:57.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f499e7fc640 1 -- 172.21.15.89:0/1754896664 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980a56d0 con 0x7f49a00a8470 2023-12-07T09:59:57.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f499e7fc640 1 -- 172.21.15.89:0/1754896664 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49980a5830 con 0x7f49a00a8470 2023-12-07T09:59:57.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f499e7fc640 1 -- 172.21.15.89:0/1754896664 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980a5bc0 con 0x7f49a00a8470 2023-12-07T09:59:57.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 -- 172.21.15.89:0/1754896664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 msgr2=0x7f49a006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 --2- 172.21.15.89:0/1754896664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a006d7b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f49a006e420 tx=0x7f499801c900 comp rx=0 tx=0).stop 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 -- 172.21.15.89:0/1754896664 shutdown_connections 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 --2- 172.21.15.89:0/1754896664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a006d7b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 --2- 172.21.15.89:0/1754896664 >> v2:172.21.15.97:3300/0 conn(0x7f49a0070b80 0x7f49a0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 -- 172.21.15.89:0/1754896664 >> 172.21.15.89:0/1754896664 conn(0x7f49a00c2ad0 msgr2=0x7f49a00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 -- 172.21.15.89:0/1754896664 shutdown_connections 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.738+0000 7f49a6032640 1 -- 172.21.15.89:0/1754896664 wait complete. 2023-12-07T09:59:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 Processor -- start 2023-12-07T09:59:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 -- start start 2023-12-07T09:59:57.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49a0070b80 0x7f49a00c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49a014e9d0 0x7f49a0143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0145470 con 0x7f49a00a8470 2023-12-07T09:59:57.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0142770 con 0x7f49a014e9d0 2023-12-07T09:59:57.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0142a50 con 0x7f49a0070b80 2023-12-07T09:59:57.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34728/0 (socket says 172.21.15.89:34728) 2023-12-07T09:59:57.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 -- 172.21.15.89:0/3574821000 learned_addr learned my addr 172.21.15.89:0/3574821000 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499f7fe640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49a0070b80 0x7f49a00c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499ffff640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49a014e9d0 0x7f49a0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 -- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49a0070b80 msgr2=0x7f49a00c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49a0070b80 0x7f49a00c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 -- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49a014e9d0 msgr2=0x7f49a0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49a014e9d0 0x7f49a0143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 -- 172.21.15.89:0/3574821000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009b30 con 0x7f49a00a8470 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499f7fe640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49a0070b80 0x7f49a00c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499ffff640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49a014e9d0 0x7f49a0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T09:59:57.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f499effd640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a014cbe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f499400c7f0 tx=0x7f499400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499400cea0 con 0x7f49a00a8470 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994007a30 con 0x7f49a00a8470 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0142d30 con 0x7f49a00a8470 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994007dc0 con 0x7f49a00a8470 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.742+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a0144b70 con 0x7f49a00a8470 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.746+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a01455e0 con 0x7f49a00a8470 2023-12-07T09:59:57.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.746+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f49940113f0 con 0x7f49a00a8470 2023-12-07T09:59:57.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.746+0000 7f4987fff640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f498c0668d0 0x7f498c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:57.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.746+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4994084600 con 0x7f49a00a8470 2023-12-07T09:59:57.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.746+0000 7f499f7fe640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f498c0668d0 0x7f498c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:57.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.746+0000 7f499f7fe640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f498c0668d0 0x7f498c068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f499000a850 tx=0x7f4990008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:57.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.750+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4994051830 con 0x7f49a00a8470 2023-12-07T09:59:57.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.898+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49a004e890 con 0x7f49a00a8470 2023-12-07T09:59:57.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.898+0000 7f4987fff640 1 -- 172.21.15.89:0/3574821000 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f4994054e50 con 0x7f49a00a8470 2023-12-07T09:59:57.908 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T09:59:57.908 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":30,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:56.607592+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f498c0668d0 msgr2=0x7f498c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f498c0668d0 0x7f498c068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f499000a850 tx=0x7f4990008040 comp rx=0 tx=0).stop 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 msgr2=0x7f49a014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a014cbe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f499400c7f0 tx=0x7f499400ccb0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 shutdown_connections 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49a014e9d0 0x7f49a0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00a8470 0x7f49a014cbe0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f498c0668d0 0x7f498c068d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 --2- 172.21.15.89:0/3574821000 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f49a0070b80 0x7f49a00c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 >> 172.21.15.89:0/3574821000 conn(0x7f49a00c2ad0 msgr2=0x7f49a0148560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 shutdown_connections 2023-12-07T09:59:57.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:57.902+0000 7f49a6032640 1 -- 172.21.15.89:0/3574821000 wait complete. 2023-12-07T09:59:57.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-07T09:59:58.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.058+0000 7f4b353df640 1 Processor -- start 2023-12-07T09:59:58.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b353df640 1 -- start start 2023-12-07T09:59:58.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b353df640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 0x7f4b30151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:58.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b353df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b3006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:58.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b353df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3006de00 con 0x7f4b30151f90 2023-12-07T09:59:58.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b353df640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b30070390 con 0x7f4b3014eaf0 2023-12-07T09:59:58.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b353df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3014eed0 con 0x7f4b300c0370 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b3006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 0x7f4b30151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b3006d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:53290/0 (socket says 172.21.15.89:53290) 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 0x7f4b30151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:55442/0 (socket says 172.21.15.89:55442) 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/3062338316 learned_addr learned my addr 172.21.15.89:0/3062338316 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b267fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4b30151f90 0x7f4b3006d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:56756/0 (socket says 172.21.15.89:56756) 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2e7fc640 1 -- 172.21.15.89:0/3062338316 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394865055 0 0) 0x7f4b3006de00 con 0x7f4b30151f90 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2e7fc640 1 -- 172.21.15.89:0/3062338316 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b1c003530 con 0x7f4b30151f90 2023-12-07T09:59:58.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/3062338316 >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 msgr2=0x7f4b30151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T09:59:58.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 --2- 172.21.15.89:0/3062338316 >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 0x7f4b30151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:58.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/3062338316 >> v1:172.21.15.97:6789/0 conn(0x7f4b30151f90 legacy=0x7f4b3006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:58.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/3062338316 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30151270 con 0x7f4b300c0370 2023-12-07T09:59:58.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.062+0000 7f4b2effd640 1 --2- 172.21.15.89:0/3062338316 >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 0x7f4b30151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T09:59:58.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b2f7fe640 1 --2- 172.21.15.89:0/3062338316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b3006d820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009870 tx=0x7f4b2801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1afac9e2a1cde1f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:58.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b2e7fc640 1 -- 172.21.15.89:0/3062338316 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280ab5f0 con 0x7f4b300c0370 2023-12-07T09:59:58.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b2e7fc640 1 -- 172.21.15.89:0/3062338316 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280ab750 con 0x7f4b300c0370 2023-12-07T09:59:58.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b2e7fc640 1 -- 172.21.15.89:0/3062338316 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280abae0 con 0x7f4b300c0370 2023-12-07T09:59:58.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 -- 172.21.15.89:0/3062338316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 msgr2=0x7f4b3006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:58.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 --2- 172.21.15.89:0/3062338316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b3006d820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009870 tx=0x7f4b2801c3f0 comp rx=0 tx=0).stop 2023-12-07T09:59:58.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 -- 172.21.15.89:0/3062338316 shutdown_connections 2023-12-07T09:59:58.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 --2- 172.21.15.89:0/3062338316 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b3006d820 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:58.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 --2- 172.21.15.89:0/3062338316 >> v2:172.21.15.97:3300/0 conn(0x7f4b3014eaf0 0x7f4b30151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:58.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 -- 172.21.15.89:0/3062338316 >> 172.21.15.89:0/3062338316 conn(0x7f4b300c2a60 msgr2=0x7f4b300c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:58.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 -- 172.21.15.89:0/3062338316 shutdown_connections 2023-12-07T09:59:58.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 -- 172.21.15.89:0/3062338316 wait complete. 2023-12-07T09:59:58.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.066+0000 7f4b353df640 1 Processor -- start 2023-12-07T09:59:58.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- start start 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b30153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b3014eaf0 0x7f4b300aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b300ab4b0 0x7f4b301ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30145dc0 con 0x7f4b300ab4b0 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301e8950 con 0x7f4b3014eaf0 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301e8c10 con 0x7f4b300c0370 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b30153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:58.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b300ab4b0 0x7f4b301ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:58.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b30153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:53292/0 (socket says 172.21.15.89:53292) 2023-12-07T09:59:58.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2effd640 1 -- 172.21.15.89:0/1000348188 learned_addr learned my addr 172.21.15.89:0/1000348188 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:58.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b267fc640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b3014eaf0 0x7f4b300aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 msgr2=0x7f4b30153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b30153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b3014eaf0 msgr2=0x7f4b300aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b3014eaf0 0x7f4b300aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 -- 172.21.15.89:0/1000348188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20009a70 con 0x7f4b300ab4b0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b2f7fe640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b300ab4b0 0x7f4b301ec100 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b280ac000 tx=0x7f4b2801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280be5f0 con 0x7f4b300ab4b0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280be770 con 0x7f4b300ab4b0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b280094d0 con 0x7f4b300ab4b0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280beb20 con 0x7f4b300ab4b0 2023-12-07T09:59:58.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b301e91d0 con 0x7f4b300ab4b0 2023-12-07T09:59:58.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.070+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b30151a50 con 0x7f4b300ab4b0 2023-12-07T09:59:58.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.074+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4b280b43f0 con 0x7f4b300ab4b0 2023-12-07T09:59:58.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.074+0000 7f4b27fff640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b100668d0 0x7f4b10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:58.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.074+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b280a8050 con 0x7f4b300ab4b0 2023-12-07T09:59:58.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.074+0000 7f4b2effd640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b100668d0 0x7f4b10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:58.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.074+0000 7f4b2effd640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b100668d0 0x7f4b10068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b30067520 tx=0x7f4b2000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:58.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.078+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b280ec380 con 0x7f4b300ab4b0 2023-12-07T09:59:58.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:58.266+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b3004e890 con 0x7f4b300ab4b0 2023-12-07T09:59:59.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.258+0000 7f4b27fff640 1 -- 172.21.15.89:0/1000348188 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4b280ef9a0 con 0x7f4b300ab4b0 2023-12-07T09:59:59.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b100668d0 msgr2=0x7f4b10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b100668d0 0x7f4b10068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b30067520 tx=0x7f4b2000b040 comp rx=0 tx=0).stop 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b300ab4b0 msgr2=0x7f4b301ec100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b300ab4b0 0x7f4b301ec100 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b280ac000 tx=0x7f4b2801ac30 comp rx=0 tx=0).stop 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 shutdown_connections 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b300ab4b0 0x7f4b301ec100 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b3014eaf0 0x7f4b300aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b100668d0 0x7f4b10068d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 --2- 172.21.15.89:0/1000348188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b300c0370 0x7f4b30153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 >> 172.21.15.89:0/1000348188 conn(0x7f4b300c2a60 msgr2=0x7f4b301508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 shutdown_connections 2023-12-07T09:59:59.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.262+0000 7f4b353df640 1 -- 172.21.15.89:0/1000348188 wait complete. 2023-12-07T09:59:59.292 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T09:59:59.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-07T09:59:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f4131479640 1 Processor -- start 2023-12-07T09:59:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f4131479640 1 -- start start 2023-12-07T09:59:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f4131479640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f412c06b810 0x7f412c0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f4131479640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c073710 con 0x7f412c0c2a60 2023-12-07T09:59:59.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f4131479640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0a6010 con 0x7f412c06f0d0 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f4131479640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c1589f0 con 0x7f412c06b810 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f412c06b810 0x7f412c0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f412c0c2a60 0x7f412c06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42764/0 (socket says 172.21.15.89:42764) 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f412c06b810 0x7f412c0c1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34752/0 (socket says 172.21.15.89:34752) 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412b7fe640 1 -- 172.21.15.89:0/2729553156 learned_addr learned my addr 172.21.15.89:0/2729553156 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412affd640 1 -- 172.21.15.89:0/2729553156 >> v1:172.21.15.97:6789/0 conn(0x7f412c06f0d0 legacy=0x7f412c0bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412affd640 1 -- 172.21.15.89:0/2729553156 >> v1:172.21.15.89:6789/0 conn(0x7f412c0c2a60 legacy=0x7f412c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.430+0000 7f412affd640 1 -- 172.21.15.89:0/2729553156 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0739d0 con 0x7f412c06b810 2023-12-07T09:59:59.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f412affd640 1 --2- 172.21.15.89:0/2729553156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06b810 0x7f412c0c1140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f411c0097c0 tx=0x7f411c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5e5a8bd99d38e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:59.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4129ffb640 1 -- 172.21.15.89:0/2729553156 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0ab600 con 0x7f412c06b810 2023-12-07T09:59:59.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4129ffb640 1 -- 172.21.15.89:0/2729553156 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0a7050 con 0x7f412c06b810 2023-12-07T09:59:59.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4129ffb640 1 -- 172.21.15.89:0/2729553156 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0ab980 con 0x7f412c06b810 2023-12-07T09:59:59.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 -- 172.21.15.89:0/2729553156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06b810 msgr2=0x7f412c0c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 --2- 172.21.15.89:0/2729553156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06b810 0x7f412c0c1140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f411c0097c0 tx=0x7f411c01c480 comp rx=0 tx=0).stop 2023-12-07T09:59:59.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 -- 172.21.15.89:0/2729553156 shutdown_connections 2023-12-07T09:59:59.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 --2- 172.21.15.89:0/2729553156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06b810 0x7f412c0c1140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 -- 172.21.15.89:0/2729553156 >> 172.21.15.89:0/2729553156 conn(0x7f412c0c3240 msgr2=0x7f412c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T09:59:59.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 -- 172.21.15.89:0/2729553156 shutdown_connections 2023-12-07T09:59:59.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 -- 172.21.15.89:0/2729553156 wait complete. 2023-12-07T09:59:59.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 Processor -- start 2023-12-07T09:59:59.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.434+0000 7f4131479640 1 -- start start 2023-12-07T09:59:59.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f412c06b810 0x7f412c145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:59.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 0x7f412c0a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:59.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f412c0c2a60 0x7f412c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c146610 con 0x7f412c06f0d0 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c1460b0 con 0x7f412c06b810 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c14a8d0 con 0x7f412c0c2a60 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 0x7f412c0a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 0x7f412c0a7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34756/0 (socket says 172.21.15.89:34756) 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f412c06b810 0x7f412c145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 -- 172.21.15.89:0/485875255 learned_addr learned my addr 172.21.15.89:0/485875255 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T09:59:59.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412b7fe640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f412c0c2a60 0x7f412c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 -- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f412c0c2a60 msgr2=0x7f412c146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f412c0c2a60 0x7f412c146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 -- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f412c06b810 msgr2=0x7f412c145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f412c06b810 0x7f412c145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 -- 172.21.15.89:0/485875255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009420 con 0x7f412c06f0d0 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f412a7fc640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 0x7f412c0a7710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f412000c500 tx=0x7f412000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:59.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120005220 con 0x7f412c06f0d0 2023-12-07T09:59:59.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120005380 con 0x7f412c06f0d0 2023-12-07T09:59:59.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120007270 con 0x7f412c06f0d0 2023-12-07T09:59:59.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c14acd0 con 0x7f412c06f0d0 2023-12-07T09:59:59.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c1ed740 con 0x7f412c06f0d0 2023-12-07T09:59:59.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c146750 con 0x7f412c06f0d0 2023-12-07T09:59:59.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.438+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41200073d0 con 0x7f412c06f0d0 2023-12-07T09:59:59.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.442+0000 7f41137fe640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T09:59:59.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.442+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41200839f0 con 0x7f412c06f0d0 2023-12-07T09:59:59.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.442+0000 7f412affd640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T09:59:59.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.442+0000 7f412affd640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f411c0ad000 tx=0x7f411c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T09:59:59.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.446+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f412c146750 con 0x7f412c06f0d0 2023-12-07T09:59:59.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T09:59:59.626+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f412c146750 con 0x7f412c06f0d0 2023-12-07T10:00:00.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f41137fe640 1 -- 172.21.15.89:0/485875255 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f412c146750 con 0x7f412c06f0d0 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 msgr2=0x7f4118068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f411c0ad000 tx=0x7f411c008040 comp rx=0 tx=0).stop 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 msgr2=0x7f412c0a7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 0x7f412c0a7710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f412000c500 tx=0x7f412000c9c0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 shutdown_connections 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f412c0c2a60 0x7f412c146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f412c06f0d0 0x7f412c0a7710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 --2- 172.21.15.89:0/485875255 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f412c06b810 0x7f412c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 >> 172.21.15.89:0/485875255 conn(0x7f412c0c3240 msgr2=0x7f412c149020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:00.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 shutdown_connections 2023-12-07T10:00:00.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.261+0000 7f4131479640 1 -- 172.21.15.89:0/485875255 wait complete. 2023-12-07T10:00:00.290 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-07T10:00:00.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:00.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.421+0000 7faf0e6aa640 1 Processor -- start 2023-12-07T10:00:00.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0e6aa640 1 -- start start 2023-12-07T10:00:00.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0e6aa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf080bd720 0x7faf08158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0e6aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faf0806cd90 0x7faf08158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0e6aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf08155790 con 0x7faf080ca610 2023-12-07T10:00:00.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0e6aa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080c4b00 con 0x7faf080bd720 2023-12-07T10:00:00.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0e6aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080c4de0 con 0x7faf0806cd90 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf080bd720 0x7faf08158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0cc47640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faf0806cd90 0x7faf08158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf080bd720 0x7faf08158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37884/0 (socket says 172.21.15.89:37884) 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 -- 172.21.15.89:0/3225751427 learned_addr learned my addr 172.21.15.89:0/3225751427 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf0cc47640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faf0806cd90 0x7faf08158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:38334/0 (socket says 172.21.15.89:38334) 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf07fff640 1 --1- 172.21.15.89:0/3225751427 >> v1:172.21.15.97:6789/0 conn(0x7faf080ca610 0x7faf080c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:55006/0 (socket says 172.21.15.89:55006) 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 -- 172.21.15.89:0/3225751427 >> v2:172.21.15.97:3300/0 conn(0x7faf0806cd90 msgr2=0x7faf08158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 --2- 172.21.15.89:0/3225751427 >> v2:172.21.15.97:3300/0 conn(0x7faf0806cd90 0x7faf08158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 -- 172.21.15.89:0/3225751427 >> v1:172.21.15.97:6789/0 conn(0x7faf080ca610 legacy=0x7faf080c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.425+0000 7faf077fe640 1 -- 172.21.15.89:0/3225751427 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08157e30 con 0x7faf080bd720 2023-12-07T10:00:00.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf077fe640 1 --2- 172.21.15.89:0/3225751427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf080bd720 0x7faf08158350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf081547a0 tx=0x7faefc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894d3a28b517e196 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:00.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf06ffd640 1 -- 172.21.15.89:0/3225751427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf080c52d0 con 0x7faf080bd720 2023-12-07T10:00:00.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf06ffd640 1 -- 172.21.15.89:0/3225751427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0a7050 con 0x7faf080bd720 2023-12-07T10:00:00.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf06ffd640 1 -- 172.21.15.89:0/3225751427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0ab820 con 0x7faf080bd720 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 -- 172.21.15.89:0/3225751427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf080bd720 msgr2=0x7faf08158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/3225751427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf080bd720 0x7faf08158350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf081547a0 tx=0x7faefc01c3e0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 -- 172.21.15.89:0/3225751427 shutdown_connections 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/3225751427 >> v2:172.21.15.97:3300/0 conn(0x7faf0806cd90 0x7faf08158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/3225751427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf080bd720 0x7faf08158350 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 -- 172.21.15.89:0/3225751427 >> 172.21.15.89:0/3225751427 conn(0x7faf08071ea0 msgr2=0x7faf080722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 -- 172.21.15.89:0/3225751427 shutdown_connections 2023-12-07T10:00:00.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 -- 172.21.15.89:0/3225751427 wait complete. 2023-12-07T10:00:00.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 Processor -- start 2023-12-07T10:00:00.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.429+0000 7faf0e6aa640 1 -- start start 2023-12-07T10:00:00.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 0x7faf08151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf080bd720 0x7faf080aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf080ca610 0x7faf081f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf08150540 con 0x7faf0806cd90 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081513a0 con 0x7faf080ca610 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf08151d70 con 0x7faf080bd720 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 0x7faf08151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 0x7faf08151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37898/0 (socket says 172.21.15.89:37898) 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 -- 172.21.15.89:0/1639324558 learned_addr learned my addr 172.21.15.89:0/1639324558 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf077fe640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf080bd720 0x7faf080aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0cc47640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf080ca610 0x7faf081f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 -- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf080bd720 msgr2=0x7faf080aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf080bd720 0x7faf080aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 -- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf080ca610 msgr2=0x7faf081f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf080ca610 0x7faf081f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 -- 172.21.15.89:0/1639324558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0094d0 con 0x7faf0806cd90 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf07fff640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 0x7faf08151830 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faef800c430 tx=0x7faef800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80074e0 con 0x7faf0806cd90 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8007640 con 0x7faf0806cd90 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8004a10 con 0x7faf0806cd90 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf08150790 con 0x7faf0806cd90 2023-12-07T10:00:00.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf08150d50 con 0x7faf0806cd90 2023-12-07T10:00:00.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf080c9de0 con 0x7faf0806cd90 2023-12-07T10:00:00.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.433+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faef8004b70 con 0x7faf0806cd90 2023-12-07T10:00:00.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.437+0000 7faf04ff9640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.437+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faef8083da0 con 0x7faf0806cd90 2023-12-07T10:00:00.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.437+0000 7faf077fe640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.437+0000 7faf077fe640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ad000 tx=0x7faefc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:00.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.445+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faef8050ff0 con 0x7faf0806cd90 2023-12-07T10:00:00.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf0804e890 con 0x7faf0806cd90 2023-12-07T10:00:00.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf04ff9640 1 -- 172.21.15.89:0/1639324558 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4907 (secure 0 0 0) 0x7faef8054610 con 0x7faf0806cd90 2023-12-07T10:00:00.649 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:00.649 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-07T10:00:00.649 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 17 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 msgr2=0x7faef4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ad000 tx=0x7faefc008040 comp rx=0 tx=0).stop 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 msgr2=0x7faf08151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 0x7faf08151830 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faef800c430 tx=0x7faef800c8f0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 shutdown_connections 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf080ca610 0x7faf081f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf080bd720 0x7faf080aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 --2- 172.21.15.89:0/1639324558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806cd90 0x7faf08151830 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 >> 172.21.15.89:0/1639324558 conn(0x7faf08071ea0 msgr2=0x7faf08158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:00.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 shutdown_connections 2023-12-07T10:00:00.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.641+0000 7faf0e6aa640 1 -- 172.21.15.89:0/1639324558 wait complete. 2023-12-07T10:00:00.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:00.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.797+0000 7f1a0b51d640 1 Processor -- start 2023-12-07T10:00:00.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.797+0000 7f1a0b51d640 1 -- start start 2023-12-07T10:00:00.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a0b51d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a0406db80 0x7f1a0406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a0b51d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1a0406d100 0x7f1a040c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a0b51d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0406bea0 con 0x7f1a04152ce0 2023-12-07T10:00:00.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a0b51d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a04159b10 con 0x7f1a0406db80 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a0b51d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a04159550 con 0x7f1a0406d100 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a08ab8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a0406db80 0x7f1a0406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a092b9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1a04152ce0 0x7f1a040700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49714/0 (socket says 172.21.15.89:49714) 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a08ab8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a0406db80 0x7f1a0406c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37904/0 (socket says 172.21.15.89:37904) 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a092b9640 1 -- 172.21.15.89:0/1223138864 learned_addr learned my addr 172.21.15.89:0/1223138864 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a09aba640 1 --2- 172.21.15.89:0/1223138864 >> v2:172.21.15.97:3300/0 conn(0x7f1a0406d100 0x7f1a040c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1223138864 >> v2:172.21.15.97:3300/0 conn(0x7f1a0406d100 msgr2=0x7f1a040c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a08ab8640 1 --2- 172.21.15.89:0/1223138864 >> v2:172.21.15.97:3300/0 conn(0x7f1a0406d100 0x7f1a040c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1223138864 >> v1:172.21.15.89:6789/0 conn(0x7f1a04152ce0 legacy=0x7f1a040700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.801+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1223138864 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04159830 con 0x7f1a0406db80 2023-12-07T10:00:00.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a08ab8640 1 --2- 172.21.15.89:0/1223138864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a0406c940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a04070030 tx=0x7f19f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dfc7077f8ab48f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:00.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f19fbfff640 1 -- 172.21.15.89:0/1223138864 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40ac630 con 0x7f1a0406db80 2023-12-07T10:00:00.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f19fbfff640 1 -- 172.21.15.89:0/1223138864 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f40ac790 con 0x7f1a0406db80 2023-12-07T10:00:00.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f19fbfff640 1 -- 172.21.15.89:0/1223138864 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40acb20 con 0x7f1a0406db80 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1223138864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 msgr2=0x7f1a0406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1223138864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a0406c940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a04070030 tx=0x7f19f401c3d0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1223138864 shutdown_connections 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1223138864 >> v2:172.21.15.97:3300/0 conn(0x7f1a0406d100 0x7f1a040c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1223138864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a0406c940 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1223138864 >> 172.21.15.89:0/1223138864 conn(0x7f1a040c2ad0 msgr2=0x7f1a040c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:00.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1223138864 shutdown_connections 2023-12-07T10:00:00.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1223138864 wait complete. 2023-12-07T10:00:00.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 Processor -- start 2023-12-07T10:00:00.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- start start 2023-12-07T10:00:00.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0406d100 0x7f1a04146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a041f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a04152ce0 0x7f1a040709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04158340 con 0x7f1a0406db80 2023-12-07T10:00:00.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04158570 con 0x7f1a0406d100 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a0b51d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041f4ab0 con 0x7f1a04152ce0 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.805+0000 7f1a08ab8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a041f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a041f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37908/0 (socket says 172.21.15.89:37908) 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1334744914 learned_addr learned my addr 172.21.15.89:0/1334744914 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a092b9640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0406d100 0x7f1a04146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a09aba640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a04152ce0 0x7f1a040709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a04152ce0 msgr2=0x7f1a040709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a04152ce0 0x7f1a040709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0406d100 msgr2=0x7f1a04146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0406d100 0x7f1a04146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 -- 172.21.15.89:0/1334744914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4009420 con 0x7f1a0406db80 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a092b9640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0406d100 0x7f1a04146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a09aba640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a04152ce0 0x7f1a040709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:00.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a08ab8640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a041f14a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f19f40af040 tx=0x7f19f4019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:00.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40b5610 con 0x7f1a0406db80 2023-12-07T10:00:00.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f40b5790 con 0x7f1a0406db80 2023-12-07T10:00:00.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a041f4d90 con 0x7f1a0406db80 2023-12-07T10:00:00.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40b5b40 con 0x7f1a0406db80 2023-12-07T10:00:00.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a04158810 con 0x7f1a0406db80 2023-12-07T10:00:00.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040ac1e0 con 0x7f1a0406db80 2023-12-07T10:00:00.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f19f40b3040 con 0x7f1a0406db80 2023-12-07T10:00:00.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f19f9ffb640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19e80668d0 0x7f19e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:00.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.809+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19f411e570 con 0x7f1a0406db80 2023-12-07T10:00:00.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.813+0000 7f1a092b9640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19e80668d0 0x7f19e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:00.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.813+0000 7f1a092b9640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19e80668d0 0x7f19e8068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005890 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:00.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.813+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19f40eb840 con 0x7f1a0406db80 2023-12-07T10:00:00.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.965+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a04067520 con 0x7f1a0406db80 2023-12-07T10:00:00.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.965+0000 7f19f9ffb640 1 -- 172.21.15.89:0/1334744914 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f19f40eee60 con 0x7f1a0406db80 2023-12-07T10:00:00.976 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:00.976 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":31,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:58.208016+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19e80668d0 msgr2=0x7f19e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19e80668d0 0x7f19e8068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005890 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 msgr2=0x7f1a041f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a041f14a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f19f40af040 tx=0x7f19f4019170 comp rx=0 tx=0).stop 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 shutdown_connections 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19e80668d0 0x7f19e8068d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1a04152ce0 0x7f1a040709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a0406db80 0x7f1a041f14a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 --2- 172.21.15.89:0/1334744914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a0406d100 0x7f1a04146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:00.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 >> 172.21.15.89:0/1334744914 conn(0x7f1a040c2ad0 msgr2=0x7f1a0414c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:00.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 shutdown_connections 2023-12-07T10:00:00.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:00.969+0000 7f1a0b51d640 1 -- 172.21.15.89:0/1334744914 wait complete. 2023-12-07T10:00:00.997 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T10:00:00.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:01.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 Processor -- start 2023-12-07T10:00:01.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 -- start start 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc9c814fcc0 0x7fc9c8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9c80c19e0 0x7fc9c80c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80ab580 con 0x7fc9c806d980 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80aa340 con 0x7fc9c80c19e0 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9ccb80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c8152fe0 con 0x7fc9c814fcc0 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9c6d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9c80c19e0 0x7fc9c80c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9bdd9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc9c806d980 0x7fc9c80aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49730/0 (socket says 172.21.15.89:49730) 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9c6d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9c80c19e0 0x7fc9c80c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37922/0 (socket says 172.21.15.89:37922) 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9bdd9b640 1 -- 172.21.15.89:0/527515068 learned_addr learned my addr 172.21.15.89:0/527515068 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.125+0000 7fc9c659c640 1 --2- 172.21.15.89:0/527515068 >> v2:172.21.15.97:3300/0 conn(0x7fc9c814fcc0 0x7fc9c8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/527515068 >> v2:172.21.15.97:3300/0 conn(0x7fc9c814fcc0 msgr2=0x7fc9c8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:01.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c6d9d640 1 --2- 172.21.15.89:0/527515068 >> v2:172.21.15.97:3300/0 conn(0x7fc9c814fcc0 0x7fc9c8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/527515068 >> v1:172.21.15.89:6789/0 conn(0x7fc9c806d980 legacy=0x7fc9c80aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/527515068 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c81532c0 con 0x7fc9c80c19e0 2023-12-07T10:00:01.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c659c640 1 --2- 172.21.15.89:0/527515068 >> v2:172.21.15.97:3300/0 conn(0x7fc9c814fcc0 0x7fc9c8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:01.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c6d9d640 1 --2- 172.21.15.89:0/527515068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80c1e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc9c806e350 tx=0x7fc9c001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a23f19f730ae042 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c5d9b640 1 -- 172.21.15.89:0/527515068 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00ab600 con 0x7fc9c80c19e0 2023-12-07T10:00:01.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c5d9b640 1 -- 172.21.15.89:0/527515068 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00a7050 con 0x7fc9c80c19e0 2023-12-07T10:00:01.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9c5d9b640 1 -- 172.21.15.89:0/527515068 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00ab980 con 0x7fc9c80c19e0 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 -- 172.21.15.89:0/527515068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c80c19e0 msgr2=0x7fc9c80c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/527515068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80c1e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc9c806e350 tx=0x7fc9c001c430 comp rx=0 tx=0).stop 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 -- 172.21.15.89:0/527515068 shutdown_connections 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/527515068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80c1e50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/527515068 >> v2:172.21.15.97:3300/0 conn(0x7fc9c814fcc0 0x7fc9c8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 -- 172.21.15.89:0/527515068 >> 172.21.15.89:0/527515068 conn(0x7fc9c80c2ad0 msgr2=0x7fc9c80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 -- 172.21.15.89:0/527515068 shutdown_connections 2023-12-07T10:00:01.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.129+0000 7fc9ccb80640 1 -- 172.21.15.89:0/527515068 wait complete. 2023-12-07T10:00:01.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 Processor -- start 2023-12-07T10:00:01.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 -- start start 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9c806d980 0x7fc9c815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 0x7fc9c814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81f1090 con 0x7fc9c8071800 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81453b0 con 0x7fc9c80c19e0 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9ccb80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c4d10 con 0x7fc9c806d980 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 0x7fc9c814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 0x7fc9c814d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37930/0 (socket says 172.21.15.89:37930) 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/2974786548 learned_addr learned my addr 172.21.15.89:0/2974786548 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c659c640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9c806d980 0x7fc9c815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9bdd9b640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9c806d980 msgr2=0x7fc9c815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9c806d980 0x7fc9c815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c80c19e0 msgr2=0x7fc9c80712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 -- 172.21.15.89:0/2974786548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009420 con 0x7fc9c8071800 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c659c640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9c806d980 0x7fc9c815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:01.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9bdd9b640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.133+0000 7fc9c6d9d640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 0x7fc9c814d080 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc9c001c910 tx=0x7fc9c001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00b4420 con 0x7fc9c8071800 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00b4580 con 0x7fc9c8071800 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c814cba0 con 0x7fc9c8071800 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00b4910 con 0x7fc9c8071800 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c81f0ad0 con 0x7fc9c8071800 2023-12-07T10:00:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c814ca00 con 0x7fc9c8071800 2023-12-07T10:00:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc9c00b2070 con 0x7fc9c8071800 2023-12-07T10:00:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9bf7fe640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9a80668d0 0x7fc9a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9c011db20 con 0x7fc9c8071800 2023-12-07T10:00:01.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9c659c640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9a80668d0 0x7fc9a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.137+0000 7fc9c659c640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9a80668d0 0x7fc9a8068d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009540 tx=0x7fc9b800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.141+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9c814ca00 con 0x7fc9c8071800 2023-12-07T10:00:01.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.289+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9c806dd60 con 0x7fc9a80668d0 2023-12-07T10:00:01.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.297+0000 7fc9bf7fe640 1 -- 172.21.15.89:0/2974786548 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252580 (secure 0 0 0) 0x7fc9c806dd60 con 0x7fc9a80668d0 2023-12-07T10:00:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:01.308 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:01.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9a80668d0 msgr2=0x7fc9a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9a80668d0 0x7fc9a8068d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009540 tx=0x7fc9b800b040 comp rx=0 tx=0).stop 2023-12-07T10:00:01.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 msgr2=0x7fc9c814d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 0x7fc9c814d080 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc9c001c910 tx=0x7fc9c001ac70 comp rx=0 tx=0).stop 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 shutdown_connections 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c8071800 0x7fc9c814d080 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c80c19e0 0x7fc9c80712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc9a80668d0 0x7fc9a8068d90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 --2- 172.21.15.89:0/2974786548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc9c806d980 0x7fc9c815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 >> 172.21.15.89:0/2974786548 conn(0x7fc9c80c2ad0 msgr2=0x7fc9c8154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 shutdown_connections 2023-12-07T10:00:01.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.301+0000 7fc9ccb80640 1 -- 172.21.15.89:0/2974786548 wait complete. 2023-12-07T10:00:01.327 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-07T10:00:00.350903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219736,"kb_used_data":3520,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3604480,"data_stored":2063914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.128636"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231884+0000","last_change":"2023-12-07T09:59:55.231884+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231884+0000","last_undegraded":"2023-12-07T09:59:55.231884+0000","last_fullsized":"2023-12-07T09:59:55.231884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222939+0000","last_change":"2023-12-07T09:59:55.222939+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222939+0000","last_undegraded":"2023-12-07T09:59:55.222939+0000","last_fullsized":"2023-12-07T09:59:55.222939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224901+0000","last_change":"2023-12-07T09:59:55.224901+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224901+0000","last_undegraded":"2023-12-07T09:59:55.224901+0000","last_fullsized":"2023-12-07T09:59:55.224901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231968+0000","last_change":"2023-12-07T09:59:55.231968+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231968+0000","last_undegraded":"2023-12-07T09:59:55.231968+0000","last_fullsized":"2023-12-07T09:59:55.231968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226077+0000","last_change":"2023-12-07T09:59:55.226077+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226077+0000","last_undegraded":"2023-12-07T09:59:55.226077+0000","last_fullsized":"2023-12-07T09:59:55.226077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225315+0000","last_change":"2023-12-07T09:59:55.225315+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225315+0000","last_undegraded":"2023-12-07T09:59:55.225315+0000","last_fullsized":"2023-12-07T09:59:55.225315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225230+0000","last_change":"2023-12-07T09:59:55.225230+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225230+0000","last_undegraded":"2023-12-07T09:59:55.225230+0000","last_fullsized":"2023-12-07T09:59:55.225230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225351+0000","last_change":"2023-12-07T09:59:55.225351+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225351+0000","last_undegraded":"2023-12-07T09:59:55.225351+0000","last_fullsized":"2023-12-07T09:59:55.225351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224687+0000","last_change":"2023-12-07T09:59:55.224687+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224687+0000","last_undegraded":"2023-12-07T09:59:55.224687+0000","last_fullsized":"2023-12-07T09:59:55.224687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222380+0000","last_change":"2023-12-07T09:59:55.222380+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222380+0000","last_undegraded":"2023-12-07T09:59:55.222380+0000","last_fullsized":"2023-12-07T09:59:55.222380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226290+0000","last_change":"2023-12-07T09:59:55.226290+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226290+0000","last_undegraded":"2023-12-07T09:59:55.226290+0000","last_fullsized":"2023-12-07T09:59:55.226290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224595+0000","last_change":"2023-12-07T09:59:55.224595+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224595+0000","last_undegraded":"2023-12-07T09:59:55.224595+0000","last_fullsized":"2023-12-07T09:59:55.224595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225339+0000","last_change":"2023-12-07T09:59:55.225339+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225339+0000","last_undegraded":"2023-12-07T09:59:55.225339+0000","last_fullsized":"2023-12-07T09:59:55.225339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225433+0000","last_change":"2023-12-07T09:59:55.225433+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225433+0000","last_undegraded":"2023-12-07T09:59:55.225433+0000","last_fullsized":"2023-12-07T09:59:55.225433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225680+0000","last_change":"2023-12-07T09:59:55.225680+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225680+0000","last_undegraded":"2023-12-07T09:59:55.225680+0000","last_fullsized":"2023-12-07T09:59:55.225680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224556+0000","last_change":"2023-12-07T09:59:55.224556+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224556+0000","last_undegraded":"2023-12-07T09:59:55.224556+0000","last_fullsized":"2023-12-07T09:59:55.224556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225560+0000","last_change":"2023-12-07T09:59:55.225560+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225560+0000","last_undegraded":"2023-12-07T09:59:55.225560+0000","last_fullsized":"2023-12-07T09:59:55.225560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226288+0000","last_change":"2023-12-07T09:59:55.226288+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226288+0000","last_undegraded":"2023-12-07T09:59:55.226288+0000","last_fullsized":"2023-12-07T09:59:55.226288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.227654+0000","last_change":"2023-12-07T09:59:55.227654+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.227654+0000","last_undegraded":"2023-12-07T09:59:55.227654+0000","last_fullsized":"2023-12-07T09:59:55.227654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226753+0000","last_change":"2023-12-07T09:59:55.226753+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226753+0000","last_undegraded":"2023-12-07T09:59:55.226753+0000","last_fullsized":"2023-12-07T09:59:55.226753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222327+0000","last_change":"2023-12-07T09:59:55.222327+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222327+0000","last_undegraded":"2023-12-07T09:59:55.222327+0000","last_fullsized":"2023-12-07T09:59:55.222327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.232049+0000","last_change":"2023-12-07T09:59:55.232049+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.232049+0000","last_undegraded":"2023-12-07T09:59:55.232049+0000","last_fullsized":"2023-12-07T09:59:55.232049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.228441+0000","last_change":"2023-12-07T09:59:55.228441+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.228441+0000","last_undegraded":"2023-12-07T09:59:55.228441+0000","last_fullsized":"2023-12-07T09:59:55.228441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226658+0000","last_change":"2023-12-07T09:59:55.226658+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226658+0000","last_undegraded":"2023-12-07T09:59:55.226658+0000","last_fullsized":"2023-12-07T09:59:55.226658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225028+0000","last_change":"2023-12-07T09:59:55.225028+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225028+0000","last_undegraded":"2023-12-07T09:59:55.225028+0000","last_fullsized":"2023-12-07T09:59:55.225028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.221792+0000","last_change":"2023-12-07T09:59:55.221792+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.221792+0000","last_undegraded":"2023-12-07T09:59:55.221792+0000","last_fullsized":"2023-12-07T09:59:55.221792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225400+0000","last_change":"2023-12-07T09:59:55.225400+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225400+0000","last_undegraded":"2023-12-07T09:59:55.225400+0000","last_fullsized":"2023-12-07T09:59:55.225400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.221795+0000","last_change":"2023-12-07T09:59:55.221795+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.221795+0000","last_undegraded":"2023-12-07T09:59:55.221795+0000","last_fullsized":"2023-12-07T09:59:55.221795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224952+0000","last_change":"2023-12-07T09:59:55.224952+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224952+0000","last_undegraded":"2023-12-07T09:59:55.224952+0000","last_fullsized":"2023-12-07T09:59:55.224952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225541+0000","last_change":"2023-12-07T09:59:55.225541+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225541+0000","last_undegraded":"2023-12-07T09:59:55.225541+0000","last_fullsized":"2023-12-07T09:59:55.225541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226288+0000","last_change":"2023-12-07T09:59:55.226288+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226288+0000","last_undegraded":"2023-12-07T09:59:55.226288+0000","last_fullsized":"2023-12-07T09:59:55.226288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231885+0000","last_change":"2023-12-07T09:59:55.231885+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231885+0000","last_undegraded":"2023-12-07T09:59:55.231885+0000","last_fullsized":"2023-12-07T09:59:55.231885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T09:59:50.986932+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:50.986932+0000","last_peered":"2023-12-07T09:59:50.986932+0000","last_clean":"2023-12-07T09:59:50.986932+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:50.986932+0000","last_undegraded":"2023-12-07T09:59:50.986932+0000","last_fullsized":"2023-12-07T09:59:50.986932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:01.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 Processor -- start 2023-12-07T10:00:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 -- start start 2023-12-07T10:00:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faebc0ca610 0x7faebc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faebc06cd90 0x7faebc0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc155790 con 0x7faebc0bd720 2023-12-07T10:00:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faebc0c4b00 con 0x7faebc0ca610 2023-12-07T10:00:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faec25f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faebc0c4de0 con 0x7faebc06cd90 2023-12-07T10:00:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faebc0ca610 0x7faebc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faebc0ca610 0x7faebc0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37932/0 (socket says 172.21.15.89:37932) 2023-12-07T10:00:01.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebb7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7faebc0bd720 0x7faebc158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49746/0 (socket says 172.21.15.89:49746) 2023-12-07T10:00:01.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 -- 172.21.15.89:0/3312059444 learned_addr learned my addr 172.21.15.89:0/3312059444 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:01.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 -- 172.21.15.89:0/3312059444 >> v2:172.21.15.97:3300/0 conn(0x7faebc06cd90 msgr2=0x7faebc0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:01.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 --2- 172.21.15.89:0/3312059444 >> v2:172.21.15.97:3300/0 conn(0x7faebc06cd90 0x7faebc0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 -- 172.21.15.89:0/3312059444 >> v1:172.21.15.89:6789/0 conn(0x7faebc0bd720 legacy=0x7faebc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebbfff640 1 -- 172.21.15.89:0/3312059444 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc157e30 con 0x7faebc0ca610 2023-12-07T10:00:01.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.501+0000 7faebaffd640 1 -- 172.21.15.89:0/3312059444 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619324296 0 0) 0x7faebc155790 con 0x7faebc0bd720 2023-12-07T10:00:01.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faebbfff640 1 --2- 172.21.15.89:0/3312059444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0ca610 0x7faebc0c94c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faebc1547a0 tx=0x7faeac01c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a3cab01c153b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faebaffd640 1 -- 172.21.15.89:0/3312059444 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc0c52d0 con 0x7faebc0ca610 2023-12-07T10:00:01.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faebaffd640 1 -- 172.21.15.89:0/3312059444 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac0a4900 con 0x7faebc0ca610 2023-12-07T10:00:01.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faebaffd640 1 -- 172.21.15.89:0/3312059444 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a4c90 con 0x7faebc0ca610 2023-12-07T10:00:01.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 -- 172.21.15.89:0/3312059444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0ca610 msgr2=0x7faebc0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 --2- 172.21.15.89:0/3312059444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0ca610 0x7faebc0c94c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faebc1547a0 tx=0x7faeac01c0c0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 -- 172.21.15.89:0/3312059444 shutdown_connections 2023-12-07T10:00:01.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 --2- 172.21.15.89:0/3312059444 >> v2:172.21.15.97:3300/0 conn(0x7faebc06cd90 0x7faebc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 --2- 172.21.15.89:0/3312059444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0ca610 0x7faebc0c94c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 -- 172.21.15.89:0/3312059444 >> 172.21.15.89:0/3312059444 conn(0x7faebc071ea0 msgr2=0x7faebc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:01.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 -- 172.21.15.89:0/3312059444 shutdown_connections 2023-12-07T10:00:01.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.505+0000 7faec25f8640 1 -- 172.21.15.89:0/3312059444 wait complete. 2023-12-07T10:00:01.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 Processor -- start 2023-12-07T10:00:01.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- start start 2023-12-07T10:00:01.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faebc06cd90 0x7faebc14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 0x7faebc149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faebc0ca610 0x7faebc14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0aa940 con 0x7faebc0bd720 2023-12-07T10:00:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc14b440 con 0x7faebc06cd90 2023-12-07T10:00:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc148960 con 0x7faebc0ca610 2023-12-07T10:00:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 0x7faebc149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 0x7faebc149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37948/0 (socket says 172.21.15.89:37948) 2023-12-07T10:00:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 -- 172.21.15.89:0/1576785789 learned_addr learned my addr 172.21.15.89:0/1576785789 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebbfff640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faebc06cd90 0x7faebc14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec0b95640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faebc0ca610 0x7faebc14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 -- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faebc0ca610 msgr2=0x7faebc14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faebc0ca610 0x7faebc14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 -- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faebc06cd90 msgr2=0x7faebc14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faebc06cd90 0x7faebc14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 -- 172.21.15.89:0/1576785789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0094d0 con 0x7faebc0bd720 2023-12-07T10:00:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faebb7fe640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 0x7faebc149f50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faeb00011f0 tx=0x7faeb000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00074e0 con 0x7faebc0bd720 2023-12-07T10:00:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb0007640 con 0x7faebc0bd720 2023-12-07T10:00:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004a10 con 0x7faebc0bd720 2023-12-07T10:00:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc1ee8a0 con 0x7faebc0bd720 2023-12-07T10:00:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc1eee60 con 0x7faebc0bd720 2023-12-07T10:00:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.509+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc1ef080 con 0x7faebc0bd720 2023-12-07T10:00:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.513+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faeb0004b70 con 0x7faebc0bd720 2023-12-07T10:00:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.513+0000 7faeb8ff9640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faea80668d0 0x7faea8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.513+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faeb0083660 con 0x7faebc0bd720 2023-12-07T10:00:01.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.513+0000 7faebbfff640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faea80668d0 0x7faea8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.513+0000 7faebbfff640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faea80668d0 0x7faea8068d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faeac0ae000 tx=0x7faeac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.517+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faeb0050940 con 0x7faebc0bd720 2023-12-07T10:00:01.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.665+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faebc04e890 con 0x7faea80668d0 2023-12-07T10:00:01.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faeb8ff9640 1 -- 172.21.15.89:0/1576785789 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252580 (secure 0 0 0) 0x7faebc04e890 con 0x7faea80668d0 2023-12-07T10:00:01.683 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:01.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faea80668d0 msgr2=0x7faea8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faea80668d0 0x7faea8068d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faeac0ae000 tx=0x7faeac008040 comp rx=0 tx=0).stop 2023-12-07T10:00:01.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 msgr2=0x7faebc149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 0x7faebc149f50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faeb00011f0 tx=0x7faeb000c9b0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 shutdown_connections 2023-12-07T10:00:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faea80668d0 0x7faea8068d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faebc0ca610 0x7faebc14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0bd720 0x7faebc149f50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 --2- 172.21.15.89:0/1576785789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faebc06cd90 0x7faebc14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.673+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 >> 172.21.15.89:0/1576785789 conn(0x7faebc071ea0 msgr2=0x7faebc0ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.677+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 shutdown_connections 2023-12-07T10:00:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.677+0000 7faec25f8640 1 -- 172.21.15.89:0/1576785789 wait complete. 2023-12-07T10:00:01.703 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-07T10:00:00.350903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219736,"kb_used_data":3520,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3604480,"data_stored":2063914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.128636"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231884+0000","last_change":"2023-12-07T09:59:55.231884+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231884+0000","last_undegraded":"2023-12-07T09:59:55.231884+0000","last_fullsized":"2023-12-07T09:59:55.231884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222939+0000","last_change":"2023-12-07T09:59:55.222939+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222939+0000","last_undegraded":"2023-12-07T09:59:55.222939+0000","last_fullsized":"2023-12-07T09:59:55.222939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224901+0000","last_change":"2023-12-07T09:59:55.224901+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224901+0000","last_undegraded":"2023-12-07T09:59:55.224901+0000","last_fullsized":"2023-12-07T09:59:55.224901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231968+0000","last_change":"2023-12-07T09:59:55.231968+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231968+0000","last_undegraded":"2023-12-07T09:59:55.231968+0000","last_fullsized":"2023-12-07T09:59:55.231968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226077+0000","last_change":"2023-12-07T09:59:55.226077+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226077+0000","last_undegraded":"2023-12-07T09:59:55.226077+0000","last_fullsized":"2023-12-07T09:59:55.226077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225315+0000","last_change":"2023-12-07T09:59:55.225315+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225315+0000","last_undegraded":"2023-12-07T09:59:55.225315+0000","last_fullsized":"2023-12-07T09:59:55.225315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225230+0000","last_change":"2023-12-07T09:59:55.225230+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225230+0000","last_undegraded":"2023-12-07T09:59:55.225230+0000","last_fullsized":"2023-12-07T09:59:55.225230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225351+0000","last_change":"2023-12-07T09:59:55.225351+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225351+0000","last_undegraded":"2023-12-07T09:59:55.225351+0000","last_fullsized":"2023-12-07T09:59:55.225351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224687+0000","last_change":"2023-12-07T09:59:55.224687+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224687+0000","last_undegraded":"2023-12-07T09:59:55.224687+0000","last_fullsized":"2023-12-07T09:59:55.224687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222380+0000","last_change":"2023-12-07T09:59:55.222380+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222380+0000","last_undegraded":"2023-12-07T09:59:55.222380+0000","last_fullsized":"2023-12-07T09:59:55.222380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226290+0000","last_change":"2023-12-07T09:59:55.226290+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226290+0000","last_undegraded":"2023-12-07T09:59:55.226290+0000","last_fullsized":"2023-12-07T09:59:55.226290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224595+0000","last_change":"2023-12-07T09:59:55.224595+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224595+0000","last_undegraded":"2023-12-07T09:59:55.224595+0000","last_fullsized":"2023-12-07T09:59:55.224595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225339+0000","last_change":"2023-12-07T09:59:55.225339+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225339+0000","last_undegraded":"2023-12-07T09:59:55.225339+0000","last_fullsized":"2023-12-07T09:59:55.225339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225433+0000","last_change":"2023-12-07T09:59:55.225433+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225433+0000","last_undegraded":"2023-12-07T09:59:55.225433+0000","last_fullsized":"2023-12-07T09:59:55.225433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225680+0000","last_change":"2023-12-07T09:59:55.225680+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225680+0000","last_undegraded":"2023-12-07T09:59:55.225680+0000","last_fullsized":"2023-12-07T09:59:55.225680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224556+0000","last_change":"2023-12-07T09:59:55.224556+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224556+0000","last_undegraded":"2023-12-07T09:59:55.224556+0000","last_fullsized":"2023-12-07T09:59:55.224556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225560+0000","last_change":"2023-12-07T09:59:55.225560+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225560+0000","last_undegraded":"2023-12-07T09:59:55.225560+0000","last_fullsized":"2023-12-07T09:59:55.225560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226288+0000","last_change":"2023-12-07T09:59:55.226288+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226288+0000","last_undegraded":"2023-12-07T09:59:55.226288+0000","last_fullsized":"2023-12-07T09:59:55.226288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.227654+0000","last_change":"2023-12-07T09:59:55.227654+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.227654+0000","last_undegraded":"2023-12-07T09:59:55.227654+0000","last_fullsized":"2023-12-07T09:59:55.227654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226753+0000","last_change":"2023-12-07T09:59:55.226753+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226753+0000","last_undegraded":"2023-12-07T09:59:55.226753+0000","last_fullsized":"2023-12-07T09:59:55.226753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222327+0000","last_change":"2023-12-07T09:59:55.222327+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222327+0000","last_undegraded":"2023-12-07T09:59:55.222327+0000","last_fullsized":"2023-12-07T09:59:55.222327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.232049+0000","last_change":"2023-12-07T09:59:55.232049+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.232049+0000","last_undegraded":"2023-12-07T09:59:55.232049+0000","last_fullsized":"2023-12-07T09:59:55.232049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.228441+0000","last_change":"2023-12-07T09:59:55.228441+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.228441+0000","last_undegraded":"2023-12-07T09:59:55.228441+0000","last_fullsized":"2023-12-07T09:59:55.228441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226658+0000","last_change":"2023-12-07T09:59:55.226658+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226658+0000","last_undegraded":"2023-12-07T09:59:55.226658+0000","last_fullsized":"2023-12-07T09:59:55.226658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225028+0000","last_change":"2023-12-07T09:59:55.225028+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225028+0000","last_undegraded":"2023-12-07T09:59:55.225028+0000","last_fullsized":"2023-12-07T09:59:55.225028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.221792+0000","last_change":"2023-12-07T09:59:55.221792+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.221792+0000","last_undegraded":"2023-12-07T09:59:55.221792+0000","last_fullsized":"2023-12-07T09:59:55.221792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225400+0000","last_change":"2023-12-07T09:59:55.225400+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225400+0000","last_undegraded":"2023-12-07T09:59:55.225400+0000","last_fullsized":"2023-12-07T09:59:55.225400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.221795+0000","last_change":"2023-12-07T09:59:55.221795+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.221795+0000","last_undegraded":"2023-12-07T09:59:55.221795+0000","last_fullsized":"2023-12-07T09:59:55.221795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224952+0000","last_change":"2023-12-07T09:59:55.224952+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224952+0000","last_undegraded":"2023-12-07T09:59:55.224952+0000","last_fullsized":"2023-12-07T09:59:55.224952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225541+0000","last_change":"2023-12-07T09:59:55.225541+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225541+0000","last_undegraded":"2023-12-07T09:59:55.225541+0000","last_fullsized":"2023-12-07T09:59:55.225541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226288+0000","last_change":"2023-12-07T09:59:55.226288+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226288+0000","last_undegraded":"2023-12-07T09:59:55.226288+0000","last_fullsized":"2023-12-07T09:59:55.226288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231885+0000","last_change":"2023-12-07T09:59:55.231885+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231885+0000","last_undegraded":"2023-12-07T09:59:55.231885+0000","last_fullsized":"2023-12-07T09:59:55.231885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T09:59:50.986932+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:50.986932+0000","last_peered":"2023-12-07T09:59:50.986932+0000","last_clean":"2023-12-07T09:59:50.986932+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:50.986932+0000","last_undegraded":"2023-12-07T09:59:50.986932+0000","last_fullsized":"2023-12-07T09:59:50.986932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:01.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:01.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.869+0000 7f7fd7e46640 1 Processor -- start 2023-12-07T10:00:01.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.869+0000 7f7fd7e46640 1 -- start start 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd7e46640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd014e9d0 0x7f7fd0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd7e46640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fd0070b80 0x7f7fd00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd7e46640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd006d320 con 0x7f7fd00c1f20 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd7e46640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd00721b0 con 0x7f7fd0070b80 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd7e46640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c2830 con 0x7f7fd014e9d0 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fd0070b80 0x7f7fd00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fd0070b80 0x7f7fd00c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37954/0 (socket says 172.21.15.89:37954) 2023-12-07T10:00:01.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 -- 172.21.15.89:0/3404058166 learned_addr learned my addr 172.21.15.89:0/3404058166 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:01.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd5be2640 1 --2- 172.21.15.89:0/3404058166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd014e9d0 0x7f7fd0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 -- 172.21.15.89:0/3404058166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd014e9d0 msgr2=0x7f7fd0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:01.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 --2- 172.21.15.89:0/3404058166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd014e9d0 0x7f7fd0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 -- 172.21.15.89:0/3404058166 >> v1:172.21.15.89:6789/0 conn(0x7f7fd00c1f20 legacy=0x7f7fd006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.873+0000 7f7fd53e1640 1 -- 172.21.15.89:0/3404058166 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0072450 con 0x7f7fd0070b80 2023-12-07T10:00:01.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd53e1640 1 --2- 172.21.15.89:0/3404058166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd0070b80 0x7f7fd00c19e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db62caa6f8457acc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd4be0640 1 -- 172.21.15.89:0/3404058166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00ab600 con 0x7f7fd0070b80 2023-12-07T10:00:01.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd4be0640 1 -- 172.21.15.89:0/3404058166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc00a7050 con 0x7f7fd0070b80 2023-12-07T10:00:01.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd4be0640 1 -- 172.21.15.89:0/3404058166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00ab980 con 0x7f7fd0070b80 2023-12-07T10:00:01.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 -- 172.21.15.89:0/3404058166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd0070b80 msgr2=0x7f7fd00c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/3404058166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd0070b80 0x7f7fd00c19e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc001c4b0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 -- 172.21.15.89:0/3404058166 shutdown_connections 2023-12-07T10:00:01.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/3404058166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd0070b80 0x7f7fd00c19e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/3404058166 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd014e9d0 0x7f7fd0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 -- 172.21.15.89:0/3404058166 >> 172.21.15.89:0/3404058166 conn(0x7f7fd00c2ad0 msgr2=0x7f7fd00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:01.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 -- 172.21.15.89:0/3404058166 shutdown_connections 2023-12-07T10:00:01.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 -- 172.21.15.89:0/3404058166 wait complete. 2023-12-07T10:00:01.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 Processor -- start 2023-12-07T10:00:01.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.877+0000 7f7fd7e46640 1 -- start start 2023-12-07T10:00:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd0070b80 0x7f7fd00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 0x7f7fd00c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd014e9d0 0x7f7fd00c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c4ae0 con 0x7f7fd00c1f20 2023-12-07T10:00:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0147080 con 0x7f7fd014e9d0 2023-12-07T10:00:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd01f14d0 con 0x7f7fd0070b80 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 0x7f7fd00c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 0x7f7fd00c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37964/0 (socket says 172.21.15.89:37964) 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 -- 172.21.15.89:0/576905628 learned_addr learned my addr 172.21.15.89:0/576905628 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd5be2640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd0070b80 0x7f7fd00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd63e3640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd014e9d0 0x7f7fd00c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 -- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd0070b80 msgr2=0x7f7fd00ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd0070b80 0x7f7fd00ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 -- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd014e9d0 msgr2=0x7f7fd00c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd014e9d0 0x7f7fd00c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 -- 172.21.15.89:0/576905628 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00094d0 con 0x7f7fd00c1f20 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd63e3640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd014e9d0 0x7f7fd00c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd53e1640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 0x7f7fd00c4060 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ae040 tx=0x7f7fc0019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00abe90 con 0x7f7fd00c1f20 2023-12-07T10:00:01.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc00b4420 con 0x7f7fd00c1f20 2023-12-07T10:00:01.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd01f0710 con 0x7f7fd00c1f20 2023-12-07T10:00:01.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00b47d0 con 0x7f7fd00c1f20 2023-12-07T10:00:01.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd01f0cd0 con 0x7f7fd00c1f20 2023-12-07T10:00:01.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd004e890 con 0x7f7fd00c1f20 2023-12-07T10:00:01.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.881+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7fc00b2070 con 0x7f7fd00c1f20 2023-12-07T10:00:01.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.885+0000 7f7fc67fc640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7fb40668d0 0x7f7fb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:01.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.885+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fc011d5a0 con 0x7f7fd00c1f20 2023-12-07T10:00:01.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.885+0000 7f7fd5be2640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7fb40668d0 0x7f7fb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:01.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.885+0000 7f7fd5be2640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7fb40668d0 0x7f7fb4068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00b240 tx=0x7f7fcc00b3a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:01.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:01.885+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fc00ea910 con 0x7f7fd00c1f20 2023-12-07T10:00:01.974 INFO:tasks.ceph.mds.d.smithi097.stderr:2023-12-07T10:00:01.968+0000 7fb410ef2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:00:02.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.037+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fd00a9150 con 0x7f7fb40668d0 2023-12-07T10:00:02.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.041+0000 7f7fc67fc640 1 -- 172.21.15.89:0/576905628 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252580 (secure 0 0 0) 0x7f7fd00a9150 con 0x7f7fb40668d0 2023-12-07T10:00:02.053 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7fb40668d0 msgr2=0x7f7fb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7fb40668d0 0x7f7fb4068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00b240 tx=0x7f7fcc00b3a0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 msgr2=0x7f7fd00c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 0x7f7fd00c4060 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ae040 tx=0x7f7fc0019250 comp rx=0 tx=0).stop 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 shutdown_connections 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd014e9d0 0x7f7fd00c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd00c1f20 0x7f7fd00c4060 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7fb40668d0 0x7f7fb4068d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 --2- 172.21.15.89:0/576905628 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7fd0070b80 0x7f7fd00ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 >> 172.21.15.89:0/576905628 conn(0x7f7fd00c2ad0 msgr2=0x7f7fd014da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 shutdown_connections 2023-12-07T10:00:02.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.045+0000 7f7fd7e46640 1 -- 172.21.15.89:0/576905628 wait complete. 2023-12-07T10:00:02.073 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-07T10:00:00.350903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219736,"kb_used_data":3520,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3604480,"data_stored":2063914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.128636"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231884+0000","last_change":"2023-12-07T09:59:55.231884+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231884+0000","last_undegraded":"2023-12-07T09:59:55.231884+0000","last_fullsized":"2023-12-07T09:59:55.231884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222939+0000","last_change":"2023-12-07T09:59:55.222939+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222939+0000","last_undegraded":"2023-12-07T09:59:55.222939+0000","last_fullsized":"2023-12-07T09:59:55.222939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224901+0000","last_change":"2023-12-07T09:59:55.224901+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224901+0000","last_undegraded":"2023-12-07T09:59:55.224901+0000","last_fullsized":"2023-12-07T09:59:55.224901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231968+0000","last_change":"2023-12-07T09:59:55.231968+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231968+0000","last_undegraded":"2023-12-07T09:59:55.231968+0000","last_fullsized":"2023-12-07T09:59:55.231968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226077+0000","last_change":"2023-12-07T09:59:55.226077+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226077+0000","last_undegraded":"2023-12-07T09:59:55.226077+0000","last_fullsized":"2023-12-07T09:59:55.226077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225315+0000","last_change":"2023-12-07T09:59:55.225315+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225315+0000","last_undegraded":"2023-12-07T09:59:55.225315+0000","last_fullsized":"2023-12-07T09:59:55.225315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225230+0000","last_change":"2023-12-07T09:59:55.225230+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225230+0000","last_undegraded":"2023-12-07T09:59:55.225230+0000","last_fullsized":"2023-12-07T09:59:55.225230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225351+0000","last_change":"2023-12-07T09:59:55.225351+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225351+0000","last_undegraded":"2023-12-07T09:59:55.225351+0000","last_fullsized":"2023-12-07T09:59:55.225351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224687+0000","last_change":"2023-12-07T09:59:55.224687+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224687+0000","last_undegraded":"2023-12-07T09:59:55.224687+0000","last_fullsized":"2023-12-07T09:59:55.224687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222380+0000","last_change":"2023-12-07T09:59:55.222380+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222380+0000","last_undegraded":"2023-12-07T09:59:55.222380+0000","last_fullsized":"2023-12-07T09:59:55.222380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226290+0000","last_change":"2023-12-07T09:59:55.226290+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226290+0000","last_undegraded":"2023-12-07T09:59:55.226290+0000","last_fullsized":"2023-12-07T09:59:55.226290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224595+0000","last_change":"2023-12-07T09:59:55.224595+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224595+0000","last_undegraded":"2023-12-07T09:59:55.224595+0000","last_fullsized":"2023-12-07T09:59:55.224595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225339+0000","last_change":"2023-12-07T09:59:55.225339+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225339+0000","last_undegraded":"2023-12-07T09:59:55.225339+0000","last_fullsized":"2023-12-07T09:59:55.225339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225433+0000","last_change":"2023-12-07T09:59:55.225433+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225433+0000","last_undegraded":"2023-12-07T09:59:55.225433+0000","last_fullsized":"2023-12-07T09:59:55.225433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225680+0000","last_change":"2023-12-07T09:59:55.225680+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225680+0000","last_undegraded":"2023-12-07T09:59:55.225680+0000","last_fullsized":"2023-12-07T09:59:55.225680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224556+0000","last_change":"2023-12-07T09:59:55.224556+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224556+0000","last_undegraded":"2023-12-07T09:59:55.224556+0000","last_fullsized":"2023-12-07T09:59:55.224556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225560+0000","last_change":"2023-12-07T09:59:55.225560+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225560+0000","last_undegraded":"2023-12-07T09:59:55.225560+0000","last_fullsized":"2023-12-07T09:59:55.225560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226288+0000","last_change":"2023-12-07T09:59:55.226288+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226288+0000","last_undegraded":"2023-12-07T09:59:55.226288+0000","last_fullsized":"2023-12-07T09:59:55.226288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.227654+0000","last_change":"2023-12-07T09:59:55.227654+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.227654+0000","last_undegraded":"2023-12-07T09:59:55.227654+0000","last_fullsized":"2023-12-07T09:59:55.227654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226753+0000","last_change":"2023-12-07T09:59:55.226753+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226753+0000","last_undegraded":"2023-12-07T09:59:55.226753+0000","last_fullsized":"2023-12-07T09:59:55.226753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.222327+0000","last_change":"2023-12-07T09:59:55.222327+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.222327+0000","last_undegraded":"2023-12-07T09:59:55.222327+0000","last_fullsized":"2023-12-07T09:59:55.222327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.232049+0000","last_change":"2023-12-07T09:59:55.232049+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.232049+0000","last_undegraded":"2023-12-07T09:59:55.232049+0000","last_fullsized":"2023-12-07T09:59:55.232049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.228441+0000","last_change":"2023-12-07T09:59:55.228441+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.228441+0000","last_undegraded":"2023-12-07T09:59:55.228441+0000","last_fullsized":"2023-12-07T09:59:55.228441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226658+0000","last_change":"2023-12-07T09:59:55.226658+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226658+0000","last_undegraded":"2023-12-07T09:59:55.226658+0000","last_fullsized":"2023-12-07T09:59:55.226658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225028+0000","last_change":"2023-12-07T09:59:55.225028+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225028+0000","last_undegraded":"2023-12-07T09:59:55.225028+0000","last_fullsized":"2023-12-07T09:59:55.225028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.221792+0000","last_change":"2023-12-07T09:59:55.221792+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.221792+0000","last_undegraded":"2023-12-07T09:59:55.221792+0000","last_fullsized":"2023-12-07T09:59:55.221792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225400+0000","last_change":"2023-12-07T09:59:55.225400+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225400+0000","last_undegraded":"2023-12-07T09:59:55.225400+0000","last_fullsized":"2023-12-07T09:59:55.225400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.221795+0000","last_change":"2023-12-07T09:59:55.221795+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.221795+0000","last_undegraded":"2023-12-07T09:59:55.221795+0000","last_fullsized":"2023-12-07T09:59:55.221795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.224952+0000","last_change":"2023-12-07T09:59:55.224952+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.224952+0000","last_undegraded":"2023-12-07T09:59:55.224952+0000","last_fullsized":"2023-12-07T09:59:55.224952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.225541+0000","last_change":"2023-12-07T09:59:55.225541+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.225541+0000","last_undegraded":"2023-12-07T09:59:55.225541+0000","last_fullsized":"2023-12-07T09:59:55.225541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.226288+0000","last_change":"2023-12-07T09:59:55.226288+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.226288+0000","last_undegraded":"2023-12-07T09:59:55.226288+0000","last_fullsized":"2023-12-07T09:59:55.226288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T09:59:56.217507+0000","last_change":"2023-12-07T09:59:56.217507+0000","last_active":"2023-12-07T09:59:56.217507+0000","last_peered":"2023-12-07T09:59:56.217507+0000","last_clean":"2023-12-07T09:59:56.217507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:56.217507+0000","last_undegraded":"2023-12-07T09:59:56.217507+0000","last_fullsized":"2023-12-07T09:59:56.217507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-07T09:59:55.231885+0000","last_change":"2023-12-07T09:59:55.231885+0000","last_active":"2023-12-07T09:59:55.210586+0000","last_peered":"2023-12-07T09:59:55.210586+0000","last_clean":"2023-12-07T09:59:55.210586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T09:59:55.231885+0000","last_undegraded":"2023-12-07T09:59:55.231885+0000","last_fullsized":"2023-12-07T09:59:55.231885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T09:59:50.986932+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:50.986932+0000","last_peered":"2023-12-07T09:59:50.986932+0000","last_clean":"2023-12-07T09:59:50.986932+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:50.986932+0000","last_undegraded":"2023-12-07T09:59:50.986932+0000","last_fullsized":"2023-12-07T09:59:50.986932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-07T10:00:02.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-07T10:00:02.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-07T10:00:02.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-07T10:00:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-12-07T10:00:02.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.231884+0000', 'last_change': '2023-12-07T09:59:55.231884+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.231884+0000', 'last_undegraded': '2023-12-07T09:59:55.231884+0000', 'last_fullsized': '2023-12-07T09:59:55.231884+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.222939+0000', 'last_change': '2023-12-07T09:59:55.222939+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.222939+0000', 'last_undegraded': '2023-12-07T09:59:55.222939+0000', 'last_fullsized': '2023-12-07T09:59:55.222939+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.224901+0000', 'last_change': '2023-12-07T09:59:55.224901+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.224901+0000', 'last_undegraded': '2023-12-07T09:59:55.224901+0000', 'last_fullsized': '2023-12-07T09:59:55.224901+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-12-07T10:00:02.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.231968+0000', 'last_change': '2023-12-07T09:59:55.231968+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.231968+0000', 'last_undegraded': '2023-12-07T09:59:55.231968+0000', 'last_fullsized': '2023-12-07T09:59:55.231968+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.226077+0000', 'last_change': '2023-12-07T09:59:55.226077+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.226077+0000', 'last_undegraded': '2023-12-07T09:59:55.226077+0000', 'last_fullsized': '2023-12-07T09:59:55.226077+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225315+0000', 'last_change': '2023-12-07T09:59:55.225315+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225315+0000', 'last_undegraded': '2023-12-07T09:59:55.225315+0000', 'last_fullsized': '2023-12-07T09:59:55.225315+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225230+0000', 'last_change': '2023-12-07T09:59:55.225230+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225230+0000', 'last_undegraded': '2023-12-07T09:59:55.225230+0000', 'last_fullsized': '2023-12-07T09:59:55.225230+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225351+0000', 'last_change': '2023-12-07T09:59:55.225351+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225351+0000', 'last_undegraded': '2023-12-07T09:59:55.225351+0000', 'last_fullsized': '2023-12-07T09:59:55.225351+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.224687+0000', 'last_change': '2023-12-07T09:59:55.224687+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.224687+0000', 'last_undegraded': '2023-12-07T09:59:55.224687+0000', 'last_fullsized': '2023-12-07T09:59:55.224687+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.222380+0000', 'last_change': '2023-12-07T09:59:55.222380+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.222380+0000', 'last_undegraded': '2023-12-07T09:59:55.222380+0000', 'last_fullsized': '2023-12-07T09:59:55.222380+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.226290+0000', 'last_change': '2023-12-07T09:59:55.226290+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.226290+0000', 'last_undegraded': '2023-12-07T09:59:55.226290+0000', 'last_fullsized': '2023-12-07T09:59:55.226290+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.224595+0000', 'last_change': '2023-12-07T09:59:55.224595+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.224595+0000', 'last_undegraded': '2023-12-07T09:59:55.224595+0000', 'last_fullsized': '2023-12-07T09:59:55.224595+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-07T10:00:02.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225339+0000', 'last_change': '2023-12-07T09:59:55.225339+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225339+0000', 'last_undegraded': '2023-12-07T09:59:55.225339+0000', 'last_fullsized': '2023-12-07T09:59:55.225339+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225433+0000', 'last_change': '2023-12-07T09:59:55.225433+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225433+0000', 'last_undegraded': '2023-12-07T09:59:55.225433+0000', 'last_fullsized': '2023-12-07T09:59:55.225433+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225680+0000', 'last_change': '2023-12-07T09:59:55.225680+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225680+0000', 'last_undegraded': '2023-12-07T09:59:55.225680+0000', 'last_fullsized': '2023-12-07T09:59:55.225680+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-07T10:00:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.224556+0000', 'last_change': '2023-12-07T09:59:55.224556+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.224556+0000', 'last_undegraded': '2023-12-07T09:59:55.224556+0000', 'last_fullsized': '2023-12-07T09:59:55.224556+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225560+0000', 'last_change': '2023-12-07T09:59:55.225560+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225560+0000', 'last_undegraded': '2023-12-07T09:59:55.225560+0000', 'last_fullsized': '2023-12-07T09:59:55.225560+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.226288+0000', 'last_change': '2023-12-07T09:59:55.226288+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.226288+0000', 'last_undegraded': '2023-12-07T09:59:55.226288+0000', 'last_fullsized': '2023-12-07T09:59:55.226288+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-07T10:00:02.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.227654+0000', 'last_change': '2023-12-07T09:59:55.227654+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.227654+0000', 'last_undegraded': '2023-12-07T09:59:55.227654+0000', 'last_fullsized': '2023-12-07T09:59:55.227654+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.226753+0000', 'last_change': '2023-12-07T09:59:55.226753+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.226753+0000', 'last_undegraded': '2023-12-07T09:59:55.226753+0000', 'last_fullsized': '2023-12-07T09:59:55.226753+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.222327+0000', 'last_change': '2023-12-07T09:59:55.222327+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.222327+0000', 'last_undegraded': '2023-12-07T09:59:55.222327+0000', 'last_fullsized': '2023-12-07T09:59:55.222327+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-07T10:00:02.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.232049+0000', 'last_change': '2023-12-07T09:59:55.232049+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.232049+0000', 'last_undegraded': '2023-12-07T09:59:55.232049+0000', 'last_fullsized': '2023-12-07T09:59:55.232049+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.228441+0000', 'last_change': '2023-12-07T09:59:55.228441+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.228441+0000', 'last_undegraded': '2023-12-07T09:59:55.228441+0000', 'last_fullsized': '2023-12-07T09:59:55.228441+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.226658+0000', 'last_change': '2023-12-07T09:59:55.226658+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.226658+0000', 'last_undegraded': '2023-12-07T09:59:55.226658+0000', 'last_fullsized': '2023-12-07T09:59:55.226658+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:00:02.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225028+0000', 'last_change': '2023-12-07T09:59:55.225028+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225028+0000', 'last_undegraded': '2023-12-07T09:59:55.225028+0000', 'last_fullsized': '2023-12-07T09:59:55.225028+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.221792+0000', 'last_change': '2023-12-07T09:59:55.221792+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.221792+0000', 'last_undegraded': '2023-12-07T09:59:55.221792+0000', 'last_fullsized': '2023-12-07T09:59:55.221792+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225400+0000', 'last_change': '2023-12-07T09:59:55.225400+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225400+0000', 'last_undegraded': '2023-12-07T09:59:55.225400+0000', 'last_fullsized': '2023-12-07T09:59:55.225400+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:00:02.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.221795+0000', 'last_change': '2023-12-07T09:59:55.221795+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.221795+0000', 'last_undegraded': '2023-12-07T09:59:55.221795+0000', 'last_fullsized': '2023-12-07T09:59:55.221795+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.224952+0000', 'last_change': '2023-12-07T09:59:55.224952+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.224952+0000', 'last_undegraded': '2023-12-07T09:59:55.224952+0000', 'last_fullsized': '2023-12-07T09:59:55.224952+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-07T10:00:02.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.225541+0000', 'last_change': '2023-12-07T09:59:55.225541+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.225541+0000', 'last_undegraded': '2023-12-07T09:59:55.225541+0000', 'last_fullsized': '2023-12-07T09:59:55.225541+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.226288+0000', 'last_change': '2023-12-07T09:59:55.226288+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.226288+0000', 'last_undegraded': '2023-12-07T09:59:55.226288+0000', 'last_fullsized': '2023-12-07T09:59:55.226288+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T09:59:56.217507+0000', 'last_change': '2023-12-07T09:59:56.217507+0000', 'last_active': '2023-12-07T09:59:56.217507+0000', 'last_peered': '2023-12-07T09:59:56.217507+0000', 'last_clean': '2023-12-07T09:59:56.217507+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:56.217507+0000', 'last_undegraded': '2023-12-07T09:59:56.217507+0000', 'last_fullsized': '2023-12-07T09:59:56.217507+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:56.217507+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-12-07T10:00:02.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-07T09:59:55.231885+0000', 'last_change': '2023-12-07T09:59:55.231885+0000', 'last_active': '2023-12-07T09:59:55.210586+0000', 'last_peered': '2023-12-07T09:59:55.210586+0000', 'last_clean': '2023-12-07T09:59:55.210586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T09:59:55.231885+0000', 'last_undegraded': '2023-12-07T09:59:55.231885+0000', 'last_fullsized': '2023-12-07T09:59:55.231885+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'last_clean_scrub_stamp': '2023-12-07T09:59:55.210586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:00:02.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-07T10:00:02.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 Processor -- start 2023-12-07T10:00:02.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 -- start start 2023-12-07T10:00:02.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff6e414ea60 0x7ff6e4155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e406bd00 0x7ff6e40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e406c440 con 0x7ff6e40bf400 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e4154790 con 0x7ff6e414ea60 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6ea079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e406c6e0 con 0x7ff6e406bd00 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff6e40bf400 0x7ff6e40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49770/0 (socket says 172.21.15.89:49770) 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e3fff640 1 -- 172.21.15.89:0/2774474107 learned_addr learned my addr 172.21.15.89:0/2774474107 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e37fe640 1 --2- 172.21.15.89:0/2774474107 >> v2:172.21.15.97:3300/0 conn(0x7ff6e414ea60 0x7ff6e4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e2ffd640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e406bd00 0x7ff6e40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e27fc640 1 -- 172.21.15.89:0/2774474107 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402140553 0 0) 0x7ff6e406c440 con 0x7ff6e40bf400 2023-12-07T10:00:02.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e27fc640 1 -- 172.21.15.89:0/2774474107 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc003530 con 0x7ff6e40bf400 2023-12-07T10:00:02.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e37fe640 1 -- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e406bd00 msgr2=0x7ff6e40700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:02.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e37fe640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e406bd00 0x7ff6e40700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e37fe640 1 -- 172.21.15.89:0/2774474107 >> v1:172.21.15.89:6789/0 conn(0x7ff6e40bf400 legacy=0x7ff6e40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e37fe640 1 -- 172.21.15.89:0/2774474107 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4154a50 con 0x7ff6e414ea60 2023-12-07T10:00:02.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.249+0000 7ff6e2ffd640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e406bd00 0x7ff6e40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:02.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6e37fe640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e414ea60 0x7ff6e4155250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097c0 tx=0x7ff6d401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6855a210fab13f2e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:02.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6e27fc640 1 -- 172.21.15.89:0/2774474107 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40ac640 con 0x7ff6e414ea60 2023-12-07T10:00:02.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6e27fc640 1 -- 172.21.15.89:0/2774474107 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d40ac7a0 con 0x7ff6e414ea60 2023-12-07T10:00:02.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6e27fc640 1 -- 172.21.15.89:0/2774474107 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40acb30 con 0x7ff6e414ea60 2023-12-07T10:00:02.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 -- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e414ea60 msgr2=0x7ff6e4155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e414ea60 0x7ff6e4155250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097c0 tx=0x7ff6d401c330 comp rx=0 tx=0).stop 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 -- 172.21.15.89:0/2774474107 shutdown_connections 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e406bd00 0x7ff6e40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 --2- 172.21.15.89:0/2774474107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e414ea60 0x7ff6e4155250 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 -- 172.21.15.89:0/2774474107 >> 172.21.15.89:0/2774474107 conn(0x7ff6e40c2ad0 msgr2=0x7ff6e40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 -- 172.21.15.89:0/2774474107 shutdown_connections 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.253+0000 7ff6ea079640 1 -- 172.21.15.89:0/2774474107 wait complete. 2023-12-07T10:00:02.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 Processor -- start 2023-12-07T10:00:02.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 -- start start 2023-12-07T10:00:02.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e406bd00 0x7ff6e4140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 0x7ff6e4141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e414ea60 0x7ff6e4137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40c3f60 con 0x7ff6e40bf400 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e413c050 con 0x7ff6e406bd00 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e413d530 con 0x7ff6e414ea60 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 0x7ff6e4141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 0x7ff6e4141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37968/0 (socket says 172.21.15.89:37968) 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 -- 172.21.15.89:0/131816342 learned_addr learned my addr 172.21.15.89:0/131816342 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e37fe640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e406bd00 0x7ff6e4140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e3fff640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e414ea60 0x7ff6e4137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 -- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e414ea60 msgr2=0x7ff6e4137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e414ea60 0x7ff6e4137be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 -- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e406bd00 msgr2=0x7ff6e4140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e406bd00 0x7ff6e4140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 -- 172.21.15.89:0/131816342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8009420 con 0x7ff6e40bf400 2023-12-07T10:00:02.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6e2ffd640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 0x7ff6e4141120 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800ebe0 tx=0x7ff6d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800eee0 con 0x7ff6e40bf400 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800cc30 con 0x7ff6e40bf400 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d4009420 con 0x7ff6e40bf400 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8013470 con 0x7ff6e40bf400 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.257+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e413d7c0 con 0x7ff6e40bf400 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.261+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e404e890 con 0x7ff6e40bf400 2023-12-07T10:00:02.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.261+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff6d80135d0 con 0x7ff6e40bf400 2023-12-07T10:00:02.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.261+0000 7ff6cbfff640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff6d00668d0 0x7ff6d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.261+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6d80846a0 con 0x7ff6e40bf400 2023-12-07T10:00:02.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.261+0000 7ff6e37fe640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff6d00668d0 0x7ff6d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.261+0000 7ff6e37fe640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff6d00668d0 0x7ff6d0068d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40ae000 tx=0x7ff6d40a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:02.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.265+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6d8051980 con 0x7ff6e40bf400 2023-12-07T10:00:02.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.469+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff6e41eca50 con 0x7ff6e40bf400 2023-12-07T10:00:02.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6cbfff640 1 -- 172.21.15.89:0/131816342 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2720 (secure 0 0 0) 0x7ff6d8017ab0 con 0x7ff6e40bf400 2023-12-07T10:00:02.480 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:02.480 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1701943139,"num_in_osds":8,"osd_in_since":1701943129,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225009664,"bytes_avail":772869103616,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5052}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-12-07T09:59:54.349943+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-07T10:00:02.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff6d00668d0 msgr2=0x7ff6d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff6d00668d0 0x7ff6d0068d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40ae000 tx=0x7ff6d40a6070 comp rx=0 tx=0).stop 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 msgr2=0x7ff6e4141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 0x7ff6e4141120 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800ebe0 tx=0x7ff6d800c520 comp rx=0 tx=0).stop 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 shutdown_connections 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff6d00668d0 0x7ff6d0068d90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff6e414ea60 0x7ff6e4137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6e40bf400 0x7ff6e4141120 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 --2- 172.21.15.89:0/131816342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff6e406bd00 0x7ff6e4140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 >> 172.21.15.89:0/131816342 conn(0x7ff6e40c2ad0 msgr2=0x7ff6e4153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 shutdown_connections 2023-12-07T10:00:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.473+0000 7ff6ea079640 1 -- 172.21.15.89:0/131816342 wait complete. 2023-12-07T10:00:02.501 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-07T10:00:02.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:02.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.629+0000 7f347d446640 1 Processor -- start 2023-12-07T10:00:02.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.629+0000 7f347d446640 1 -- start start 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f347d446640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34780c65d0 0x7f34781601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f347d446640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34780c5a30 con 0x7f34780c49e0 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f347d446640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34781522c0 con 0x7f3478151ee0 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f347d446640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347806bc70 con 0x7f34780c65d0 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34777fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34780c65d0 0x7f34781601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34777fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34780c65d0 0x7f34781601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37972/0 (socket says 172.21.15.89:37972) 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f346e7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f34780c49e0 0x7f34780c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49786/0 (socket says 172.21.15.89:49786) 2023-12-07T10:00:02.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34777fe640 1 -- 172.21.15.89:0/591910366 learned_addr learned my addr 172.21.15.89:0/591910366 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34777fe640 1 -- 172.21.15.89:0/591910366 >> v1:172.21.15.97:6789/0 conn(0x7f3478151ee0 legacy=0x7f347806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34777fe640 1 -- 172.21.15.89:0/591910366 >> v1:172.21.15.89:6789/0 conn(0x7f34780c49e0 legacy=0x7f34780c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34777fe640 1 -- 172.21.15.89:0/591910366 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478155490 con 0x7f34780c65d0 2023-12-07T10:00:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.633+0000 7f34767fc640 1 -- 172.21.15.89:0/591910366 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413932288 0 0) 0x7f34780c5a30 con 0x7f34780c49e0 2023-12-07T10:00:02.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f34777fe640 1 --2- 172.21.15.89:0/591910366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781601e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3470009870 tx=0x7f347001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239ac7737ece69b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:02.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f34767fc640 1 -- 172.21.15.89:0/591910366 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700ab610 con 0x7f34780c65d0 2023-12-07T10:00:02.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f34767fc640 1 -- 172.21.15.89:0/591910366 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34700ab770 con 0x7f34780c65d0 2023-12-07T10:00:02.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f34767fc640 1 -- 172.21.15.89:0/591910366 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700abb00 con 0x7f34780c65d0 2023-12-07T10:00:02.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 -- 172.21.15.89:0/591910366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 msgr2=0x7f34781601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 --2- 172.21.15.89:0/591910366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781601e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3470009870 tx=0x7f347001c480 comp rx=0 tx=0).stop 2023-12-07T10:00:02.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 -- 172.21.15.89:0/591910366 shutdown_connections 2023-12-07T10:00:02.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 --2- 172.21.15.89:0/591910366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781601e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 -- 172.21.15.89:0/591910366 >> 172.21.15.89:0/591910366 conn(0x7f34780ca060 msgr2=0x7f34780ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:02.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 -- 172.21.15.89:0/591910366 shutdown_connections 2023-12-07T10:00:02.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 -- 172.21.15.89:0/591910366 wait complete. 2023-12-07T10:00:02.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 Processor -- start 2023-12-07T10:00:02.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.637+0000 7f347d446640 1 -- start start 2023-12-07T10:00:02.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34780c49e0 0x7f34780c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3478151ee0 0x7f34781447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478158200 con 0x7f34780c65d0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34780c1820 con 0x7f3478151ee0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34781ed8c0 con 0x7f34780c49e0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37986/0 (socket says 172.21.15.89:37986) 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 -- 172.21.15.89:0/628874596 learned_addr learned my addr 172.21.15.89:0/628874596 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f34777fe640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3478151ee0 0x7f34781447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f3476ffd640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34780c49e0 0x7f34780c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 -- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34780c49e0 msgr2=0x7f34780c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34780c49e0 0x7f34780c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 -- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3478151ee0 msgr2=0x7f34781447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3478151ee0 0x7f34781447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 -- 172.21.15.89:0/628874596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700094d0 con 0x7f34780c65d0 2023-12-07T10:00:02.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f34777fe640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3478151ee0 0x7f34781447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f3476ffd640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34780c49e0 0x7f34780c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346e7fc640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781442a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f346000c440 tx=0x7f346000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600074e0 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460007640 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34781edba0 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460004a10 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34780c14b0 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347804e890 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.641+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3460004b70 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.645+0000 7f346ffff640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3458066900 0x7f3458068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.645+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34600837e0 con 0x7f34780c65d0 2023-12-07T10:00:02.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.645+0000 7f3476ffd640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3458066900 0x7f3458068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:02.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.645+0000 7f3476ffd640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3458066900 0x7f3458068dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3468007fd0 tx=0x7f3468009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:02.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.649+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3460050ab0 con 0x7f34780c65d0 2023-12-07T10:00:02.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.793+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34780c50d0 con 0x7f3458066900 2023-12-07T10:00:02.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.801+0000 7f346ffff640 1 -- 172.21.15.89:0/628874596 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267813 (secure 0 0 0) 0x7f34680039a0 con 0x7f3458066900 2023-12-07T10:00:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:02.815 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:02.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3458066900 msgr2=0x7f3458068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3458066900 0x7f3458068dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3468007fd0 tx=0x7f3468009040 comp rx=0 tx=0).stop 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 msgr2=0x7f34781442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781442a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f346000c440 tx=0x7f346000c900 comp rx=0 tx=0).stop 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 shutdown_connections 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3478151ee0 0x7f34781447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34780c65d0 0x7f34781442a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3458066900 0x7f3458068dc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 --2- 172.21.15.89:0/628874596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34780c49e0 0x7f34780c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 >> 172.21.15.89:0/628874596 conn(0x7f34780ca060 msgr2=0x7f34780c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 shutdown_connections 2023-12-07T10:00:02.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:02.805+0000 7f347d446640 1 -- 172.21.15.89:0/628874596 wait complete. 2023-12-07T10:00:02.834 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-07T10:00:02.351272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220124,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":4038656,"data_stored":2258372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.128735"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224056+0000","last_change":"2023-12-07T09:59:57.243490+0000","last_active":"2023-12-07T09:59:58.224056+0000","last_peered":"2023-12-07T09:59:58.224056+0000","last_clean":"2023-12-07T09:59:58.224056+0000","last_became_active":"2023-12-07T09:59:57.242850+0000","last_became_peered":"2023-12-07T09:59:57.242850+0000","last_unstale":"2023-12-07T09:59:58.224056+0000","last_undegraded":"2023-12-07T09:59:58.224056+0000","last_fullsized":"2023-12-07T09:59:58.224056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225365+0000","last_change":"2023-12-07T09:59:57.229817+0000","last_active":"2023-12-07T09:59:58.225365+0000","last_peered":"2023-12-07T09:59:58.225365+0000","last_clean":"2023-12-07T09:59:58.225365+0000","last_became_active":"2023-12-07T09:59:57.229526+0000","last_became_peered":"2023-12-07T09:59:57.229526+0000","last_unstale":"2023-12-07T09:59:58.225365+0000","last_undegraded":"2023-12-07T09:59:58.225365+0000","last_fullsized":"2023-12-07T09:59:58.225365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:15:58.859354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214123+0000","last_change":"2023-12-07T09:59:57.238691+0000","last_active":"2023-12-07T09:59:58.214123+0000","last_peered":"2023-12-07T09:59:58.214123+0000","last_clean":"2023-12-07T09:59:58.214123+0000","last_became_active":"2023-12-07T09:59:57.238414+0000","last_became_peered":"2023-12-07T09:59:57.238414+0000","last_unstale":"2023-12-07T09:59:58.214123+0000","last_undegraded":"2023-12-07T09:59:58.214123+0000","last_fullsized":"2023-12-07T09:59:58.214123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223569+0000","last_change":"2023-12-07T09:59:57.243320+0000","last_active":"2023-12-07T09:59:58.223569+0000","last_peered":"2023-12-07T09:59:58.223569+0000","last_clean":"2023-12-07T09:59:58.223569+0000","last_became_active":"2023-12-07T09:59:57.243117+0000","last_became_peered":"2023-12-07T09:59:57.243117+0000","last_unstale":"2023-12-07T09:59:58.223569+0000","last_undegraded":"2023-12-07T09:59:58.223569+0000","last_fullsized":"2023-12-07T09:59:58.223569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224910+0000","last_change":"2023-12-07T09:59:57.236855+0000","last_active":"2023-12-07T09:59:58.224910+0000","last_peered":"2023-12-07T09:59:58.224910+0000","last_clean":"2023-12-07T09:59:58.224910+0000","last_became_active":"2023-12-07T09:59:57.236380+0000","last_became_peered":"2023-12-07T09:59:57.236380+0000","last_unstale":"2023-12-07T09:59:58.224910+0000","last_undegraded":"2023-12-07T09:59:58.224910+0000","last_fullsized":"2023-12-07T09:59:58.224910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:18:14.300474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224869+0000","last_change":"2023-12-07T09:59:57.233976+0000","last_active":"2023-12-07T09:59:58.224869+0000","last_peered":"2023-12-07T09:59:58.224869+0000","last_clean":"2023-12-07T09:59:58.224869+0000","last_became_active":"2023-12-07T09:59:57.233707+0000","last_became_peered":"2023-12-07T09:59:57.233707+0000","last_unstale":"2023-12-07T09:59:58.224869+0000","last_undegraded":"2023-12-07T09:59:58.224869+0000","last_fullsized":"2023-12-07T09:59:58.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215102+0000","last_change":"2023-12-07T09:59:57.246474+0000","last_active":"2023-12-07T09:59:58.215102+0000","last_peered":"2023-12-07T09:59:58.215102+0000","last_clean":"2023-12-07T09:59:58.215102+0000","last_became_active":"2023-12-07T09:59:57.246185+0000","last_became_peered":"2023-12-07T09:59:57.246185+0000","last_unstale":"2023-12-07T09:59:58.215102+0000","last_undegraded":"2023-12-07T09:59:58.215102+0000","last_fullsized":"2023-12-07T09:59:58.215102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214578+0000","last_change":"2023-12-07T09:59:57.230825+0000","last_active":"2023-12-07T09:59:58.214578+0000","last_peered":"2023-12-07T09:59:58.214578+0000","last_clean":"2023-12-07T09:59:58.214578+0000","last_became_active":"2023-12-07T09:59:57.230278+0000","last_became_peered":"2023-12-07T09:59:57.230278+0000","last_unstale":"2023-12-07T09:59:58.214578+0000","last_undegraded":"2023-12-07T09:59:58.214578+0000","last_fullsized":"2023-12-07T09:59:58.214578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.217200+0000","last_change":"2023-12-07T09:59:57.238932+0000","last_active":"2023-12-07T09:59:58.217200+0000","last_peered":"2023-12-07T09:59:58.217200+0000","last_clean":"2023-12-07T09:59:58.217200+0000","last_became_active":"2023-12-07T09:59:57.238605+0000","last_became_peered":"2023-12-07T09:59:57.238605+0000","last_unstale":"2023-12-07T09:59:58.217200+0000","last_undegraded":"2023-12-07T09:59:58.217200+0000","last_fullsized":"2023-12-07T09:59:58.217200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224031+0000","last_change":"2023-12-07T09:59:57.236999+0000","last_active":"2023-12-07T09:59:58.224031+0000","last_peered":"2023-12-07T09:59:58.224031+0000","last_clean":"2023-12-07T09:59:58.224031+0000","last_became_active":"2023-12-07T09:59:57.236732+0000","last_became_peered":"2023-12-07T09:59:57.236732+0000","last_unstale":"2023-12-07T09:59:58.224031+0000","last_undegraded":"2023-12-07T09:59:58.224031+0000","last_fullsized":"2023-12-07T09:59:58.224031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215270+0000","last_change":"2023-12-07T09:59:57.242828+0000","last_active":"2023-12-07T09:59:58.215270+0000","last_peered":"2023-12-07T09:59:58.215270+0000","last_clean":"2023-12-07T09:59:58.215270+0000","last_became_active":"2023-12-07T09:59:57.242554+0000","last_became_peered":"2023-12-07T09:59:57.242554+0000","last_unstale":"2023-12-07T09:59:58.215270+0000","last_undegraded":"2023-12-07T09:59:58.215270+0000","last_fullsized":"2023-12-07T09:59:58.215270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214623+0000","last_change":"2023-12-07T09:59:57.227453+0000","last_active":"2023-12-07T09:59:58.214623+0000","last_peered":"2023-12-07T09:59:58.214623+0000","last_clean":"2023-12-07T09:59:58.214623+0000","last_became_active":"2023-12-07T09:59:57.226914+0000","last_became_peered":"2023-12-07T09:59:57.226914+0000","last_unstale":"2023-12-07T09:59:58.214623+0000","last_undegraded":"2023-12-07T09:59:58.214623+0000","last_fullsized":"2023-12-07T09:59:58.214623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225070+0000","last_change":"2023-12-07T09:59:57.241629+0000","last_active":"2023-12-07T09:59:58.225070+0000","last_peered":"2023-12-07T09:59:58.225070+0000","last_clean":"2023-12-07T09:59:58.225070+0000","last_became_active":"2023-12-07T09:59:57.238255+0000","last_became_peered":"2023-12-07T09:59:57.238255+0000","last_unstale":"2023-12-07T09:59:58.225070+0000","last_undegraded":"2023-12-07T09:59:58.225070+0000","last_fullsized":"2023-12-07T09:59:58.225070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:23:31.673878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224993+0000","last_change":"2023-12-07T09:59:57.227431+0000","last_active":"2023-12-07T09:59:58.224993+0000","last_peered":"2023-12-07T09:59:58.224993+0000","last_clean":"2023-12-07T09:59:58.224993+0000","last_became_active":"2023-12-07T09:59:57.226781+0000","last_became_peered":"2023-12-07T09:59:57.226781+0000","last_unstale":"2023-12-07T09:59:58.224993+0000","last_undegraded":"2023-12-07T09:59:58.224993+0000","last_fullsized":"2023-12-07T09:59:58.224993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.213694+0000","last_change":"2023-12-07T09:59:57.242046+0000","last_active":"2023-12-07T09:59:58.213694+0000","last_peered":"2023-12-07T09:59:58.213694+0000","last_clean":"2023-12-07T09:59:58.213694+0000","last_became_active":"2023-12-07T09:59:57.241392+0000","last_became_peered":"2023-12-07T09:59:57.241392+0000","last_unstale":"2023-12-07T09:59:58.213694+0000","last_undegraded":"2023-12-07T09:59:58.213694+0000","last_fullsized":"2023-12-07T09:59:58.213694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215096+0000","last_change":"2023-12-07T09:59:57.238463+0000","last_active":"2023-12-07T09:59:58.215096+0000","last_peered":"2023-12-07T09:59:58.215096+0000","last_clean":"2023-12-07T09:59:58.215096+0000","last_became_active":"2023-12-07T09:59:57.238172+0000","last_became_peered":"2023-12-07T09:59:57.238172+0000","last_unstale":"2023-12-07T09:59:58.215096+0000","last_undegraded":"2023-12-07T09:59:58.215096+0000","last_fullsized":"2023-12-07T09:59:58.215096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215286+0000","last_change":"2023-12-07T09:59:57.245997+0000","last_active":"2023-12-07T09:59:58.215286+0000","last_peered":"2023-12-07T09:59:58.215286+0000","last_clean":"2023-12-07T09:59:58.215286+0000","last_became_active":"2023-12-07T09:59:57.244225+0000","last_became_peered":"2023-12-07T09:59:57.244225+0000","last_unstale":"2023-12-07T09:59:58.215286+0000","last_undegraded":"2023-12-07T09:59:58.215286+0000","last_fullsized":"2023-12-07T09:59:58.215286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225527+0000","last_change":"2023-12-07T09:59:57.239271+0000","last_active":"2023-12-07T09:59:58.225527+0000","last_peered":"2023-12-07T09:59:58.225527+0000","last_clean":"2023-12-07T09:59:58.225527+0000","last_became_active":"2023-12-07T09:59:57.238981+0000","last_became_peered":"2023-12-07T09:59:57.238981+0000","last_unstale":"2023-12-07T09:59:58.225527+0000","last_undegraded":"2023-12-07T09:59:58.225527+0000","last_fullsized":"2023-12-07T09:59:58.225527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:36:48.300066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225018+0000","last_change":"2023-12-07T09:59:57.237336+0000","last_active":"2023-12-07T09:59:58.225018+0000","last_peered":"2023-12-07T09:59:58.225018+0000","last_clean":"2023-12-07T09:59:58.225018+0000","last_became_active":"2023-12-07T09:59:57.237105+0000","last_became_peered":"2023-12-07T09:59:57.237105+0000","last_unstale":"2023-12-07T09:59:58.225018+0000","last_undegraded":"2023-12-07T09:59:58.225018+0000","last_fullsized":"2023-12-07T09:59:58.225018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225409+0000","last_change":"2023-12-07T09:59:57.224514+0000","last_active":"2023-12-07T09:59:58.225409+0000","last_peered":"2023-12-07T09:59:58.225409+0000","last_clean":"2023-12-07T09:59:58.225409+0000","last_became_active":"2023-12-07T09:59:57.223056+0000","last_became_peered":"2023-12-07T09:59:57.223056+0000","last_unstale":"2023-12-07T09:59:58.225409+0000","last_undegraded":"2023-12-07T09:59:58.225409+0000","last_fullsized":"2023-12-07T09:59:58.225409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:12.564625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216281+0000","last_change":"2023-12-07T09:59:57.229394+0000","last_active":"2023-12-07T09:59:58.216281+0000","last_peered":"2023-12-07T09:59:58.216281+0000","last_clean":"2023-12-07T09:59:58.216281+0000","last_became_active":"2023-12-07T09:59:57.229071+0000","last_became_peered":"2023-12-07T09:59:57.229071+0000","last_unstale":"2023-12-07T09:59:58.216281+0000","last_undegraded":"2023-12-07T09:59:58.216281+0000","last_fullsized":"2023-12-07T09:59:58.216281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216294+0000","last_change":"2023-12-07T09:59:57.237863+0000","last_active":"2023-12-07T09:59:58.216294+0000","last_peered":"2023-12-07T09:59:58.216294+0000","last_clean":"2023-12-07T09:59:58.216294+0000","last_became_active":"2023-12-07T09:59:57.237612+0000","last_became_peered":"2023-12-07T09:59:57.237612+0000","last_unstale":"2023-12-07T09:59:58.216294+0000","last_undegraded":"2023-12-07T09:59:58.216294+0000","last_fullsized":"2023-12-07T09:59:58.216294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223318+0000","last_change":"2023-12-07T09:59:57.230638+0000","last_active":"2023-12-07T09:59:58.223318+0000","last_peered":"2023-12-07T09:59:58.223318+0000","last_clean":"2023-12-07T09:59:58.223318+0000","last_became_active":"2023-12-07T09:59:57.230319+0000","last_became_peered":"2023-12-07T09:59:57.230319+0000","last_unstale":"2023-12-07T09:59:58.223318+0000","last_undegraded":"2023-12-07T09:59:58.223318+0000","last_fullsized":"2023-12-07T09:59:58.223318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.213681+0000","last_change":"2023-12-07T09:59:57.223628+0000","last_active":"2023-12-07T09:59:58.213681+0000","last_peered":"2023-12-07T09:59:58.213681+0000","last_clean":"2023-12-07T09:59:58.213681+0000","last_became_active":"2023-12-07T09:59:57.223315+0000","last_became_peered":"2023-12-07T09:59:57.223315+0000","last_unstale":"2023-12-07T09:59:58.213681+0000","last_undegraded":"2023-12-07T09:59:58.213681+0000","last_fullsized":"2023-12-07T09:59:58.213681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224233+0000","last_change":"2023-12-07T09:59:57.235369+0000","last_active":"2023-12-07T09:59:58.224233+0000","last_peered":"2023-12-07T09:59:58.224233+0000","last_clean":"2023-12-07T09:59:58.224233+0000","last_became_active":"2023-12-07T09:59:57.235129+0000","last_became_peered":"2023-12-07T09:59:57.235129+0000","last_unstale":"2023-12-07T09:59:58.224233+0000","last_undegraded":"2023-12-07T09:59:58.224233+0000","last_fullsized":"2023-12-07T09:59:58.224233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225502+0000","last_change":"2023-12-07T09:59:57.228494+0000","last_active":"2023-12-07T09:59:58.225502+0000","last_peered":"2023-12-07T09:59:58.225502+0000","last_clean":"2023-12-07T09:59:58.225502+0000","last_became_active":"2023-12-07T09:59:57.228210+0000","last_became_peered":"2023-12-07T09:59:57.228210+0000","last_unstale":"2023-12-07T09:59:58.225502+0000","last_undegraded":"2023-12-07T09:59:58.225502+0000","last_fullsized":"2023-12-07T09:59:58.225502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:58.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223902+0000","last_change":"2023-12-07T09:59:57.245295+0000","last_active":"2023-12-07T09:59:58.223902+0000","last_peered":"2023-12-07T09:59:58.223902+0000","last_clean":"2023-12-07T09:59:58.223902+0000","last_became_active":"2023-12-07T09:59:57.245030+0000","last_became_peered":"2023-12-07T09:59:57.245030+0000","last_unstale":"2023-12-07T09:59:58.223902+0000","last_undegraded":"2023-12-07T09:59:58.223902+0000","last_fullsized":"2023-12-07T09:59:58.223902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214375+0000","last_change":"2023-12-07T09:59:57.227268+0000","last_active":"2023-12-07T09:59:58.214375+0000","last_peered":"2023-12-07T09:59:58.214375+0000","last_clean":"2023-12-07T09:59:58.214375+0000","last_became_active":"2023-12-07T09:59:57.226493+0000","last_became_peered":"2023-12-07T09:59:57.226493+0000","last_unstale":"2023-12-07T09:59:58.214375+0000","last_undegraded":"2023-12-07T09:59:58.214375+0000","last_fullsized":"2023-12-07T09:59:58.214375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216345+0000","last_change":"2023-12-07T09:59:57.236890+0000","last_active":"2023-12-07T09:59:58.216345+0000","last_peered":"2023-12-07T09:59:58.216345+0000","last_clean":"2023-12-07T09:59:58.216345+0000","last_became_active":"2023-12-07T09:59:57.236640+0000","last_became_peered":"2023-12-07T09:59:57.236640+0000","last_unstale":"2023-12-07T09:59:58.216345+0000","last_undegraded":"2023-12-07T09:59:58.216345+0000","last_fullsized":"2023-12-07T09:59:58.216345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214980+0000","last_change":"2023-12-07T09:59:57.244392+0000","last_active":"2023-12-07T09:59:58.214980+0000","last_peered":"2023-12-07T09:59:58.214980+0000","last_clean":"2023-12-07T09:59:58.214980+0000","last_became_active":"2023-12-07T09:59:57.244056+0000","last_became_peered":"2023-12-07T09:59:57.244056+0000","last_unstale":"2023-12-07T09:59:58.214980+0000","last_undegraded":"2023-12-07T09:59:58.214980+0000","last_fullsized":"2023-12-07T09:59:58.214980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223926+0000","last_change":"2023-12-07T09:59:57.239542+0000","last_active":"2023-12-07T09:59:58.223926+0000","last_peered":"2023-12-07T09:59:58.223926+0000","last_clean":"2023-12-07T09:59:58.223926+0000","last_became_active":"2023-12-07T09:59:57.238943+0000","last_became_peered":"2023-12-07T09:59:57.238943+0000","last_unstale":"2023-12-07T09:59:58.223926+0000","last_undegraded":"2023-12-07T09:59:58.223926+0000","last_fullsized":"2023-12-07T09:59:58.223926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:31.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214770+0000","last_change":"2023-12-07T09:59:57.230613+0000","last_active":"2023-12-07T09:59:58.214770+0000","last_peered":"2023-12-07T09:59:58.214770+0000","last_clean":"2023-12-07T09:59:58.214770+0000","last_became_active":"2023-12-07T09:59:57.228342+0000","last_became_peered":"2023-12-07T09:59:57.228342+0000","last_unstale":"2023-12-07T09:59:58.214770+0000","last_undegraded":"2023-12-07T09:59:58.214770+0000","last_fullsized":"2023-12-07T09:59:58.214770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223922+0000","last_change":"2023-12-07T09:59:57.229840+0000","last_active":"2023-12-07T09:59:58.223922+0000","last_peered":"2023-12-07T09:59:58.223922+0000","last_clean":"2023-12-07T09:59:58.223922+0000","last_became_active":"2023-12-07T09:59:57.229062+0000","last_became_peered":"2023-12-07T09:59:57.229062+0000","last_unstale":"2023-12-07T09:59:58.223922+0000","last_undegraded":"2023-12-07T09:59:58.223922+0000","last_fullsized":"2023-12-07T09:59:58.223922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261037+0000","last_change":"2023-12-07T09:59:56.247813+0000","last_active":"2023-12-07T09:59:57.261037+0000","last_peered":"2023-12-07T09:59:57.261037+0000","last_clean":"2023-12-07T09:59:57.261037+0000","last_became_active":"2023-12-07T09:59:56.247138+0000","last_became_peered":"2023-12-07T09:59:56.247138+0000","last_unstale":"2023-12-07T09:59:57.261037+0000","last_undegraded":"2023-12-07T09:59:57.261037+0000","last_fullsized":"2023-12-07T09:59:57.261037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224106+0000","last_change":"2023-12-07T09:59:57.240365+0000","last_active":"2023-12-07T09:59:58.224106+0000","last_peered":"2023-12-07T09:59:58.224106+0000","last_clean":"2023-12-07T09:59:58.224106+0000","last_became_active":"2023-12-07T09:59:57.240064+0000","last_became_peered":"2023-12-07T09:59:57.240064+0000","last_unstale":"2023-12-07T09:59:58.224106+0000","last_undegraded":"2023-12-07T09:59:58.224106+0000","last_fullsized":"2023-12-07T09:59:58.224106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.259136+0000","last_change":"2023-12-07T09:59:56.235235+0000","last_active":"2023-12-07T09:59:57.259136+0000","last_peered":"2023-12-07T09:59:57.259136+0000","last_clean":"2023-12-07T09:59:57.259136+0000","last_became_active":"2023-12-07T09:59:56.234964+0000","last_became_peered":"2023-12-07T09:59:56.234964+0000","last_unstale":"2023-12-07T09:59:57.259136+0000","last_undegraded":"2023-12-07T09:59:57.259136+0000","last_fullsized":"2023-12-07T09:59:57.259136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216365+0000","last_change":"2023-12-07T09:59:57.239310+0000","last_active":"2023-12-07T09:59:58.216365+0000","last_peered":"2023-12-07T09:59:58.216365+0000","last_clean":"2023-12-07T09:59:58.216365+0000","last_became_active":"2023-12-07T09:59:57.239006+0000","last_became_peered":"2023-12-07T09:59:57.239006+0000","last_unstale":"2023-12-07T09:59:58.216365+0000","last_undegraded":"2023-12-07T09:59:58.216365+0000","last_fullsized":"2023-12-07T09:59:58.216365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.263399+0000","last_change":"2023-12-07T09:59:56.254732+0000","last_active":"2023-12-07T09:59:57.263399+0000","last_peered":"2023-12-07T09:59:57.263399+0000","last_clean":"2023-12-07T09:59:57.263399+0000","last_became_active":"2023-12-07T09:59:56.254439+0000","last_became_peered":"2023-12-07T09:59:56.254439+0000","last_unstale":"2023-12-07T09:59:57.263399+0000","last_undegraded":"2023-12-07T09:59:57.263399+0000","last_fullsized":"2023-12-07T09:59:57.263399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223971+0000","last_change":"2023-12-07T09:59:57.245223+0000","last_active":"2023-12-07T09:59:58.223971+0000","last_peered":"2023-12-07T09:59:58.223971+0000","last_clean":"2023-12-07T09:59:58.223971+0000","last_became_active":"2023-12-07T09:59:57.245009+0000","last_became_peered":"2023-12-07T09:59:57.245009+0000","last_unstale":"2023-12-07T09:59:58.223971+0000","last_undegraded":"2023-12-07T09:59:58.223971+0000","last_fullsized":"2023-12-07T09:59:58.223971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261894+0000","last_change":"2023-12-07T09:59:56.251685+0000","last_active":"2023-12-07T09:59:57.261894+0000","last_peered":"2023-12-07T09:59:57.261894+0000","last_clean":"2023-12-07T09:59:57.261894+0000","last_became_active":"2023-12-07T09:59:56.251379+0000","last_became_peered":"2023-12-07T09:59:56.251379+0000","last_unstale":"2023-12-07T09:59:57.261894+0000","last_undegraded":"2023-12-07T09:59:57.261894+0000","last_fullsized":"2023-12-07T09:59:57.261894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:45.496128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215488+0000","last_change":"2023-12-07T09:59:57.232971+0000","last_active":"2023-12-07T09:59:58.215488+0000","last_peered":"2023-12-07T09:59:58.215488+0000","last_clean":"2023-12-07T09:59:58.215488+0000","last_became_active":"2023-12-07T09:59:57.232675+0000","last_became_peered":"2023-12-07T09:59:57.232675+0000","last_unstale":"2023-12-07T09:59:58.215488+0000","last_undegraded":"2023-12-07T09:59:58.215488+0000","last_fullsized":"2023-12-07T09:59:58.215488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261540+0000","last_change":"2023-12-07T09:59:56.257431+0000","last_active":"2023-12-07T09:59:57.261540+0000","last_peered":"2023-12-07T09:59:57.261540+0000","last_clean":"2023-12-07T09:59:57.261540+0000","last_became_active":"2023-12-07T09:59:56.257143+0000","last_became_peered":"2023-12-07T09:59:56.257143+0000","last_unstale":"2023-12-07T09:59:57.261540+0000","last_undegraded":"2023-12-07T09:59:57.261540+0000","last_fullsized":"2023-12-07T09:59:57.261540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214180+0000","last_change":"2023-12-07T09:59:57.228028+0000","last_active":"2023-12-07T09:59:58.214180+0000","last_peered":"2023-12-07T09:59:58.214180+0000","last_clean":"2023-12-07T09:59:58.214180+0000","last_became_active":"2023-12-07T09:59:57.227746+0000","last_became_peered":"2023-12-07T09:59:57.227746+0000","last_unstale":"2023-12-07T09:59:58.214180+0000","last_undegraded":"2023-12-07T09:59:58.214180+0000","last_fullsized":"2023-12-07T09:59:58.214180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.260598+0000","last_change":"2023-12-07T09:59:56.255384+0000","last_active":"2023-12-07T09:59:57.260598+0000","last_peered":"2023-12-07T09:59:57.260598+0000","last_clean":"2023-12-07T09:59:57.260598+0000","last_became_active":"2023-12-07T09:59:56.255104+0000","last_became_peered":"2023-12-07T09:59:56.255104+0000","last_unstale":"2023-12-07T09:59:57.260598+0000","last_undegraded":"2023-12-07T09:59:57.260598+0000","last_fullsized":"2023-12-07T09:59:57.260598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215915+0000","last_change":"2023-12-07T09:59:57.241610+0000","last_active":"2023-12-07T09:59:58.215915+0000","last_peered":"2023-12-07T09:59:58.215915+0000","last_clean":"2023-12-07T09:59:58.215915+0000","last_became_active":"2023-12-07T09:59:57.241339+0000","last_became_peered":"2023-12-07T09:59:57.241339+0000","last_unstale":"2023-12-07T09:59:58.215915+0000","last_undegraded":"2023-12-07T09:59:58.215915+0000","last_fullsized":"2023-12-07T09:59:58.215915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218354+0000","last_change":"2023-12-07T09:59:56.254460+0000","last_active":"2023-12-07T09:59:57.218354+0000","last_peered":"2023-12-07T09:59:57.218354+0000","last_clean":"2023-12-07T09:59:57.218354+0000","last_became_active":"2023-12-07T09:59:56.254187+0000","last_became_peered":"2023-12-07T09:59:56.254187+0000","last_unstale":"2023-12-07T09:59:57.218354+0000","last_undegraded":"2023-12-07T09:59:57.218354+0000","last_fullsized":"2023-12-07T09:59:57.218354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:04.346155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.222983+0000","last_change":"2023-12-07T09:59:57.233603+0000","last_active":"2023-12-07T09:59:58.222983+0000","last_peered":"2023-12-07T09:59:58.222983+0000","last_clean":"2023-12-07T09:59:58.222983+0000","last_became_active":"2023-12-07T09:59:57.233247+0000","last_became_peered":"2023-12-07T09:59:57.233247+0000","last_unstale":"2023-12-07T09:59:58.222983+0000","last_undegraded":"2023-12-07T09:59:58.222983+0000","last_fullsized":"2023-12-07T09:59:58.222983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218950+0000","last_change":"2023-12-07T09:59:56.240171+0000","last_active":"2023-12-07T09:59:57.218950+0000","last_peered":"2023-12-07T09:59:57.218950+0000","last_clean":"2023-12-07T09:59:57.218950+0000","last_became_active":"2023-12-07T09:59:56.239779+0000","last_became_peered":"2023-12-07T09:59:56.239779+0000","last_unstale":"2023-12-07T09:59:57.218950+0000","last_undegraded":"2023-12-07T09:59:57.218950+0000","last_fullsized":"2023-12-07T09:59:57.218950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214236+0000","last_change":"2023-12-07T09:59:57.239958+0000","last_active":"2023-12-07T09:59:58.214236+0000","last_peered":"2023-12-07T09:59:58.214236+0000","last_clean":"2023-12-07T09:59:58.214236+0000","last_became_active":"2023-12-07T09:59:57.239590+0000","last_became_peered":"2023-12-07T09:59:57.239590+0000","last_unstale":"2023-12-07T09:59:58.214236+0000","last_undegraded":"2023-12-07T09:59:58.214236+0000","last_fullsized":"2023-12-07T09:59:58.214236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.219810+0000","last_change":"2023-12-07T09:59:56.249207+0000","last_active":"2023-12-07T09:59:57.219810+0000","last_peered":"2023-12-07T09:59:57.219810+0000","last_clean":"2023-12-07T09:59:57.219810+0000","last_became_active":"2023-12-07T09:59:56.248795+0000","last_became_peered":"2023-12-07T09:59:56.248795+0000","last_unstale":"2023-12-07T09:59:57.219810+0000","last_undegraded":"2023-12-07T09:59:57.219810+0000","last_fullsized":"2023-12-07T09:59:57.219810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:39.635874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225303+0000","last_change":"2023-12-07T09:59:57.237888+0000","last_active":"2023-12-07T09:59:58.225303+0000","last_peered":"2023-12-07T09:59:58.225303+0000","last_clean":"2023-12-07T09:59:58.225303+0000","last_became_active":"2023-12-07T09:59:57.237543+0000","last_became_peered":"2023-12-07T09:59:57.237543+0000","last_unstale":"2023-12-07T09:59:58.225303+0000","last_undegraded":"2023-12-07T09:59:58.225303+0000","last_fullsized":"2023-12-07T09:59:58.225303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:26.165219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.222117+0000","last_change":"2023-12-07T09:59:56.257460+0000","last_active":"2023-12-07T09:59:57.222117+0000","last_peered":"2023-12-07T09:59:57.222117+0000","last_clean":"2023-12-07T09:59:57.222117+0000","last_became_active":"2023-12-07T09:59:56.257108+0000","last_became_peered":"2023-12-07T09:59:56.257108+0000","last_unstale":"2023-12-07T09:59:57.222117+0000","last_undegraded":"2023-12-07T09:59:57.222117+0000","last_fullsized":"2023-12-07T09:59:57.222117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225101+0000","last_change":"2023-12-07T09:59:57.232163+0000","last_active":"2023-12-07T09:59:58.225101+0000","last_peered":"2023-12-07T09:59:58.225101+0000","last_clean":"2023-12-07T09:59:58.225101+0000","last_became_active":"2023-12-07T09:59:57.231401+0000","last_became_peered":"2023-12-07T09:59:57.231401+0000","last_unstale":"2023-12-07T09:59:58.225101+0000","last_undegraded":"2023-12-07T09:59:58.225101+0000","last_fullsized":"2023-12-07T09:59:58.225101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:01:46.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.260990+0000","last_change":"2023-12-07T09:59:56.245272+0000","last_active":"2023-12-07T09:59:57.260990+0000","last_peered":"2023-12-07T09:59:57.260990+0000","last_clean":"2023-12-07T09:59:57.260990+0000","last_became_active":"2023-12-07T09:59:56.244612+0000","last_became_peered":"2023-12-07T09:59:56.244612+0000","last_unstale":"2023-12-07T09:59:57.260990+0000","last_undegraded":"2023-12-07T09:59:57.260990+0000","last_fullsized":"2023-12-07T09:59:57.260990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214059+0000","last_change":"2023-12-07T09:59:57.240066+0000","last_active":"2023-12-07T09:59:58.214059+0000","last_peered":"2023-12-07T09:59:58.214059+0000","last_clean":"2023-12-07T09:59:58.214059+0000","last_became_active":"2023-12-07T09:59:57.239795+0000","last_became_peered":"2023-12-07T09:59:57.239795+0000","last_unstale":"2023-12-07T09:59:58.214059+0000","last_undegraded":"2023-12-07T09:59:58.214059+0000","last_fullsized":"2023-12-07T09:59:58.214059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.268856+0000","last_change":"2023-12-07T09:59:56.256946+0000","last_active":"2023-12-07T09:59:57.268856+0000","last_peered":"2023-12-07T09:59:57.268856+0000","last_clean":"2023-12-07T09:59:57.268856+0000","last_became_active":"2023-12-07T09:59:56.256514+0000","last_became_peered":"2023-12-07T09:59:56.256514+0000","last_unstale":"2023-12-07T09:59:57.268856+0000","last_undegraded":"2023-12-07T09:59:57.268856+0000","last_fullsized":"2023-12-07T09:59:57.268856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:25.242109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223163+0000","last_change":"2023-12-07T09:59:57.233881+0000","last_active":"2023-12-07T09:59:58.223163+0000","last_peered":"2023-12-07T09:59:58.223163+0000","last_clean":"2023-12-07T09:59:58.223163+0000","last_became_active":"2023-12-07T09:59:57.233618+0000","last_became_peered":"2023-12-07T09:59:57.233618+0000","last_unstale":"2023-12-07T09:59:58.223163+0000","last_undegraded":"2023-12-07T09:59:58.223163+0000","last_fullsized":"2023-12-07T09:59:58.223163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261402+0000","last_change":"2023-12-07T09:59:56.244124+0000","last_active":"2023-12-07T09:59:57.261402+0000","last_peered":"2023-12-07T09:59:57.261402+0000","last_clean":"2023-12-07T09:59:57.261402+0000","last_became_active":"2023-12-07T09:59:56.243879+0000","last_became_peered":"2023-12-07T09:59:56.243879+0000","last_unstale":"2023-12-07T09:59:57.261402+0000","last_undegraded":"2023-12-07T09:59:57.261402+0000","last_fullsized":"2023-12-07T09:59:57.261402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:03.809080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225017+0000","last_change":"2023-12-07T09:59:57.226535+0000","last_active":"2023-12-07T09:59:58.225017+0000","last_peered":"2023-12-07T09:59:58.225017+0000","last_clean":"2023-12-07T09:59:58.225017+0000","last_became_active":"2023-12-07T09:59:57.226242+0000","last_became_peered":"2023-12-07T09:59:57.226242+0000","last_unstale":"2023-12-07T09:59:58.225017+0000","last_undegraded":"2023-12-07T09:59:58.225017+0000","last_fullsized":"2023-12-07T09:59:58.225017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.216732+0000","last_change":"2023-12-07T09:59:56.245266+0000","last_active":"2023-12-07T09:59:57.216732+0000","last_peered":"2023-12-07T09:59:57.216732+0000","last_clean":"2023-12-07T09:59:57.216732+0000","last_became_active":"2023-12-07T09:59:56.244990+0000","last_became_peered":"2023-12-07T09:59:56.244990+0000","last_unstale":"2023-12-07T09:59:57.216732+0000","last_undegraded":"2023-12-07T09:59:57.216732+0000","last_fullsized":"2023-12-07T09:59:57.216732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214803+0000","last_change":"2023-12-07T09:59:57.231869+0000","last_active":"2023-12-07T09:59:58.214803+0000","last_peered":"2023-12-07T09:59:58.214803+0000","last_clean":"2023-12-07T09:59:58.214803+0000","last_became_active":"2023-12-07T09:59:57.231357+0000","last_became_peered":"2023-12-07T09:59:57.231357+0000","last_unstale":"2023-12-07T09:59:58.214803+0000","last_undegraded":"2023-12-07T09:59:58.214803+0000","last_fullsized":"2023-12-07T09:59:58.214803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218227+0000","last_change":"2023-12-07T09:59:56.249076+0000","last_active":"2023-12-07T09:59:57.218227+0000","last_peered":"2023-12-07T09:59:57.218227+0000","last_clean":"2023-12-07T09:59:57.218227+0000","last_became_active":"2023-12-07T09:59:56.248779+0000","last_became_peered":"2023-12-07T09:59:56.248779+0000","last_unstale":"2023-12-07T09:59:57.218227+0000","last_undegraded":"2023-12-07T09:59:57.218227+0000","last_fullsized":"2023-12-07T09:59:57.218227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223928+0000","last_change":"2023-12-07T09:59:57.239368+0000","last_active":"2023-12-07T09:59:58.223928+0000","last_peered":"2023-12-07T09:59:58.223928+0000","last_clean":"2023-12-07T09:59:58.223928+0000","last_became_active":"2023-12-07T09:59:57.238640+0000","last_became_peered":"2023-12-07T09:59:57.238640+0000","last_unstale":"2023-12-07T09:59:58.223928+0000","last_undegraded":"2023-12-07T09:59:58.223928+0000","last_fullsized":"2023-12-07T09:59:58.223928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:17.962783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.264641+0000","last_change":"2023-12-07T09:59:56.252633+0000","last_active":"2023-12-07T09:59:57.264641+0000","last_peered":"2023-12-07T09:59:57.264641+0000","last_clean":"2023-12-07T09:59:57.264641+0000","last_became_active":"2023-12-07T09:59:56.252316+0000","last_became_peered":"2023-12-07T09:59:56.252316+0000","last_unstale":"2023-12-07T09:59:57.264641+0000","last_undegraded":"2023-12-07T09:59:57.264641+0000","last_fullsized":"2023-12-07T09:59:57.264641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:29.900543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216261+0000","last_change":"2023-12-07T09:59:57.224125+0000","last_active":"2023-12-07T09:59:58.216261+0000","last_peered":"2023-12-07T09:59:58.216261+0000","last_clean":"2023-12-07T09:59:58.216261+0000","last_became_active":"2023-12-07T09:59:57.223773+0000","last_became_peered":"2023-12-07T09:59:57.223773+0000","last_unstale":"2023-12-07T09:59:58.216261+0000","last_undegraded":"2023-12-07T09:59:58.216261+0000","last_fullsized":"2023-12-07T09:59:58.216261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.266693+0000","last_change":"2023-12-07T09:59:56.258524+0000","last_active":"2023-12-07T09:59:57.266693+0000","last_peered":"2023-12-07T09:59:57.266693+0000","last_clean":"2023-12-07T09:59:57.266693+0000","last_became_active":"2023-12-07T09:59:56.258272+0000","last_became_peered":"2023-12-07T09:59:56.258272+0000","last_unstale":"2023-12-07T09:59:57.266693+0000","last_undegraded":"2023-12-07T09:59:57.266693+0000","last_fullsized":"2023-12-07T09:59:57.266693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214349+0000","last_change":"2023-12-07T09:59:57.222118+0000","last_active":"2023-12-07T09:59:58.214349+0000","last_peered":"2023-12-07T09:59:58.214349+0000","last_clean":"2023-12-07T09:59:58.214349+0000","last_became_active":"2023-12-07T09:59:57.221427+0000","last_became_peered":"2023-12-07T09:59:57.221427+0000","last_unstale":"2023-12-07T09:59:58.214349+0000","last_undegraded":"2023-12-07T09:59:58.214349+0000","last_fullsized":"2023-12-07T09:59:58.214349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261128+0000","last_change":"2023-12-07T09:59:56.243609+0000","last_active":"2023-12-07T09:59:57.261128+0000","last_peered":"2023-12-07T09:59:57.261128+0000","last_clean":"2023-12-07T09:59:57.261128+0000","last_became_active":"2023-12-07T09:59:56.243310+0000","last_became_peered":"2023-12-07T09:59:56.243310+0000","last_unstale":"2023-12-07T09:59:57.261128+0000","last_undegraded":"2023-12-07T09:59:57.261128+0000","last_fullsized":"2023-12-07T09:59:57.261128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224395+0000","last_change":"2023-12-07T09:59:57.240863+0000","last_active":"2023-12-07T09:59:58.224395+0000","last_peered":"2023-12-07T09:59:58.224395+0000","last_clean":"2023-12-07T09:59:58.224395+0000","last_became_active":"2023-12-07T09:59:57.239236+0000","last_became_peered":"2023-12-07T09:59:57.239236+0000","last_unstale":"2023-12-07T09:59:58.224395+0000","last_undegraded":"2023-12-07T09:59:58.224395+0000","last_fullsized":"2023-12-07T09:59:58.224395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.262429+0000","last_change":"2023-12-07T09:59:56.247923+0000","last_active":"2023-12-07T09:59:57.262429+0000","last_peered":"2023-12-07T09:59:57.262429+0000","last_clean":"2023-12-07T09:59:57.262429+0000","last_became_active":"2023-12-07T09:59:56.247372+0000","last_became_peered":"2023-12-07T09:59:56.247372+0000","last_unstale":"2023-12-07T09:59:57.262429+0000","last_undegraded":"2023-12-07T09:59:57.262429+0000","last_fullsized":"2023-12-07T09:59:57.262429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225364+0000","last_change":"2023-12-07T09:59:57.230224+0000","last_active":"2023-12-07T09:59:58.225364+0000","last_peered":"2023-12-07T09:59:58.225364+0000","last_clean":"2023-12-07T09:59:58.225364+0000","last_became_active":"2023-12-07T09:59:57.229926+0000","last_became_peered":"2023-12-07T09:59:57.229926+0000","last_unstale":"2023-12-07T09:59:58.225364+0000","last_undegraded":"2023-12-07T09:59:58.225364+0000","last_fullsized":"2023-12-07T09:59:58.225364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:14.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.220419+0000","last_change":"2023-12-07T09:59:56.257331+0000","last_active":"2023-12-07T09:59:57.220419+0000","last_peered":"2023-12-07T09:59:57.220419+0000","last_clean":"2023-12-07T09:59:57.220419+0000","last_became_active":"2023-12-07T09:59:56.257002+0000","last_became_peered":"2023-12-07T09:59:56.257002+0000","last_unstale":"2023-12-07T09:59:57.220419+0000","last_undegraded":"2023-12-07T09:59:57.220419+0000","last_fullsized":"2023-12-07T09:59:57.220419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224887+0000","last_change":"2023-12-07T09:59:57.229233+0000","last_active":"2023-12-07T09:59:58.224887+0000","last_peered":"2023-12-07T09:59:58.224887+0000","last_clean":"2023-12-07T09:59:58.224887+0000","last_became_active":"2023-12-07T09:59:57.228954+0000","last_became_peered":"2023-12-07T09:59:57.228954+0000","last_unstale":"2023-12-07T09:59:58.224887+0000","last_undegraded":"2023-12-07T09:59:58.224887+0000","last_fullsized":"2023-12-07T09:59:58.224887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:10:27.580956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261930+0000","last_change":"2023-12-07T09:59:56.245087+0000","last_active":"2023-12-07T09:59:57.261930+0000","last_peered":"2023-12-07T09:59:57.261930+0000","last_clean":"2023-12-07T09:59:57.261930+0000","last_became_active":"2023-12-07T09:59:56.244700+0000","last_became_peered":"2023-12-07T09:59:56.244700+0000","last_unstale":"2023-12-07T09:59:57.261930+0000","last_undegraded":"2023-12-07T09:59:57.261930+0000","last_fullsized":"2023-12-07T09:59:57.261930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225233+0000","last_change":"2023-12-07T09:59:57.226382+0000","last_active":"2023-12-07T09:59:58.225233+0000","last_peered":"2023-12-07T09:59:58.225233+0000","last_clean":"2023-12-07T09:59:58.225233+0000","last_became_active":"2023-12-07T09:59:57.226109+0000","last_became_peered":"2023-12-07T09:59:57.226109+0000","last_unstale":"2023-12-07T09:59:58.225233+0000","last_undegraded":"2023-12-07T09:59:58.225233+0000","last_fullsized":"2023-12-07T09:59:58.225233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:33.099334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.235952+0000","last_change":"2023-12-07T09:59:56.250622+0000","last_active":"2023-12-07T09:59:57.235952+0000","last_peered":"2023-12-07T09:59:57.235952+0000","last_clean":"2023-12-07T09:59:57.235952+0000","last_became_active":"2023-12-07T09:59:56.250318+0000","last_became_peered":"2023-12-07T09:59:56.250318+0000","last_unstale":"2023-12-07T09:59:57.235952+0000","last_undegraded":"2023-12-07T09:59:57.235952+0000","last_fullsized":"2023-12-07T09:59:57.235952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224724+0000","last_change":"2023-12-07T09:59:57.222557+0000","last_active":"2023-12-07T09:59:58.224724+0000","last_peered":"2023-12-07T09:59:58.224724+0000","last_clean":"2023-12-07T09:59:58.224724+0000","last_became_active":"2023-12-07T09:59:57.221911+0000","last_became_peered":"2023-12-07T09:59:57.221911+0000","last_unstale":"2023-12-07T09:59:58.224724+0000","last_undegraded":"2023-12-07T09:59:58.224724+0000","last_fullsized":"2023-12-07T09:59:58.224724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:08.918724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218443+0000","last_change":"2023-12-07T09:59:56.248159+0000","last_active":"2023-12-07T09:59:57.218443+0000","last_peered":"2023-12-07T09:59:57.218443+0000","last_clean":"2023-12-07T09:59:57.218443+0000","last_became_active":"2023-12-07T09:59:56.247890+0000","last_became_peered":"2023-12-07T09:59:56.247890+0000","last_unstale":"2023-12-07T09:59:57.218443+0000","last_undegraded":"2023-12-07T09:59:57.218443+0000","last_fullsized":"2023-12-07T09:59:57.218443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:11.557704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214972+0000","last_change":"2023-12-07T09:59:57.244429+0000","last_active":"2023-12-07T09:59:58.214972+0000","last_peered":"2023-12-07T09:59:58.214972+0000","last_clean":"2023-12-07T09:59:58.214972+0000","last_became_active":"2023-12-07T09:59:57.244108+0000","last_became_peered":"2023-12-07T09:59:57.244108+0000","last_unstale":"2023-12-07T09:59:58.214972+0000","last_undegraded":"2023-12-07T09:59:58.214972+0000","last_fullsized":"2023-12-07T09:59:58.214972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.214202+0000","last_change":"2023-12-07T09:59:56.250231+0000","last_active":"2023-12-07T09:59:57.214202+0000","last_peered":"2023-12-07T09:59:57.214202+0000","last_clean":"2023-12-07T09:59:57.214202+0000","last_became_active":"2023-12-07T09:59:56.249795+0000","last_became_peered":"2023-12-07T09:59:56.249795+0000","last_unstale":"2023-12-07T09:59:57.214202+0000","last_undegraded":"2023-12-07T09:59:57.214202+0000","last_fullsized":"2023-12-07T09:59:57.214202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225438+0000","last_change":"2023-12-07T09:59:57.223699+0000","last_active":"2023-12-07T09:59:58.225438+0000","last_peered":"2023-12-07T09:59:58.225438+0000","last_clean":"2023-12-07T09:59:58.225438+0000","last_became_active":"2023-12-07T09:59:57.223208+0000","last_became_peered":"2023-12-07T09:59:57.223208+0000","last_unstale":"2023-12-07T09:59:58.225438+0000","last_undegraded":"2023-12-07T09:59:58.225438+0000","last_fullsized":"2023-12-07T09:59:58.225438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:08.149324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.259713+0000","last_change":"2023-12-07T09:59:56.244977+0000","last_active":"2023-12-07T09:59:57.259713+0000","last_peered":"2023-12-07T09:59:57.259713+0000","last_clean":"2023-12-07T09:59:57.259713+0000","last_became_active":"2023-12-07T09:59:56.244693+0000","last_became_peered":"2023-12-07T09:59:56.244693+0000","last_unstale":"2023-12-07T09:59:57.259713+0000","last_undegraded":"2023-12-07T09:59:57.259713+0000","last_fullsized":"2023-12-07T09:59:57.259713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:40.487500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214471+0000","last_change":"2023-12-07T09:59:57.239649+0000","last_active":"2023-12-07T09:59:58.214471+0000","last_peered":"2023-12-07T09:59:58.214471+0000","last_clean":"2023-12-07T09:59:58.214471+0000","last_became_active":"2023-12-07T09:59:57.239278+0000","last_became_peered":"2023-12-07T09:59:57.239278+0000","last_unstale":"2023-12-07T09:59:58.214471+0000","last_undegraded":"2023-12-07T09:59:58.214471+0000","last_fullsized":"2023-12-07T09:59:58.214471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224204+0000","last_change":"2023-12-07T09:59:56.246751+0000","last_active":"2023-12-07T09:59:58.224204+0000","last_peered":"2023-12-07T09:59:58.224204+0000","last_clean":"2023-12-07T09:59:58.224204+0000","last_became_active":"2023-12-07T09:59:56.246313+0000","last_became_peered":"2023-12-07T09:59:56.246313+0000","last_unstale":"2023-12-07T09:59:58.224204+0000","last_undegraded":"2023-12-07T09:59:58.224204+0000","last_fullsized":"2023-12-07T09:59:58.224204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223891+0000","last_change":"2023-12-07T09:59:57.234589+0000","last_active":"2023-12-07T09:59:58.223891+0000","last_peered":"2023-12-07T09:59:58.223891+0000","last_clean":"2023-12-07T09:59:58.223891+0000","last_became_active":"2023-12-07T09:59:57.234320+0000","last_became_peered":"2023-12-07T09:59:57.234320+0000","last_unstale":"2023-12-07T09:59:58.223891+0000","last_undegraded":"2023-12-07T09:59:58.223891+0000","last_fullsized":"2023-12-07T09:59:58.223891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.224731+0000","last_change":"2023-12-07T09:59:56.247423+0000","last_active":"2023-12-07T09:59:57.224731+0000","last_peered":"2023-12-07T09:59:57.224731+0000","last_clean":"2023-12-07T09:59:57.224731+0000","last_became_active":"2023-12-07T09:59:56.247188+0000","last_became_peered":"2023-12-07T09:59:56.247188+0000","last_unstale":"2023-12-07T09:59:57.224731+0000","last_undegraded":"2023-12-07T09:59:57.224731+0000","last_fullsized":"2023-12-07T09:59:57.224731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223850+0000","last_change":"2023-12-07T09:59:57.238384+0000","last_active":"2023-12-07T09:59:58.223850+0000","last_peered":"2023-12-07T09:59:58.223850+0000","last_clean":"2023-12-07T09:59:58.223850+0000","last_became_active":"2023-12-07T09:59:57.238044+0000","last_became_peered":"2023-12-07T09:59:57.238044+0000","last_unstale":"2023-12-07T09:59:58.223850+0000","last_undegraded":"2023-12-07T09:59:58.223850+0000","last_fullsized":"2023-12-07T09:59:58.223850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:54.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.221478+0000","last_change":"2023-12-07T09:59:56.244982+0000","last_active":"2023-12-07T09:59:57.221478+0000","last_peered":"2023-12-07T09:59:57.221478+0000","last_clean":"2023-12-07T09:59:57.221478+0000","last_became_active":"2023-12-07T09:59:56.244390+0000","last_became_peered":"2023-12-07T09:59:56.244390+0000","last_unstale":"2023-12-07T09:59:57.221478+0000","last_undegraded":"2023-12-07T09:59:57.221478+0000","last_fullsized":"2023-12-07T09:59:57.221478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223762+0000","last_change":"2023-12-07T09:59:57.242678+0000","last_active":"2023-12-07T09:59:58.223762+0000","last_peered":"2023-12-07T09:59:58.223762+0000","last_clean":"2023-12-07T09:59:58.223762+0000","last_became_active":"2023-12-07T09:59:57.242415+0000","last_became_peered":"2023-12-07T09:59:57.242415+0000","last_unstale":"2023-12-07T09:59:58.223762+0000","last_undegraded":"2023-12-07T09:59:58.223762+0000","last_fullsized":"2023-12-07T09:59:58.223762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.216858+0000","last_change":"2023-12-07T09:59:56.248618+0000","last_active":"2023-12-07T09:59:57.216858+0000","last_peered":"2023-12-07T09:59:57.216858+0000","last_clean":"2023-12-07T09:59:57.216858+0000","last_became_active":"2023-12-07T09:59:56.245467+0000","last_became_peered":"2023-12-07T09:59:56.245467+0000","last_unstale":"2023-12-07T09:59:57.216858+0000","last_undegraded":"2023-12-07T09:59:57.216858+0000","last_fullsized":"2023-12-07T09:59:57.216858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223612+0000","last_change":"2023-12-07T09:59:57.239076+0000","last_active":"2023-12-07T09:59:58.223612+0000","last_peered":"2023-12-07T09:59:58.223612+0000","last_clean":"2023-12-07T09:59:58.223612+0000","last_became_active":"2023-12-07T09:59:57.238794+0000","last_became_peered":"2023-12-07T09:59:57.238794+0000","last_unstale":"2023-12-07T09:59:58.223612+0000","last_undegraded":"2023-12-07T09:59:58.223612+0000","last_fullsized":"2023-12-07T09:59:58.223612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218595+0000","last_change":"2023-12-07T09:59:56.244136+0000","last_active":"2023-12-07T09:59:57.218595+0000","last_peered":"2023-12-07T09:59:57.218595+0000","last_clean":"2023-12-07T09:59:57.218595+0000","last_became_active":"2023-12-07T09:59:56.243848+0000","last_became_peered":"2023-12-07T09:59:56.243848+0000","last_unstale":"2023-12-07T09:59:57.218595+0000","last_undegraded":"2023-12-07T09:59:57.218595+0000","last_fullsized":"2023-12-07T09:59:57.218595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215811+0000","last_change":"2023-12-07T09:59:57.231677+0000","last_active":"2023-12-07T09:59:58.215811+0000","last_peered":"2023-12-07T09:59:58.215811+0000","last_clean":"2023-12-07T09:59:58.215811+0000","last_became_active":"2023-12-07T09:59:57.231321+0000","last_became_peered":"2023-12-07T09:59:57.231321+0000","last_unstale":"2023-12-07T09:59:58.215811+0000","last_undegraded":"2023-12-07T09:59:58.215811+0000","last_fullsized":"2023-12-07T09:59:58.215811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.220706+0000","last_change":"2023-12-07T09:59:56.249073+0000","last_active":"2023-12-07T09:59:57.220706+0000","last_peered":"2023-12-07T09:59:57.220706+0000","last_clean":"2023-12-07T09:59:57.220706+0000","last_became_active":"2023-12-07T09:59:56.248772+0000","last_became_peered":"2023-12-07T09:59:56.248772+0000","last_unstale":"2023-12-07T09:59:57.220706+0000","last_undegraded":"2023-12-07T09:59:57.220706+0000","last_fullsized":"2023-12-07T09:59:57.220706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:47.202027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215455+0000","last_change":"2023-12-07T09:59:57.228735+0000","last_active":"2023-12-07T09:59:58.215455+0000","last_peered":"2023-12-07T09:59:58.215455+0000","last_clean":"2023-12-07T09:59:58.215455+0000","last_became_active":"2023-12-07T09:59:57.228440+0000","last_became_peered":"2023-12-07T09:59:57.228440+0000","last_unstale":"2023-12-07T09:59:58.215455+0000","last_undegraded":"2023-12-07T09:59:58.215455+0000","last_fullsized":"2023-12-07T09:59:58.215455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.235558+0000","last_change":"2023-12-07T09:59:56.247518+0000","last_active":"2023-12-07T09:59:57.235558+0000","last_peered":"2023-12-07T09:59:57.235558+0000","last_clean":"2023-12-07T09:59:57.235558+0000","last_became_active":"2023-12-07T09:59:56.246103+0000","last_became_peered":"2023-12-07T09:59:56.246103+0000","last_unstale":"2023-12-07T09:59:57.235558+0000","last_undegraded":"2023-12-07T09:59:57.235558+0000","last_fullsized":"2023-12-07T09:59:57.235558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.224048+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:57.224048+0000","last_peered":"2023-12-07T09:59:57.224048+0000","last_clean":"2023-12-07T09:59:57.224048+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:57.224048+0000","last_undegraded":"2023-12-07T09:59:57.224048+0000","last_fullsized":"2023-12-07T09:59:57.224048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8540000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:05.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:05.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.977+0000 7fdc66279640 1 Processor -- start 2023-12-07T10:00:05.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.977+0000 7fdc66279640 1 -- start start 2023-12-07T10:00:05.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.977+0000 7fdc66279640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc6014e9d0 0x7fdc60151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:05.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc66279640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc600a8470 0x7fdc6006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc66279640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6006d320 con 0x7fdc60070b80 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc66279640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600721b0 con 0x7fdc6014e9d0 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc66279640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600c2830 con 0x7fdc600a8470 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc6014e9d0 0x7fdc60151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc6014e9d0 0x7fdc60151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37994/0 (socket says 172.21.15.89:37994) 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 -- 172.21.15.89:0/4021943655 learned_addr learned my addr 172.21.15.89:0/4021943655 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5f7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdc60070b80 0x7fdc600c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49800/0 (socket says 172.21.15.89:49800) 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc64816640 1 --2- 172.21.15.89:0/4021943655 >> v2:172.21.15.97:3300/0 conn(0x7fdc600a8470 0x7fdc6006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5effd640 1 -- 172.21.15.89:0/4021943655 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631676790 0 0) 0x7fdc6006d320 con 0x7fdc60070b80 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5effd640 1 -- 172.21.15.89:0/4021943655 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc48003530 con 0x7fdc60070b80 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 -- 172.21.15.89:0/4021943655 >> v2:172.21.15.97:3300/0 conn(0x7fdc600a8470 msgr2=0x7fdc6006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 --2- 172.21.15.89:0/4021943655 >> v2:172.21.15.97:3300/0 conn(0x7fdc600a8470 0x7fdc6006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 -- 172.21.15.89:0/4021943655 >> v1:172.21.15.89:6789/0 conn(0x7fdc60070b80 legacy=0x7fdc600c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:05.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 -- 172.21.15.89:0/4021943655 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60072450 con 0x7fdc6014e9d0 2023-12-07T10:00:05.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5ffff640 1 --2- 172.21.15.89:0/4021943655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc6014e9d0 0x7fdc60151e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc600c3b30 tx=0x7fdc5001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c203c76005ea13 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:05.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.981+0000 7fdc5effd640 1 -- 172.21.15.89:0/4021943655 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500ad680 con 0x7fdc6014e9d0 2023-12-07T10:00:05.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc5effd640 1 -- 172.21.15.89:0/4021943655 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500ad7e0 con 0x7fdc6014e9d0 2023-12-07T10:00:05.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc5effd640 1 -- 172.21.15.89:0/4021943655 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500adb70 con 0x7fdc6014e9d0 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- 172.21.15.89:0/4021943655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc6014e9d0 msgr2=0x7fdc60151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 --2- 172.21.15.89:0/4021943655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc6014e9d0 0x7fdc60151e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc600c3b30 tx=0x7fdc5001c470 comp rx=0 tx=0).stop 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- 172.21.15.89:0/4021943655 shutdown_connections 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 --2- 172.21.15.89:0/4021943655 >> v2:172.21.15.97:3300/0 conn(0x7fdc600a8470 0x7fdc6006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 --2- 172.21.15.89:0/4021943655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc6014e9d0 0x7fdc60151e60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- 172.21.15.89:0/4021943655 >> 172.21.15.89:0/4021943655 conn(0x7fdc600c2ad0 msgr2=0x7fdc600c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- 172.21.15.89:0/4021943655 shutdown_connections 2023-12-07T10:00:05.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- 172.21.15.89:0/4021943655 wait complete. 2023-12-07T10:00:05.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 Processor -- start 2023-12-07T10:00:05.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- start start 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 0x7fdc601ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc600a8470 0x7fdc601f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc6014e9d0 0x7fdc6014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601ece30 con 0x7fdc60070b80 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601f0270 con 0x7fdc600a8470 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc66279640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601439b0 con 0x7fdc6014e9d0 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc5ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 0x7fdc601ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc5ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 0x7fdc601ec8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38008/0 (socket says 172.21.15.89:38008) 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.985+0000 7fdc5ffff640 1 -- 172.21.15.89:0/3669074100 learned_addr learned my addr 172.21.15.89:0/3669074100 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5f7fe640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc600a8470 0x7fdc601f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc64816640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc6014e9d0 0x7fdc6014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:05.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5ffff640 1 -- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc6014e9d0 msgr2=0x7fdc6014a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5ffff640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc6014e9d0 0x7fdc6014a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5ffff640 1 -- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc600a8470 msgr2=0x7fdc601f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5ffff640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc600a8470 0x7fdc601f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5ffff640 1 -- 172.21.15.89:0/3669074100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500094d0 con 0x7fdc60070b80 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc64816640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc6014e9d0 0x7fdc6014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5ffff640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 0x7fdc601ec8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc50019080 tx=0x7fdc5001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500ade20 con 0x7fdc60070b80 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500b8420 con 0x7fdc60070b80 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6014d8f0 con 0x7fdc60070b80 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500b8790 con 0x7fdc60070b80 2023-12-07T10:00:05.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6014d610 con 0x7fdc60070b80 2023-12-07T10:00:05.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6004e890 con 0x7fdc60070b80 2023-12-07T10:00:05.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.989+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc500b4040 con 0x7fdc60070b80 2023-12-07T10:00:06.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.993+0000 7fdc5cff9640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc4c066900 0x7fdc4c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.993+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc5011e5d0 con 0x7fdc60070b80 2023-12-07T10:00:06.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.993+0000 7fdc5f7fe640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc4c066900 0x7fdc4c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.993+0000 7fdc5f7fe640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc4c066900 0x7fdc4c068dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc600c16a0 tx=0x7fdc54007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:05.997+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc500eb9d0 con 0x7fdc60070b80 2023-12-07T10:00:06.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.141+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc6006be00 con 0x7fdc4c066900 2023-12-07T10:00:06.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.149+0000 7fdc5cff9640 1 -- 172.21.15.89:0/3669074100 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267813 (secure 0 0 0) 0x7fdc54007300 con 0x7fdc4c066900 2023-12-07T10:00:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:06.162 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc4c066900 msgr2=0x7fdc4c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc4c066900 0x7fdc4c068dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc600c16a0 tx=0x7fdc54007d40 comp rx=0 tx=0).stop 2023-12-07T10:00:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 msgr2=0x7fdc601ec8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 0x7fdc601ec8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc50019080 tx=0x7fdc5001acb0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 shutdown_connections 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc4c066900 0x7fdc4c068dc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc6014e9d0 0x7fdc6014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc600a8470 0x7fdc601f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 --2- 172.21.15.89:0/3669074100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc60070b80 0x7fdc601ec8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 >> 172.21.15.89:0/3669074100 conn(0x7fdc600c2ad0 msgr2=0x7fdc6014b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 shutdown_connections 2023-12-07T10:00:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.153+0000 7fdc66279640 1 -- 172.21.15.89:0/3669074100 wait complete. 2023-12-07T10:00:06.181 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-12-07T10:00:04.351730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220124,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":4038656,"data_stored":2258372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001525"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224056+0000","last_change":"2023-12-07T09:59:57.243490+0000","last_active":"2023-12-07T09:59:58.224056+0000","last_peered":"2023-12-07T09:59:58.224056+0000","last_clean":"2023-12-07T09:59:58.224056+0000","last_became_active":"2023-12-07T09:59:57.242850+0000","last_became_peered":"2023-12-07T09:59:57.242850+0000","last_unstale":"2023-12-07T09:59:58.224056+0000","last_undegraded":"2023-12-07T09:59:58.224056+0000","last_fullsized":"2023-12-07T09:59:58.224056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225365+0000","last_change":"2023-12-07T09:59:57.229817+0000","last_active":"2023-12-07T09:59:58.225365+0000","last_peered":"2023-12-07T09:59:58.225365+0000","last_clean":"2023-12-07T09:59:58.225365+0000","last_became_active":"2023-12-07T09:59:57.229526+0000","last_became_peered":"2023-12-07T09:59:57.229526+0000","last_unstale":"2023-12-07T09:59:58.225365+0000","last_undegraded":"2023-12-07T09:59:58.225365+0000","last_fullsized":"2023-12-07T09:59:58.225365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:15:58.859354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214123+0000","last_change":"2023-12-07T09:59:57.238691+0000","last_active":"2023-12-07T09:59:58.214123+0000","last_peered":"2023-12-07T09:59:58.214123+0000","last_clean":"2023-12-07T09:59:58.214123+0000","last_became_active":"2023-12-07T09:59:57.238414+0000","last_became_peered":"2023-12-07T09:59:57.238414+0000","last_unstale":"2023-12-07T09:59:58.214123+0000","last_undegraded":"2023-12-07T09:59:58.214123+0000","last_fullsized":"2023-12-07T09:59:58.214123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223569+0000","last_change":"2023-12-07T09:59:57.243320+0000","last_active":"2023-12-07T09:59:58.223569+0000","last_peered":"2023-12-07T09:59:58.223569+0000","last_clean":"2023-12-07T09:59:58.223569+0000","last_became_active":"2023-12-07T09:59:57.243117+0000","last_became_peered":"2023-12-07T09:59:57.243117+0000","last_unstale":"2023-12-07T09:59:58.223569+0000","last_undegraded":"2023-12-07T09:59:58.223569+0000","last_fullsized":"2023-12-07T09:59:58.223569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224910+0000","last_change":"2023-12-07T09:59:57.236855+0000","last_active":"2023-12-07T09:59:58.224910+0000","last_peered":"2023-12-07T09:59:58.224910+0000","last_clean":"2023-12-07T09:59:58.224910+0000","last_became_active":"2023-12-07T09:59:57.236380+0000","last_became_peered":"2023-12-07T09:59:57.236380+0000","last_unstale":"2023-12-07T09:59:58.224910+0000","last_undegraded":"2023-12-07T09:59:58.224910+0000","last_fullsized":"2023-12-07T09:59:58.224910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:18:14.300474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224869+0000","last_change":"2023-12-07T09:59:57.233976+0000","last_active":"2023-12-07T09:59:58.224869+0000","last_peered":"2023-12-07T09:59:58.224869+0000","last_clean":"2023-12-07T09:59:58.224869+0000","last_became_active":"2023-12-07T09:59:57.233707+0000","last_became_peered":"2023-12-07T09:59:57.233707+0000","last_unstale":"2023-12-07T09:59:58.224869+0000","last_undegraded":"2023-12-07T09:59:58.224869+0000","last_fullsized":"2023-12-07T09:59:58.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215102+0000","last_change":"2023-12-07T09:59:57.246474+0000","last_active":"2023-12-07T09:59:58.215102+0000","last_peered":"2023-12-07T09:59:58.215102+0000","last_clean":"2023-12-07T09:59:58.215102+0000","last_became_active":"2023-12-07T09:59:57.246185+0000","last_became_peered":"2023-12-07T09:59:57.246185+0000","last_unstale":"2023-12-07T09:59:58.215102+0000","last_undegraded":"2023-12-07T09:59:58.215102+0000","last_fullsized":"2023-12-07T09:59:58.215102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214578+0000","last_change":"2023-12-07T09:59:57.230825+0000","last_active":"2023-12-07T09:59:58.214578+0000","last_peered":"2023-12-07T09:59:58.214578+0000","last_clean":"2023-12-07T09:59:58.214578+0000","last_became_active":"2023-12-07T09:59:57.230278+0000","last_became_peered":"2023-12-07T09:59:57.230278+0000","last_unstale":"2023-12-07T09:59:58.214578+0000","last_undegraded":"2023-12-07T09:59:58.214578+0000","last_fullsized":"2023-12-07T09:59:58.214578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.217200+0000","last_change":"2023-12-07T09:59:57.238932+0000","last_active":"2023-12-07T09:59:58.217200+0000","last_peered":"2023-12-07T09:59:58.217200+0000","last_clean":"2023-12-07T09:59:58.217200+0000","last_became_active":"2023-12-07T09:59:57.238605+0000","last_became_peered":"2023-12-07T09:59:57.238605+0000","last_unstale":"2023-12-07T09:59:58.217200+0000","last_undegraded":"2023-12-07T09:59:58.217200+0000","last_fullsized":"2023-12-07T09:59:58.217200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224031+0000","last_change":"2023-12-07T09:59:57.236999+0000","last_active":"2023-12-07T09:59:58.224031+0000","last_peered":"2023-12-07T09:59:58.224031+0000","last_clean":"2023-12-07T09:59:58.224031+0000","last_became_active":"2023-12-07T09:59:57.236732+0000","last_became_peered":"2023-12-07T09:59:57.236732+0000","last_unstale":"2023-12-07T09:59:58.224031+0000","last_undegraded":"2023-12-07T09:59:58.224031+0000","last_fullsized":"2023-12-07T09:59:58.224031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215270+0000","last_change":"2023-12-07T09:59:57.242828+0000","last_active":"2023-12-07T09:59:58.215270+0000","last_peered":"2023-12-07T09:59:58.215270+0000","last_clean":"2023-12-07T09:59:58.215270+0000","last_became_active":"2023-12-07T09:59:57.242554+0000","last_became_peered":"2023-12-07T09:59:57.242554+0000","last_unstale":"2023-12-07T09:59:58.215270+0000","last_undegraded":"2023-12-07T09:59:58.215270+0000","last_fullsized":"2023-12-07T09:59:58.215270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214623+0000","last_change":"2023-12-07T09:59:57.227453+0000","last_active":"2023-12-07T09:59:58.214623+0000","last_peered":"2023-12-07T09:59:58.214623+0000","last_clean":"2023-12-07T09:59:58.214623+0000","last_became_active":"2023-12-07T09:59:57.226914+0000","last_became_peered":"2023-12-07T09:59:57.226914+0000","last_unstale":"2023-12-07T09:59:58.214623+0000","last_undegraded":"2023-12-07T09:59:58.214623+0000","last_fullsized":"2023-12-07T09:59:58.214623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225070+0000","last_change":"2023-12-07T09:59:57.241629+0000","last_active":"2023-12-07T09:59:58.225070+0000","last_peered":"2023-12-07T09:59:58.225070+0000","last_clean":"2023-12-07T09:59:58.225070+0000","last_became_active":"2023-12-07T09:59:57.238255+0000","last_became_peered":"2023-12-07T09:59:57.238255+0000","last_unstale":"2023-12-07T09:59:58.225070+0000","last_undegraded":"2023-12-07T09:59:58.225070+0000","last_fullsized":"2023-12-07T09:59:58.225070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:23:31.673878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224993+0000","last_change":"2023-12-07T09:59:57.227431+0000","last_active":"2023-12-07T09:59:58.224993+0000","last_peered":"2023-12-07T09:59:58.224993+0000","last_clean":"2023-12-07T09:59:58.224993+0000","last_became_active":"2023-12-07T09:59:57.226781+0000","last_became_peered":"2023-12-07T09:59:57.226781+0000","last_unstale":"2023-12-07T09:59:58.224993+0000","last_undegraded":"2023-12-07T09:59:58.224993+0000","last_fullsized":"2023-12-07T09:59:58.224993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.213694+0000","last_change":"2023-12-07T09:59:57.242046+0000","last_active":"2023-12-07T09:59:58.213694+0000","last_peered":"2023-12-07T09:59:58.213694+0000","last_clean":"2023-12-07T09:59:58.213694+0000","last_became_active":"2023-12-07T09:59:57.241392+0000","last_became_peered":"2023-12-07T09:59:57.241392+0000","last_unstale":"2023-12-07T09:59:58.213694+0000","last_undegraded":"2023-12-07T09:59:58.213694+0000","last_fullsized":"2023-12-07T09:59:58.213694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215096+0000","last_change":"2023-12-07T09:59:57.238463+0000","last_active":"2023-12-07T09:59:58.215096+0000","last_peered":"2023-12-07T09:59:58.215096+0000","last_clean":"2023-12-07T09:59:58.215096+0000","last_became_active":"2023-12-07T09:59:57.238172+0000","last_became_peered":"2023-12-07T09:59:57.238172+0000","last_unstale":"2023-12-07T09:59:58.215096+0000","last_undegraded":"2023-12-07T09:59:58.215096+0000","last_fullsized":"2023-12-07T09:59:58.215096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215286+0000","last_change":"2023-12-07T09:59:57.245997+0000","last_active":"2023-12-07T09:59:58.215286+0000","last_peered":"2023-12-07T09:59:58.215286+0000","last_clean":"2023-12-07T09:59:58.215286+0000","last_became_active":"2023-12-07T09:59:57.244225+0000","last_became_peered":"2023-12-07T09:59:57.244225+0000","last_unstale":"2023-12-07T09:59:58.215286+0000","last_undegraded":"2023-12-07T09:59:58.215286+0000","last_fullsized":"2023-12-07T09:59:58.215286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225527+0000","last_change":"2023-12-07T09:59:57.239271+0000","last_active":"2023-12-07T09:59:58.225527+0000","last_peered":"2023-12-07T09:59:58.225527+0000","last_clean":"2023-12-07T09:59:58.225527+0000","last_became_active":"2023-12-07T09:59:57.238981+0000","last_became_peered":"2023-12-07T09:59:57.238981+0000","last_unstale":"2023-12-07T09:59:58.225527+0000","last_undegraded":"2023-12-07T09:59:58.225527+0000","last_fullsized":"2023-12-07T09:59:58.225527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:36:48.300066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225018+0000","last_change":"2023-12-07T09:59:57.237336+0000","last_active":"2023-12-07T09:59:58.225018+0000","last_peered":"2023-12-07T09:59:58.225018+0000","last_clean":"2023-12-07T09:59:58.225018+0000","last_became_active":"2023-12-07T09:59:57.237105+0000","last_became_peered":"2023-12-07T09:59:57.237105+0000","last_unstale":"2023-12-07T09:59:58.225018+0000","last_undegraded":"2023-12-07T09:59:58.225018+0000","last_fullsized":"2023-12-07T09:59:58.225018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225409+0000","last_change":"2023-12-07T09:59:57.224514+0000","last_active":"2023-12-07T09:59:58.225409+0000","last_peered":"2023-12-07T09:59:58.225409+0000","last_clean":"2023-12-07T09:59:58.225409+0000","last_became_active":"2023-12-07T09:59:57.223056+0000","last_became_peered":"2023-12-07T09:59:57.223056+0000","last_unstale":"2023-12-07T09:59:58.225409+0000","last_undegraded":"2023-12-07T09:59:58.225409+0000","last_fullsized":"2023-12-07T09:59:58.225409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:12.564625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216281+0000","last_change":"2023-12-07T09:59:57.229394+0000","last_active":"2023-12-07T09:59:58.216281+0000","last_peered":"2023-12-07T09:59:58.216281+0000","last_clean":"2023-12-07T09:59:58.216281+0000","last_became_active":"2023-12-07T09:59:57.229071+0000","last_became_peered":"2023-12-07T09:59:57.229071+0000","last_unstale":"2023-12-07T09:59:58.216281+0000","last_undegraded":"2023-12-07T09:59:58.216281+0000","last_fullsized":"2023-12-07T09:59:58.216281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216294+0000","last_change":"2023-12-07T09:59:57.237863+0000","last_active":"2023-12-07T09:59:58.216294+0000","last_peered":"2023-12-07T09:59:58.216294+0000","last_clean":"2023-12-07T09:59:58.216294+0000","last_became_active":"2023-12-07T09:59:57.237612+0000","last_became_peered":"2023-12-07T09:59:57.237612+0000","last_unstale":"2023-12-07T09:59:58.216294+0000","last_undegraded":"2023-12-07T09:59:58.216294+0000","last_fullsized":"2023-12-07T09:59:58.216294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223318+0000","last_change":"2023-12-07T09:59:57.230638+0000","last_active":"2023-12-07T09:59:58.223318+0000","last_peered":"2023-12-07T09:59:58.223318+0000","last_clean":"2023-12-07T09:59:58.223318+0000","last_became_active":"2023-12-07T09:59:57.230319+0000","last_became_peered":"2023-12-07T09:59:57.230319+0000","last_unstale":"2023-12-07T09:59:58.223318+0000","last_undegraded":"2023-12-07T09:59:58.223318+0000","last_fullsized":"2023-12-07T09:59:58.223318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.213681+0000","last_change":"2023-12-07T09:59:57.223628+0000","last_active":"2023-12-07T09:59:58.213681+0000","last_peered":"2023-12-07T09:59:58.213681+0000","last_clean":"2023-12-07T09:59:58.213681+0000","last_became_active":"2023-12-07T09:59:57.223315+0000","last_became_peered":"2023-12-07T09:59:57.223315+0000","last_unstale":"2023-12-07T09:59:58.213681+0000","last_undegraded":"2023-12-07T09:59:58.213681+0000","last_fullsized":"2023-12-07T09:59:58.213681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224233+0000","last_change":"2023-12-07T09:59:57.235369+0000","last_active":"2023-12-07T09:59:58.224233+0000","last_peered":"2023-12-07T09:59:58.224233+0000","last_clean":"2023-12-07T09:59:58.224233+0000","last_became_active":"2023-12-07T09:59:57.235129+0000","last_became_peered":"2023-12-07T09:59:57.235129+0000","last_unstale":"2023-12-07T09:59:58.224233+0000","last_undegraded":"2023-12-07T09:59:58.224233+0000","last_fullsized":"2023-12-07T09:59:58.224233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225502+0000","last_change":"2023-12-07T09:59:57.228494+0000","last_active":"2023-12-07T09:59:58.225502+0000","last_peered":"2023-12-07T09:59:58.225502+0000","last_clean":"2023-12-07T09:59:58.225502+0000","last_became_active":"2023-12-07T09:59:57.228210+0000","last_became_peered":"2023-12-07T09:59:57.228210+0000","last_unstale":"2023-12-07T09:59:58.225502+0000","last_undegraded":"2023-12-07T09:59:58.225502+0000","last_fullsized":"2023-12-07T09:59:58.225502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:58.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223902+0000","last_change":"2023-12-07T09:59:57.245295+0000","last_active":"2023-12-07T09:59:58.223902+0000","last_peered":"2023-12-07T09:59:58.223902+0000","last_clean":"2023-12-07T09:59:58.223902+0000","last_became_active":"2023-12-07T09:59:57.245030+0000","last_became_peered":"2023-12-07T09:59:57.245030+0000","last_unstale":"2023-12-07T09:59:58.223902+0000","last_undegraded":"2023-12-07T09:59:58.223902+0000","last_fullsized":"2023-12-07T09:59:58.223902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214375+0000","last_change":"2023-12-07T09:59:57.227268+0000","last_active":"2023-12-07T09:59:58.214375+0000","last_peered":"2023-12-07T09:59:58.214375+0000","last_clean":"2023-12-07T09:59:58.214375+0000","last_became_active":"2023-12-07T09:59:57.226493+0000","last_became_peered":"2023-12-07T09:59:57.226493+0000","last_unstale":"2023-12-07T09:59:58.214375+0000","last_undegraded":"2023-12-07T09:59:58.214375+0000","last_fullsized":"2023-12-07T09:59:58.214375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216345+0000","last_change":"2023-12-07T09:59:57.236890+0000","last_active":"2023-12-07T09:59:58.216345+0000","last_peered":"2023-12-07T09:59:58.216345+0000","last_clean":"2023-12-07T09:59:58.216345+0000","last_became_active":"2023-12-07T09:59:57.236640+0000","last_became_peered":"2023-12-07T09:59:57.236640+0000","last_unstale":"2023-12-07T09:59:58.216345+0000","last_undegraded":"2023-12-07T09:59:58.216345+0000","last_fullsized":"2023-12-07T09:59:58.216345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214980+0000","last_change":"2023-12-07T09:59:57.244392+0000","last_active":"2023-12-07T09:59:58.214980+0000","last_peered":"2023-12-07T09:59:58.214980+0000","last_clean":"2023-12-07T09:59:58.214980+0000","last_became_active":"2023-12-07T09:59:57.244056+0000","last_became_peered":"2023-12-07T09:59:57.244056+0000","last_unstale":"2023-12-07T09:59:58.214980+0000","last_undegraded":"2023-12-07T09:59:58.214980+0000","last_fullsized":"2023-12-07T09:59:58.214980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223926+0000","last_change":"2023-12-07T09:59:57.239542+0000","last_active":"2023-12-07T09:59:58.223926+0000","last_peered":"2023-12-07T09:59:58.223926+0000","last_clean":"2023-12-07T09:59:58.223926+0000","last_became_active":"2023-12-07T09:59:57.238943+0000","last_became_peered":"2023-12-07T09:59:57.238943+0000","last_unstale":"2023-12-07T09:59:58.223926+0000","last_undegraded":"2023-12-07T09:59:58.223926+0000","last_fullsized":"2023-12-07T09:59:58.223926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:31.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214770+0000","last_change":"2023-12-07T09:59:57.230613+0000","last_active":"2023-12-07T09:59:58.214770+0000","last_peered":"2023-12-07T09:59:58.214770+0000","last_clean":"2023-12-07T09:59:58.214770+0000","last_became_active":"2023-12-07T09:59:57.228342+0000","last_became_peered":"2023-12-07T09:59:57.228342+0000","last_unstale":"2023-12-07T09:59:58.214770+0000","last_undegraded":"2023-12-07T09:59:58.214770+0000","last_fullsized":"2023-12-07T09:59:58.214770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223922+0000","last_change":"2023-12-07T09:59:57.229840+0000","last_active":"2023-12-07T09:59:58.223922+0000","last_peered":"2023-12-07T09:59:58.223922+0000","last_clean":"2023-12-07T09:59:58.223922+0000","last_became_active":"2023-12-07T09:59:57.229062+0000","last_became_peered":"2023-12-07T09:59:57.229062+0000","last_unstale":"2023-12-07T09:59:58.223922+0000","last_undegraded":"2023-12-07T09:59:58.223922+0000","last_fullsized":"2023-12-07T09:59:58.223922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261037+0000","last_change":"2023-12-07T09:59:56.247813+0000","last_active":"2023-12-07T09:59:57.261037+0000","last_peered":"2023-12-07T09:59:57.261037+0000","last_clean":"2023-12-07T09:59:57.261037+0000","last_became_active":"2023-12-07T09:59:56.247138+0000","last_became_peered":"2023-12-07T09:59:56.247138+0000","last_unstale":"2023-12-07T09:59:57.261037+0000","last_undegraded":"2023-12-07T09:59:57.261037+0000","last_fullsized":"2023-12-07T09:59:57.261037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224106+0000","last_change":"2023-12-07T09:59:57.240365+0000","last_active":"2023-12-07T09:59:58.224106+0000","last_peered":"2023-12-07T09:59:58.224106+0000","last_clean":"2023-12-07T09:59:58.224106+0000","last_became_active":"2023-12-07T09:59:57.240064+0000","last_became_peered":"2023-12-07T09:59:57.240064+0000","last_unstale":"2023-12-07T09:59:58.224106+0000","last_undegraded":"2023-12-07T09:59:58.224106+0000","last_fullsized":"2023-12-07T09:59:58.224106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.259136+0000","last_change":"2023-12-07T09:59:56.235235+0000","last_active":"2023-12-07T09:59:57.259136+0000","last_peered":"2023-12-07T09:59:57.259136+0000","last_clean":"2023-12-07T09:59:57.259136+0000","last_became_active":"2023-12-07T09:59:56.234964+0000","last_became_peered":"2023-12-07T09:59:56.234964+0000","last_unstale":"2023-12-07T09:59:57.259136+0000","last_undegraded":"2023-12-07T09:59:57.259136+0000","last_fullsized":"2023-12-07T09:59:57.259136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216365+0000","last_change":"2023-12-07T09:59:57.239310+0000","last_active":"2023-12-07T09:59:58.216365+0000","last_peered":"2023-12-07T09:59:58.216365+0000","last_clean":"2023-12-07T09:59:58.216365+0000","last_became_active":"2023-12-07T09:59:57.239006+0000","last_became_peered":"2023-12-07T09:59:57.239006+0000","last_unstale":"2023-12-07T09:59:58.216365+0000","last_undegraded":"2023-12-07T09:59:58.216365+0000","last_fullsized":"2023-12-07T09:59:58.216365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.263399+0000","last_change":"2023-12-07T09:59:56.254732+0000","last_active":"2023-12-07T09:59:57.263399+0000","last_peered":"2023-12-07T09:59:57.263399+0000","last_clean":"2023-12-07T09:59:57.263399+0000","last_became_active":"2023-12-07T09:59:56.254439+0000","last_became_peered":"2023-12-07T09:59:56.254439+0000","last_unstale":"2023-12-07T09:59:57.263399+0000","last_undegraded":"2023-12-07T09:59:57.263399+0000","last_fullsized":"2023-12-07T09:59:57.263399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223971+0000","last_change":"2023-12-07T09:59:57.245223+0000","last_active":"2023-12-07T09:59:58.223971+0000","last_peered":"2023-12-07T09:59:58.223971+0000","last_clean":"2023-12-07T09:59:58.223971+0000","last_became_active":"2023-12-07T09:59:57.245009+0000","last_became_peered":"2023-12-07T09:59:57.245009+0000","last_unstale":"2023-12-07T09:59:58.223971+0000","last_undegraded":"2023-12-07T09:59:58.223971+0000","last_fullsized":"2023-12-07T09:59:58.223971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261894+0000","last_change":"2023-12-07T09:59:56.251685+0000","last_active":"2023-12-07T09:59:57.261894+0000","last_peered":"2023-12-07T09:59:57.261894+0000","last_clean":"2023-12-07T09:59:57.261894+0000","last_became_active":"2023-12-07T09:59:56.251379+0000","last_became_peered":"2023-12-07T09:59:56.251379+0000","last_unstale":"2023-12-07T09:59:57.261894+0000","last_undegraded":"2023-12-07T09:59:57.261894+0000","last_fullsized":"2023-12-07T09:59:57.261894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:45.496128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215488+0000","last_change":"2023-12-07T09:59:57.232971+0000","last_active":"2023-12-07T09:59:58.215488+0000","last_peered":"2023-12-07T09:59:58.215488+0000","last_clean":"2023-12-07T09:59:58.215488+0000","last_became_active":"2023-12-07T09:59:57.232675+0000","last_became_peered":"2023-12-07T09:59:57.232675+0000","last_unstale":"2023-12-07T09:59:58.215488+0000","last_undegraded":"2023-12-07T09:59:58.215488+0000","last_fullsized":"2023-12-07T09:59:58.215488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261540+0000","last_change":"2023-12-07T09:59:56.257431+0000","last_active":"2023-12-07T09:59:57.261540+0000","last_peered":"2023-12-07T09:59:57.261540+0000","last_clean":"2023-12-07T09:59:57.261540+0000","last_became_active":"2023-12-07T09:59:56.257143+0000","last_became_peered":"2023-12-07T09:59:56.257143+0000","last_unstale":"2023-12-07T09:59:57.261540+0000","last_undegraded":"2023-12-07T09:59:57.261540+0000","last_fullsized":"2023-12-07T09:59:57.261540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214180+0000","last_change":"2023-12-07T09:59:57.228028+0000","last_active":"2023-12-07T09:59:58.214180+0000","last_peered":"2023-12-07T09:59:58.214180+0000","last_clean":"2023-12-07T09:59:58.214180+0000","last_became_active":"2023-12-07T09:59:57.227746+0000","last_became_peered":"2023-12-07T09:59:57.227746+0000","last_unstale":"2023-12-07T09:59:58.214180+0000","last_undegraded":"2023-12-07T09:59:58.214180+0000","last_fullsized":"2023-12-07T09:59:58.214180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.260598+0000","last_change":"2023-12-07T09:59:56.255384+0000","last_active":"2023-12-07T09:59:57.260598+0000","last_peered":"2023-12-07T09:59:57.260598+0000","last_clean":"2023-12-07T09:59:57.260598+0000","last_became_active":"2023-12-07T09:59:56.255104+0000","last_became_peered":"2023-12-07T09:59:56.255104+0000","last_unstale":"2023-12-07T09:59:57.260598+0000","last_undegraded":"2023-12-07T09:59:57.260598+0000","last_fullsized":"2023-12-07T09:59:57.260598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215915+0000","last_change":"2023-12-07T09:59:57.241610+0000","last_active":"2023-12-07T09:59:58.215915+0000","last_peered":"2023-12-07T09:59:58.215915+0000","last_clean":"2023-12-07T09:59:58.215915+0000","last_became_active":"2023-12-07T09:59:57.241339+0000","last_became_peered":"2023-12-07T09:59:57.241339+0000","last_unstale":"2023-12-07T09:59:58.215915+0000","last_undegraded":"2023-12-07T09:59:58.215915+0000","last_fullsized":"2023-12-07T09:59:58.215915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218354+0000","last_change":"2023-12-07T09:59:56.254460+0000","last_active":"2023-12-07T09:59:57.218354+0000","last_peered":"2023-12-07T09:59:57.218354+0000","last_clean":"2023-12-07T09:59:57.218354+0000","last_became_active":"2023-12-07T09:59:56.254187+0000","last_became_peered":"2023-12-07T09:59:56.254187+0000","last_unstale":"2023-12-07T09:59:57.218354+0000","last_undegraded":"2023-12-07T09:59:57.218354+0000","last_fullsized":"2023-12-07T09:59:57.218354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:04.346155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.222983+0000","last_change":"2023-12-07T09:59:57.233603+0000","last_active":"2023-12-07T09:59:58.222983+0000","last_peered":"2023-12-07T09:59:58.222983+0000","last_clean":"2023-12-07T09:59:58.222983+0000","last_became_active":"2023-12-07T09:59:57.233247+0000","last_became_peered":"2023-12-07T09:59:57.233247+0000","last_unstale":"2023-12-07T09:59:58.222983+0000","last_undegraded":"2023-12-07T09:59:58.222983+0000","last_fullsized":"2023-12-07T09:59:58.222983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218950+0000","last_change":"2023-12-07T09:59:56.240171+0000","last_active":"2023-12-07T09:59:57.218950+0000","last_peered":"2023-12-07T09:59:57.218950+0000","last_clean":"2023-12-07T09:59:57.218950+0000","last_became_active":"2023-12-07T09:59:56.239779+0000","last_became_peered":"2023-12-07T09:59:56.239779+0000","last_unstale":"2023-12-07T09:59:57.218950+0000","last_undegraded":"2023-12-07T09:59:57.218950+0000","last_fullsized":"2023-12-07T09:59:57.218950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214236+0000","last_change":"2023-12-07T09:59:57.239958+0000","last_active":"2023-12-07T09:59:58.214236+0000","last_peered":"2023-12-07T09:59:58.214236+0000","last_clean":"2023-12-07T09:59:58.214236+0000","last_became_active":"2023-12-07T09:59:57.239590+0000","last_became_peered":"2023-12-07T09:59:57.239590+0000","last_unstale":"2023-12-07T09:59:58.214236+0000","last_undegraded":"2023-12-07T09:59:58.214236+0000","last_fullsized":"2023-12-07T09:59:58.214236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.219810+0000","last_change":"2023-12-07T09:59:56.249207+0000","last_active":"2023-12-07T09:59:57.219810+0000","last_peered":"2023-12-07T09:59:57.219810+0000","last_clean":"2023-12-07T09:59:57.219810+0000","last_became_active":"2023-12-07T09:59:56.248795+0000","last_became_peered":"2023-12-07T09:59:56.248795+0000","last_unstale":"2023-12-07T09:59:57.219810+0000","last_undegraded":"2023-12-07T09:59:57.219810+0000","last_fullsized":"2023-12-07T09:59:57.219810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:39.635874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225303+0000","last_change":"2023-12-07T09:59:57.237888+0000","last_active":"2023-12-07T09:59:58.225303+0000","last_peered":"2023-12-07T09:59:58.225303+0000","last_clean":"2023-12-07T09:59:58.225303+0000","last_became_active":"2023-12-07T09:59:57.237543+0000","last_became_peered":"2023-12-07T09:59:57.237543+0000","last_unstale":"2023-12-07T09:59:58.225303+0000","last_undegraded":"2023-12-07T09:59:58.225303+0000","last_fullsized":"2023-12-07T09:59:58.225303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:26.165219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.222117+0000","last_change":"2023-12-07T09:59:56.257460+0000","last_active":"2023-12-07T09:59:57.222117+0000","last_peered":"2023-12-07T09:59:57.222117+0000","last_clean":"2023-12-07T09:59:57.222117+0000","last_became_active":"2023-12-07T09:59:56.257108+0000","last_became_peered":"2023-12-07T09:59:56.257108+0000","last_unstale":"2023-12-07T09:59:57.222117+0000","last_undegraded":"2023-12-07T09:59:57.222117+0000","last_fullsized":"2023-12-07T09:59:57.222117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225101+0000","last_change":"2023-12-07T09:59:57.232163+0000","last_active":"2023-12-07T09:59:58.225101+0000","last_peered":"2023-12-07T09:59:58.225101+0000","last_clean":"2023-12-07T09:59:58.225101+0000","last_became_active":"2023-12-07T09:59:57.231401+0000","last_became_peered":"2023-12-07T09:59:57.231401+0000","last_unstale":"2023-12-07T09:59:58.225101+0000","last_undegraded":"2023-12-07T09:59:58.225101+0000","last_fullsized":"2023-12-07T09:59:58.225101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:01:46.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.260990+0000","last_change":"2023-12-07T09:59:56.245272+0000","last_active":"2023-12-07T09:59:57.260990+0000","last_peered":"2023-12-07T09:59:57.260990+0000","last_clean":"2023-12-07T09:59:57.260990+0000","last_became_active":"2023-12-07T09:59:56.244612+0000","last_became_peered":"2023-12-07T09:59:56.244612+0000","last_unstale":"2023-12-07T09:59:57.260990+0000","last_undegraded":"2023-12-07T09:59:57.260990+0000","last_fullsized":"2023-12-07T09:59:57.260990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214059+0000","last_change":"2023-12-07T09:59:57.240066+0000","last_active":"2023-12-07T09:59:58.214059+0000","last_peered":"2023-12-07T09:59:58.214059+0000","last_clean":"2023-12-07T09:59:58.214059+0000","last_became_active":"2023-12-07T09:59:57.239795+0000","last_became_peered":"2023-12-07T09:59:57.239795+0000","last_unstale":"2023-12-07T09:59:58.214059+0000","last_undegraded":"2023-12-07T09:59:58.214059+0000","last_fullsized":"2023-12-07T09:59:58.214059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.268856+0000","last_change":"2023-12-07T09:59:56.256946+0000","last_active":"2023-12-07T09:59:57.268856+0000","last_peered":"2023-12-07T09:59:57.268856+0000","last_clean":"2023-12-07T09:59:57.268856+0000","last_became_active":"2023-12-07T09:59:56.256514+0000","last_became_peered":"2023-12-07T09:59:56.256514+0000","last_unstale":"2023-12-07T09:59:57.268856+0000","last_undegraded":"2023-12-07T09:59:57.268856+0000","last_fullsized":"2023-12-07T09:59:57.268856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:25.242109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223163+0000","last_change":"2023-12-07T09:59:57.233881+0000","last_active":"2023-12-07T09:59:58.223163+0000","last_peered":"2023-12-07T09:59:58.223163+0000","last_clean":"2023-12-07T09:59:58.223163+0000","last_became_active":"2023-12-07T09:59:57.233618+0000","last_became_peered":"2023-12-07T09:59:57.233618+0000","last_unstale":"2023-12-07T09:59:58.223163+0000","last_undegraded":"2023-12-07T09:59:58.223163+0000","last_fullsized":"2023-12-07T09:59:58.223163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261402+0000","last_change":"2023-12-07T09:59:56.244124+0000","last_active":"2023-12-07T09:59:57.261402+0000","last_peered":"2023-12-07T09:59:57.261402+0000","last_clean":"2023-12-07T09:59:57.261402+0000","last_became_active":"2023-12-07T09:59:56.243879+0000","last_became_peered":"2023-12-07T09:59:56.243879+0000","last_unstale":"2023-12-07T09:59:57.261402+0000","last_undegraded":"2023-12-07T09:59:57.261402+0000","last_fullsized":"2023-12-07T09:59:57.261402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:03.809080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225017+0000","last_change":"2023-12-07T09:59:57.226535+0000","last_active":"2023-12-07T09:59:58.225017+0000","last_peered":"2023-12-07T09:59:58.225017+0000","last_clean":"2023-12-07T09:59:58.225017+0000","last_became_active":"2023-12-07T09:59:57.226242+0000","last_became_peered":"2023-12-07T09:59:57.226242+0000","last_unstale":"2023-12-07T09:59:58.225017+0000","last_undegraded":"2023-12-07T09:59:58.225017+0000","last_fullsized":"2023-12-07T09:59:58.225017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.216732+0000","last_change":"2023-12-07T09:59:56.245266+0000","last_active":"2023-12-07T09:59:57.216732+0000","last_peered":"2023-12-07T09:59:57.216732+0000","last_clean":"2023-12-07T09:59:57.216732+0000","last_became_active":"2023-12-07T09:59:56.244990+0000","last_became_peered":"2023-12-07T09:59:56.244990+0000","last_unstale":"2023-12-07T09:59:57.216732+0000","last_undegraded":"2023-12-07T09:59:57.216732+0000","last_fullsized":"2023-12-07T09:59:57.216732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214803+0000","last_change":"2023-12-07T09:59:57.231869+0000","last_active":"2023-12-07T09:59:58.214803+0000","last_peered":"2023-12-07T09:59:58.214803+0000","last_clean":"2023-12-07T09:59:58.214803+0000","last_became_active":"2023-12-07T09:59:57.231357+0000","last_became_peered":"2023-12-07T09:59:57.231357+0000","last_unstale":"2023-12-07T09:59:58.214803+0000","last_undegraded":"2023-12-07T09:59:58.214803+0000","last_fullsized":"2023-12-07T09:59:58.214803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218227+0000","last_change":"2023-12-07T09:59:56.249076+0000","last_active":"2023-12-07T09:59:57.218227+0000","last_peered":"2023-12-07T09:59:57.218227+0000","last_clean":"2023-12-07T09:59:57.218227+0000","last_became_active":"2023-12-07T09:59:56.248779+0000","last_became_peered":"2023-12-07T09:59:56.248779+0000","last_unstale":"2023-12-07T09:59:57.218227+0000","last_undegraded":"2023-12-07T09:59:57.218227+0000","last_fullsized":"2023-12-07T09:59:57.218227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223928+0000","last_change":"2023-12-07T09:59:57.239368+0000","last_active":"2023-12-07T09:59:58.223928+0000","last_peered":"2023-12-07T09:59:58.223928+0000","last_clean":"2023-12-07T09:59:58.223928+0000","last_became_active":"2023-12-07T09:59:57.238640+0000","last_became_peered":"2023-12-07T09:59:57.238640+0000","last_unstale":"2023-12-07T09:59:58.223928+0000","last_undegraded":"2023-12-07T09:59:58.223928+0000","last_fullsized":"2023-12-07T09:59:58.223928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:17.962783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.264641+0000","last_change":"2023-12-07T09:59:56.252633+0000","last_active":"2023-12-07T09:59:57.264641+0000","last_peered":"2023-12-07T09:59:57.264641+0000","last_clean":"2023-12-07T09:59:57.264641+0000","last_became_active":"2023-12-07T09:59:56.252316+0000","last_became_peered":"2023-12-07T09:59:56.252316+0000","last_unstale":"2023-12-07T09:59:57.264641+0000","last_undegraded":"2023-12-07T09:59:57.264641+0000","last_fullsized":"2023-12-07T09:59:57.264641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:29.900543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.216261+0000","last_change":"2023-12-07T09:59:57.224125+0000","last_active":"2023-12-07T09:59:58.216261+0000","last_peered":"2023-12-07T09:59:58.216261+0000","last_clean":"2023-12-07T09:59:58.216261+0000","last_became_active":"2023-12-07T09:59:57.223773+0000","last_became_peered":"2023-12-07T09:59:57.223773+0000","last_unstale":"2023-12-07T09:59:58.216261+0000","last_undegraded":"2023-12-07T09:59:58.216261+0000","last_fullsized":"2023-12-07T09:59:58.216261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.266693+0000","last_change":"2023-12-07T09:59:56.258524+0000","last_active":"2023-12-07T09:59:57.266693+0000","last_peered":"2023-12-07T09:59:57.266693+0000","last_clean":"2023-12-07T09:59:57.266693+0000","last_became_active":"2023-12-07T09:59:56.258272+0000","last_became_peered":"2023-12-07T09:59:56.258272+0000","last_unstale":"2023-12-07T09:59:57.266693+0000","last_undegraded":"2023-12-07T09:59:57.266693+0000","last_fullsized":"2023-12-07T09:59:57.266693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214349+0000","last_change":"2023-12-07T09:59:57.222118+0000","last_active":"2023-12-07T09:59:58.214349+0000","last_peered":"2023-12-07T09:59:58.214349+0000","last_clean":"2023-12-07T09:59:58.214349+0000","last_became_active":"2023-12-07T09:59:57.221427+0000","last_became_peered":"2023-12-07T09:59:57.221427+0000","last_unstale":"2023-12-07T09:59:58.214349+0000","last_undegraded":"2023-12-07T09:59:58.214349+0000","last_fullsized":"2023-12-07T09:59:58.214349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261128+0000","last_change":"2023-12-07T09:59:56.243609+0000","last_active":"2023-12-07T09:59:57.261128+0000","last_peered":"2023-12-07T09:59:57.261128+0000","last_clean":"2023-12-07T09:59:57.261128+0000","last_became_active":"2023-12-07T09:59:56.243310+0000","last_became_peered":"2023-12-07T09:59:56.243310+0000","last_unstale":"2023-12-07T09:59:57.261128+0000","last_undegraded":"2023-12-07T09:59:57.261128+0000","last_fullsized":"2023-12-07T09:59:57.261128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224395+0000","last_change":"2023-12-07T09:59:57.240863+0000","last_active":"2023-12-07T09:59:58.224395+0000","last_peered":"2023-12-07T09:59:58.224395+0000","last_clean":"2023-12-07T09:59:58.224395+0000","last_became_active":"2023-12-07T09:59:57.239236+0000","last_became_peered":"2023-12-07T09:59:57.239236+0000","last_unstale":"2023-12-07T09:59:58.224395+0000","last_undegraded":"2023-12-07T09:59:58.224395+0000","last_fullsized":"2023-12-07T09:59:58.224395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.262429+0000","last_change":"2023-12-07T09:59:56.247923+0000","last_active":"2023-12-07T09:59:57.262429+0000","last_peered":"2023-12-07T09:59:57.262429+0000","last_clean":"2023-12-07T09:59:57.262429+0000","last_became_active":"2023-12-07T09:59:56.247372+0000","last_became_peered":"2023-12-07T09:59:56.247372+0000","last_unstale":"2023-12-07T09:59:57.262429+0000","last_undegraded":"2023-12-07T09:59:57.262429+0000","last_fullsized":"2023-12-07T09:59:57.262429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225364+0000","last_change":"2023-12-07T09:59:57.230224+0000","last_active":"2023-12-07T09:59:58.225364+0000","last_peered":"2023-12-07T09:59:58.225364+0000","last_clean":"2023-12-07T09:59:58.225364+0000","last_became_active":"2023-12-07T09:59:57.229926+0000","last_became_peered":"2023-12-07T09:59:57.229926+0000","last_unstale":"2023-12-07T09:59:58.225364+0000","last_undegraded":"2023-12-07T09:59:58.225364+0000","last_fullsized":"2023-12-07T09:59:58.225364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:14.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.220419+0000","last_change":"2023-12-07T09:59:56.257331+0000","last_active":"2023-12-07T09:59:57.220419+0000","last_peered":"2023-12-07T09:59:57.220419+0000","last_clean":"2023-12-07T09:59:57.220419+0000","last_became_active":"2023-12-07T09:59:56.257002+0000","last_became_peered":"2023-12-07T09:59:56.257002+0000","last_unstale":"2023-12-07T09:59:57.220419+0000","last_undegraded":"2023-12-07T09:59:57.220419+0000","last_fullsized":"2023-12-07T09:59:57.220419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224887+0000","last_change":"2023-12-07T09:59:57.229233+0000","last_active":"2023-12-07T09:59:58.224887+0000","last_peered":"2023-12-07T09:59:58.224887+0000","last_clean":"2023-12-07T09:59:58.224887+0000","last_became_active":"2023-12-07T09:59:57.228954+0000","last_became_peered":"2023-12-07T09:59:57.228954+0000","last_unstale":"2023-12-07T09:59:58.224887+0000","last_undegraded":"2023-12-07T09:59:58.224887+0000","last_fullsized":"2023-12-07T09:59:58.224887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:10:27.580956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.261930+0000","last_change":"2023-12-07T09:59:56.245087+0000","last_active":"2023-12-07T09:59:57.261930+0000","last_peered":"2023-12-07T09:59:57.261930+0000","last_clean":"2023-12-07T09:59:57.261930+0000","last_became_active":"2023-12-07T09:59:56.244700+0000","last_became_peered":"2023-12-07T09:59:56.244700+0000","last_unstale":"2023-12-07T09:59:57.261930+0000","last_undegraded":"2023-12-07T09:59:57.261930+0000","last_fullsized":"2023-12-07T09:59:57.261930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225233+0000","last_change":"2023-12-07T09:59:57.226382+0000","last_active":"2023-12-07T09:59:58.225233+0000","last_peered":"2023-12-07T09:59:58.225233+0000","last_clean":"2023-12-07T09:59:58.225233+0000","last_became_active":"2023-12-07T09:59:57.226109+0000","last_became_peered":"2023-12-07T09:59:57.226109+0000","last_unstale":"2023-12-07T09:59:58.225233+0000","last_undegraded":"2023-12-07T09:59:58.225233+0000","last_fullsized":"2023-12-07T09:59:58.225233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:33.099334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.235952+0000","last_change":"2023-12-07T09:59:56.250622+0000","last_active":"2023-12-07T09:59:57.235952+0000","last_peered":"2023-12-07T09:59:57.235952+0000","last_clean":"2023-12-07T09:59:57.235952+0000","last_became_active":"2023-12-07T09:59:56.250318+0000","last_became_peered":"2023-12-07T09:59:56.250318+0000","last_unstale":"2023-12-07T09:59:57.235952+0000","last_undegraded":"2023-12-07T09:59:57.235952+0000","last_fullsized":"2023-12-07T09:59:57.235952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224724+0000","last_change":"2023-12-07T09:59:57.222557+0000","last_active":"2023-12-07T09:59:58.224724+0000","last_peered":"2023-12-07T09:59:58.224724+0000","last_clean":"2023-12-07T09:59:58.224724+0000","last_became_active":"2023-12-07T09:59:57.221911+0000","last_became_peered":"2023-12-07T09:59:57.221911+0000","last_unstale":"2023-12-07T09:59:58.224724+0000","last_undegraded":"2023-12-07T09:59:58.224724+0000","last_fullsized":"2023-12-07T09:59:58.224724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:08.918724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218443+0000","last_change":"2023-12-07T09:59:56.248159+0000","last_active":"2023-12-07T09:59:57.218443+0000","last_peered":"2023-12-07T09:59:57.218443+0000","last_clean":"2023-12-07T09:59:57.218443+0000","last_became_active":"2023-12-07T09:59:56.247890+0000","last_became_peered":"2023-12-07T09:59:56.247890+0000","last_unstale":"2023-12-07T09:59:57.218443+0000","last_undegraded":"2023-12-07T09:59:57.218443+0000","last_fullsized":"2023-12-07T09:59:57.218443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:11.557704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214972+0000","last_change":"2023-12-07T09:59:57.244429+0000","last_active":"2023-12-07T09:59:58.214972+0000","last_peered":"2023-12-07T09:59:58.214972+0000","last_clean":"2023-12-07T09:59:58.214972+0000","last_became_active":"2023-12-07T09:59:57.244108+0000","last_became_peered":"2023-12-07T09:59:57.244108+0000","last_unstale":"2023-12-07T09:59:58.214972+0000","last_undegraded":"2023-12-07T09:59:58.214972+0000","last_fullsized":"2023-12-07T09:59:58.214972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.214202+0000","last_change":"2023-12-07T09:59:56.250231+0000","last_active":"2023-12-07T09:59:57.214202+0000","last_peered":"2023-12-07T09:59:57.214202+0000","last_clean":"2023-12-07T09:59:57.214202+0000","last_became_active":"2023-12-07T09:59:56.249795+0000","last_became_peered":"2023-12-07T09:59:56.249795+0000","last_unstale":"2023-12-07T09:59:57.214202+0000","last_undegraded":"2023-12-07T09:59:57.214202+0000","last_fullsized":"2023-12-07T09:59:57.214202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.225438+0000","last_change":"2023-12-07T09:59:57.223699+0000","last_active":"2023-12-07T09:59:58.225438+0000","last_peered":"2023-12-07T09:59:58.225438+0000","last_clean":"2023-12-07T09:59:58.225438+0000","last_became_active":"2023-12-07T09:59:57.223208+0000","last_became_peered":"2023-12-07T09:59:57.223208+0000","last_unstale":"2023-12-07T09:59:58.225438+0000","last_undegraded":"2023-12-07T09:59:58.225438+0000","last_fullsized":"2023-12-07T09:59:58.225438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:08.149324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.259713+0000","last_change":"2023-12-07T09:59:56.244977+0000","last_active":"2023-12-07T09:59:57.259713+0000","last_peered":"2023-12-07T09:59:57.259713+0000","last_clean":"2023-12-07T09:59:57.259713+0000","last_became_active":"2023-12-07T09:59:56.244693+0000","last_became_peered":"2023-12-07T09:59:56.244693+0000","last_unstale":"2023-12-07T09:59:57.259713+0000","last_undegraded":"2023-12-07T09:59:57.259713+0000","last_fullsized":"2023-12-07T09:59:57.259713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:40.487500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.214471+0000","last_change":"2023-12-07T09:59:57.239649+0000","last_active":"2023-12-07T09:59:58.214471+0000","last_peered":"2023-12-07T09:59:58.214471+0000","last_clean":"2023-12-07T09:59:58.214471+0000","last_became_active":"2023-12-07T09:59:57.239278+0000","last_became_peered":"2023-12-07T09:59:57.239278+0000","last_unstale":"2023-12-07T09:59:58.214471+0000","last_undegraded":"2023-12-07T09:59:58.214471+0000","last_fullsized":"2023-12-07T09:59:58.214471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.224204+0000","last_change":"2023-12-07T09:59:56.246751+0000","last_active":"2023-12-07T09:59:58.224204+0000","last_peered":"2023-12-07T09:59:58.224204+0000","last_clean":"2023-12-07T09:59:58.224204+0000","last_became_active":"2023-12-07T09:59:56.246313+0000","last_became_peered":"2023-12-07T09:59:56.246313+0000","last_unstale":"2023-12-07T09:59:58.224204+0000","last_undegraded":"2023-12-07T09:59:58.224204+0000","last_fullsized":"2023-12-07T09:59:58.224204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223891+0000","last_change":"2023-12-07T09:59:57.234589+0000","last_active":"2023-12-07T09:59:58.223891+0000","last_peered":"2023-12-07T09:59:58.223891+0000","last_clean":"2023-12-07T09:59:58.223891+0000","last_became_active":"2023-12-07T09:59:57.234320+0000","last_became_peered":"2023-12-07T09:59:57.234320+0000","last_unstale":"2023-12-07T09:59:58.223891+0000","last_undegraded":"2023-12-07T09:59:58.223891+0000","last_fullsized":"2023-12-07T09:59:58.223891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.224731+0000","last_change":"2023-12-07T09:59:56.247423+0000","last_active":"2023-12-07T09:59:57.224731+0000","last_peered":"2023-12-07T09:59:57.224731+0000","last_clean":"2023-12-07T09:59:57.224731+0000","last_became_active":"2023-12-07T09:59:56.247188+0000","last_became_peered":"2023-12-07T09:59:56.247188+0000","last_unstale":"2023-12-07T09:59:57.224731+0000","last_undegraded":"2023-12-07T09:59:57.224731+0000","last_fullsized":"2023-12-07T09:59:57.224731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223850+0000","last_change":"2023-12-07T09:59:57.238384+0000","last_active":"2023-12-07T09:59:58.223850+0000","last_peered":"2023-12-07T09:59:58.223850+0000","last_clean":"2023-12-07T09:59:58.223850+0000","last_became_active":"2023-12-07T09:59:57.238044+0000","last_became_peered":"2023-12-07T09:59:57.238044+0000","last_unstale":"2023-12-07T09:59:58.223850+0000","last_undegraded":"2023-12-07T09:59:58.223850+0000","last_fullsized":"2023-12-07T09:59:58.223850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:54.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.221478+0000","last_change":"2023-12-07T09:59:56.244982+0000","last_active":"2023-12-07T09:59:57.221478+0000","last_peered":"2023-12-07T09:59:57.221478+0000","last_clean":"2023-12-07T09:59:57.221478+0000","last_became_active":"2023-12-07T09:59:56.244390+0000","last_became_peered":"2023-12-07T09:59:56.244390+0000","last_unstale":"2023-12-07T09:59:57.221478+0000","last_undegraded":"2023-12-07T09:59:57.221478+0000","last_fullsized":"2023-12-07T09:59:57.221478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223762+0000","last_change":"2023-12-07T09:59:57.242678+0000","last_active":"2023-12-07T09:59:58.223762+0000","last_peered":"2023-12-07T09:59:58.223762+0000","last_clean":"2023-12-07T09:59:58.223762+0000","last_became_active":"2023-12-07T09:59:57.242415+0000","last_became_peered":"2023-12-07T09:59:57.242415+0000","last_unstale":"2023-12-07T09:59:58.223762+0000","last_undegraded":"2023-12-07T09:59:58.223762+0000","last_fullsized":"2023-12-07T09:59:58.223762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.216858+0000","last_change":"2023-12-07T09:59:56.248618+0000","last_active":"2023-12-07T09:59:57.216858+0000","last_peered":"2023-12-07T09:59:57.216858+0000","last_clean":"2023-12-07T09:59:57.216858+0000","last_became_active":"2023-12-07T09:59:56.245467+0000","last_became_peered":"2023-12-07T09:59:56.245467+0000","last_unstale":"2023-12-07T09:59:57.216858+0000","last_undegraded":"2023-12-07T09:59:57.216858+0000","last_fullsized":"2023-12-07T09:59:57.216858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.223612+0000","last_change":"2023-12-07T09:59:57.239076+0000","last_active":"2023-12-07T09:59:58.223612+0000","last_peered":"2023-12-07T09:59:58.223612+0000","last_clean":"2023-12-07T09:59:58.223612+0000","last_became_active":"2023-12-07T09:59:57.238794+0000","last_became_peered":"2023-12-07T09:59:57.238794+0000","last_unstale":"2023-12-07T09:59:58.223612+0000","last_undegraded":"2023-12-07T09:59:58.223612+0000","last_fullsized":"2023-12-07T09:59:58.223612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.218595+0000","last_change":"2023-12-07T09:59:56.244136+0000","last_active":"2023-12-07T09:59:57.218595+0000","last_peered":"2023-12-07T09:59:57.218595+0000","last_clean":"2023-12-07T09:59:57.218595+0000","last_became_active":"2023-12-07T09:59:56.243848+0000","last_became_peered":"2023-12-07T09:59:56.243848+0000","last_unstale":"2023-12-07T09:59:57.218595+0000","last_undegraded":"2023-12-07T09:59:57.218595+0000","last_fullsized":"2023-12-07T09:59:57.218595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215811+0000","last_change":"2023-12-07T09:59:57.231677+0000","last_active":"2023-12-07T09:59:58.215811+0000","last_peered":"2023-12-07T09:59:58.215811+0000","last_clean":"2023-12-07T09:59:58.215811+0000","last_became_active":"2023-12-07T09:59:57.231321+0000","last_became_peered":"2023-12-07T09:59:57.231321+0000","last_unstale":"2023-12-07T09:59:58.215811+0000","last_undegraded":"2023-12-07T09:59:58.215811+0000","last_fullsized":"2023-12-07T09:59:58.215811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.220706+0000","last_change":"2023-12-07T09:59:56.249073+0000","last_active":"2023-12-07T09:59:57.220706+0000","last_peered":"2023-12-07T09:59:57.220706+0000","last_clean":"2023-12-07T09:59:57.220706+0000","last_became_active":"2023-12-07T09:59:56.248772+0000","last_became_peered":"2023-12-07T09:59:56.248772+0000","last_unstale":"2023-12-07T09:59:57.220706+0000","last_undegraded":"2023-12-07T09:59:57.220706+0000","last_fullsized":"2023-12-07T09:59:57.220706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:47.202027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-07T09:59:58.215455+0000","last_change":"2023-12-07T09:59:57.228735+0000","last_active":"2023-12-07T09:59:58.215455+0000","last_peered":"2023-12-07T09:59:58.215455+0000","last_clean":"2023-12-07T09:59:58.215455+0000","last_became_active":"2023-12-07T09:59:57.228440+0000","last_became_peered":"2023-12-07T09:59:57.228440+0000","last_unstale":"2023-12-07T09:59:58.215455+0000","last_undegraded":"2023-12-07T09:59:58.215455+0000","last_fullsized":"2023-12-07T09:59:58.215455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.235558+0000","last_change":"2023-12-07T09:59:56.247518+0000","last_active":"2023-12-07T09:59:57.235558+0000","last_peered":"2023-12-07T09:59:57.235558+0000","last_clean":"2023-12-07T09:59:57.235558+0000","last_became_active":"2023-12-07T09:59:56.246103+0000","last_became_peered":"2023-12-07T09:59:56.246103+0000","last_unstale":"2023-12-07T09:59:57.235558+0000","last_undegraded":"2023-12-07T09:59:57.235558+0000","last_fullsized":"2023-12-07T09:59:57.235558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-07T09:59:57.224048+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T09:59:57.224048+0000","last_peered":"2023-12-07T09:59:57.224048+0000","last_clean":"2023-12-07T09:59:57.224048+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T09:59:57.224048+0000","last_undegraded":"2023-12-07T09:59:57.224048+0000","last_fullsized":"2023-12-07T09:59:57.224048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8540000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:06.185 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T10:00:06.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-07T10:00:06.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.357+0000 7ff8d19e6640 1 Processor -- start 2023-12-07T10:00:06.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.357+0000 7ff8d19e6640 1 -- start start 2023-12-07T10:00:06.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8d19e6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8cc151e20 0x7ff8cc0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8d19e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc0c7da0 0x7ff8cc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8d19e6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc06bd20 con 0x7ff8cc06ca50 2023-12-07T10:00:06.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8d19e6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc0c5330 con 0x7ff8cc151e20 2023-12-07T10:00:06.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8d19e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc06c5c0 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8caffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8cc151e20 0x7ff8cc0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8ca7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff8cc06ca50 0x7ff8cc0c68b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49810/0 (socket says 172.21.15.89:49810) 2023-12-07T10:00:06.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8ca7fc640 1 -- 172.21.15.89:0/1576607911 learned_addr learned my addr 172.21.15.89:0/1576607911 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:06.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8cb7fe640 1 --2- 172.21.15.89:0/1576607911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc0c7da0 0x7ff8cc15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8caffd640 1 -- 172.21.15.89:0/1576607911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc0c7da0 msgr2=0x7ff8cc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:06.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8caffd640 1 --2- 172.21.15.89:0/1576607911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc0c7da0 0x7ff8cc15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8caffd640 1 -- 172.21.15.89:0/1576607911 >> v1:172.21.15.89:6789/0 conn(0x7ff8cc06ca50 legacy=0x7ff8cc0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8caffd640 1 -- 172.21.15.89:0/1576607911 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc155480 con 0x7ff8cc151e20 2023-12-07T10:00:06.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.361+0000 7ff8c9ffb640 1 -- 172.21.15.89:0/1576607911 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240752004 0 0) 0x7ff8cc06bd20 con 0x7ff8cc06ca50 2023-12-07T10:00:06.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8caffd640 1 --2- 172.21.15.89:0/1576607911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc151e20 0x7ff8cc0c4820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097c0 tx=0x7ff8bc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1163a695850cfb34 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8c9ffb640 1 -- 172.21.15.89:0/1576607911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0ab600 con 0x7ff8cc151e20 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8c9ffb640 1 -- 172.21.15.89:0/1576607911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0a7050 con 0x7ff8cc151e20 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8c9ffb640 1 -- 172.21.15.89:0/1576607911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0ab980 con 0x7ff8cc151e20 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- 172.21.15.89:0/1576607911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc151e20 msgr2=0x7ff8cc0c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/1576607911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc151e20 0x7ff8cc0c4820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097c0 tx=0x7ff8bc01c330 comp rx=0 tx=0).stop 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- 172.21.15.89:0/1576607911 shutdown_connections 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/1576607911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc0c7da0 0x7ff8cc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/1576607911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc151e20 0x7ff8cc0c4820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- 172.21.15.89:0/1576607911 >> 172.21.15.89:0/1576607911 conn(0x7ff8cc0aba70 msgr2=0x7ff8cc0abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- 172.21.15.89:0/1576607911 shutdown_connections 2023-12-07T10:00:06.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- 172.21.15.89:0/1576607911 wait complete. 2023-12-07T10:00:06.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 Processor -- start 2023-12-07T10:00:06.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- start start 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc06ca50 0x7ff8cc14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 0x7ff8cc1ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc151e20 0x7ff8cc1ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc146670 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1edde0 con 0x7ff8cc06ca50 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8d19e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc14bca0 con 0x7ff8cc151e20 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8ca7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 0x7ff8cc1ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8ca7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 0x7ff8cc1ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38014/0 (socket says 172.21.15.89:38014) 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.365+0000 7ff8ca7fc640 1 -- 172.21.15.89:0/2646372959 learned_addr learned my addr 172.21.15.89:0/2646372959 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:06.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8cb7fe640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc151e20 0x7ff8cc1ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8caffd640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc06ca50 0x7ff8cc14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8ca7fc640 1 -- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc151e20 msgr2=0x7ff8cc1ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8ca7fc640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc151e20 0x7ff8cc1ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8ca7fc640 1 -- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc06ca50 msgr2=0x7ff8cc14b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8ca7fc640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc06ca50 0x7ff8cc14b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8ca7fc640 1 -- 172.21.15.89:0/2646372959 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009420 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8ca7fc640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 0x7ff8cc1ed360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000c450 tx=0x7ff8c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c00074e0 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc0acef0 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c0007640 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c00049f0 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc0ad1b0 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc1ed030 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.369+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff8c0004b50 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.373+0000 7ff8b3fff640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8b80668d0 0x7ff8b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.373+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c0083980 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.373+0000 7ff8caffd640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8b80668d0 0x7ff8b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.373+0000 7ff8caffd640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8b80668d0 0x7ff8b8068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0ad000 tx=0x7ff8bc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.377+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8c00546c0 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.577+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff8cc074970 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8b3fff640 1 -- 172.21.15.89:0/2646372959 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff8c0018070 con 0x7ff8cc0c7da0 2023-12-07T10:00:06.589 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-07T10:00:06.589 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg== 2023-12-07T10:00:06.590 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-12-07T10:00:06.590 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:00:06.590 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-07T10:00:06.590 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.0 2023-12-07T10:00:06.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8b80668d0 msgr2=0x7ff8b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8b80668d0 0x7ff8b8068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0ad000 tx=0x7ff8bc0a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:06.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 msgr2=0x7ff8cc1ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 0x7ff8cc1ed360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000c450 tx=0x7ff8c000c910 comp rx=0 tx=0).stop 2023-12-07T10:00:06.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 shutdown_connections 2023-12-07T10:00:06.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8b80668d0 0x7ff8b8068d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff8cc151e20 0x7ff8cc1ed8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8cc0c7da0 0x7ff8cc1ed360 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 --2- 172.21.15.89:0/2646372959 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc06ca50 0x7ff8cc14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 >> 172.21.15.89:0/2646372959 conn(0x7ff8cc0aba70 msgr2=0x7ff8cc0c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:06.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 shutdown_connections 2023-12-07T10:00:06.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.581+0000 7ff8d19e6640 1 -- 172.21.15.89:0/2646372959 wait complete. 2023-12-07T10:00:06.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:06.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 Processor -- start 2023-12-07T10:00:06.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 -- start start 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7da014e9d0 0x7f7da0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7da0070b80 0x7f7da00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da00c1f20 0x7f7da006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da006d320 con 0x7f7da014e9d0 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00721b0 con 0x7f7da0070b80 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da78c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da00c2830 con 0x7f7da00c1f20 2023-12-07T10:00:06.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7da014e9d0 0x7f7da0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7da014e9d0 0x7f7da0151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38030/0 (socket says 172.21.15.89:38030) 2023-12-07T10:00:06.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 -- 172.21.15.89:0/2347405379 learned_addr learned my addr 172.21.15.89:0/2347405379 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:06.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da4e64640 1 --2- 172.21.15.89:0/2347405379 >> v2:172.21.15.97:3300/0 conn(0x7f7da0070b80 0x7f7da00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5e66640 1 --2- 172.21.15.89:0/2347405379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da00c1f20 0x7f7da006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 -- 172.21.15.89:0/2347405379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da00c1f20 msgr2=0x7f7da006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:06.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 --2- 172.21.15.89:0/2347405379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da00c1f20 0x7f7da006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 -- 172.21.15.89:0/2347405379 >> v2:172.21.15.97:3300/0 conn(0x7f7da0070b80 msgr2=0x7f7da00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:06.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 --2- 172.21.15.89:0/2347405379 >> v2:172.21.15.97:3300/0 conn(0x7f7da0070b80 0x7f7da00c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da5665640 1 -- 172.21.15.89:0/2347405379 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0072450 con 0x7f7da014e9d0 2023-12-07T10:00:06.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.741+0000 7f7da4e64640 1 --2- 172.21.15.89:0/2347405379 >> v2:172.21.15.97:3300/0 conn(0x7f7da0070b80 0x7f7da00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:06.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da5665640 1 --2- 172.21.15.89:0/2347405379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da014e9d0 0x7f7da0151e60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7da006e420 tx=0x7f7d9c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd96f621ad99ad8e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7d97fff640 1 -- 172.21.15.89:0/2347405379 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0ab600 con 0x7f7da014e9d0 2023-12-07T10:00:06.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7d97fff640 1 -- 172.21.15.89:0/2347405379 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c0a7050 con 0x7f7da014e9d0 2023-12-07T10:00:06.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7d97fff640 1 -- 172.21.15.89:0/2347405379 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0ab980 con 0x7f7da014e9d0 2023-12-07T10:00:06.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 -- 172.21.15.89:0/2347405379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da014e9d0 msgr2=0x7f7da0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2347405379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da014e9d0 0x7f7da0151e60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7da006e420 tx=0x7f7d9c01c470 comp rx=0 tx=0).stop 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 -- 172.21.15.89:0/2347405379 shutdown_connections 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2347405379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da00c1f20 0x7f7da006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2347405379 >> v2:172.21.15.97:3300/0 conn(0x7f7da0070b80 0x7f7da00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2347405379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da014e9d0 0x7f7da0151e60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 -- 172.21.15.89:0/2347405379 >> 172.21.15.89:0/2347405379 conn(0x7f7da00c2ad0 msgr2=0x7f7da00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 -- 172.21.15.89:0/2347405379 shutdown_connections 2023-12-07T10:00:06.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.745+0000 7f7da78c9640 1 -- 172.21.15.89:0/2347405379 wait complete. 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 Processor -- start 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- start start 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da0070b80 0x7f7da00c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 0x7f7da01e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7da014e9d0 0x7f7da01e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01e9ec0 con 0x7f7da00c1f20 2023-12-07T10:00:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01e8f40 con 0x7f7da014e9d0 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da00ac260 con 0x7f7da0070b80 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 0x7f7da01e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 0x7f7da01e9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38046/0 (socket says 172.21.15.89:38046) 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 -- 172.21.15.89:0/2979782280 learned_addr learned my addr 172.21.15.89:0/2979782280 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da5665640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da0070b80 0x7f7da00c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da5e66640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7da014e9d0 0x7f7da01e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 -- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da0070b80 msgr2=0x7f7da00c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da0070b80 0x7f7da00c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 -- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7da014e9d0 msgr2=0x7f7da01e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7da014e9d0 0x7f7da01e9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 -- 172.21.15.89:0/2979782280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0094d0 con 0x7f7da00c1f20 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da4e64640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 0x7f7da01e9440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7d900107c0 tx=0x7f7d90010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000ecf0 con 0x7f7da00c1f20 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9000ee50 con 0x7f7da00c1f20 2023-12-07T10:00:06.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90004230 con 0x7f7da00c1f20 2023-12-07T10:00:06.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da00abf80 con 0x7f7da00c1f20 2023-12-07T10:00:06.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da01ed240 con 0x7f7da00c1f20 2023-12-07T10:00:06.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.749+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da004e890 con 0x7f7da00c1f20 2023-12-07T10:00:06.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.753+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7d90004390 con 0x7f7da00c1f20 2023-12-07T10:00:06.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.753+0000 7f7d95ffb640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d840668d0 0x7f7d84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:06.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.753+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d90086760 con 0x7f7da00c1f20 2023-12-07T10:00:06.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.753+0000 7f7da5665640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d840668d0 0x7f7d84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:06.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.753+0000 7f7da5665640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d840668d0 0x7f7d84068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7da00c3980 tx=0x7f7d9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:06.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.757+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d900539b0 con 0x7f7da00c1f20 2023-12-07T10:00:06.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7da00700a0 con 0x7f7da00c1f20 2023-12-07T10:00:06.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7d95ffb640 1 -- 172.21.15.89:0/2979782280 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f7d90056fd0 con 0x7f7da00c1f20 2023-12-07T10:00:06.949 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:06.949 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5037,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-07T10:00:06.949 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 17 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d840668d0 msgr2=0x7f7d84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d840668d0 0x7f7d84068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7da00c3980 tx=0x7f7d9c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 msgr2=0x7f7da01e9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 0x7f7da01e9440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7d900107c0 tx=0x7f7d90010c80 comp rx=0 tx=0).stop 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 shutdown_connections 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7da014e9d0 0x7f7da01e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da00c1f20 0x7f7da01e9440 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d840668d0 0x7f7d84068d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 --2- 172.21.15.89:0/2979782280 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7da0070b80 0x7f7da00c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 >> 172.21.15.89:0/2979782280 conn(0x7f7da00c2ad0 msgr2=0x7f7da01451a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:06.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 shutdown_connections 2023-12-07T10:00:06.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:06.941+0000 7f7da78c9640 1 -- 172.21.15.89:0/2979782280 wait complete. 2023-12-07T10:00:07.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T09:59:56.607949+0000', 'modified': '2023-12-07T09:59:59.632179+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6835/2626061332', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6833', 'nonce': 2626061332}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 2626061332}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-07T10:00:07.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T10:00:07.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-07T10:00:07.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.505+0000 7f3d1152a640 1 Processor -- start 2023-12-07T10:00:07.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.505+0000 7f3d1152a640 1 -- start start 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d1152a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c070b80 0x7f3d0c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d1152a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3d0c0a8470 0x7f3d0c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d1152a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c06d320 con 0x7f3d0c14e9d0 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d1152a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0721b0 con 0x7f3d0c0a8470 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d1152a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0c2830 con 0x7f3d0c070b80 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3d0c0a8470 0x7f3d0c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3d0c14e9d0 0x7f3d0c0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49816/0 (socket says 172.21.15.89:49816) 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0affd640 1 -- 172.21.15.89:0/1254879810 learned_addr learned my addr 172.21.15.89:0/1254879810 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/1254879810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c070b80 0x7f3d0c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1254879810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c070b80 msgr2=0x7f3d0c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/1254879810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c070b80 0x7f3d0c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1254879810 >> v1:172.21.15.89:6789/0 conn(0x7f3d0c14e9d0 legacy=0x7f3d0c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1254879810 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c072450 con 0x7f3d0c0a8470 2023-12-07T10:00:07.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d09ffb640 1 -- 172.21.15.89:0/1254879810 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369468721 0 0) 0x7f3d0c06d320 con 0x7f3d0c14e9d0 2023-12-07T10:00:07.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.509+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/1254879810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0a8470 0x7f3d0c06d7b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009d90 tx=0x7f3d0401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc61460abaff9b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d09ffb640 1 -- 172.21.15.89:0/1254879810 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040a5890 con 0x7f3d0c0a8470 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d09ffb640 1 -- 172.21.15.89:0/1254879810 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d040a59f0 con 0x7f3d0c0a8470 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d09ffb640 1 -- 172.21.15.89:0/1254879810 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040a5d80 con 0x7f3d0c0a8470 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- 172.21.15.89:0/1254879810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0a8470 msgr2=0x7f3d0c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 --2- 172.21.15.89:0/1254879810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0a8470 0x7f3d0c06d7b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009d90 tx=0x7f3d0401c8c0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- 172.21.15.89:0/1254879810 shutdown_connections 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 --2- 172.21.15.89:0/1254879810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c0a8470 0x7f3d0c06d7b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 --2- 172.21.15.89:0/1254879810 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c070b80 0x7f3d0c151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- 172.21.15.89:0/1254879810 >> 172.21.15.89:0/1254879810 conn(0x7f3d0c0c2ad0 msgr2=0x7f3d0c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- 172.21.15.89:0/1254879810 shutdown_connections 2023-12-07T10:00:07.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- 172.21.15.89:0/1254879810 wait complete. 2023-12-07T10:00:07.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 Processor -- start 2023-12-07T10:00:07.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- start start 2023-12-07T10:00:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 0x7f3d0c0c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c0a8470 0x7f3d0c0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0c14e9d0 0x7f3d0c1ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c150f00 con 0x7f3d0c070b80 2023-12-07T10:00:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0abaa0 con 0x7f3d0c14e9d0 2023-12-07T10:00:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d1152a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c143800 con 0x7f3d0c0a8470 2023-12-07T10:00:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d0affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 0x7f3d0c0c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d0affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 0x7f3d0c0c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38054/0 (socket says 172.21.15.89:38054) 2023-12-07T10:00:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d0affd640 1 -- 172.21.15.89:0/427921515 learned_addr learned my addr 172.21.15.89:0/427921515 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0c14e9d0 0x7f3d0c1ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.513+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c0a8470 0x7f3d0c0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d0affd640 1 -- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c0a8470 msgr2=0x7f3d0c0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d0affd640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c0a8470 0x7f3d0c0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d0affd640 1 -- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0c14e9d0 msgr2=0x7f3d0c1ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d0affd640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0c14e9d0 0x7f3d0c1ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d0affd640 1 -- 172.21.15.89:0/427921515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009a70 con 0x7f3d0c070b80 2023-12-07T10:00:07.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d0affd640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 0x7f3d0c0c4a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c4b0 tx=0x7f3cfc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3cf37fe640 1 -- 172.21.15.89:0/427921515 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0074e0 con 0x7f3d0c070b80 2023-12-07T10:00:07.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3cf37fe640 1 -- 172.21.15.89:0/427921515 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc007660 con 0x7f3d0c070b80 2023-12-07T10:00:07.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c143520 con 0x7f3d0c070b80 2023-12-07T10:00:07.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3cf37fe640 1 -- 172.21.15.89:0/427921515 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc004a30 con 0x7f3d0c070b80 2023-12-07T10:00:07.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c14f3b0 con 0x7f3d0c070b80 2023-12-07T10:00:07.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3cf37fe640 1 -- 172.21.15.89:0/427921515 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3cfc004b90 con 0x7f3d0c070b80 2023-12-07T10:00:07.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3cf37fe640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3cf80668d0 0x7f3cf8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.517+0000 7f3cf37fe640 1 -- 172.21.15.89:0/427921515 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cfc0834d0 con 0x7f3d0c070b80 2023-12-07T10:00:07.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3cf80668d0 0x7f3cf8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 Processor -- start 2023-12-07T10:00:07.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- start start 2023-12-07T10:00:07.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3cf80668d0 0x7f3cf8068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0ac040 tx=0x7f3d00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f41fc0 0x561149f423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 0x561149f42cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f43200 0x561149f8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149e0b110 con 0x561149f428e0 2023-12-07T10:00:07.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149d9b9a0 con 0x561149f43200 2023-12-07T10:00:07.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x561149d98ed0 con 0x561149f41fc0 2023-12-07T10:00:07.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 0x561149f42cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 0x561149f42cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38066/0 (socket says 172.21.15.89:38066) 2023-12-07T10:00:07.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3325406710 learned_addr learned my addr 172.21.15.89:0/3325406710 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f41fc0 msgr2=0x561149f423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f41fc0 0x561149f423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f43200 msgr2=0x561149f8cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f43200 0x561149f8cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f43200 0x561149f8cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3325406710 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561149a8c890 con 0x561149f428e0 2023-12-07T10:00:07.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 0x561149f42cc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3d00010b20 tx=0x7f3d00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c300f3b5daffab7a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3cf0ff9640 1 -- 172.21.15.89:0/3325406710 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00025070 con 0x561149f428e0 2023-12-07T10:00:07.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3cf0ff9640 1 -- 172.21.15.89:0/3325406710 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0001a070 con 0x561149f428e0 2023-12-07T10:00:07.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3cf0ff9640 1 -- 172.21.15.89:0/3325406710 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00016cd0 con 0x561149f428e0 2023-12-07T10:00:07.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- 172.21.15.89:0/3325406710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 msgr2=0x561149f42cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 0x561149f42cc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3d00010b20 tx=0x7f3d00013000 comp rx=0 tx=0).stop 2023-12-07T10:00:07.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- 172.21.15.89:0/3325406710 shutdown_connections 2023-12-07T10:00:07.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f43200 0x561149f8cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f428e0 0x561149f42cc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 --2- 172.21.15.89:0/3325406710 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f41fc0 0x561149f423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- 172.21.15.89:0/3325406710 >> 172.21.15.89:0/3325406710 conn(0x561149f80830 msgr2=0x561149f82c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- 172.21.15.89:0/3325406710 shutdown_connections 2023-12-07T10:00:07.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.521+0000 7f3d148af000 1 -- 172.21.15.89:0/3325406710 wait complete. 2023-12-07T10:00:07.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- start start 2023-12-07T10:00:07.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 Processor -- start 2023-12-07T10:00:07.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f48df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 0x561149f49870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149d947c0 con 0x561149f43200 2023-12-07T10:00:07.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149d4cbf0 con 0x561149f41fc0 2023-12-07T10:00:07.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x561149d52a90 con 0x561149f428e0 2023-12-07T10:00:07.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 10 client.0 _ll_register_callbacks cb 0x561149f2fe20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T10:00:07.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 0x561149f49870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0a7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f48df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 0x561149f49870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38068/0 (socket says 172.21.15.89:38068) 2023-12-07T10:00:07.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1362180592 learned_addr learned my addr 172.21.15.89:0/1362180592 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 msgr2=0x561149f49330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f49330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 msgr2=0x561149f48df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f48df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/1362180592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0000e040 con 0x561149f43200 2023-12-07T10:00:07.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 0x561149f49870 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d0401a4f0 tx=0x7f3d0401b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e940af71873bd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3ce9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T10:00:07.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/1362180592 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04009450 con 0x561149f43200 2023-12-07T10:00:07.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/1362180592 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d040b8440 con 0x561149f43200 2023-12-07T10:00:07.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561149d56470 con 0x561149f43200 2023-12-07T10:00:07.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/1362180592 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d040b8600 con 0x561149f43200 2023-12-07T10:00:07.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 10 client.5268 fetch_fsmap learned FSMap version 17 2023-12-07T10:00:07.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561149d55190 con 0x561149f43200 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/1362180592 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561149d56470 con 0x561149f43200 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/1362180592 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3d040b8760 con 0x561149f43200 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 10 client.5268 fetch_fsmap finished waiting for FSMap version 17 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 10 client.5268 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 20 client.5268 populate_metadata read hostname 'smithi089' 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f95e40 0x561149f98230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 4 client.5268 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T10:00:07.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 --> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561149d59b50 con 0x561149f95e40 2023-12-07T10:00:07.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.525+0000 7f3d0affd640 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f95e40 0x561149f98230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d0affd640 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f95e40 0x561149f98230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5245339a316a1380 server_cookie=234a7d235191bc9d in_seq=0 out_seq=0 2023-12-07T10:00:07.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3ce9ffb640 10 client.5268 ms_handle_connect on v2:172.21.15.97:6833/2626061332 2023-12-07T10:00:07.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/1362180592 <== mds.0 v2:172.21.15.97:6833/2626061332 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561149d59b50 con 0x561149f95e40 2023-12-07T10:00:07.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3ce9ffb640 10 client.5268 handle_command_reply: tid=0 2023-12-07T10:00:07.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 client.5268 shutdown 2023-12-07T10:00:07.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 msgr2=0x561149f49870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 0x561149f49870 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d0401a4f0 tx=0x7f3d0401b100 comp rx=0 tx=0).stop 2023-12-07T10:00:07.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 shutdown_connections 2023-12-07T10:00:07.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f95e40 0x561149f98230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f43200 0x561149f49870 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f49330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3ce9ffb640 0 client.5268 ms_handle_reset on v2:172.21.15.97:6833/2626061332 2023-12-07T10:00:07.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 --2- 172.21.15.89:0/1362180592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f48df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 >> 172.21.15.89:0/1362180592 conn(0x561149f80830 msgr2=0x561149f82c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 shutdown_connections 2023-12-07T10:00:07.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 1 -- 172.21.15.89:0/1362180592 wait complete. 2023-12-07T10:00:07.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.529+0000 7f3d148af000 20 client.5268 trim_cache size 0 max 16384 2023-12-07T10:00:07.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 Processor -- start 2023-12-07T10:00:07.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- start start 2023-12-07T10:00:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f80830 0x561149f96220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 0x561149f96760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f96ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149a4d940 con 0x561149f41fc0 2023-12-07T10:00:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149d538f0 con 0x561149f80830 2023-12-07T10:00:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x561149f47590 con 0x561149f428e0 2023-12-07T10:00:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 0x561149f96760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 0x561149f96760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38084/0 (socket says 172.21.15.89:38084) 2023-12-07T10:00:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3853278360 learned_addr learned my addr 172.21.15.89:0/3853278360 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3853278360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 msgr2=0x561149f96ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f96ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3853278360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f80830 msgr2=0x561149f96220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f80830 0x561149f96220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 -- 172.21.15.89:0/3853278360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561149d3b490 con 0x561149f41fc0 2023-12-07T10:00:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 0x561149f96760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561149e37da0 tx=0x7f3d00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b737bc787b93bfa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3cf17fa640 1 -- 172.21.15.89:0/3853278360 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00025040 con 0x561149f41fc0 2023-12-07T10:00:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3cf17fa640 1 -- 172.21.15.89:0/3853278360 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0001a040 con 0x561149f41fc0 2023-12-07T10:00:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3cf17fa640 1 -- 172.21.15.89:0/3853278360 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000059a0 con 0x561149f41fc0 2023-12-07T10:00:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- 172.21.15.89:0/3853278360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 msgr2=0x561149f96760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 0x561149f96760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561149e37da0 tx=0x7f3d00015000 comp rx=0 tx=0).stop 2023-12-07T10:00:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- 172.21.15.89:0/3853278360 shutdown_connections 2023-12-07T10:00:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149f96ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f41fc0 0x561149f96760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 --2- 172.21.15.89:0/3853278360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f80830 0x561149f96220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- 172.21.15.89:0/3853278360 >> 172.21.15.89:0/3853278360 conn(0x561149f4a8a0 msgr2=0x561149f41860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- 172.21.15.89:0/3853278360 shutdown_connections 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.545+0000 7f3d148af000 1 -- 172.21.15.89:0/3853278360 wait complete. 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- start start 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 Processor -- start 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f994e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149fa7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 0x561149fa8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149a8d1b0 con 0x561149f80830 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x561149e1b570 con 0x561149f41fc0 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x561149d4dd60 con 0x561149f428e0 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 10 client.0 _ll_register_callbacks cb 0x561149d9f8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T10:00:07.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 0x561149fa8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 0x561149fa8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38088/0 (socket says 172.21.15.89:38088) 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/3538377389 learned_addr learned my addr 172.21.15.89:0/3538377389 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0a7fc640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149fa7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0affd640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 msgr2=0x561149fa7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149fa7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 msgr2=0x561149f994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 -- 172.21.15.89:0/3538377389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561149a8c890 con 0x561149f80830 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0b7fe640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 0x561149fa8220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d040194d0 tx=0x7f3d04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3012971369a962 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/3538377389 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04009450 con 0x561149f80830 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/3538377389 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d040039a0 con 0x561149f80830 2023-12-07T10:00:07.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561149d93110 con 0x561149f80830 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/3538377389 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d04003b60 con 0x561149f80830 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 10 client.5274 fetch_fsmap learned FSMap version 17 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561149a8ccc0 con 0x561149f80830 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/3538377389 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561149d93110 con 0x561149f80830 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/3538377389 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3d04003cc0 con 0x561149f80830 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 10 client.5274 fetch_fsmap finished waiting for FSMap version 17 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 10 client.5274 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 20 client.5274 populate_metadata read hostname 'smithi089' 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f43200 0x561149fa8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 4 client.5274 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 --> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561149dc1650 con 0x561149f43200 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0affd640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f43200 0x561149fa8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3ce9ffb640 10 client.5274 ms_handle_connect on v2:172.21.15.97:6833/2626061332 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.549+0000 7f3d0affd640 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f43200 0x561149fa8760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7474b751e38db367 server_cookie=e3a09481786ced8f in_seq=0 out_seq=0 2023-12-07T10:00:07.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3ce9ffb640 1 -- 172.21.15.89:0/3538377389 <== mds.0 v2:172.21.15.97:6833/2626061332 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x561149dc1650 con 0x561149f43200 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3ce9ffb640 10 client.5274 handle_command_reply: tid=0 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 client.5274 shutdown 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 msgr2=0x561149fa8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 0x561149fa8220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d040194d0 tx=0x7f3d04009750 comp rx=0 tx=0).stop 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 shutdown_connections 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:6833/2626061332,v1:172.21.15.97:6835/2626061332] conn(0x561149f43200 0x561149fa8760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561149f80830 0x561149fa8220 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x561149f428e0 0x561149fa7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3ce9ffb640 0 client.5274 ms_handle_reset on v2:172.21.15.97:6833/2626061332 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 --2- 172.21.15.89:0/3538377389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561149f41fc0 0x561149f994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 >> 172.21.15.89:0/3538377389 conn(0x561149f4a8a0 msgr2=0x561149f9a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 shutdown_connections 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 1 -- 172.21.15.89:0/3538377389 wait complete. 2023-12-07T10:00:07.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d148af000 20 client.5274 trim_cache size 0 max 16384 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "06923b89-f6c6-4736-b27e-9e03456ddc01", 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5052, 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 10.309831891, 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 17, 2023-12-07T10:00:07.578 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 31, 2023-12-07T10:00:07.579 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 31, 2023-12-07T10:00:07.579 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 17.41149776 2023-12-07T10:00:07.579 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3cf80668d0 msgr2=0x7f3cf8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3cf80668d0 0x7f3cf8068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0ac040 tx=0x7f3d00008040 comp rx=0 tx=0).stop 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 msgr2=0x7f3d0c0c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 0x7f3d0c0c4a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c4b0 tx=0x7f3cfc00c970 comp rx=0 tx=0).stop 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 shutdown_connections 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0c14e9d0 0x7f3d0c1ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3cf80668d0 0x7f3cf8068d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d0c0a8470 0x7f3d0c0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 --2- 172.21.15.89:0/427921515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d0c070b80 0x7f3d0c0c4a50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 >> 172.21.15.89:0/427921515 conn(0x7f3d0c0c2ad0 msgr2=0x7f3d0c1484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 shutdown_connections 2023-12-07T10:00:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.553+0000 7f3d1152a640 1 -- 172.21.15.89:0/427921515 wait complete. 2023-12-07T10:00:07.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:00:07.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.709+0000 7fcf5b3df640 1 Processor -- start 2023-12-07T10:00:07.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.709+0000 7fcf5b3df640 1 -- start start 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.709+0000 7fcf5b3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf54152ce0 0x7fcf5406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.709+0000 7fcf5b3df640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf5406d100 0x7fcf540c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.709+0000 7fcf5b3df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5406bea0 con 0x7fcf5406db80 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5b3df640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf54159b10 con 0x7fcf5406d100 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5b3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf54159550 con 0x7fcf54152ce0 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf5406d100 0x7fcf540c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf5406d100 0x7fcf540c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:38548/0 (socket says 172.21.15.89:38548) 2023-12-07T10:00:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 -- 172.21.15.89:0/2865870269 learned_addr learned my addr 172.21.15.89:0/2865870269 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5917b640 1 --2- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf54152ce0 0x7fcf5406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 -- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf54152ce0 msgr2=0x7fcf5406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 --2- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf54152ce0 0x7fcf5406c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 -- 172.21.15.89:0/2865870269 >> v1:172.21.15.97:6789/0 conn(0x7fcf5406db80 legacy=0x7fcf540700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 -- 172.21.15.89:0/2865870269 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54159830 con 0x7fcf5406d100 2023-12-07T10:00:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.713+0000 7fcf5997c640 1 --2- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c19e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009e50 tx=0x7fcf4c01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75aa205a11bd28f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf4bfff640 1 -- 172.21.15.89:0/2865870269 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0a5840 con 0x7fcf5406d100 2023-12-07T10:00:07.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf4bfff640 1 -- 172.21.15.89:0/2865870269 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c0a59a0 con 0x7fcf5406d100 2023-12-07T10:00:07.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf4bfff640 1 -- 172.21.15.89:0/2865870269 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0a5d30 con 0x7fcf5406d100 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 msgr2=0x7fcf540c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c19e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009e50 tx=0x7fcf4c01c980 comp rx=0 tx=0).stop 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- 172.21.15.89:0/2865870269 shutdown_connections 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c19e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/2865870269 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf54152ce0 0x7fcf5406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- 172.21.15.89:0/2865870269 >> 172.21.15.89:0/2865870269 conn(0x7fcf540c2ad0 msgr2=0x7fcf540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- 172.21.15.89:0/2865870269 shutdown_connections 2023-12-07T10:00:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- 172.21.15.89:0/2865870269 wait complete. 2023-12-07T10:00:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 Processor -- start 2023-12-07T10:00:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- start start 2023-12-07T10:00:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf5406db80 0x7fcf54148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 0x7fcf54149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf54149940 con 0x7fcf54152ce0 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf541f4e00 con 0x7fcf5406d100 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5b3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf541f24a0 con 0x7fcf5406db80 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5997c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 0x7fcf54149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5997c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 0x7fcf54149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38094/0 (socket says 172.21.15.89:38094) 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5997c640 1 -- 172.21.15.89:0/1380470592 learned_addr learned my addr 172.21.15.89:0/1380470592 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5917b640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.717+0000 7fcf5897a640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf5406db80 0x7fcf54148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5997c640 1 -- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf5406db80 msgr2=0x7fcf54148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5997c640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf5406db80 0x7fcf54148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5997c640 1 -- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 msgr2=0x7fcf540c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5997c640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5997c640 1 -- 172.21.15.89:0/1380470592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c009b30 con 0x7fcf54152ce0 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5997c640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 0x7fcf54149400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0af040 tx=0x7fcf4c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0b8670 con 0x7fcf54152ce0 2023-12-07T10:00:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c0b87d0 con 0x7fcf54152ce0 2023-12-07T10:00:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0b8b60 con 0x7fcf54152ce0 2023-12-07T10:00:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf541f16e0 con 0x7fcf54152ce0 2023-12-07T10:00:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf541f1ca0 con 0x7fcf54152ce0 2023-12-07T10:00:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5404e890 con 0x7fcf54152ce0 2023-12-07T10:00:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcf4c0b8cc0 con 0x7fcf54152ce0 2023-12-07T10:00:07.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf49ffb640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcf380668d0 0x7fcf38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:07.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.721+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf4c11f760 con 0x7fcf54152ce0 2023-12-07T10:00:07.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.725+0000 7fcf5917b640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcf380668d0 0x7fcf38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:07.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.725+0000 7fcf5917b640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcf380668d0 0x7fcf38068d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf540c5fa0 tx=0x7fcf50009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:07.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.729+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf4c0ecae0 con 0x7fcf54152ce0 2023-12-07T10:00:07.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.909+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf5406d960 con 0x7fcf54152ce0 2023-12-07T10:00:07.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.909+0000 7fcf49ffb640 1 -- 172.21.15.89:0/1380470592 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf4c0bc070 con 0x7fcf54152ce0 2023-12-07T10:00:07.919 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:00:07.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcf380668d0 msgr2=0x7fcf38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcf380668d0 0x7fcf38068d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcf540c5fa0 tx=0x7fcf50009190 comp rx=0 tx=0).stop 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 msgr2=0x7fcf54149400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 0x7fcf54149400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0af040 tx=0x7fcf4c019720 comp rx=0 tx=0).stop 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 shutdown_connections 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf54152ce0 0x7fcf54149400 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcf380668d0 0x7fcf38068d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcf5406db80 0x7fcf54148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 --2- 172.21.15.89:0/1380470592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf5406d100 0x7fcf540c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 >> 172.21.15.89:0/1380470592 conn(0x7fcf540c2ad0 msgr2=0x7fcf5414c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 shutdown_connections 2023-12-07T10:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:07.913+0000 7fcf5b3df640 1 -- 172.21.15.89:0/1380470592 wait complete. 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:00:07.940 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:00:07.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:00:07.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:00:07.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:07.941 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T10:00:07.951 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:00:07.951 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:00:07.951 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:00:07.951 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.951 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-12-07T10:00:07.952 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T10:00:07.953 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.953 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:00:07.953 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:07.953 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:00:07.953 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.953 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:07.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:07.955 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:00:08.010 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T10:00:08.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.012 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:08.069 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:00:08.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.070 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T10:00:08.070 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T10:00:08.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:00:08.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:00:08.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:00:08.071 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T10:00:08.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.163 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:00:08.172 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:00:08.173 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:00:08.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T10:00:08.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:08.236 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:08.292 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:00:08.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:08.292 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:08.343 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-07T10:00:08.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:08.439 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:08.439 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:08.452 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:08.452 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:08.452 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:00:08.452 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 0@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:00:08.453 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:00:08.456 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:00:08.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:08.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.479 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:00:08.540 INFO:teuthology.orchestra.run.smithi089.stdout:client4856 2023-12-07T10:00:08.541 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:08.541 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:08.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:00:08.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.761+0000 7f3a509f5640 1 Processor -- start 2023-12-07T10:00:08.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.761+0000 7f3a509f5640 1 -- start start 2023-12-07T10:00:08.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.761+0000 7f3a509f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3a4c14fcc0 0x7f3a4c156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:08.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.761+0000 7f3a509f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a4c0c19e0 0x7f3a4c0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:08.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a509f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c0ab580 con 0x7f3a4c06d980 2023-12-07T10:00:08.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a509f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0aa340 con 0x7f3a4c0c19e0 2023-12-07T10:00:08.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a509f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c152fe0 con 0x7f3a4c14fcc0 2023-12-07T10:00:08.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a4c0c19e0 0x7f3a4c0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3a4c0c19e0 0x7f3a4c0c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38106/0 (socket says 172.21.15.89:38106) 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/4131614667 learned_addr learned my addr 172.21.15.89:0/4131614667 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4a59c640 1 --2- 172.21.15.89:0/4131614667 >> v2:172.21.15.97:3300/0 conn(0x7f3a4c14fcc0 0x7f3a4c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/4131614667 >> v2:172.21.15.97:3300/0 conn(0x7f3a4c14fcc0 msgr2=0x7f3a4c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 --2- 172.21.15.89:0/4131614667 >> v2:172.21.15.97:3300/0 conn(0x7f3a4c14fcc0 0x7f3a4c156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/4131614667 >> v1:172.21.15.97:6789/0 conn(0x7f3a4c06d980 legacy=0x7f3a4c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:08.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/4131614667 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c1532c0 con 0x7f3a4c0c19e0 2023-12-07T10:00:08.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a4ad9d640 1 --2- 172.21.15.89:0/4131614667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c1e50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06e350 tx=0x7f3a4401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5d2e1297846ecf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:08.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a49d9b640 1 -- 172.21.15.89:0/4131614667 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440ac640 con 0x7f3a4c0c19e0 2023-12-07T10:00:08.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.765+0000 7f3a49d9b640 1 -- 172.21.15.89:0/4131614667 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440ac7a0 con 0x7f3a4c0c19e0 2023-12-07T10:00:08.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a49d9b640 1 -- 172.21.15.89:0/4131614667 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440acb30 con 0x7f3a4c0c19e0 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- 172.21.15.89:0/4131614667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c0c19e0 msgr2=0x7f3a4c0c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 --2- 172.21.15.89:0/4131614667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c1e50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06e350 tx=0x7f3a4401c4d0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- 172.21.15.89:0/4131614667 shutdown_connections 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 --2- 172.21.15.89:0/4131614667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c1e50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 --2- 172.21.15.89:0/4131614667 >> v2:172.21.15.97:3300/0 conn(0x7f3a4c14fcc0 0x7f3a4c156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- 172.21.15.89:0/4131614667 >> 172.21.15.89:0/4131614667 conn(0x7f3a4c0c2ad0 msgr2=0x7f3a4c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- 172.21.15.89:0/4131614667 shutdown_connections 2023-12-07T10:00:08.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- 172.21.15.89:0/4131614667 wait complete. 2023-12-07T10:00:08.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 Processor -- start 2023-12-07T10:00:08.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- start start 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a4c06d980 0x7f3a4c1f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 0x7f3a4c0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0a8cd0 con 0x7f3a4c150c80 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c1f0bc0 con 0x7f3a4c0c19e0 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a509f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c1f0ea0 con 0x7f3a4c06d980 2023-12-07T10:00:08.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a4ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 0x7f3a4c0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a4ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 0x7f3a4c0c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38112/0 (socket says 172.21.15.89:38112) 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/3434722583 learned_addr learned my addr 172.21.15.89:0/3434722583 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a4a59c640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a4c06d980 0x7f3a4c1f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.769+0000 7f3a41d9b640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a4c06d980 msgr2=0x7f3a4c1f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a4ad9d640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a4c06d980 0x7f3a4c1f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a4c0c19e0 msgr2=0x7f3a4c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a4ad9d640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a4ad9d640 1 -- 172.21.15.89:0/3434722583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440094d0 con 0x7f3a4c150c80 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a4ad9d640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 0x7f3a4c0c4ca0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3a440af040 tx=0x7f3a44019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440b5610 con 0x7f3a4c150c80 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440b5770 con 0x7f3a4c150c80 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c0c5a50 con 0x7f3a4c150c80 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440b5b20 con 0x7f3a4c150c80 2023-12-07T10:00:08.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c150630 con 0x7f3a4c150c80 2023-12-07T10:00:08.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c1f1060 con 0x7f3a4c150c80 2023-12-07T10:00:08.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a440b3040 con 0x7f3a4c150c80 2023-12-07T10:00:08.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a437fe640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a2c0668d0 0x7f3a2c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:08.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.773+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a4411e640 con 0x7f3a4c150c80 2023-12-07T10:00:08.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.777+0000 7f3a4a59c640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a2c0668d0 0x7f3a2c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:08.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.777+0000 7f3a4a59c640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a2c0668d0 0x7f3a2c068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0a9ab0 tx=0x7f3a3c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:08.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.777+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a440eb920 con 0x7f3a4c150c80 2023-12-07T10:00:08.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3a4c06dd60 con 0x7f3a4c150c80 2023-12-07T10:00:08.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a437fe640 1 -- 172.21.15.89:0/3434722583 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3a4c06dd60 con 0x7f3a4c150c80 2023-12-07T10:00:08.969 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a2c0668d0 msgr2=0x7f3a2c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a2c0668d0 0x7f3a2c068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0a9ab0 tx=0x7f3a3c009190 comp rx=0 tx=0).stop 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 msgr2=0x7f3a4c0c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 0x7f3a4c0c4ca0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3a440af040 tx=0x7f3a44019270 comp rx=0 tx=0).stop 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 shutdown_connections 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a4c150c80 0x7f3a4c0c4ca0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a4c0c19e0 0x7f3a4c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3a2c0668d0 0x7f3a2c068d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 --2- 172.21.15.89:0/3434722583 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a4c06d980 0x7f3a4c1f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:08.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 >> 172.21.15.89:0/3434722583 conn(0x7f3a4c0c2ad0 msgr2=0x7f3a4c14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:08.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 shutdown_connections 2023-12-07T10:00:08.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:08.961+0000 7f3a509f5640 1 -- 172.21.15.89:0/3434722583 wait complete. 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:00:08.990 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:00:08.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:08.991 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:09.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.005 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:00:09.070 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:00:09.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.072 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:09.124 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:00:09.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:00:09.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.219 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:00:09.229 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:00:09.229 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:00:09.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.229 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:00:09.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:09.294 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:09.349 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:00:09.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:09.349 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:09.400 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-07T10:00:09.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.400 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:09.491 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:09.491 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:09.504 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:09.504 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:09.504 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:00:09.505 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:00:09.505 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:00:09.507 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:00:09.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.508 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:09.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:09.528 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:00:09.581 INFO:teuthology.orchestra.run.smithi097.stdout:client4862 2023-12-07T10:00:09.581 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:09.581 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:09.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-07T10:00:09.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e81f5640 1 Processor -- start 2023-12-07T10:00:09.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e81f5640 1 -- start start 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e81f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06e014e9d0 0x7f06e0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e81f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e006d320 con 0x7f06e00a8470 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e81f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e00721b0 con 0x7f06e0070b80 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e81f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e00c2830 con 0x7f06e014e9d0 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e5f91640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06e014e9d0 0x7f06e0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e6792640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f06e00a8470 0x7f06e006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55308/0 (socket says 172.21.15.89:55308) 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e5f91640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06e014e9d0 0x7f06e0151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56824/0 (socket says 172.21.15.89:56824) 2023-12-07T10:00:09.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e6792640 1 -- 172.21.15.89:0/546522776 learned_addr learned my addr 172.21.15.89:0/546522776 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:09.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e5f91640 1 -- 172.21.15.89:0/546522776 >> v1:172.21.15.97:6789/0 conn(0x7f06e0070b80 legacy=0x7f06e00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e5f91640 1 -- 172.21.15.89:0/546522776 >> v1:172.21.15.89:6789/0 conn(0x7f06e00a8470 legacy=0x7f06e006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.765+0000 7f06e5f91640 1 -- 172.21.15.89:0/546522776 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0072450 con 0x7f06e014e9d0 2023-12-07T10:00:09.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e5f91640 1 --2- 172.21.15.89:0/546522776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e0151e60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0097c0 tx=0x7f06dc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560973a0b4e82e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:09.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e4f8f640 1 -- 172.21.15.89:0/546522776 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0ab600 con 0x7f06e014e9d0 2023-12-07T10:00:09.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e4f8f640 1 -- 172.21.15.89:0/546522776 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0a7050 con 0x7f06e014e9d0 2023-12-07T10:00:09.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e4f8f640 1 -- 172.21.15.89:0/546522776 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0ab980 con 0x7f06e014e9d0 2023-12-07T10:00:09.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 -- 172.21.15.89:0/546522776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 msgr2=0x7f06e0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 --2- 172.21.15.89:0/546522776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e0151e60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0097c0 tx=0x7f06dc01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 -- 172.21.15.89:0/546522776 shutdown_connections 2023-12-07T10:00:09.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 --2- 172.21.15.89:0/546522776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e0151e60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 -- 172.21.15.89:0/546522776 >> 172.21.15.89:0/546522776 conn(0x7f06e00c2ad0 msgr2=0x7f06e00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:09.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 -- 172.21.15.89:0/546522776 shutdown_connections 2023-12-07T10:00:09.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 -- 172.21.15.89:0/546522776 wait complete. 2023-12-07T10:00:09.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 Processor -- start 2023-12-07T10:00:09.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.769+0000 7f06e81f5640 1 -- start start 2023-12-07T10:00:09.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06e0070b80 0x7f06e01f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:09.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06e00a8470 0x7f06e0140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:09.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e00bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:09.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e014f6c0 con 0x7f06e014e9d0 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0140cd0 con 0x7f06e00a8470 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0140f70 con 0x7f06e0070b80 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e6792640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e00bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06e0070b80 0x7f06e01f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e6792640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e00bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56834/0 (socket says 172.21.15.89:56834) 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e6792640 1 -- 172.21.15.89:0/3201465725 learned_addr learned my addr 172.21.15.89:0/3201465725 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5790640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06e00a8470 0x7f06e0140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 -- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06e00a8470 msgr2=0x7f06e0140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06e00a8470 0x7f06e0140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 -- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 msgr2=0x7f06e00bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e00bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 -- 172.21.15.89:0/3201465725 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc009420 con 0x7f06e0070b80 2023-12-07T10:00:09.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e6792640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e00bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e5f91640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06e0070b80 0x7f06e01f1880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0ab000 tx=0x7f06dc01ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0b7650 con 0x7f06e0070b80 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0b77f0 con 0x7f06e0070b80 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0b7ba0 con 0x7f06e0070b80 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0141250 con 0x7f06e0070b80 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e01f1080 con 0x7f06e0070b80 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e0067a40 con 0x7f06e0070b80 2023-12-07T10:00:09.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.773+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f06dc0b7d00 con 0x7f06e0070b80 2023-12-07T10:00:09.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.777+0000 7f06d67fc640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06c40668d0 0x7f06c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:09.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.777+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06dc11e940 con 0x7f06e0070b80 2023-12-07T10:00:09.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.777+0000 7f06e5790640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06c40668d0 0x7f06c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:09.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.777+0000 7f06e5790640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06c40668d0 0x7f06c4068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06d0007fd0 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.781+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06dc0ebca0 con 0x7f06e0070b80 2023-12-07T10:00:09.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.985+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f06e004e890 con 0x7f06e0070b80 2023-12-07T10:00:09.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.985+0000 7f06d67fc640 1 -- 172.21.15.89:0/3201465725 <== mon.2 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7f06dc0b0090 con 0x7f06e0070b80 2023-12-07T10:00:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06c40668d0 msgr2=0x7f06c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06c40668d0 0x7f06c4068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06d0007fd0 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2023-12-07T10:00:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06e0070b80 msgr2=0x7f06e01f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06e0070b80 0x7f06e01f1880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0ab000 tx=0x7f06dc01ac30 comp rx=0 tx=0).stop 2023-12-07T10:00:09.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 shutdown_connections 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e014e9d0 0x7f06e00bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06e00a8470 0x7f06e0140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06c40668d0 0x7f06c4068d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 --2- 172.21.15.89:0/3201465725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06e0070b80 0x7f06e01f1880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 >> 172.21.15.89:0/3201465725 conn(0x7f06e00c2ad0 msgr2=0x7f06e00c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 shutdown_connections 2023-12-07T10:00:09.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:09.989+0000 7f06e81f5640 1 -- 172.21.15.89:0/3201465725 wait complete. 2023-12-07T10:00:10.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:10.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 Processor -- start 2023-12-07T10:00:10.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 -- start start 2023-12-07T10:00:10.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7238070b80 0x7f7238151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72380a8470 0x7f723806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723806d320 con 0x7f723814e9d0 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380721b0 con 0x7f72380a8470 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723e365640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72380c2830 con 0x7f7238070b80 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f7237fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f723814e9d0 0x7f72380c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55310/0 (socket says 172.21.15.89:55310) 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f7237fff640 1 -- 172.21.15.89:0/1642570432 learned_addr learned my addr 172.21.15.89:0/1642570432 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f723c902640 1 --2- 172.21.15.89:0/1642570432 >> v2:172.21.15.97:3300/0 conn(0x7f72380a8470 0x7f723806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f72377fe640 1 --2- 172.21.15.89:0/1642570432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7238070b80 0x7f7238151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f7236ffd640 1 -- 172.21.15.89:0/1642570432 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257683159 0 0) 0x7f723806d320 con 0x7f723814e9d0 2023-12-07T10:00:10.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f7236ffd640 1 -- 172.21.15.89:0/1642570432 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7220003530 con 0x7f723814e9d0 2023-12-07T10:00:10.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f72377fe640 1 -- 172.21.15.89:0/1642570432 >> v2:172.21.15.97:3300/0 conn(0x7f72380a8470 msgr2=0x7f723806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:10.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f72377fe640 1 --2- 172.21.15.89:0/1642570432 >> v2:172.21.15.97:3300/0 conn(0x7f72380a8470 0x7f723806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f72377fe640 1 -- 172.21.15.89:0/1642570432 >> v1:172.21.15.89:6789/0 conn(0x7f723814e9d0 legacy=0x7f72380c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.153+0000 7f72377fe640 1 -- 172.21.15.89:0/1642570432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238072450 con 0x7f7238070b80 2023-12-07T10:00:10.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f72377fe640 1 --2- 172.21.15.89:0/1642570432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7238070b80 0x7f7238151e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f722c0097c0 tx=0x7f722c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873ef69450639ac server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f7236ffd640 1 -- 172.21.15.89:0/1642570432 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0ab600 con 0x7f7238070b80 2023-12-07T10:00:10.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f7236ffd640 1 -- 172.21.15.89:0/1642570432 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c0a7050 con 0x7f7238070b80 2023-12-07T10:00:10.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f7236ffd640 1 -- 172.21.15.89:0/1642570432 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0ab980 con 0x7f7238070b80 2023-12-07T10:00:10.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 -- 172.21.15.89:0/1642570432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7238070b80 msgr2=0x7f7238151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 --2- 172.21.15.89:0/1642570432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7238070b80 0x7f7238151e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f722c0097c0 tx=0x7f722c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 -- 172.21.15.89:0/1642570432 shutdown_connections 2023-12-07T10:00:10.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 --2- 172.21.15.89:0/1642570432 >> v2:172.21.15.97:3300/0 conn(0x7f72380a8470 0x7f723806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 --2- 172.21.15.89:0/1642570432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7238070b80 0x7f7238151e60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 -- 172.21.15.89:0/1642570432 >> 172.21.15.89:0/1642570432 conn(0x7f72380c2ad0 msgr2=0x7f72380c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:10.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 -- 172.21.15.89:0/1642570432 shutdown_connections 2023-12-07T10:00:10.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.157+0000 7f723e365640 1 -- 172.21.15.89:0/1642570432 wait complete. 2023-12-07T10:00:10.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 Processor -- start 2023-12-07T10:00:10.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 -- start start 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 0x7f7238154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72380a8470 0x7f7238154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f723814e9d0 0x7f72381477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238152d50 con 0x7f7238070b80 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238153af0 con 0x7f723814e9d0 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72381550b0 con 0x7f72380a8470 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 0x7f7238154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 0x7f7238154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56838/0 (socket says 172.21.15.89:56838) 2023-12-07T10:00:10.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 -- 172.21.15.89:0/2550644450 learned_addr learned my addr 172.21.15.89:0/2550644450 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723c902640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f723814e9d0 0x7f72381477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f72377fe640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72380a8470 0x7f7238154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 -- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72380a8470 msgr2=0x7f7238154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72380a8470 0x7f7238154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 -- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f723814e9d0 msgr2=0x7f72381477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f723814e9d0 0x7f72381477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 -- 172.21.15.89:0/2550644450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c009420 con 0x7f7238070b80 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723c902640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f723814e9d0 0x7f72381477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:10.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7237fff640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 0x7f7238154630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f722800c450 tx=0x7f722800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228005cf0 con 0x7f7238070b80 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228005e50 con 0x7f7238070b80 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72381eda10 con 0x7f7238070b80 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228007270 con 0x7f7238070b80 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.161+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7238152970 con 0x7f7238070b80 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.165+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238152e90 con 0x7f7238070b80 2023-12-07T10:00:10.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.165+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f72280073d0 con 0x7f7238070b80 2023-12-07T10:00:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.165+0000 7f7234ff9640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7224066900 0x7f7224068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.165+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7228083780 con 0x7f7238070b80 2023-12-07T10:00:10.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.165+0000 7f72377fe640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7224066900 0x7f7224068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.165+0000 7f72377fe640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7224066900 0x7f7224068dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f722c0ad000 tx=0x7f722c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.169+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7228050b00 con 0x7f7238070b80 2023-12-07T10:00:10.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.317+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f723804e890 con 0x7f7238070b80 2023-12-07T10:00:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f7234ff9640 1 -- 172.21.15.89:0/2550644450 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f7228017090 con 0x7f7238070b80 2023-12-07T10:00:10.324 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:10.325 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":31,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T09:59:58.208016+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:10.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7224066900 msgr2=0x7f7224068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7224066900 0x7f7224068dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f722c0ad000 tx=0x7f722c008040 comp rx=0 tx=0).stop 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 msgr2=0x7f7238154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 0x7f7238154630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f722800c450 tx=0x7f722800c910 comp rx=0 tx=0).stop 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 shutdown_connections 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f723814e9d0 0x7f72381477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7224066900 0x7f7224068dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f72380a8470 0x7f7238154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 --2- 172.21.15.89:0/2550644450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7238070b80 0x7f7238154630 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 >> 172.21.15.89:0/2550644450 conn(0x7f72380c2ad0 msgr2=0x7f723814c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 shutdown_connections 2023-12-07T10:00:10.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.321+0000 7f723e365640 1 -- 172.21.15.89:0/2550644450 wait complete. 2023-12-07T10:00:10.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:55.032694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:55.602397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:10.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:10.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 Processor -- start 2023-12-07T10:00:10.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 -- start start 2023-12-07T10:00:10.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f647c0a86d0 0x7f647c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c14fd00 0x7f647c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c152d90 con 0x7f647c156600 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c152480 con 0x7f647c0a86d0 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f648105a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0a9760 con 0x7f647c14fd00 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f6473fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f647c156600 0x7f647c14f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55320/0 (socket says 172.21.15.89:55320) 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f6473fff640 1 -- 172.21.15.89:0/909845924 learned_addr learned my addr 172.21.15.89:0/909845924 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647ad9d640 1 --2- 172.21.15.89:0/909845924 >> v2:172.21.15.97:3300/0 conn(0x7f647c0a86d0 0x7f647c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647b59e640 1 --2- 172.21.15.89:0/909845924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c14fd00 0x7f647c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647a59c640 1 -- 172.21.15.89:0/909845924 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166876112 0 0) 0x7f647c152d90 con 0x7f647c156600 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647a59c640 1 -- 172.21.15.89:0/909845924 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6468003530 con 0x7f647c156600 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647b59e640 1 -- 172.21.15.89:0/909845924 >> v2:172.21.15.97:3300/0 conn(0x7f647c0a86d0 msgr2=0x7f647c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647b59e640 1 --2- 172.21.15.89:0/909845924 >> v2:172.21.15.97:3300/0 conn(0x7f647c0a86d0 0x7f647c0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647b59e640 1 -- 172.21.15.89:0/909845924 >> v1:172.21.15.89:6789/0 conn(0x7f647c156600 legacy=0x7f647c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647b59e640 1 -- 172.21.15.89:0/909845924 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c152740 con 0x7f647c14fd00 2023-12-07T10:00:10.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.485+0000 7f647ad9d640 1 --2- 172.21.15.89:0/909845924 >> v2:172.21.15.97:3300/0 conn(0x7f647c0a86d0 0x7f647c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f647b59e640 1 --2- 172.21.15.89:0/909845924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c14fd00 0x7f647c0aae40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6474009dc0 tx=0x7f647401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f7d72806bdc9540 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f647a59c640 1 -- 172.21.15.89:0/909845924 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740a58e0 con 0x7f647c14fd00 2023-12-07T10:00:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f647a59c640 1 -- 172.21.15.89:0/909845924 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64740a5a40 con 0x7f647c14fd00 2023-12-07T10:00:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f647a59c640 1 -- 172.21.15.89:0/909845924 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740a5dd0 con 0x7f647c14fd00 2023-12-07T10:00:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 -- 172.21.15.89:0/909845924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c14fd00 msgr2=0x7f647c0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 --2- 172.21.15.89:0/909845924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c14fd00 0x7f647c0aae40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6474009dc0 tx=0x7f647401c930 comp rx=0 tx=0).stop 2023-12-07T10:00:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 -- 172.21.15.89:0/909845924 shutdown_connections 2023-12-07T10:00:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 --2- 172.21.15.89:0/909845924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c14fd00 0x7f647c0aae40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 --2- 172.21.15.89:0/909845924 >> v2:172.21.15.97:3300/0 conn(0x7f647c0a86d0 0x7f647c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 -- 172.21.15.89:0/909845924 >> 172.21.15.89:0/909845924 conn(0x7f647c0c2a60 msgr2=0x7f647c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 -- 172.21.15.89:0/909845924 shutdown_connections 2023-12-07T10:00:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.489+0000 7f648105a640 1 -- 172.21.15.89:0/909845924 wait complete. 2023-12-07T10:00:10.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 Processor -- start 2023-12-07T10:00:10.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- start start 2023-12-07T10:00:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c0a86d0 0x7f647c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 0x7f647c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f647c156600 0x7f647c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c147980 con 0x7f647c14fd00 2023-12-07T10:00:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c153d30 con 0x7f647c156600 2023-12-07T10:00:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1486d0 con 0x7f647c0a86d0 2023-12-07T10:00:10.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 0x7f647c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 0x7f647c15b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56846/0 (socket says 172.21.15.89:56846) 2023-12-07T10:00:10.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 -- 172.21.15.89:0/3857422655 learned_addr learned my addr 172.21.15.89:0/3857422655 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f647ad9d640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c0a86d0 0x7f647c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f647b59e640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f647c156600 0x7f647c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 -- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c0a86d0 msgr2=0x7f647c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c0a86d0 0x7f647c1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 -- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f647c156600 msgr2=0x7f647c14e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f647c156600 0x7f647c14e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 -- 172.21.15.89:0/3857422655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009420 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f647ad9d640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c0a86d0 0x7f647c1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f6473fff640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 0x7f647c15b410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f646400c420 tx=0x7f646400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464005cf0 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464005e70 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640072f0 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6474009a70 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c148920 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.493+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c04e890 con 0x7f647c14fd00 2023-12-07T10:00:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.497+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6464007490 con 0x7f647c14fd00 2023-12-07T10:00:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.497+0000 7f64737fe640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f645c0668d0 0x7f645c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.497+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64640839a0 con 0x7f647c14fd00 2023-12-07T10:00:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.497+0000 7f647ad9d640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f645c0668d0 0x7f645c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.497+0000 7f647ad9d640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f645c0668d0 0x7f645c068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f647c155560 tx=0x7f646c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.501+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6464050d40 con 0x7f647c14fd00 2023-12-07T10:00:10.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.653+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f647c066d30 con 0x7f647c14fd00 2023-12-07T10:00:10.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.653+0000 7f64737fe640 1 -- 172.21.15.89:0/3857422655 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f647c066d30 con 0x7f647c14fd00 2023-12-07T10:00:10.658 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:10.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f645c0668d0 msgr2=0x7f645c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f645c0668d0 0x7f645c068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f647c155560 tx=0x7f646c009190 comp rx=0 tx=0).stop 2023-12-07T10:00:10.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 msgr2=0x7f647c15b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 0x7f647c15b410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f646400c420 tx=0x7f646400c8e0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 shutdown_connections 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f647c156600 0x7f647c14e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647c14fd00 0x7f647c15b410 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f645c0668d0 0x7f645c068d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 --2- 172.21.15.89:0/3857422655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f647c0a86d0 0x7f647c1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 >> 172.21.15.89:0/3857422655 conn(0x7f647c0c2a60 msgr2=0x7f647c0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 shutdown_connections 2023-12-07T10:00:10.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.657+0000 7f648105a640 1 -- 172.21.15.89:0/3857422655 wait complete. 2023-12-07T10:00:10.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:00:10.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.813+0000 7f90a132b640 1 Processor -- start 2023-12-07T10:00:10.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.813+0000 7f90a132b640 1 -- start start 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f90a132b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f909c0c30a0 0x7f909c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f90a132b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f909c0c4b80 0x7f909c0c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f90a132b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0c0930 con 0x7f909c0bc140 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f90a132b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0c05e0 con 0x7f909c0c30a0 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f90a132b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c154d00 con 0x7f909c0c4b80 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f909c0c30a0 0x7f909c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f909c0c30a0 0x7f909c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56854/0 (socket says 172.21.15.89:56854) 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 -- 172.21.15.89:0/4272368852 learned_addr learned my addr 172.21.15.89:0/4272368852 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f90a0b2a640 1 --2- 172.21.15.89:0/4272368852 >> v2:172.21.15.97:3300/0 conn(0x7f909c0c4b80 0x7f909c0c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 -- 172.21.15.89:0/4272368852 >> v2:172.21.15.97:3300/0 conn(0x7f909c0c4b80 msgr2=0x7f909c0c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 --2- 172.21.15.89:0/4272368852 >> v2:172.21.15.97:3300/0 conn(0x7f909c0c4b80 0x7f909c0c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 -- 172.21.15.89:0/4272368852 >> v1:172.21.15.97:6789/0 conn(0x7f909c0bc140 legacy=0x7f909c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 -- 172.21.15.89:0/4272368852 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c1549f0 con 0x7f909c0c30a0 2023-12-07T10:00:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909affd640 1 -- 172.21.15.89:0/4272368852 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463837027 0 0) 0x7f909c0c0930 con 0x7f909c0bc140 2023-12-07T10:00:10.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.817+0000 7f909b7fe640 1 --2- 172.21.15.89:0/4272368852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c072560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f909c151bb0 tx=0x7f909001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cbd23ec582c23c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f909affd640 1 -- 172.21.15.89:0/4272368852 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab600 con 0x7f909c0c30a0 2023-12-07T10:00:10.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f909affd640 1 -- 172.21.15.89:0/4272368852 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900a7050 con 0x7f909c0c30a0 2023-12-07T10:00:10.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f909affd640 1 -- 172.21.15.89:0/4272368852 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab980 con 0x7f909c0c30a0 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- 172.21.15.89:0/4272368852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 msgr2=0x7f909c072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 --2- 172.21.15.89:0/4272368852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c072560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f909c151bb0 tx=0x7f909001c470 comp rx=0 tx=0).stop 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- 172.21.15.89:0/4272368852 shutdown_connections 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 --2- 172.21.15.89:0/4272368852 >> v2:172.21.15.97:3300/0 conn(0x7f909c0c4b80 0x7f909c0c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 --2- 172.21.15.89:0/4272368852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c072560 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- 172.21.15.89:0/4272368852 >> 172.21.15.89:0/4272368852 conn(0x7f909c0c5a60 msgr2=0x7f909c0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- 172.21.15.89:0/4272368852 shutdown_connections 2023-12-07T10:00:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- 172.21.15.89:0/4272368852 wait complete. 2023-12-07T10:00:10.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 Processor -- start 2023-12-07T10:00:10.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- start start 2023-12-07T10:00:10.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909c0bc140 0x7f909c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c0bda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f909c0c4b80 0x7f909c0bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0bd300 con 0x7f909c0c30a0 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0bd5a0 con 0x7f909c0bc140 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f90a132b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1536f0 con 0x7f909c0c4b80 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f909b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c0bda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f909b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c0bda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56858/0 (socket says 172.21.15.89:56858) 2023-12-07T10:00:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.821+0000 7f909b7fe640 1 -- 172.21.15.89:0/4046332432 learned_addr learned my addr 172.21.15.89:0/4046332432 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909bfff640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909c0bc140 0x7f909c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909b7fe640 1 -- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f909c0c4b80 msgr2=0x7f909c0bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f90a0b2a640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f909c0c4b80 0x7f909c0bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909b7fe640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f909c0c4b80 0x7f909c0bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909b7fe640 1 -- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909c0bc140 msgr2=0x7f909c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909b7fe640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909c0bc140 0x7f909c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909b7fe640 1 -- 172.21.15.89:0/4046332432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900094d0 con 0x7f909c0c30a0 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909bfff640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909c0bc140 0x7f909c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f90a0b2a640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f909c0c4b80 0x7f909c0bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f909b7fe640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c0bda30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9090019080 tx=0x7f9090019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900abbb0 con 0x7f909c0c30a0 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900abd10 con 0x7f909c0c30a0 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900b4620 con 0x7f909c0c30a0 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c1539d0 con 0x7f909c0c30a0 2023-12-07T10:00:10.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c154780 con 0x7f909c0c30a0 2023-12-07T10:00:10.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0680c0 con 0x7f909c0c30a0 2023-12-07T10:00:10.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90900b2070 con 0x7f909c0c30a0 2023-12-07T10:00:10.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f9098ff9640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f90880668d0 0x7f9088068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:10.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.825+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f909011d210 con 0x7f909c0c30a0 2023-12-07T10:00:10.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.829+0000 7f909bfff640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f90880668d0 0x7f9088068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:10.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.829+0000 7f909bfff640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f90880668d0 0x7f9088068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f908c000f70 tx=0x7f908c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:10.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.829+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90900ea4d0 con 0x7f909c0c30a0 2023-12-07T10:00:10.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:10.842 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:10.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.981+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f909c153e80 con 0x7f909c0c30a0 2023-12-07T10:00:10.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.981+0000 7f9098ff9640 1 -- 172.21.15.89:0/4046332432 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90900edaf0 con 0x7f909c0c30a0 2023-12-07T10:00:10.986 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.981+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f90880668d0 msgr2=0x7f9088068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.981+0000 7f90a132b640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f90880668d0 0x7f9088068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f908c000f70 tx=0x7f908c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.981+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 msgr2=0x7f909c0bda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.981+0000 7f90a132b640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c0bda30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9090019080 tx=0x7f9090019210 comp rx=0 tx=0).stop 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 shutdown_connections 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f90880668d0 0x7f9088068d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f909c0c4b80 0x7f909c0bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c0c30a0 0x7f909c0bda30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 --2- 172.21.15.89:0/4046332432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f909c0bc140 0x7f909c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:10.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 >> 172.21.15.89:0/4046332432 conn(0x7f909c0c5a60 msgr2=0x7f909c15ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:10.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 shutdown_connections 2023-12-07T10:00:10.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:10.985+0000 7f90a132b640 1 -- 172.21.15.89:0/4046332432 wait complete. 2023-12-07T10:00:11.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:00:11.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.141+0000 7ff00d809640 1 Processor -- start 2023-12-07T10:00:11.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.141+0000 7ff00d809640 1 -- start start 2023-12-07T10:00:11.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff00d809640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff00814eaf0 0x7ff008151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff00d809640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff008151f90 0x7ff00806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff00d809640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00806de00 con 0x7ff0080c0370 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff00d809640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff008070390 con 0x7ff00814eaf0 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff00d809640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00814eed0 con 0x7ff008151f90 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff00814eaf0 0x7ff008151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff0077fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff0080c0370 0x7ff00806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55322/0 (socket says 172.21.15.89:55322) 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff0077fe640 1 -- 172.21.15.89:0/318127781 learned_addr learned my addr 172.21.15.89:0/318127781 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff00814eaf0 0x7ff008151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56864/0 (socket says 172.21.15.89:56864) 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7feffe7fc640 1 --2- 172.21.15.89:0/318127781 >> v2:172.21.15.97:3300/0 conn(0x7ff008151f90 0x7ff00806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 -- 172.21.15.89:0/318127781 >> v2:172.21.15.97:3300/0 conn(0x7ff008151f90 msgr2=0x7ff00806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 --2- 172.21.15.89:0/318127781 >> v2:172.21.15.97:3300/0 conn(0x7ff008151f90 0x7ff00806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 -- 172.21.15.89:0/318127781 >> v1:172.21.15.89:6789/0 conn(0x7ff0080c0370 legacy=0x7ff00806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 -- 172.21.15.89:0/318127781 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008151270 con 0x7ff00814eaf0 2023-12-07T10:00:11.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff0067fc640 1 -- 172.21.15.89:0/318127781 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372599041 0 0) 0x7ff00806de00 con 0x7ff0080c0370 2023-12-07T10:00:11.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7feffe7fc640 1 --2- 172.21.15.89:0/318127781 >> v2:172.21.15.97:3300/0 conn(0x7ff008151f90 0x7ff00806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:11.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff006ffd640 1 --2- 172.21.15.89:0/318127781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff00814eaf0 0x7ff008151a50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff00806e2d0 tx=0x7feff801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75add07575ec236b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.145+0000 7ff0067fc640 1 -- 172.21.15.89:0/318127781 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80a5880 con 0x7ff00814eaf0 2023-12-07T10:00:11.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff0067fc640 1 -- 172.21.15.89:0/318127781 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80a59e0 con 0x7ff00814eaf0 2023-12-07T10:00:11.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff0067fc640 1 -- 172.21.15.89:0/318127781 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80a5d70 con 0x7ff00814eaf0 2023-12-07T10:00:11.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- 172.21.15.89:0/318127781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff00814eaf0 msgr2=0x7ff008151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 --2- 172.21.15.89:0/318127781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff00814eaf0 0x7ff008151a50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff00806e2d0 tx=0x7feff801c7c0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- 172.21.15.89:0/318127781 shutdown_connections 2023-12-07T10:00:11.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 --2- 172.21.15.89:0/318127781 >> v2:172.21.15.97:3300/0 conn(0x7ff008151f90 0x7ff00806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 --2- 172.21.15.89:0/318127781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff00814eaf0 0x7ff008151a50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- 172.21.15.89:0/318127781 >> 172.21.15.89:0/318127781 conn(0x7ff0080c2a60 msgr2=0x7ff0080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:11.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- 172.21.15.89:0/318127781 shutdown_connections 2023-12-07T10:00:11.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- 172.21.15.89:0/318127781 wait complete. 2023-12-07T10:00:11.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 Processor -- start 2023-12-07T10:00:11.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- start start 2023-12-07T10:00:11.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 0x7ff0080c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff00814eaf0 0x7ff008149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0080a9d50 0x7ff0080c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff008145460 con 0x7ff0080c0370 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081eba60 con 0x7ff0080a9d50 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff00d809640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c26b0 con 0x7ff00814eaf0 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff006ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 0x7ff0080c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff006ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 0x7ff0080c1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56874/0 (socket says 172.21.15.89:56874) 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff006ffd640 1 -- 172.21.15.89:0/1420019427 learned_addr learned my addr 172.21.15.89:0/1420019427 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7ff0077fe640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0080a9d50 0x7ff0080c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.149+0000 7feffe7fc640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff00814eaf0 0x7ff008149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff006ffd640 1 -- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff00814eaf0 msgr2=0x7ff008149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff006ffd640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff00814eaf0 0x7ff008149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff006ffd640 1 -- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0080a9d50 msgr2=0x7ff0080c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff006ffd640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0080a9d50 0x7ff0080c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff006ffd640 1 -- 172.21.15.89:0/1420019427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009a70 con 0x7ff0080c0370 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7feffe7fc640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff00814eaf0 0x7ff008149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff0077fe640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0080a9d50 0x7ff0080c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff006ffd640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 0x7ff0080c1e60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feff80193d0 tx=0x7feff8019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80b9860 con 0x7ff0080c0370 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80b99c0 con 0x7ff0080c0370 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0081eb410 con 0x7ff0080c0370 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80b9d50 con 0x7ff0080c0370 2023-12-07T10:00:11.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0080c23a0 con 0x7ff0080c0370 2023-12-07T10:00:11.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00804e890 con 0x7ff0080c0370 2023-12-07T10:00:11.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feff80ad440 con 0x7ff0080c0370 2023-12-07T10:00:11.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff004ff9640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fefe8066900 0x7fefe8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feff811f690 con 0x7ff0080c0370 2023-12-07T10:00:11.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.153+0000 7feffe7fc640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fefe8066900 0x7fefe8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.157+0000 7feffe7fc640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fefe8066900 0x7fefe8068dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0081e8f00 tx=0x7feff0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.157+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feff80ec9f0 con 0x7ff0080c0370 2023-12-07T10:00:11.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.305+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff00806d950 con 0x7ff0080c0370 2023-12-07T10:00:11.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.305+0000 7ff004ff9640 1 -- 172.21.15.89:0/1420019427 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7feff80f0010 con 0x7ff0080c0370 2023-12-07T10:00:11.312 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fefe8066900 msgr2=0x7fefe8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fefe8066900 0x7fefe8068dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0081e8f00 tx=0x7feff0008040 comp rx=0 tx=0).stop 2023-12-07T10:00:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 msgr2=0x7ff0080c1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 0x7ff0080c1e60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feff80193d0 tx=0x7feff8019560 comp rx=0 tx=0).stop 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 shutdown_connections 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0080a9d50 0x7ff0080c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fefe8066900 0x7fefe8068dc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff00814eaf0 0x7ff008149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 --2- 172.21.15.89:0/1420019427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0080c0370 0x7ff0080c1e60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 >> 172.21.15.89:0/1420019427 conn(0x7ff0080c2a60 msgr2=0x7ff00806c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 shutdown_connections 2023-12-07T10:00:11.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.309+0000 7ff00d809640 1 -- 172.21.15.89:0/1420019427 wait complete. 2023-12-07T10:00:11.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T10:00:11.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.465+0000 7f48d558d640 1 Processor -- start 2023-12-07T10:00:11.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.465+0000 7f48d558d640 1 -- start start 2023-12-07T10:00:11.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48d558d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00bd720 0x7f48d0158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48d558d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48d006cd90 0x7f48d0158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48d558d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d0155790 con 0x7f48d00ca610 2023-12-07T10:00:11.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48d558d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d00c4b00 con 0x7f48d006cd90 2023-12-07T10:00:11.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48d558d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00c4de0 con 0x7f48d00bd720 2023-12-07T10:00:11.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48cf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48d006cd90 0x7f48d0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48c67fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00bd720 0x7f48d0158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48ceffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f48d00ca610 0x7f48d00c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:55000/0 (socket says 172.21.15.89:55000) 2023-12-07T10:00:11.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48ceffd640 1 -- 172.21.15.89:0/1167976975 learned_addr learned my addr 172.21.15.89:0/1167976975 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48ce7fc640 1 -- 172.21.15.89:0/1167976975 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759782694 0 0) 0x7f48d0155790 con 0x7f48d00ca610 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48ce7fc640 1 -- 172.21.15.89:0/1167976975 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48bc003530 con 0x7f48d00ca610 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48cf7fe640 1 -- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00bd720 msgr2=0x7f48d0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48cf7fe640 1 --2- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00bd720 0x7f48d0158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48cf7fe640 1 -- 172.21.15.89:0/1167976975 >> v1:172.21.15.97:6789/0 conn(0x7f48d00ca610 legacy=0x7f48d00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48cf7fe640 1 -- 172.21.15.89:0/1167976975 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0157e30 con 0x7f48d006cd90 2023-12-07T10:00:11.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.469+0000 7f48c67fc640 1 --2- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00bd720 0x7f48d0158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:11.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48cf7fe640 1 --2- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d0158890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009d90 tx=0x7f48c801c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e85e7d880590a1cd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48ce7fc640 1 -- 172.21.15.89:0/1167976975 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00c52d0 con 0x7f48d006cd90 2023-12-07T10:00:11.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48ce7fc640 1 -- 172.21.15.89:0/1167976975 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c80a5800 con 0x7f48d006cd90 2023-12-07T10:00:11.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48ce7fc640 1 -- 172.21.15.89:0/1167976975 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80a5b90 con 0x7f48d006cd90 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 -- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 msgr2=0x7f48d0158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 --2- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d0158890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009d90 tx=0x7f48c801c830 comp rx=0 tx=0).stop 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 -- 172.21.15.89:0/1167976975 shutdown_connections 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 --2- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d0158890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 --2- 172.21.15.89:0/1167976975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00bd720 0x7f48d0158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 -- 172.21.15.89:0/1167976975 >> 172.21.15.89:0/1167976975 conn(0x7f48d0071ea0 msgr2=0x7f48d00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 -- 172.21.15.89:0/1167976975 shutdown_connections 2023-12-07T10:00:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 -- 172.21.15.89:0/1167976975 wait complete. 2023-12-07T10:00:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 Processor -- start 2023-12-07T10:00:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.473+0000 7f48d558d640 1 -- start start 2023-12-07T10:00:11.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d01eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 0x7f48d014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00ca610 0x7f48d014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d014fd10 con 0x7f48d00bd720 2023-12-07T10:00:11.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00c1a90 con 0x7f48d006cd90 2023-12-07T10:00:11.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00ab600 con 0x7f48d00ca610 2023-12-07T10:00:11.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 0x7f48d014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 0x7f48d014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56888/0 (socket says 172.21.15.89:56888) 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 -- 172.21.15.89:0/2003131431 learned_addr learned my addr 172.21.15.89:0/2003131431 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48cf7fe640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00ca610 0x7f48d014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48ceffd640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d01eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 -- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00ca610 msgr2=0x7f48d014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00ca610 0x7f48d014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 -- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 msgr2=0x7f48d01eaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d01eaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 -- 172.21.15.89:0/2003131431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0009420 con 0x7f48d00bd720 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48cf7fe640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00ca610 0x7f48d014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c67fc640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 0x7f48d014f290 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f48c000ebe0 tx=0x7f48c000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000eee0 con 0x7f48d00bd720 2023-12-07T10:00:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c000cc30 con 0x7f48d00bd720 2023-12-07T10:00:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0013470 con 0x7f48d00bd720 2023-12-07T10:00:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c8009a70 con 0x7f48d00bd720 2023-12-07T10:00:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d00ab8a0 con 0x7f48d00bd720 2023-12-07T10:00:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d00c9de0 con 0x7f48d00bd720 2023-12-07T10:00:11.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.477+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f48c00135d0 con 0x7f48d00bd720 2023-12-07T10:00:11.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.481+0000 7f48c7fff640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f48b00668d0 0x7f48b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.481+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48c0084600 con 0x7f48d00bd720 2023-12-07T10:00:11.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.481+0000 7f48ceffd640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f48b00668d0 0x7f48b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.481+0000 7f48ceffd640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f48b00668d0 0x7f48b0068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48b80011f0 tx=0x7f48b8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.485+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48c0051980 con 0x7f48d00bd720 2023-12-07T10:00:11.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.633+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48d004e890 con 0x7f48d00bd720 2023-12-07T10:00:11.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.633+0000 7f48c7fff640 1 -- 172.21.15.89:0/2003131431 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+207 (secure 0 0 0) 0x7f48c0054fa0 con 0x7f48d00bd720 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 4, 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "cephfs_metadata" 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:11.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 5, 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "cephfs_data" 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f48b00668d0 msgr2=0x7f48b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f48b00668d0 0x7f48b0068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48b80011f0 tx=0x7f48b8007d40 comp rx=0 tx=0).stop 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 msgr2=0x7f48d014f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 0x7f48d014f290 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f48c000ebe0 tx=0x7f48c000c520 comp rx=0 tx=0).stop 2023-12-07T10:00:11.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 shutdown_connections 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f48b00668d0 0x7f48b0068d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48d00ca610 0x7f48d014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d00bd720 0x7f48d014f290 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 --2- 172.21.15.89:0/2003131431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48d006cd90 0x7f48d01eaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 >> 172.21.15.89:0/2003131431 conn(0x7f48d0071ea0 msgr2=0x7f48d0158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 shutdown_connections 2023-12-07T10:00:11.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.637+0000 7f48d558d640 1 -- 172.21.15.89:0/2003131431 wait complete. 2023-12-07T10:00:11.662 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-07T10:00:11.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-07T10:00:11.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.797+0000 7f04b4a17640 1 Processor -- start 2023-12-07T10:00:11.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.797+0000 7f04b4a17640 1 -- start start 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.797+0000 7f04b4a17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04b00bff20 0x7f04b00c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.797+0000 7f04b4a17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04b00c08f0 0x7f04b0151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.797+0000 7f04b4a17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00a5ce0 con 0x7f04b00c2da0 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04b4a17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00a6210 con 0x7f04b00bff20 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04b4a17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00a5f30 con 0x7f04b00c08f0 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04b00bff20 0x7f04b00c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04b00bff20 0x7f04b00c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56894/0 (socket says 172.21.15.89:56894) 2023-12-07T10:00:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 -- 172.21.15.89:0/1696188051 learned_addr learned my addr 172.21.15.89:0/1696188051 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04aed9d640 1 --2- 172.21.15.89:0/1696188051 >> v2:172.21.15.97:3300/0 conn(0x7f04b00c08f0 0x7f04b0151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 -- 172.21.15.89:0/1696188051 >> v2:172.21.15.97:3300/0 conn(0x7f04b00c08f0 msgr2=0x7f04b0151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 --2- 172.21.15.89:0/1696188051 >> v2:172.21.15.97:3300/0 conn(0x7f04b00c08f0 0x7f04b0151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 -- 172.21.15.89:0/1696188051 >> v1:172.21.15.97:6789/0 conn(0x7f04b00c2da0 legacy=0x7f04b006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 -- 172.21.15.89:0/1696188051 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b01554d0 con 0x7f04b00bff20 2023-12-07T10:00:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04ae59c640 1 --2- 172.21.15.89:0/1696188051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b00c6280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04b01548b0 tx=0x7f04a001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c67e9ca62ca53 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04add9b640 1 -- 172.21.15.89:0/1696188051 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00a5710 con 0x7f04b00bff20 2023-12-07T10:00:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04add9b640 1 -- 172.21.15.89:0/1696188051 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00a5870 con 0x7f04b00bff20 2023-12-07T10:00:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.801+0000 7f04add9b640 1 -- 172.21.15.89:0/1696188051 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00a5c00 con 0x7f04b00bff20 2023-12-07T10:00:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- 172.21.15.89:0/1696188051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 msgr2=0x7f04b00c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1696188051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b00c6280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04b01548b0 tx=0x7f04a001c940 comp rx=0 tx=0).stop 2023-12-07T10:00:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- 172.21.15.89:0/1696188051 shutdown_connections 2023-12-07T10:00:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1696188051 >> v2:172.21.15.97:3300/0 conn(0x7f04b00c08f0 0x7f04b0151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1696188051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b00c6280 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- 172.21.15.89:0/1696188051 >> 172.21.15.89:0/1696188051 conn(0x7f04b00a8640 msgr2=0x7f04b00a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- 172.21.15.89:0/1696188051 shutdown_connections 2023-12-07T10:00:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- 172.21.15.89:0/1696188051 wait complete. 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 Processor -- start 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- start start 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b01530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04b00c08f0 0x7f04b0147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c2da0 0x7f04b0148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014fce0 con 0x7f04b00bff20 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0148560 con 0x7f04b00c2da0 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04b4a17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014fa00 con 0x7f04b00c08f0 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04ae59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b01530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04ae59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b01530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56902/0 (socket says 172.21.15.89:56902) 2023-12-07T10:00:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04ae59c640 1 -- 172.21.15.89:0/1052230904 learned_addr learned my addr 172.21.15.89:0/1052230904 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04a5d9b640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04b00c08f0 0x7f04b0147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.805+0000 7f04aed9d640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c2da0 0x7f04b0148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04ae59c640 1 -- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04b00c08f0 msgr2=0x7f04b0147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04ae59c640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04b00c08f0 0x7f04b0147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04ae59c640 1 -- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c2da0 msgr2=0x7f04b0148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04ae59c640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c2da0 0x7f04b0148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04ae59c640 1 -- 172.21.15.89:0/1052230904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009b30 con 0x7f04b00bff20 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04ae59c640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b01530e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f04a00af040 tx=0x7f04a00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00b8670 con 0x7f04b00bff20 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00b87d0 con 0x7f04b00bff20 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00b8b80 con 0x7f04b00bff20 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b014c180 con 0x7f04b00bff20 2023-12-07T10:00:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b014c740 con 0x7f04b00bff20 2023-12-07T10:00:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b004e890 con 0x7f04b00bff20 2023-12-07T10:00:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f04a00b8ce0 con 0x7f04b00bff20 2023-12-07T10:00:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a77fe640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f04900668d0 0x7f0490068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04a011f800 con 0x7f04b00bff20 2023-12-07T10:00:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.809+0000 7f04a5d9b640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f04900668d0 0x7f0490068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.813+0000 7f04a5d9b640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f04900668d0 0x7f0490068d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04b014db90 tx=0x7f0498009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:11.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.813+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04a00ecb80 con 0x7f04b00bff20 2023-12-07T10:00:11.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:11.965+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f04b00c06d0 con 0x7f04b00bff20 2023-12-07T10:00:12.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04a77fe640 1 -- 172.21.15.89:0/1052230904 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v32) v1 ==== 140+0+0 (secure 0 0 0) 0x7f04a00bc0b0 con 0x7f04b00bff20 2023-12-07T10:00:12.429 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_metadata' created 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f04900668d0 msgr2=0x7f0490068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f04900668d0 0x7f0490068d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04b014db90 tx=0x7f0498009040 comp rx=0 tx=0).stop 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 msgr2=0x7f04b01530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b01530e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f04a00af040 tx=0x7f04a00196e0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 shutdown_connections 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c2da0 0x7f04b0148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f04900668d0 0x7f0490068d90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f04b00c08f0 0x7f04b0147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 --2- 172.21.15.89:0/1052230904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b00bff20 0x7f04b01530e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 >> 172.21.15.89:0/1052230904 conn(0x7f04b00a8640 msgr2=0x7f04b00c1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:12.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 shutdown_connections 2023-12-07T10:00:12.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.425+0000 7f04b4a17640 1 -- 172.21.15.89:0/1052230904 wait complete. 2023-12-07T10:00:12.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T10:00:12.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 Processor -- start 2023-12-07T10:00:12.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 -- start start 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb23c156600 0x7fb23c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c152d90 con 0x7fb23c0a86d0 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c152480 con 0x7fb23c156600 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb240b72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0a9760 con 0x7fb23c14fb30 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb233fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb23c156600 0x7fb23c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb23a59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb23c0a86d0 0x7fb23c0a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55326/0 (socket says 172.21.15.89:55326) 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb23a59c640 1 -- 172.21.15.89:0/2311869227 learned_addr learned my addr 172.21.15.89:0/2311869227 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:12.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb23ad9d640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:12.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb233fff640 1 -- 172.21.15.89:0/2311869227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 msgr2=0x7fb23c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:12.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb233fff640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb233fff640 1 -- 172.21.15.89:0/2311869227 >> v1:172.21.15.89:6789/0 conn(0x7fb23c0a86d0 legacy=0x7fb23c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:12.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb233fff640 1 -- 172.21.15.89:0/2311869227 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c152740 con 0x7fb23c156600 2023-12-07T10:00:12.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb23ad9d640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:12.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.597+0000 7fb239d9b640 1 -- 172.21.15.89:0/2311869227 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736045402 0 0) 0x7fb23c152d90 con 0x7fb23c0a86d0 2023-12-07T10:00:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb233fff640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c156600 0x7fb23c14f5f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097f0 tx=0x7fb22401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa725ca36a7a44cb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb239d9b640 1 -- 172.21.15.89:0/2311869227 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240ab600 con 0x7fb23c156600 2023-12-07T10:00:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb239d9b640 1 -- 172.21.15.89:0/2311869227 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2240a7050 con 0x7fb23c156600 2023-12-07T10:00:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb239d9b640 1 -- 172.21.15.89:0/2311869227 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240ab980 con 0x7fb23c156600 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 -- 172.21.15.89:0/2311869227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c156600 msgr2=0x7fb23c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c156600 0x7fb23c14f5f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097f0 tx=0x7fb22401c480 comp rx=0 tx=0).stop 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 -- 172.21.15.89:0/2311869227 shutdown_connections 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 --2- 172.21.15.89:0/2311869227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c156600 0x7fb23c14f5f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 -- 172.21.15.89:0/2311869227 >> 172.21.15.89:0/2311869227 conn(0x7fb23c0c2a60 msgr2=0x7fb23c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 -- 172.21.15.89:0/2311869227 shutdown_connections 2023-12-07T10:00:12.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.601+0000 7fb240b72640 1 -- 172.21.15.89:0/2311869227 wait complete. 2023-12-07T10:00:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 Processor -- start 2023-12-07T10:00:12.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- start start 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 0x7fb23c0c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb23c156600 0x7fb23c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c06c170 con 0x7fb23c0a86d0 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c149120 con 0x7fb23c156600 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c1493e0 con 0x7fb23c14fb30 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 0x7fb23c0c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 0x7fb23c0c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56922/0 (socket says 172.21.15.89:56922) 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 -- 172.21.15.89:0/3353602601 learned_addr learned my addr 172.21.15.89:0/3353602601 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb233fff640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23ad9d640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb23c156600 0x7fb23c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 -- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 msgr2=0x7fb23c148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:12.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 -- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb23c156600 msgr2=0x7fb23c149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb23c156600 0x7fb23c149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 -- 172.21.15.89:0/3353602601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009420 con 0x7fb23c0a86d0 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23ad9d640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb23c156600 0x7fb23c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb23a59c640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 0x7fb23c0c1f90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c480 tx=0x7fb22c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0074e0 con 0x7fb23c0a86d0 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c007660 con 0x7fb23c0a86d0 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c004a30 con 0x7fb23c0a86d0 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c148b60 con 0x7fb23c0a86d0 2023-12-07T10:00:12.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c147d50 con 0x7fb23c0a86d0 2023-12-07T10:00:12.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.605+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c04e890 con 0x7fb23c0a86d0 2023-12-07T10:00:12.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.609+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb22c004b90 con 0x7fb23c0a86d0 2023-12-07T10:00:12.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.609+0000 7fb232ffd640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb21c0668d0 0x7fb21c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:12.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.609+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fb22c083750 con 0x7fb23c0a86d0 2023-12-07T10:00:12.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.609+0000 7fb233fff640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb21c0668d0 0x7fb21c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:12.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.609+0000 7fb233fff640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb21c0668d0 0x7fb21c068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ad000 tx=0x7fb2240a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:12.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.613+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb22c0542c0 con 0x7fb23c0a86d0 2023-12-07T10:00:12.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:12.761+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb23c15ca70 con 0x7fb23c0a86d0 2023-12-07T10:00:13.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb232ffd640 1 -- 172.21.15.89:0/3353602601 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v33) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb22c053e50 con 0x7fb23c0a86d0 2023-12-07T10:00:13.433 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_data' created 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb21c0668d0 msgr2=0x7fb21c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb21c0668d0 0x7fb21c068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ad000 tx=0x7fb2240a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 msgr2=0x7fb23c0c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 0x7fb23c0c1f90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c480 tx=0x7fb22c00c940 comp rx=0 tx=0).stop 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 shutdown_connections 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb23c156600 0x7fb23c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb21c0668d0 0x7fb21c068d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb23c14fb30 0x7fb23c148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 --2- 172.21.15.89:0/3353602601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0a86d0 0x7fb23c0c1f90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 >> 172.21.15.89:0/3353602601 conn(0x7fb23c0c2a60 msgr2=0x7fb23c0c49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 shutdown_connections 2023-12-07T10:00:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.429+0000 7fb240b72640 1 -- 172.21.15.89:0/3353602601 wait complete. 2023-12-07T10:00:13.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-07T10:00:13.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 Processor -- start 2023-12-07T10:00:13.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 -- start start 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a480a86d0 0x7f2a480a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a48156600 0x7f2a4814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a48152d90 con 0x7f2a4814fb30 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a48152480 con 0x7f2a480a86d0 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4edd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480a9760 con 0x7f2a48156600 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4cb6d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a480a86d0 0x7f2a480a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4d36e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2a4814fb30 0x7f2a480aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55330/0 (socket says 172.21.15.89:55330) 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4cb6d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a480a86d0 0x7f2a480a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56932/0 (socket says 172.21.15.89:56932) 2023-12-07T10:00:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a4d36e640 1 -- 172.21.15.89:0/2830916767 learned_addr learned my addr 172.21.15.89:0/2830916767 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:13.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.609+0000 7f2a3ffff640 1 --2- 172.21.15.89:0/2830916767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a48156600 0x7f2a4814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:13.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/2830916767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a48156600 msgr2=0x7f2a4814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:13.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4cb6d640 1 --2- 172.21.15.89:0/2830916767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a48156600 0x7f2a4814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/2830916767 >> v1:172.21.15.89:6789/0 conn(0x7f2a4814fb30 legacy=0x7f2a480aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:13.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/2830916767 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48152740 con 0x7f2a480a86d0 2023-12-07T10:00:13.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4cb6d640 1 --2- 172.21.15.89:0/2830916767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a480a8f30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e465603a658f3b2d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:13.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a3f7fe640 1 -- 172.21.15.89:0/2830916767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab600 con 0x7f2a480a86d0 2023-12-07T10:00:13.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a3f7fe640 1 -- 172.21.15.89:0/2830916767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440a7050 con 0x7f2a480a86d0 2023-12-07T10:00:13.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a3f7fe640 1 -- 172.21.15.89:0/2830916767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab980 con 0x7f2a480a86d0 2023-12-07T10:00:13.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4edd1640 1 -- 172.21.15.89:0/2830916767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 msgr2=0x7f2a480a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:13.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/2830916767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a480a8f30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c480 comp rx=0 tx=0).stop 2023-12-07T10:00:13.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4edd1640 1 -- 172.21.15.89:0/2830916767 shutdown_connections 2023-12-07T10:00:13.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/2830916767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a48156600 0x7f2a4814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/2830916767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a480a8f30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.613+0000 7f2a4edd1640 1 -- 172.21.15.89:0/2830916767 >> 172.21.15.89:0/2830916767 conn(0x7f2a480c2a60 msgr2=0x7f2a480c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:13.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 -- 172.21.15.89:0/2830916767 shutdown_connections 2023-12-07T10:00:13.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 -- 172.21.15.89:0/2830916767 wait complete. 2023-12-07T10:00:13.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 Processor -- start 2023-12-07T10:00:13.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 -- start start 2023-12-07T10:00:13.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a48071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:13.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a4814fb30 0x7f2a481edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48156600 0x7f2a481545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a481ee210 con 0x7f2a480a86d0 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4806d360 con 0x7f2a48156600 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4edd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480704d0 con 0x7f2a4814fb30 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a48071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a48071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56946/0 (socket says 172.21.15.89:56946) 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/3274264597 learned_addr learned my addr 172.21.15.89:0/3274264597 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4d36e640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48156600 0x7f2a481545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:13.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a3ffff640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a4814fb30 0x7f2a481edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:13.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a4814fb30 msgr2=0x7f2a481edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:13.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a4814fb30 0x7f2a481edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48156600 msgr2=0x7f2a481545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:13.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48156600 0x7f2a481545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:13.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 -- 172.21.15.89:0/3274264597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009420 con 0x7f2a480a86d0 2023-12-07T10:00:13.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.617+0000 7f2a4cb6d640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a48071680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ae040 tx=0x7f2a4401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b7450 con 0x7f2a480a86d0 2023-12-07T10:00:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440b75b0 con 0x7f2a480a86d0 2023-12-07T10:00:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b7960 con 0x7f2a480a86d0 2023-12-07T10:00:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4806cd10 con 0x7f2a480a86d0 2023-12-07T10:00:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a480700f0 con 0x7f2a480a86d0 2023-12-07T10:00:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4804e890 con 0x7f2a480a86d0 2023-12-07T10:00:13.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2a440b7ac0 con 0x7f2a480a86d0 2023-12-07T10:00:13.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3d7fa640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2a340668d0 0x7f2a34068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:13.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f2a4411f330 con 0x7f2a480a86d0 2023-12-07T10:00:13.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.621+0000 7f2a3ffff640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2a340668d0 0x7f2a34068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:13.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.625+0000 7f2a3ffff640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2a340668d0 0x7f2a34068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2a4806e0b0 tx=0x7f2a38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.625+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a440ec3f0 con 0x7f2a480a86d0 2023-12-07T10:00:13.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:13.805+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f2a480c03f0 con 0x7f2a480a86d0 2023-12-07T10:00:14.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.481+0000 7f2a3d7fa640 1 -- 172.21.15.89:0/3274264597 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f2a440efa10 con 0x7f2a480a86d0 2023-12-07T10:00:14.487 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 6 and data pool 7 2023-12-07T10:00:14.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2a340668d0 msgr2=0x7f2a34068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2a340668d0 0x7f2a34068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2a4806e0b0 tx=0x7f2a38008040 comp rx=0 tx=0).stop 2023-12-07T10:00:14.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 msgr2=0x7f2a48071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a48071680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ae040 tx=0x7f2a4401acc0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 shutdown_connections 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48156600 0x7f2a481545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2a340668d0 0x7f2a34068d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2a4814fb30 0x7f2a481edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 --2- 172.21.15.89:0/3274264597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a480a86d0 0x7f2a48071680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 >> 172.21.15.89:0/3274264597 conn(0x7f2a480c2a60 msgr2=0x7f2a48151280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 shutdown_connections 2023-12-07T10:00:14.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.493+0000 7f2a4edd1640 1 -- 172.21.15.89:0/3274264597 wait complete. 2023-12-07T10:00:14.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:14.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 Processor -- start 2023-12-07T10:00:14.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 -- start start 2023-12-07T10:00:14.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140ca620 0x7f66140caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f66140c4890 0x7f66140c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661406b7d0 con 0x7f66140bd5a0 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6614155160 con 0x7f66140c4890 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f661a6bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661406b180 con 0x7f66140ca620 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f66140c4890 0x7f66140c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f66140c4890 0x7f66140c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56962/0 (socket says 172.21.15.89:56962) 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6619eba640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f66140bd5a0 0x7f66140c8450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55342/0 (socket says 172.21.15.89:55342) 2023-12-07T10:00:14.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 -- 172.21.15.89:0/2635013203 learned_addr learned my addr 172.21.15.89:0/2635013203 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:14.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f66196b9640 1 --2- 172.21.15.89:0/2635013203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140ca620 0x7f66140caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 -- 172.21.15.89:0/2635013203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140ca620 msgr2=0x7f66140caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:14.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 --2- 172.21.15.89:0/2635013203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140ca620 0x7f66140caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 -- 172.21.15.89:0/2635013203 >> v1:172.21.15.89:6789/0 conn(0x7f66140bd5a0 legacy=0x7f66140c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.661+0000 7f6618eb8640 1 -- 172.21.15.89:0/2635013203 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661406b460 con 0x7f66140c4890 2023-12-07T10:00:14.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f6618eb8640 1 --2- 172.21.15.89:0/2635013203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140c4890 0x7f66140c7f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6604009870 tx=0x7f660401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c7a1fa9f9ac782 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:14.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f660bfff640 1 -- 172.21.15.89:0/2635013203 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040ab600 con 0x7f66140c4890 2023-12-07T10:00:14.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f660bfff640 1 -- 172.21.15.89:0/2635013203 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66040ab760 con 0x7f66140c4890 2023-12-07T10:00:14.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f660bfff640 1 -- 172.21.15.89:0/2635013203 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040abaf0 con 0x7f66140c4890 2023-12-07T10:00:14.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 -- 172.21.15.89:0/2635013203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140c4890 msgr2=0x7f66140c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 --2- 172.21.15.89:0/2635013203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140c4890 0x7f66140c7f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6604009870 tx=0x7f660401c4b0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 -- 172.21.15.89:0/2635013203 shutdown_connections 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 --2- 172.21.15.89:0/2635013203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140c4890 0x7f66140c7f10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 --2- 172.21.15.89:0/2635013203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140ca620 0x7f66140caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 -- 172.21.15.89:0/2635013203 >> 172.21.15.89:0/2635013203 conn(0x7f66140ac0a0 msgr2=0x7f66140c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 -- 172.21.15.89:0/2635013203 shutdown_connections 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.665+0000 7f661a6bb640 1 -- 172.21.15.89:0/2635013203 wait complete. 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 Processor -- start 2023-12-07T10:00:14.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 -- start start 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 0x7f6614156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140c4890 0x7f66141f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66140ca620 0x7f661415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66141f12e0 con 0x7f66140bd5a0 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140ae3b0 con 0x7f66140ca620 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140ae690 con 0x7f66140c4890 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 0x7f6614156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 0x7f6614156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56974/0 (socket says 172.21.15.89:56974) 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 -- 172.21.15.89:0/4239488196 learned_addr learned my addr 172.21.15.89:0/4239488196 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:14.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f6618eb8640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140c4890 0x7f66141f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f6619eba640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66140ca620 0x7f661415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 -- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140c4890 msgr2=0x7f66141f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140c4890 0x7f66141f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 -- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66140ca620 msgr2=0x7f661415e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66140ca620 0x7f661415e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 -- 172.21.15.89:0/4239488196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040094d0 con 0x7f66140bd5a0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f6618eb8640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140c4890 0x7f66141f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f66196b9640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 0x7f6614156110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f661000d800 tx=0x7f661000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000b6c0 con 0x7f66140bd5a0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661000b820 con 0x7f66140bd5a0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000bb90 con 0x7f66140bd5a0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66140ae970 con 0x7f66140bd5a0 2023-12-07T10:00:14.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.669+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661415e890 con 0x7f66140bd5a0 2023-12-07T10:00:14.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.673+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661404e890 con 0x7f66140bd5a0 2023-12-07T10:00:14.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.673+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f661000bcf0 con 0x7f66140bd5a0 2023-12-07T10:00:14.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.673+0000 7f6609ffb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65f80668d0 0x7f65f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.673+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6610084cd0 con 0x7f66140bd5a0 2023-12-07T10:00:14.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.673+0000 7f6618eb8640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65f80668d0 0x7f65f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.673+0000 7f6618eb8640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65f80668d0 0x7f65f8068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66040af000 tx=0x7f66040a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:14.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.677+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6610051ba0 con 0x7f66140bd5a0 2023-12-07T10:00:14.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.829+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6614153c20 con 0x7f66140bd5a0 2023-12-07T10:00:14.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.829+0000 7f6609ffb640 1 -- 172.21.15.89:0/4239488196 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20182 (secure 0 0 0) 0x7f66100551c0 con 0x7f66140bd5a0 2023-12-07T10:00:14.834 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:14.834 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":34,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:13.809919+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:14.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.829+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65f80668d0 msgr2=0x7f65f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.829+0000 7f661a6bb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65f80668d0 0x7f65f8068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66040af000 tx=0x7f66040a7000 comp rx=0 tx=0).stop 2023-12-07T10:00:14.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.829+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 msgr2=0x7f6614156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.829+0000 7f661a6bb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 0x7f6614156110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f661000d800 tx=0x7f661000dcc0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 shutdown_connections 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66140ca620 0x7f661415e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65f80668d0 0x7f65f8068d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f66140c4890 0x7f66141f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 --2- 172.21.15.89:0/4239488196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66140bd5a0 0x7f6614156110 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 >> 172.21.15.89:0/4239488196 conn(0x7f66140ac0a0 msgr2=0x7f66140a9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 shutdown_connections 2023-12-07T10:00:14.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.833+0000 7f661a6bb640 1 -- 172.21.15.89:0/4239488196 wait complete. 2023-12-07T10:00:14.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:14.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 Processor -- start 2023-12-07T10:00:14.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 -- start start 2023-12-07T10:00:14.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80006a5a0 0x7fd8000c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd8000c1ae0 0x7fd80006a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:14.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8001551d0 con 0x7fd8000c0510 2023-12-07T10:00:14.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80006e9c0 con 0x7fd8000c1ae0 2023-12-07T10:00:14.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd807e32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8000a86e0 con 0x7fd80006a5a0 2023-12-07T10:00:14.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd805bce640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80006a5a0 0x7fd8000c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd8000c1ae0 0x7fd80006a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd8000c1ae0 0x7fd80006a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:51406/0 (socket says 172.21.15.89:51406) 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8063cf640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd8000c0510 0x7fd8000c09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:55026/0 (socket says 172.21.15.89:55026) 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 -- 172.21.15.89:0/3438732960 learned_addr learned my addr 172.21.15.89:0/3438732960 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd805bce640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80006a5a0 0x7fd8000c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:57190/0 (socket says 172.21.15.89:57190) 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 -- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80006a5a0 msgr2=0x7fd8000c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 --2- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80006a5a0 0x7fd8000c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 -- 172.21.15.89:0/3438732960 >> v1:172.21.15.97:6789/0 conn(0x7fd8000c0510 legacy=0x7fd8000c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.989+0000 7fd8053cd640 1 -- 172.21.15.89:0/3438732960 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800072840 con 0x7fd8000c1ae0 2023-12-07T10:00:14.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd8053cd640 1 --2- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8000c1ae0 0x7fd80006a980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009870 tx=0x7fd7f001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9918f1a004dd20d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:14.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd804bcc640 1 -- 172.21.15.89:0/3438732960 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00ab600 con 0x7fd8000c1ae0 2023-12-07T10:00:14.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd804bcc640 1 -- 172.21.15.89:0/3438732960 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f00a7050 con 0x7fd8000c1ae0 2023-12-07T10:00:14.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd804bcc640 1 -- 172.21.15.89:0/3438732960 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00ab980 con 0x7fd8000c1ae0 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 -- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8000c1ae0 msgr2=0x7fd80006a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 --2- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8000c1ae0 0x7fd80006a980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009870 tx=0x7fd7f001c540 comp rx=0 tx=0).stop 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 -- 172.21.15.89:0/3438732960 shutdown_connections 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 --2- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8000c1ae0 0x7fd80006a980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 --2- 172.21.15.89:0/3438732960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80006a5a0 0x7fd8000c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 -- 172.21.15.89:0/3438732960 >> 172.21.15.89:0/3438732960 conn(0x7fd8000c3be0 msgr2=0x7fd8000c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:14.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 -- 172.21.15.89:0/3438732960 shutdown_connections 2023-12-07T10:00:15.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.993+0000 7fd807e32640 1 -- 172.21.15.89:0/3438732960 wait complete. 2023-12-07T10:00:15.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 Processor -- start 2023-12-07T10:00:15.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 -- start start 2023-12-07T10:00:15.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80006a5a0 0x7fd800142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8000c0510 0x7fd800142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8000c1ae0 0x7fd8001574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8001566c0 con 0x7fd8000c0510 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80014e340 con 0x7fd80006a5a0 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80014caf0 con 0x7fd8000c1ae0 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd8053cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8000c0510 0x7fd800142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd8053cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8000c0510 0x7fd800142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56976/0 (socket says 172.21.15.89:56976) 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80006a5a0 0x7fd800142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd8053cd640 1 -- 172.21.15.89:0/1824073642 learned_addr learned my addr 172.21.15.89:0/1824073642 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd8063cf640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8000c1ae0 0x7fd8001574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 -- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8000c1ae0 msgr2=0x7fd8001574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8000c1ae0 0x7fd8001574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 -- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8000c0510 msgr2=0x7fd800142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8000c0510 0x7fd800142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 -- 172.21.15.89:0/1824073642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00094d0 con 0x7fd80006a5a0 2023-12-07T10:00:15.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd805bce640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80006a5a0 0x7fd800142840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00e8a0 tx=0x7fd7fc00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:15.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00c940 con 0x7fd80006a5a0 2023-12-07T10:00:15.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc00caa0 con 0x7fd80006a5a0 2023-12-07T10:00:15.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00ce10 con 0x7fd80006a5a0 2023-12-07T10:00:15.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8001589d0 con 0x7fd80006a5a0 2023-12-07T10:00:15.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:14.997+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8000c6c20 con 0x7fd80006a5a0 2023-12-07T10:00:15.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.001+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80004e890 con 0x7fd80006a5a0 2023-12-07T10:00:15.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.001+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd7fc013470 con 0x7fd80006a5a0 2023-12-07T10:00:15.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.001+0000 7fd7f67fc640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7e40668d0 0x7fd7e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.001+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd7fc084870 con 0x7fd80006a5a0 2023-12-07T10:00:15.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.001+0000 7fd8053cd640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7e40668d0 0x7fd7e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.001+0000 7fd8053cd640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7e40668d0 0x7fd7e4068d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd7f001c580 tx=0x7fd7f00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:15.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.005+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7fc0517f0 con 0x7fd80006a5a0 2023-12-07T10:00:15.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.157+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8001ecc10 con 0x7fd80006a5a0 2023-12-07T10:00:15.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.157+0000 7fd7f67fc640 1 -- 172.21.15.89:0/1824073642 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20182 (secure 0 0 0) 0x7fd7fc054e10 con 0x7fd80006a5a0 2023-12-07T10:00:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:15.164 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":34,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:13.809919+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:15.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7e40668d0 msgr2=0x7fd7e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7e40668d0 0x7fd7e4068d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd7f001c580 tx=0x7fd7f00a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80006a5a0 msgr2=0x7fd800142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80006a5a0 0x7fd800142840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00e8a0 tx=0x7fd7fc00ed60 comp rx=0 tx=0).stop 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 shutdown_connections 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7e40668d0 0x7fd7e4068d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd8000c1ae0 0x7fd8001574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8000c0510 0x7fd800142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 --2- 172.21.15.89:0/1824073642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80006a5a0 0x7fd800142840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 >> 172.21.15.89:0/1824073642 conn(0x7fd8000c3be0 msgr2=0x7fd8000a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 shutdown_connections 2023-12-07T10:00:15.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.161+0000 7fd807e32640 1 -- 172.21.15.89:0/1824073642 wait complete. 2023-12-07T10:00:15.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-07T10:00:15.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef93054640 1 Processor -- start 2023-12-07T10:00:15.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef93054640 1 -- start start 2023-12-07T10:00:15.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef93054640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 0x7fef8c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef93054640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c06f760 con 0x7fef8c1500d0 2023-12-07T10:00:15.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef93054640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c0adf90 con 0x7fef8c0a7330 2023-12-07T10:00:15.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef93054640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c156d10 con 0x7fef8c14fcf0 2023-12-07T10:00:15.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef83fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fef8c1500d0 0x7fef8c0c3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55352/0 (socket says 172.21.15.89:55352) 2023-12-07T10:00:15.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef83fff640 1 -- 172.21.15.89:0/963870051 learned_addr learned my addr 172.21.15.89:0/963870051 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:15.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.321+0000 7fef90df0640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 0x7fef8c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557217780 0 0) 0x7fef8c06f760 con 0x7fef8c1500d0 2023-12-07T10:00:15.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef74003530 con 0x7fef8c1500d0 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660994358 0 0) 0x7fef8c0adf90 con 0x7fef8c0a7330 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef8c06f760 con 0x7fef8c0a7330 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916810205 0 0) 0x7fef74003530 con 0x7fef8c1500d0 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 msgr2=0x7fef8c1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 0x7fef8c1567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 >> v1:172.21.15.97:6789/0 conn(0x7fef8c0a7330 legacy=0x7fef8c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c06fc90 con 0x7fef8c1500d0 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fef7c001800 con 0x7fef8c1500d0 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 >> v1:172.21.15.89:6789/0 conn(0x7fef8c1500d0 legacy=0x7fef8c0c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef74003b40 0x7fef74003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 0x7fef740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74004d10 0x7fef74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c156d10 con 0x7fef74003b40 2023-12-07T10:00:15.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7400ba90 con 0x7fef74004d10 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7400bc50 con 0x7fef8c14fcf0 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef74003b40 0x7fef74003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef83fff640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 0x7fef740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef915f1640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74004d10 0x7fef74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 -- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 msgr2=0x7fef740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c14fcf0 0x7fef740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 -- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74004d10 msgr2=0x7fef74005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74004d10 0x7fef74005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 -- 172.21.15.89:0/963870051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74003530 con 0x7fef74003b40 2023-12-07T10:00:15.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.325+0000 7fef90df0640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef74003b40 0x7fef74003f40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fef88009ae0 tx=0x7fef8801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba30d036ccab2113 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:15.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880a6510 con 0x7fef74003b40 2023-12-07T10:00:15.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880a6670 con 0x7fef74003b40 2023-12-07T10:00:15.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef837fe640 1 -- 172.21.15.89:0/963870051 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880a6a20 con 0x7fef74003b40 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- 172.21.15.89:0/963870051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef74003b40 msgr2=0x7fef74003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 --2- 172.21.15.89:0/963870051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef74003b40 0x7fef74003f40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fef88009ae0 tx=0x7fef8801ca20 comp rx=0 tx=0).stop 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef915f1640 1 -- 172.21.15.89:0/963870051 reap_dead start 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- 172.21.15.89:0/963870051 shutdown_connections 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- 172.21.15.89:0/963870051 >> 172.21.15.89:0/963870051 conn(0x7fef8c06a5a0 msgr2=0x7fef8c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- 172.21.15.89:0/963870051 shutdown_connections 2023-12-07T10:00:15.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- 172.21.15.89:0/963870051 wait complete. 2023-12-07T10:00:15.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 Processor -- start 2023-12-07T10:00:15.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- start start 2023-12-07T10:00:15.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74003b40 0x7fef8c1edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef8c1506c0 0x7fef8c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c1ee960 0x7fef8c1eede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c15c440 con 0x7fef8c1506c0 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c1ee440 con 0x7fef74003b40 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef93054640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c1ef320 con 0x7fef8c1ee960 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.329+0000 7fef83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef8c1506c0 0x7fef8c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef90df0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74003b40 0x7fef8c1edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef90df0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74003b40 0x7fef8c1edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:51428/0 (socket says 172.21.15.89:51428) 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef915f1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c1ee960 0x7fef8c1eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef90df0640 1 -- 172.21.15.89:0/2628916035 learned_addr learned my addr 172.21.15.89:0/2628916035 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef83fff640 1 -- 172.21.15.89:0/2628916035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c1ee960 msgr2=0x7fef8c1eede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef83fff640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c1ee960 0x7fef8c1eede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef83fff640 1 -- 172.21.15.89:0/2628916035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74003b40 msgr2=0x7fef8c1edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef83fff640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74003b40 0x7fef8c1edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef83fff640 1 -- 172.21.15.89:0/2628916035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c150c30 con 0x7fef8c1506c0 2023-12-07T10:00:15.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef83fff640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef8c1506c0 0x7fef8c0c1700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e7b0 tx=0x7fef7c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:15.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0070d0 con 0x7fef8c1506c0 2023-12-07T10:00:15.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c007230 con 0x7fef8c1506c0 2023-12-07T10:00:15.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0075e0 con 0x7fef8c1506c0 2023-12-07T10:00:15.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c1f0a60 con 0x7fef8c1506c0 2023-12-07T10:00:15.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c1f1020 con 0x7fef8c1506c0 2023-12-07T10:00:15.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c04e890 con 0x7fef8c1506c0 2023-12-07T10:00:15.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fef7c0057b0 con 0x7fef8c1506c0 2023-12-07T10:00:15.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.333+0000 7fef817fa640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef78066900 0x7fef78068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:15.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.337+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fef7c0843c0 con 0x7fef8c1506c0 2023-12-07T10:00:15.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.337+0000 7fef90df0640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef78066900 0x7fef78068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:15.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.337+0000 7fef90df0640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef78066900 0x7fef78068dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef88000c10 tx=0x7fef880046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:15.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.337+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef7c0513e0 con 0x7fef8c1506c0 2023-12-07T10:00:15.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:15.529+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fef8c06f2e0 con 0x7fef8c1506c0 2023-12-07T10:00:15.967 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-12-07T10:00:15.961+0000 7f1e8ccf4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:00:16.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.489+0000 7fef817fa640 1 -- 172.21.15.89:0/2628916035 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fef7c054a00 con 0x7fef8c1506c0 2023-12-07T10:00:16.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.489+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef78066900 msgr2=0x7fef78068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.489+0000 7fef93054640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef78066900 0x7fef78068dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef88000c10 tx=0x7fef880046d0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.489+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef8c1506c0 msgr2=0x7fef8c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.489+0000 7fef93054640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef8c1506c0 0x7fef8c0c1700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e7b0 tx=0x7fef7c00ec70 comp rx=0 tx=0).stop 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 shutdown_connections 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef78066900 0x7fef78068dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef8c1ee960 0x7fef8c1eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef8c1506c0 0x7fef8c0c1700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 --2- 172.21.15.89:0/2628916035 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef74003b40 0x7fef8c1edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 >> 172.21.15.89:0/2628916035 conn(0x7fef8c06a5a0 msgr2=0x7fef8c06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 shutdown_connections 2023-12-07T10:00:16.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.493+0000 7fef93054640 1 -- 172.21.15.89:0/2628916035 wait complete. 2023-12-07T10:00:16.519 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T10:00:16.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-07T10:00:16.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 Processor -- start 2023-12-07T10:00:16.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 -- start start 2023-12-07T10:00:16.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35bc0c8430 0x7f35bc06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:16.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35bc0c7f20 0x7f35bc06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:16.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc06cf70 con 0x7f35bc151d80 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc152160 con 0x7f35bc0c8430 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35c19f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc0c6a30 con 0x7f35bc0c7f20 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35bc0c8430 0x7f35bc06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35bc0c8430 0x7f35bc06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57000/0 (socket says 172.21.15.89:57000) 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 -- 172.21.15.89:0/1282951790 learned_addr learned my addr 172.21.15.89:0/1282951790 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35bb7fe640 1 --2- 172.21.15.89:0/1282951790 >> v2:172.21.15.97:3300/0 conn(0x7f35bc0c7f20 0x7f35bc06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 -- 172.21.15.89:0/1282951790 >> v2:172.21.15.97:3300/0 conn(0x7f35bc0c7f20 msgr2=0x7f35bc06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 --2- 172.21.15.89:0/1282951790 >> v2:172.21.15.97:3300/0 conn(0x7f35bc0c7f20 0x7f35bc06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 -- 172.21.15.89:0/1282951790 >> v1:172.21.15.97:6789/0 conn(0x7f35bc151d80 legacy=0x7f35bc0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:16.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.657+0000 7f35b27fc640 1 -- 172.21.15.89:0/1282951790 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0c72d0 con 0x7f35bc0c8430 2023-12-07T10:00:16.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35b27fc640 1 --2- 172.21.15.89:0/1282951790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc06b720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0c4220 tx=0x7f35a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7254b28863d9327a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:16.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35ba7fc640 1 -- 172.21.15.89:0/1282951790 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40ab640 con 0x7f35bc0c8430 2023-12-07T10:00:16.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35ba7fc640 1 -- 172.21.15.89:0/1282951790 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a40a7070 con 0x7f35bc0c8430 2023-12-07T10:00:16.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35ba7fc640 1 -- 172.21.15.89:0/1282951790 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40ab9c0 con 0x7f35bc0c8430 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 -- 172.21.15.89:0/1282951790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 msgr2=0x7f35bc06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 --2- 172.21.15.89:0/1282951790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc06b720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0c4220 tx=0x7f35a401c440 comp rx=0 tx=0).stop 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 -- 172.21.15.89:0/1282951790 shutdown_connections 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 --2- 172.21.15.89:0/1282951790 >> v2:172.21.15.97:3300/0 conn(0x7f35bc0c7f20 0x7f35bc06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 --2- 172.21.15.89:0/1282951790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc06b720 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 -- 172.21.15.89:0/1282951790 >> 172.21.15.89:0/1282951790 conn(0x7f35bc0abd00 msgr2=0x7f35bc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 -- 172.21.15.89:0/1282951790 shutdown_connections 2023-12-07T10:00:16.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.661+0000 7f35c19f5640 1 -- 172.21.15.89:0/1282951790 wait complete. 2023-12-07T10:00:16.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 Processor -- start 2023-12-07T10:00:16.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- start start 2023-12-07T10:00:16.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35bc0c7f20 0x7f35bc1ee370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:16.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:16.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35bc151d80 0x7f35bc145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:16.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc156560 con 0x7f35bc0c8430 2023-12-07T10:00:16.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0c3920 con 0x7f35bc0c7f20 2023-12-07T10:00:16.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0c3c00 con 0x7f35bc151d80 2023-12-07T10:00:16.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:16.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57006/0 (socket says 172.21.15.89:57006) 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 -- 172.21.15.89:0/139951723 learned_addr learned my addr 172.21.15.89:0/139951723 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35bb7fe640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35bc151d80 0x7f35bc145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35baffd640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35bc0c7f20 0x7f35bc1ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 -- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35bc151d80 msgr2=0x7f35bc145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35bc151d80 0x7f35bc145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 -- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35bc0c7f20 msgr2=0x7f35bc1ee370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35bc0c7f20 0x7f35bc1ee370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 -- 172.21.15.89:0/139951723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40094d0 con 0x7f35bc0c8430 2023-12-07T10:00:16.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b27fc640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc156d20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f35a4019050 tx=0x7f35a401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:16.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40be3f0 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a40be550 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40be900 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc156800 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc1f0170 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.665+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc04e890 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.669+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f35a40b43f0 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.669+0000 7f35b8ff9640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f359c066900 0x7f359c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.669+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f35a411ebf0 con 0x7f35bc0c8430 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.669+0000 7f35baffd640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f359c066900 0x7f359c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:16.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.669+0000 7f35baffd640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f359c066900 0x7f359c068dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000f70 tx=0x7f35ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:16.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.673+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35a40ebb60 con 0x7f35bc0c8430 2023-12-07T10:00:16.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:16.853+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f35bc0c3d40 con 0x7f35bc0c8430 2023-12-07T10:00:17.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.489+0000 7f35b8ff9640 1 -- 172.21.15.89:0/139951723 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f35bc0c3d40 con 0x7f35bc0c8430 2023-12-07T10:00:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f359c066900 msgr2=0x7f359c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f359c066900 0x7f359c068dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000f70 tx=0x7f35ac009040 comp rx=0 tx=0).stop 2023-12-07T10:00:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 msgr2=0x7f35bc156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc156d20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f35a4019050 tx=0x7f35a401ac80 comp rx=0 tx=0).stop 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 shutdown_connections 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f359c066900 0x7f359c068dc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f35bc151d80 0x7f35bc145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35bc0c8430 0x7f35bc156d20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 --2- 172.21.15.89:0/139951723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35bc0c7f20 0x7f35bc1ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 >> 172.21.15.89:0/139951723 conn(0x7f35bc0abd00 msgr2=0x7f35bc150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 shutdown_connections 2023-12-07T10:00:17.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.493+0000 7f35c19f5640 1 -- 172.21.15.89:0/139951723 wait complete. 2023-12-07T10:00:17.520 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-07T10:00:17.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:17.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 Processor -- start 2023-12-07T10:00:17.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 -- start start 2023-12-07T10:00:17.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a414e9d0 0x7fe7a4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:17.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe7a40a8470 0x7fe7a406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:17.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a406d320 con 0x7fe7a4070b80 2023-12-07T10:00:17.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40721b0 con 0x7fe7a40a8470 2023-12-07T10:00:17.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a8e32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40c2830 con 0x7fe7a414e9d0 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a414e9d0 0x7fe7a4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a2d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe7a40a8470 0x7fe7a406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a1d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe7a4070b80 0x7fe7a40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:55056/0 (socket says 172.21.15.89:55056) 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a1d9b640 1 -- 172.21.15.89:0/450333788 learned_addr learned my addr 172.21.15.89:0/450333788 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a414e9d0 msgr2=0x7fe7a4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a2d9d640 1 --2- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a414e9d0 0x7fe7a4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/450333788 >> v1:172.21.15.97:6789/0 conn(0x7fe7a4070b80 legacy=0x7fe7a40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/450333788 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4072450 con 0x7fe7a40a8470 2023-12-07T10:00:17.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.653+0000 7fe7a259c640 1 --2- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a414e9d0 0x7fe7a4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:17.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a2d9d640 1 --2- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a40a8470 0x7fe7a406d7b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009d90 tx=0x7fe79c01ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec71e942a34e3964 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:17.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a159a640 1 -- 172.21.15.89:0/450333788 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0a79b0 con 0x7fe7a40a8470 2023-12-07T10:00:17.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a159a640 1 -- 172.21.15.89:0/450333788 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c0a7b10 con 0x7fe7a40a8470 2023-12-07T10:00:17.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a159a640 1 -- 172.21.15.89:0/450333788 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0a7ea0 con 0x7fe7a40a8470 2023-12-07T10:00:17.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 -- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a40a8470 msgr2=0x7fe7a406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a40a8470 0x7fe7a406d7b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009d90 tx=0x7fe79c01ead0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 -- 172.21.15.89:0/450333788 shutdown_connections 2023-12-07T10:00:17.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a40a8470 0x7fe7a406d7b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/450333788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a414e9d0 0x7fe7a4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 -- 172.21.15.89:0/450333788 >> 172.21.15.89:0/450333788 conn(0x7fe7a40c2ad0 msgr2=0x7fe7a40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:17.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 -- 172.21.15.89:0/450333788 shutdown_connections 2023-12-07T10:00:17.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.657+0000 7fe7a8e32640 1 -- 172.21.15.89:0/450333788 wait complete. 2023-12-07T10:00:17.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 Processor -- start 2023-12-07T10:00:17.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 -- start start 2023-12-07T10:00:17.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a4070b80 0x7fe7a415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:17.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a40a8470 0x7fe7a4141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:17.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 0x7fe7a4141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:17.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41f1280 con 0x7fe7a414e9d0 2023-12-07T10:00:17.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41f17b0 con 0x7fe7a4070b80 2023-12-07T10:00:17.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a8e32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41f14d0 con 0x7fe7a40a8470 2023-12-07T10:00:17.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 0x7fe7a4141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:17.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 0x7fe7a4141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57022/0 (socket says 172.21.15.89:57022) 2023-12-07T10:00:17.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/331100329 learned_addr learned my addr 172.21.15.89:0/331100329 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:17.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a259c640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a4070b80 0x7fe7a415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:17.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a1d9b640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a40a8470 0x7fe7a4141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:17.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a40a8470 msgr2=0x7fe7a4141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a40a8470 0x7fe7a4141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a4070b80 msgr2=0x7fe7a415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a4070b80 0x7fe7a415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 -- 172.21.15.89:0/331100329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009420 con 0x7fe7a414e9d0 2023-12-07T10:00:17.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe7a2d9d640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 0x7fe7a4141fc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0b2040 tx=0x7fe79c01b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:17.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.661+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0a79b0 con 0x7fe7a414e9d0 2023-12-07T10:00:17.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c009450 con 0x7fe7a414e9d0 2023-12-07T10:00:17.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0afd90 con 0x7fe7a414e9d0 2023-12-07T10:00:17.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c009a70 con 0x7fe7a414e9d0 2023-12-07T10:00:17.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a40c4120 con 0x7fe7a414e9d0 2023-12-07T10:00:17.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a404e890 con 0x7fe7a414e9d0 2023-12-07T10:00:17.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe79c0b6070 con 0x7fe7a414e9d0 2023-12-07T10:00:17.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe792ffd640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7840668d0 0x7fe784068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:17.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe79c11f370 con 0x7fe7a414e9d0 2023-12-07T10:00:17.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe7a259c640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7840668d0 0x7fe784068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:17.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.665+0000 7fe7a259c640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7840668d0 0x7fe784068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe794009c50 tx=0x7fe794009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:17.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.669+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe79c0ec1e0 con 0x7fe7a414e9d0 2023-12-07T10:00:17.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.849+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7a41ed300 con 0x7fe7a414e9d0 2023-12-07T10:00:17.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.849+0000 7fe792ffd640 1 -- 172.21.15.89:0/331100329 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6124 (secure 0 0 0) 0x7fe79c0ef800 con 0x7fe7a414e9d0 2023-12-07T10:00:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:17.854 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:17.854 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.849+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7840668d0 msgr2=0x7fe784068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.849+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7840668d0 0x7fe784068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe794009c50 tx=0x7fe794009190 comp rx=0 tx=0).stop 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.849+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 msgr2=0x7fe7a4141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.849+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 0x7fe7a4141fc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0b2040 tx=0x7fe79c01b870 comp rx=0 tx=0).stop 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 shutdown_connections 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7a414e9d0 0x7fe7a4141fc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7840668d0 0x7fe784068d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7a40a8470 0x7fe7a4141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 --2- 172.21.15.89:0/331100329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7a4070b80 0x7fe7a415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:17.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 >> 172.21.15.89:0/331100329 conn(0x7fe7a40c2ad0 msgr2=0x7fe7a415b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:17.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 shutdown_connections 2023-12-07T10:00:17.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:17.853+0000 7fe7a8e32640 1 -- 172.21.15.89:0/331100329 wait complete. 2023-12-07T10:00:17.876 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:18.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 Processor -- start 2023-12-07T10:00:18.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 -- start start 2023-12-07T10:00:18.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3788156500 0x7f378806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880c19e0 0x7f37880c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378806dec0 con 0x7f378814fcc0 2023-12-07T10:00:18.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37880aa340 con 0x7f3788156500 2023-12-07T10:00:18.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378eda1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788156980 con 0x7f37880c19e0 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3788156500 0x7f378806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378cb3d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f378814fcc0 0x7f37880aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55362/0 (socket says 172.21.15.89:55362) 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3788156500 0x7f378806d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57026/0 (socket says 172.21.15.89:57026) 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378cb3d640 1 -- 172.21.15.89:0/511308427 learned_addr learned my addr 172.21.15.89:0/511308427 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f378d33e640 1 --2- 172.21.15.89:0/511308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880c19e0 0x7f37880c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377ffff640 1 -- 172.21.15.89:0/511308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880c19e0 msgr2=0x7f37880c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:18.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377ffff640 1 --2- 172.21.15.89:0/511308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880c19e0 0x7f37880c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377ffff640 1 -- 172.21.15.89:0/511308427 >> v1:172.21.15.89:6789/0 conn(0x7f378814fcc0 legacy=0x7f37880aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377ffff640 1 -- 172.21.15.89:0/511308427 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880ab580 con 0x7f3788156500 2023-12-07T10:00:18.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.009+0000 7f377f7fe640 1 -- 172.21.15.89:0/511308427 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718656543 0 0) 0x7f378806dec0 con 0x7f378814fcc0 2023-12-07T10:00:18.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f377ffff640 1 --2- 172.21.15.89:0/511308427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3788156500 0x7f378806d980 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f37780097c0 tx=0x7f377801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6fa3d0d71c0e8f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f377f7fe640 1 -- 172.21.15.89:0/511308427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780ad660 con 0x7f3788156500 2023-12-07T10:00:18.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f377f7fe640 1 -- 172.21.15.89:0/511308427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780ad7c0 con 0x7f3788156500 2023-12-07T10:00:18.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f377f7fe640 1 -- 172.21.15.89:0/511308427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780adb50 con 0x7f3788156500 2023-12-07T10:00:18.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 -- 172.21.15.89:0/511308427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3788156500 msgr2=0x7f378806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 --2- 172.21.15.89:0/511308427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3788156500 0x7f378806d980 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f37780097c0 tx=0x7f377801c450 comp rx=0 tx=0).stop 2023-12-07T10:00:18.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 -- 172.21.15.89:0/511308427 shutdown_connections 2023-12-07T10:00:18.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 --2- 172.21.15.89:0/511308427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880c19e0 0x7f37880c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 --2- 172.21.15.89:0/511308427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3788156500 0x7f378806d980 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 -- 172.21.15.89:0/511308427 >> 172.21.15.89:0/511308427 conn(0x7f37880c2ad0 msgr2=0x7f37880c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:18.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 -- 172.21.15.89:0/511308427 shutdown_connections 2023-12-07T10:00:18.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.013+0000 7f378eda1640 1 -- 172.21.15.89:0/511308427 wait complete. 2023-12-07T10:00:18.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 Processor -- start 2023-12-07T10:00:18.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 -- start start 2023-12-07T10:00:18.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 0x7f378814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3788156500 0x7f37880bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880700a0 0x7f37880c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37881f02d0 con 0x7f37880c19e0 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37881f0570 con 0x7f3788156500 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37881f0850 con 0x7f37880700a0 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 0x7f378814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 0x7f378814e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57032/0 (socket says 172.21.15.89:57032) 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 -- 172.21.15.89:0/2557091875 learned_addr learned my addr 172.21.15.89:0/2557091875 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f377ffff640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3788156500 0x7f37880bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378d33e640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880700a0 0x7f37880c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 -- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880700a0 msgr2=0x7f37880c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880700a0 0x7f37880c0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 -- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3788156500 msgr2=0x7f37880bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3788156500 0x7f37880bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 -- 172.21.15.89:0/2557091875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009420 con 0x7f37880c19e0 2023-12-07T10:00:18.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378cb3d640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 0x7f378814e9b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37840011f0 tx=0x7f378400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840074e0 con 0x7f37880c19e0 2023-12-07T10:00:18.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784007640 con 0x7f37880c19e0 2023-12-07T10:00:18.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784004a10 con 0x7f37880c19e0 2023-12-07T10:00:18.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37881f0b30 con 0x7f37880c19e0 2023-12-07T10:00:18.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.017+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378814eef0 con 0x7f37880c19e0 2023-12-07T10:00:18.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.021+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37881f1050 con 0x7f37880c19e0 2023-12-07T10:00:18.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.021+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3784004b70 con 0x7f37880c19e0 2023-12-07T10:00:18.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.021+0000 7f377d7fa640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f37740668d0 0x7f3774068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.021+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3784083a70 con 0x7f37880c19e0 2023-12-07T10:00:18.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.021+0000 7f377ffff640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f37740668d0 0x7f3774068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.021+0000 7f377ffff640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f37740668d0 0x7f3774068d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f37780af000 tx=0x7f37780a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.025+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37881f1050 con 0x7f37880c19e0 2023-12-07T10:00:18.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.177+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37881f1050 con 0x7f37880c19e0 2023-12-07T10:00:18.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.177+0000 7f377d7fa640 1 -- 172.21.15.89:0/2557091875 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f37881f1050 con 0x7f37880c19e0 2023-12-07T10:00:18.182 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:18.182 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.177+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f37740668d0 msgr2=0x7f3774068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.177+0000 7f378eda1640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f37740668d0 0x7f3774068d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f37780af000 tx=0x7f37780a7000 comp rx=0 tx=0).stop 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.177+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 msgr2=0x7f378814e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.177+0000 7f378eda1640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 0x7f378814e9b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37840011f0 tx=0x7f378400c9b0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 shutdown_connections 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f37740668d0 0x7f3774068d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37880700a0 0x7f37880c0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3788156500 0x7f37880bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 --2- 172.21.15.89:0/2557091875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37880c19e0 0x7f378814e9b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 >> 172.21.15.89:0/2557091875 conn(0x7f37880c2ad0 msgr2=0x7f3788153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:18.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 shutdown_connections 2023-12-07T10:00:18.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.181+0000 7f378eda1640 1 -- 172.21.15.89:0/2557091875 wait complete. 2023-12-07T10:00:18.204 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T10:00:18.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:18.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9ca1a1640 1 Processor -- start 2023-12-07T10:00:18.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9ca1a1640 1 -- start start 2023-12-07T10:00:18.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9ca1a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9c406d980 0x7ff9c40c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9ca1a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c4156980 con 0x7ff9c4156500 2023-12-07T10:00:18.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9ca1a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40ab580 con 0x7ff9c414fcc0 2023-12-07T10:00:18.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9ca1a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c40aa340 con 0x7ff9c406d980 2023-12-07T10:00:18.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9c3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9c406d980 0x7ff9c40c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9c2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff9c4156500 0x7ff9c40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55378/0 (socket says 172.21.15.89:55378) 2023-12-07T10:00:18.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.337+0000 7ff9c2ffd640 1 -- 172.21.15.89:0/838599954 learned_addr learned my addr 172.21.15.89:0/838599954 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:18.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c3fff640 1 -- 172.21.15.89:0/838599954 >> v1:172.21.15.97:6789/0 conn(0x7ff9c414fcc0 legacy=0x7ff9c40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:18.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c3fff640 1 -- 172.21.15.89:0/838599954 >> v1:172.21.15.89:6789/0 conn(0x7ff9c4156500 legacy=0x7ff9c40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c3fff640 1 -- 172.21.15.89:0/838599954 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4152fe0 con 0x7ff9c406d980 2023-12-07T10:00:18.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c27fc640 1 -- 172.21.15.89:0/838599954 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502205409 0 0) 0x7ff9b8001120 con 0x7ff9c4156500 2023-12-07T10:00:18.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c3fff640 1 --2- 172.21.15.89:0/838599954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40c20f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009d90 tx=0x7ff9bc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddf2a5b353232f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c27fc640 1 -- 172.21.15.89:0/838599954 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0a59a0 con 0x7ff9c406d980 2023-12-07T10:00:18.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c27fc640 1 -- 172.21.15.89:0/838599954 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0a5b00 con 0x7ff9c406d980 2023-12-07T10:00:18.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9c27fc640 1 -- 172.21.15.89:0/838599954 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0a5e90 con 0x7ff9c406d980 2023-12-07T10:00:18.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/838599954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 msgr2=0x7ff9c40c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.341+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/838599954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40c20f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009d90 tx=0x7ff9bc01c8e0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/838599954 shutdown_connections 2023-12-07T10:00:18.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/838599954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40c20f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/838599954 >> 172.21.15.89:0/838599954 conn(0x7ff9c40c2ad0 msgr2=0x7ff9c40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:18.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/838599954 shutdown_connections 2023-12-07T10:00:18.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/838599954 wait complete. 2023-12-07T10:00:18.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 Processor -- start 2023-12-07T10:00:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- start start 2023-12-07T10:00:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c4156500 0x7ff9c4147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c4149ee0 0x7ff9c4148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c3ef0 con 0x7ff9c406d980 2023-12-07T10:00:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c414c980 con 0x7ff9c4156500 2023-12-07T10:00:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9ca1a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c414cc60 con 0x7ff9c4149ee0 2023-12-07T10:00:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57052/0 (socket says 172.21.15.89:57052) 2023-12-07T10:00:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 -- 172.21.15.89:0/1458795782 learned_addr learned my addr 172.21.15.89:0/1458795782 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c3fff640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c4149ee0 0x7ff9c4148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c2ffd640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c4156500 0x7ff9c4147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 -- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c4149ee0 msgr2=0x7ff9c4148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c4149ee0 0x7ff9c4148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 -- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c4156500 msgr2=0x7ff9c4147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c4156500 0x7ff9c4147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c37fe640 1 -- 172.21.15.89:0/1458795782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009a70 con 0x7ff9c406d980 2023-12-07T10:00:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.345+0000 7ff9c2ffd640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c4156500 0x7ff9c4147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9c37fe640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40a9180 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c490 tx=0x7ff9b4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4003600 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4003780 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4003b70 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c414cf40 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40c3bc0 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c414d160 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff9b4003cd0 con 0x7ff9c406d980 2023-12-07T10:00:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9abfff640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9b0066900 0x7ff9b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff9b4083860 con 0x7ff9c406d980 2023-12-07T10:00:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9c2ffd640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9b0066900 0x7ff9b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.349+0000 7ff9c2ffd640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9b0066900 0x7ff9b0068dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9c41519d0 tx=0x7ff9b8007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.353+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9b40507f0 con 0x7ff9c406d980 2023-12-07T10:00:18.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.505+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9c414caf0 con 0x7ff9b0066900 2023-12-07T10:00:18.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.517+0000 7ff9abfff640 1 -- 172.21.15.89:0/1458795782 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527129 (secure 0 0 0) 0x7ff9c414caf0 con 0x7ff9b0066900 2023-12-07T10:00:18.532 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:18.536 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:18.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9b0066900 msgr2=0x7ff9b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9b0066900 0x7ff9b0068dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9c41519d0 tx=0x7ff9b8007cb0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 msgr2=0x7ff9c40a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40a9180 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c490 tx=0x7ff9b4001e80 comp rx=0 tx=0).stop 2023-12-07T10:00:18.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 shutdown_connections 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9b0066900 0x7ff9b0068dc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9c4149ee0 0x7ff9c4148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9c4156500 0x7ff9c4147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 --2- 172.21.15.89:0/1458795782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c406d980 0x7ff9c40a9180 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 >> 172.21.15.89:0/1458795782 conn(0x7ff9c40c2ad0 msgr2=0x7ff9c40aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 shutdown_connections 2023-12-07T10:00:18.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.525+0000 7ff9ca1a1640 1 -- 172.21.15.89:0/1458795782 wait complete. 2023-12-07T10:00:18.548 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-12-07T10:00:18.354504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":351,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220464,"kb_used_data":4280,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754256,"statfs":{"total":773094113280,"available":772868358144,"internally_reserved":0,"allocated":4382720,"data_stored":2429887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924472"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496222+0000","last_change":"2023-12-07T10:00:14.489920+0000","last_active":"2023-12-07T10:00:14.496222+0000","last_peered":"2023-12-07T10:00:14.496222+0000","last_clean":"2023-12-07T10:00:14.496222+0000","last_became_active":"2023-12-07T10:00:14.489224+0000","last_became_peered":"2023-12-07T10:00:14.489224+0000","last_unstale":"2023-12-07T10:00:14.496222+0000","last_undegraded":"2023-12-07T10:00:14.496222+0000","last_fullsized":"2023-12-07T10:00:14.496222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:37:05.508848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440926+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:00:13.440926+0000","last_peered":"2023-12-07T10:00:13.440926+0000","last_clean":"2023-12-07T10:00:13.440926+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:00:13.440926+0000","last_undegraded":"2023-12-07T10:00:13.440926+0000","last_fullsized":"2023-12-07T10:00:13.440926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457052+0000","last_change":"2023-12-07T09:59:56.247518+0000","last_active":"2023-12-07T10:00:13.457052+0000","last_peered":"2023-12-07T10:00:13.457052+0000","last_clean":"2023-12-07T10:00:13.457052+0000","last_became_active":"2023-12-07T09:59:56.246103+0000","last_became_peered":"2023-12-07T09:59:56.246103+0000","last_unstale":"2023-12-07T10:00:13.457052+0000","last_undegraded":"2023-12-07T10:00:13.457052+0000","last_fullsized":"2023-12-07T10:00:13.457052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.441342+0000","last_change":"2023-12-07T09:59:57.228735+0000","last_active":"2023-12-07T10:00:13.441342+0000","last_peered":"2023-12-07T10:00:13.441342+0000","last_clean":"2023-12-07T10:00:13.441342+0000","last_became_active":"2023-12-07T09:59:57.228440+0000","last_became_peered":"2023-12-07T09:59:57.228440+0000","last_unstale":"2023-12-07T10:00:13.441342+0000","last_undegraded":"2023-12-07T10:00:13.441342+0000","last_fullsized":"2023-12-07T10:00:13.441342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.504142+0000","last_change":"2023-12-07T10:00:13.459981+0000","last_active":"2023-12-07T10:00:14.504142+0000","last_peered":"2023-12-07T10:00:14.504142+0000","last_clean":"2023-12-07T10:00:14.504142+0000","last_became_active":"2023-12-07T10:00:13.459053+0000","last_became_peered":"2023-12-07T10:00:13.459053+0000","last_unstale":"2023-12-07T10:00:14.504142+0000","last_undegraded":"2023-12-07T10:00:14.504142+0000","last_fullsized":"2023-12-07T10:00:14.504142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:03:41.315208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.497553+0000","last_change":"2023-12-07T10:00:14.487526+0000","last_active":"2023-12-07T10:00:14.497553+0000","last_peered":"2023-12-07T10:00:14.497553+0000","last_clean":"2023-12-07T10:00:14.497553+0000","last_became_active":"2023-12-07T10:00:14.486985+0000","last_became_peered":"2023-12-07T10:00:14.486985+0000","last_unstale":"2023-12-07T10:00:14.497553+0000","last_undegraded":"2023-12-07T10:00:14.497553+0000","last_fullsized":"2023-12-07T10:00:14.497553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:50.063311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.454943+0000","last_change":"2023-12-07T09:59:56.249073+0000","last_active":"2023-12-07T10:00:13.454943+0000","last_peered":"2023-12-07T10:00:13.454943+0000","last_clean":"2023-12-07T10:00:13.454943+0000","last_became_active":"2023-12-07T09:59:56.248772+0000","last_became_peered":"2023-12-07T09:59:56.248772+0000","last_unstale":"2023-12-07T10:00:13.454943+0000","last_undegraded":"2023-12-07T10:00:13.454943+0000","last_fullsized":"2023-12-07T10:00:13.454943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:47.202027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437858+0000","last_change":"2023-12-07T09:59:57.231677+0000","last_active":"2023-12-07T10:00:13.437858+0000","last_peered":"2023-12-07T10:00:13.437858+0000","last_clean":"2023-12-07T10:00:13.437858+0000","last_became_active":"2023-12-07T09:59:57.231321+0000","last_became_peered":"2023-12-07T09:59:57.231321+0000","last_unstale":"2023-12-07T10:00:13.437858+0000","last_undegraded":"2023-12-07T10:00:13.437858+0000","last_fullsized":"2023-12-07T10:00:13.437858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.474517+0000","last_change":"2023-12-07T10:00:13.456978+0000","last_active":"2023-12-07T10:00:14.474517+0000","last_peered":"2023-12-07T10:00:14.474517+0000","last_clean":"2023-12-07T10:00:14.474517+0000","last_became_active":"2023-12-07T10:00:13.456590+0000","last_became_peered":"2023-12-07T10:00:13.456590+0000","last_unstale":"2023-12-07T10:00:14.474517+0000","last_undegraded":"2023-12-07T10:00:14.474517+0000","last_fullsized":"2023-12-07T10:00:14.474517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:08:52.766136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.476683+0000","last_change":"2023-12-07T10:00:14.475069+0000","last_active":"2023-12-07T10:00:14.476683+0000","last_peered":"2023-12-07T10:00:14.476683+0000","last_clean":"2023-12-07T10:00:14.476683+0000","last_became_active":"2023-12-07T10:00:14.474781+0000","last_became_peered":"2023-12-07T10:00:14.474781+0000","last_unstale":"2023-12-07T10:00:14.476683+0000","last_undegraded":"2023-12-07T10:00:14.476683+0000","last_fullsized":"2023-12-07T10:00:14.476683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:03:11.618769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438121+0000","last_change":"2023-12-07T09:59:56.244136+0000","last_active":"2023-12-07T10:00:13.438121+0000","last_peered":"2023-12-07T10:00:13.438121+0000","last_clean":"2023-12-07T10:00:13.438121+0000","last_became_active":"2023-12-07T09:59:56.243848+0000","last_became_peered":"2023-12-07T09:59:56.243848+0000","last_unstale":"2023-12-07T10:00:13.438121+0000","last_undegraded":"2023-12-07T10:00:13.438121+0000","last_fullsized":"2023-12-07T10:00:13.438121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.454861+0000","last_change":"2023-12-07T09:59:57.239076+0000","last_active":"2023-12-07T10:00:13.454861+0000","last_peered":"2023-12-07T10:00:13.454861+0000","last_clean":"2023-12-07T10:00:13.454861+0000","last_became_active":"2023-12-07T09:59:57.238794+0000","last_became_peered":"2023-12-07T09:59:57.238794+0000","last_unstale":"2023-12-07T10:00:13.454861+0000","last_undegraded":"2023-12-07T10:00:13.454861+0000","last_fullsized":"2023-12-07T10:00:13.454861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.458492+0000","last_change":"2023-12-07T10:00:13.464851+0000","last_active":"2023-12-07T10:00:14.458492+0000","last_peered":"2023-12-07T10:00:14.458492+0000","last_clean":"2023-12-07T10:00:14.458492+0000","last_became_active":"2023-12-07T10:00:13.464524+0000","last_became_peered":"2023-12-07T10:00:13.464524+0000","last_unstale":"2023-12-07T10:00:14.458492+0000","last_undegraded":"2023-12-07T10:00:14.458492+0000","last_fullsized":"2023-12-07T10:00:14.458492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:48.866866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486239+0000","last_change":"2023-12-07T10:00:14.477930+0000","last_active":"2023-12-07T10:00:14.486239+0000","last_peered":"2023-12-07T10:00:14.486239+0000","last_clean":"2023-12-07T10:00:14.486239+0000","last_became_active":"2023-12-07T10:00:14.477633+0000","last_became_peered":"2023-12-07T10:00:14.477633+0000","last_unstale":"2023-12-07T10:00:14.486239+0000","last_undegraded":"2023-12-07T10:00:14.486239+0000","last_fullsized":"2023-12-07T10:00:14.486239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:59.720998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447456+0000","last_change":"2023-12-07T09:59:56.248618+0000","last_active":"2023-12-07T10:00:13.447456+0000","last_peered":"2023-12-07T10:00:13.447456+0000","last_clean":"2023-12-07T10:00:13.447456+0000","last_became_active":"2023-12-07T09:59:56.245467+0000","last_became_peered":"2023-12-07T09:59:56.245467+0000","last_unstale":"2023-12-07T10:00:13.447456+0000","last_undegraded":"2023-12-07T10:00:13.447456+0000","last_fullsized":"2023-12-07T10:00:13.447456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445353+0000","last_change":"2023-12-07T09:59:57.242678+0000","last_active":"2023-12-07T10:00:13.445353+0000","last_peered":"2023-12-07T10:00:13.445353+0000","last_clean":"2023-12-07T10:00:13.445353+0000","last_became_active":"2023-12-07T09:59:57.242415+0000","last_became_peered":"2023-12-07T09:59:57.242415+0000","last_unstale":"2023-12-07T10:00:13.445353+0000","last_undegraded":"2023-12-07T10:00:13.445353+0000","last_fullsized":"2023-12-07T10:00:13.445353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.481000+0000","last_change":"2023-12-07T10:00:13.459770+0000","last_active":"2023-12-07T10:00:14.481000+0000","last_peered":"2023-12-07T10:00:14.481000+0000","last_clean":"2023-12-07T10:00:14.481000+0000","last_became_active":"2023-12-07T10:00:13.459406+0000","last_became_peered":"2023-12-07T10:00:13.459406+0000","last_unstale":"2023-12-07T10:00:14.481000+0000","last_undegraded":"2023-12-07T10:00:14.481000+0000","last_fullsized":"2023-12-07T10:00:14.481000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:00.736597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488386+0000","last_change":"2023-12-07T10:00:14.483259+0000","last_active":"2023-12-07T10:00:14.488386+0000","last_peered":"2023-12-07T10:00:14.488386+0000","last_clean":"2023-12-07T10:00:14.488386+0000","last_became_active":"2023-12-07T10:00:14.482350+0000","last_became_peered":"2023-12-07T10:00:14.482350+0000","last_unstale":"2023-12-07T10:00:14.488386+0000","last_undegraded":"2023-12-07T10:00:14.488386+0000","last_fullsized":"2023-12-07T10:00:14.488386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:52.735101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445584+0000","last_change":"2023-12-07T09:59:56.244982+0000","last_active":"2023-12-07T10:00:13.445584+0000","last_peered":"2023-12-07T10:00:13.445584+0000","last_clean":"2023-12-07T10:00:13.445584+0000","last_became_active":"2023-12-07T09:59:56.244390+0000","last_became_peered":"2023-12-07T09:59:56.244390+0000","last_unstale":"2023-12-07T10:00:13.445584+0000","last_undegraded":"2023-12-07T10:00:13.445584+0000","last_fullsized":"2023-12-07T10:00:13.445584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457827+0000","last_change":"2023-12-07T09:59:57.238384+0000","last_active":"2023-12-07T10:00:13.457827+0000","last_peered":"2023-12-07T10:00:13.457827+0000","last_clean":"2023-12-07T10:00:13.457827+0000","last_became_active":"2023-12-07T09:59:57.238044+0000","last_became_peered":"2023-12-07T09:59:57.238044+0000","last_unstale":"2023-12-07T10:00:13.457827+0000","last_undegraded":"2023-12-07T10:00:13.457827+0000","last_fullsized":"2023-12-07T10:00:13.457827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:54.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.467241+0000","last_change":"2023-12-07T10:00:13.457101+0000","last_active":"2023-12-07T10:00:14.467241+0000","last_peered":"2023-12-07T10:00:14.467241+0000","last_clean":"2023-12-07T10:00:14.467241+0000","last_became_active":"2023-12-07T10:00:13.456581+0000","last_became_peered":"2023-12-07T10:00:13.456581+0000","last_unstale":"2023-12-07T10:00:14.467241+0000","last_undegraded":"2023-12-07T10:00:14.467241+0000","last_fullsized":"2023-12-07T10:00:14.467241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:42.371498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.500057+0000","last_change":"2023-12-07T10:00:14.498086+0000","last_active":"2023-12-07T10:00:14.500057+0000","last_peered":"2023-12-07T10:00:14.500057+0000","last_clean":"2023-12-07T10:00:14.500057+0000","last_became_active":"2023-12-07T10:00:14.497784+0000","last_became_peered":"2023-12-07T10:00:14.497784+0000","last_unstale":"2023-12-07T10:00:14.500057+0000","last_undegraded":"2023-12-07T10:00:14.500057+0000","last_fullsized":"2023-12-07T10:00:14.500057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:57.851577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448032+0000","last_change":"2023-12-07T09:59:56.247423+0000","last_active":"2023-12-07T10:00:13.448032+0000","last_peered":"2023-12-07T10:00:13.448032+0000","last_clean":"2023-12-07T10:00:13.448032+0000","last_became_active":"2023-12-07T09:59:56.247188+0000","last_became_peered":"2023-12-07T09:59:56.247188+0000","last_unstale":"2023-12-07T10:00:13.448032+0000","last_undegraded":"2023-12-07T10:00:13.448032+0000","last_fullsized":"2023-12-07T10:00:13.448032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446135+0000","last_change":"2023-12-07T09:59:57.234589+0000","last_active":"2023-12-07T10:00:13.446135+0000","last_peered":"2023-12-07T10:00:13.446135+0000","last_clean":"2023-12-07T10:00:13.446135+0000","last_became_active":"2023-12-07T09:59:57.234320+0000","last_became_peered":"2023-12-07T09:59:57.234320+0000","last_unstale":"2023-12-07T10:00:13.446135+0000","last_undegraded":"2023-12-07T10:00:13.446135+0000","last_fullsized":"2023-12-07T10:00:13.446135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.461050+0000","last_change":"2023-12-07T10:00:13.460260+0000","last_active":"2023-12-07T10:00:14.461050+0000","last_peered":"2023-12-07T10:00:14.461050+0000","last_clean":"2023-12-07T10:00:14.461050+0000","last_became_active":"2023-12-07T10:00:13.459945+0000","last_became_peered":"2023-12-07T10:00:13.459945+0000","last_unstale":"2023-12-07T10:00:14.461050+0000","last_undegraded":"2023-12-07T10:00:14.461050+0000","last_fullsized":"2023-12-07T10:00:14.461050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:59.524554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.490235+0000","last_change":"2023-12-07T10:00:14.485920+0000","last_active":"2023-12-07T10:00:14.490235+0000","last_peered":"2023-12-07T10:00:14.490235+0000","last_clean":"2023-12-07T10:00:14.490235+0000","last_became_active":"2023-12-07T10:00:14.485654+0000","last_became_peered":"2023-12-07T10:00:14.485654+0000","last_unstale":"2023-12-07T10:00:14.490235+0000","last_undegraded":"2023-12-07T10:00:14.490235+0000","last_fullsized":"2023-12-07T10:00:14.490235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:03:42.317711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446875+0000","last_change":"2023-12-07T09:59:56.246751+0000","last_active":"2023-12-07T10:00:13.446875+0000","last_peered":"2023-12-07T10:00:13.446875+0000","last_clean":"2023-12-07T10:00:13.446875+0000","last_became_active":"2023-12-07T09:59:56.246313+0000","last_became_peered":"2023-12-07T09:59:56.246313+0000","last_unstale":"2023-12-07T10:00:13.446875+0000","last_undegraded":"2023-12-07T10:00:13.446875+0000","last_fullsized":"2023-12-07T10:00:13.446875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448927+0000","last_change":"2023-12-07T09:59:57.239649+0000","last_active":"2023-12-07T10:00:13.448927+0000","last_peered":"2023-12-07T10:00:13.448927+0000","last_clean":"2023-12-07T10:00:13.448927+0000","last_became_active":"2023-12-07T09:59:57.239278+0000","last_became_peered":"2023-12-07T09:59:57.239278+0000","last_unstale":"2023-12-07T10:00:13.448927+0000","last_undegraded":"2023-12-07T10:00:13.448927+0000","last_fullsized":"2023-12-07T10:00:13.448927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.466433+0000","last_change":"2023-12-07T10:00:13.454591+0000","last_active":"2023-12-07T10:00:14.466433+0000","last_peered":"2023-12-07T10:00:14.466433+0000","last_clean":"2023-12-07T10:00:14.466433+0000","last_became_active":"2023-12-07T10:00:13.453993+0000","last_became_peered":"2023-12-07T10:00:13.453993+0000","last_unstale":"2023-12-07T10:00:14.466433+0000","last_undegraded":"2023-12-07T10:00:14.466433+0000","last_fullsized":"2023-12-07T10:00:14.466433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:02:02.946064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496174+0000","last_change":"2023-12-07T10:00:14.487983+0000","last_active":"2023-12-07T10:00:14.496174+0000","last_peered":"2023-12-07T10:00:14.496174+0000","last_clean":"2023-12-07T10:00:14.496174+0000","last_became_active":"2023-12-07T10:00:14.487643+0000","last_became_peered":"2023-12-07T10:00:14.487643+0000","last_unstale":"2023-12-07T10:00:14.496174+0000","last_undegraded":"2023-12-07T10:00:14.496174+0000","last_fullsized":"2023-12-07T10:00:14.496174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:15.880384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448835+0000","last_change":"2023-12-07T09:59:56.244977+0000","last_active":"2023-12-07T10:00:13.448835+0000","last_peered":"2023-12-07T10:00:13.448835+0000","last_clean":"2023-12-07T10:00:13.448835+0000","last_became_active":"2023-12-07T09:59:56.244693+0000","last_became_peered":"2023-12-07T09:59:56.244693+0000","last_unstale":"2023-12-07T10:00:13.448835+0000","last_undegraded":"2023-12-07T10:00:13.448835+0000","last_fullsized":"2023-12-07T10:00:13.448835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:40.487500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434785+0000","last_change":"2023-12-07T09:59:57.223699+0000","last_active":"2023-12-07T10:00:13.434785+0000","last_peered":"2023-12-07T10:00:13.434785+0000","last_clean":"2023-12-07T10:00:13.434785+0000","last_became_active":"2023-12-07T09:59:57.223208+0000","last_became_peered":"2023-12-07T09:59:57.223208+0000","last_unstale":"2023-12-07T10:00:13.434785+0000","last_undegraded":"2023-12-07T10:00:13.434785+0000","last_fullsized":"2023-12-07T10:00:13.434785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:08.149324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460089+0000","last_change":"2023-12-07T10:00:13.464128+0000","last_active":"2023-12-07T10:00:14.460089+0000","last_peered":"2023-12-07T10:00:14.460089+0000","last_clean":"2023-12-07T10:00:14.460089+0000","last_became_active":"2023-12-07T10:00:13.463467+0000","last_became_peered":"2023-12-07T10:00:13.463467+0000","last_unstale":"2023-12-07T10:00:14.460089+0000","last_undegraded":"2023-12-07T10:00:14.460089+0000","last_fullsized":"2023-12-07T10:00:14.460089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:12:58.305658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484587+0000","last_change":"2023-12-07T10:00:14.477637+0000","last_active":"2023-12-07T10:00:14.484587+0000","last_peered":"2023-12-07T10:00:14.484587+0000","last_clean":"2023-12-07T10:00:14.484587+0000","last_became_active":"2023-12-07T10:00:14.477358+0000","last_became_peered":"2023-12-07T10:00:14.477358+0000","last_unstale":"2023-12-07T10:00:14.484587+0000","last_undegraded":"2023-12-07T10:00:14.484587+0000","last_fullsized":"2023-12-07T10:00:14.484587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:27.066740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448512+0000","last_change":"2023-12-07T09:59:56.250231+0000","last_active":"2023-12-07T10:00:13.448512+0000","last_peered":"2023-12-07T10:00:13.448512+0000","last_clean":"2023-12-07T10:00:13.448512+0000","last_became_active":"2023-12-07T09:59:56.249795+0000","last_became_peered":"2023-12-07T09:59:56.249795+0000","last_unstale":"2023-12-07T10:00:13.448512+0000","last_undegraded":"2023-12-07T10:00:13.448512+0000","last_fullsized":"2023-12-07T10:00:13.448512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440804+0000","last_change":"2023-12-07T09:59:57.244429+0000","last_active":"2023-12-07T10:00:13.440804+0000","last_peered":"2023-12-07T10:00:13.440804+0000","last_clean":"2023-12-07T10:00:13.440804+0000","last_became_active":"2023-12-07T09:59:57.244108+0000","last_became_peered":"2023-12-07T09:59:57.244108+0000","last_unstale":"2023-12-07T10:00:13.440804+0000","last_undegraded":"2023-12-07T10:00:13.440804+0000","last_fullsized":"2023-12-07T10:00:13.440804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.467446+0000","last_change":"2023-12-07T10:00:13.463586+0000","last_active":"2023-12-07T10:00:14.467446+0000","last_peered":"2023-12-07T10:00:14.467446+0000","last_clean":"2023-12-07T10:00:14.467446+0000","last_became_active":"2023-12-07T10:00:13.463304+0000","last_became_peered":"2023-12-07T10:00:13.463304+0000","last_unstale":"2023-12-07T10:00:14.467446+0000","last_undegraded":"2023-12-07T10:00:14.467446+0000","last_fullsized":"2023-12-07T10:00:14.467446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:13:25.037083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.491500+0000","last_change":"2023-12-07T10:00:14.486211+0000","last_active":"2023-12-07T10:00:14.491500+0000","last_peered":"2023-12-07T10:00:14.491500+0000","last_clean":"2023-12-07T10:00:14.491500+0000","last_became_active":"2023-12-07T10:00:14.485872+0000","last_became_peered":"2023-12-07T10:00:14.485872+0000","last_unstale":"2023-12-07T10:00:14.491500+0000","last_undegraded":"2023-12-07T10:00:14.491500+0000","last_fullsized":"2023-12-07T10:00:14.491500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:01.011443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437959+0000","last_change":"2023-12-07T09:59:56.248159+0000","last_active":"2023-12-07T10:00:13.437959+0000","last_peered":"2023-12-07T10:00:13.437959+0000","last_clean":"2023-12-07T10:00:13.437959+0000","last_became_active":"2023-12-07T09:59:56.247890+0000","last_became_peered":"2023-12-07T09:59:56.247890+0000","last_unstale":"2023-12-07T10:00:13.437959+0000","last_undegraded":"2023-12-07T10:00:13.437959+0000","last_fullsized":"2023-12-07T10:00:13.437959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:11.557704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434556+0000","last_change":"2023-12-07T09:59:57.222557+0000","last_active":"2023-12-07T10:00:13.434556+0000","last_peered":"2023-12-07T10:00:13.434556+0000","last_clean":"2023-12-07T10:00:13.434556+0000","last_became_active":"2023-12-07T09:59:57.221911+0000","last_became_peered":"2023-12-07T09:59:57.221911+0000","last_unstale":"2023-12-07T10:00:13.434556+0000","last_undegraded":"2023-12-07T10:00:13.434556+0000","last_fullsized":"2023-12-07T10:00:13.434556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:08.918724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.509843+0000","last_change":"2023-12-07T10:00:13.458506+0000","last_active":"2023-12-07T10:00:14.509843+0000","last_peered":"2023-12-07T10:00:14.509843+0000","last_clean":"2023-12-07T10:00:14.509843+0000","last_became_active":"2023-12-07T10:00:13.458231+0000","last_became_peered":"2023-12-07T10:00:13.458231+0000","last_unstale":"2023-12-07T10:00:14.509843+0000","last_undegraded":"2023-12-07T10:00:14.509843+0000","last_fullsized":"2023-12-07T10:00:14.509843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:56:17.622330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.494311+0000","last_change":"2023-12-07T10:00:14.482697+0000","last_active":"2023-12-07T10:00:14.494311+0000","last_peered":"2023-12-07T10:00:14.494311+0000","last_clean":"2023-12-07T10:00:14.494311+0000","last_became_active":"2023-12-07T10:00:14.482415+0000","last_became_peered":"2023-12-07T10:00:14.482415+0000","last_unstale":"2023-12-07T10:00:14.494311+0000","last_undegraded":"2023-12-07T10:00:14.494311+0000","last_fullsized":"2023-12-07T10:00:14.494311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:55.703291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457901+0000","last_change":"2023-12-07T09:59:56.250622+0000","last_active":"2023-12-07T10:00:13.457901+0000","last_peered":"2023-12-07T10:00:13.457901+0000","last_clean":"2023-12-07T10:00:13.457901+0000","last_became_active":"2023-12-07T09:59:56.250318+0000","last_became_peered":"2023-12-07T09:59:56.250318+0000","last_unstale":"2023-12-07T10:00:13.457901+0000","last_undegraded":"2023-12-07T10:00:13.457901+0000","last_fullsized":"2023-12-07T10:00:13.457901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434787+0000","last_change":"2023-12-07T09:59:57.226382+0000","last_active":"2023-12-07T10:00:13.434787+0000","last_peered":"2023-12-07T10:00:13.434787+0000","last_clean":"2023-12-07T10:00:13.434787+0000","last_became_active":"2023-12-07T09:59:57.226109+0000","last_became_peered":"2023-12-07T09:59:57.226109+0000","last_unstale":"2023-12-07T10:00:13.434787+0000","last_undegraded":"2023-12-07T10:00:13.434787+0000","last_fullsized":"2023-12-07T10:00:13.434787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:33.099334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.458578+0000","last_change":"2023-12-07T10:00:13.453976+0000","last_active":"2023-12-07T10:00:14.458578+0000","last_peered":"2023-12-07T10:00:14.458578+0000","last_clean":"2023-12-07T10:00:14.458578+0000","last_became_active":"2023-12-07T10:00:13.452164+0000","last_became_peered":"2023-12-07T10:00:13.452164+0000","last_unstale":"2023-12-07T10:00:14.458578+0000","last_undegraded":"2023-12-07T10:00:14.458578+0000","last_fullsized":"2023-12-07T10:00:14.458578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:45:12.054481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496146+0000","last_change":"2023-12-07T10:00:14.486647+0000","last_active":"2023-12-07T10:00:14.496146+0000","last_peered":"2023-12-07T10:00:14.496146+0000","last_clean":"2023-12-07T10:00:14.496146+0000","last_became_active":"2023-12-07T10:00:14.484392+0000","last_became_peered":"2023-12-07T10:00:14.484392+0000","last_unstale":"2023-12-07T10:00:14.496146+0000","last_undegraded":"2023-12-07T10:00:14.496146+0000","last_fullsized":"2023-12-07T10:00:14.496146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:58.703203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445387+0000","last_change":"2023-12-07T09:59:56.245087+0000","last_active":"2023-12-07T10:00:13.445387+0000","last_peered":"2023-12-07T10:00:13.445387+0000","last_clean":"2023-12-07T10:00:13.445387+0000","last_became_active":"2023-12-07T09:59:56.244700+0000","last_became_peered":"2023-12-07T09:59:56.244700+0000","last_unstale":"2023-12-07T10:00:13.445387+0000","last_undegraded":"2023-12-07T10:00:13.445387+0000","last_fullsized":"2023-12-07T10:00:13.445387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434570+0000","last_change":"2023-12-07T09:59:57.229233+0000","last_active":"2023-12-07T10:00:13.434570+0000","last_peered":"2023-12-07T10:00:13.434570+0000","last_clean":"2023-12-07T10:00:13.434570+0000","last_became_active":"2023-12-07T09:59:57.228954+0000","last_became_peered":"2023-12-07T09:59:57.228954+0000","last_unstale":"2023-12-07T10:00:13.434570+0000","last_undegraded":"2023-12-07T10:00:13.434570+0000","last_fullsized":"2023-12-07T10:00:13.434570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:10:27.580956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.480053+0000","last_change":"2023-12-07T10:00:13.448982+0000","last_active":"2023-12-07T10:00:14.480053+0000","last_peered":"2023-12-07T10:00:14.480053+0000","last_clean":"2023-12-07T10:00:14.480053+0000","last_became_active":"2023-12-07T10:00:13.448751+0000","last_became_peered":"2023-12-07T10:00:13.448751+0000","last_unstale":"2023-12-07T10:00:14.480053+0000","last_undegraded":"2023-12-07T10:00:14.480053+0000","last_fullsized":"2023-12-07T10:00:14.480053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:48.866866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496321+0000","last_change":"2023-12-07T10:00:14.488737+0000","last_active":"2023-12-07T10:00:14.496321+0000","last_peered":"2023-12-07T10:00:14.496321+0000","last_clean":"2023-12-07T10:00:14.496321+0000","last_became_active":"2023-12-07T10:00:14.488450+0000","last_became_peered":"2023-12-07T10:00:14.488450+0000","last_unstale":"2023-12-07T10:00:14.496321+0000","last_undegraded":"2023-12-07T10:00:14.496321+0000","last_fullsized":"2023-12-07T10:00:14.496321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:54:14.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437136+0000","last_change":"2023-12-07T09:59:56.257331+0000","last_active":"2023-12-07T10:00:13.437136+0000","last_peered":"2023-12-07T10:00:13.437136+0000","last_clean":"2023-12-07T10:00:13.437136+0000","last_became_active":"2023-12-07T09:59:56.257002+0000","last_became_peered":"2023-12-07T09:59:56.257002+0000","last_unstale":"2023-12-07T10:00:13.437136+0000","last_undegraded":"2023-12-07T10:00:13.437136+0000","last_fullsized":"2023-12-07T10:00:13.437136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434665+0000","last_change":"2023-12-07T09:59:57.230224+0000","last_active":"2023-12-07T10:00:13.434665+0000","last_peered":"2023-12-07T10:00:13.434665+0000","last_clean":"2023-12-07T10:00:13.434665+0000","last_became_active":"2023-12-07T09:59:57.229926+0000","last_became_peered":"2023-12-07T09:59:57.229926+0000","last_unstale":"2023-12-07T10:00:13.434665+0000","last_undegraded":"2023-12-07T10:00:13.434665+0000","last_fullsized":"2023-12-07T10:00:13.434665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:14.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.509184+0000","last_change":"2023-12-07T10:00:13.455854+0000","last_active":"2023-12-07T10:00:14.509184+0000","last_peered":"2023-12-07T10:00:14.509184+0000","last_clean":"2023-12-07T10:00:14.509184+0000","last_became_active":"2023-12-07T10:00:13.455591+0000","last_became_peered":"2023-12-07T10:00:13.455591+0000","last_unstale":"2023-12-07T10:00:14.509184+0000","last_undegraded":"2023-12-07T10:00:14.509184+0000","last_fullsized":"2023-12-07T10:00:14.509184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:48.866866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.504007+0000","last_change":"2023-12-07T10:00:14.492941+0000","last_active":"2023-12-07T10:00:14.504007+0000","last_peered":"2023-12-07T10:00:14.504007+0000","last_clean":"2023-12-07T10:00:14.504007+0000","last_became_active":"2023-12-07T10:00:14.492667+0000","last_became_peered":"2023-12-07T10:00:14.492667+0000","last_unstale":"2023-12-07T10:00:14.504007+0000","last_undegraded":"2023-12-07T10:00:14.504007+0000","last_fullsized":"2023-12-07T10:00:14.504007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:19.999369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.439161+0000","last_change":"2023-12-07T09:59:56.247923+0000","last_active":"2023-12-07T10:00:13.439161+0000","last_peered":"2023-12-07T10:00:13.439161+0000","last_clean":"2023-12-07T10:00:13.439161+0000","last_became_active":"2023-12-07T09:59:56.247372+0000","last_became_peered":"2023-12-07T09:59:56.247372+0000","last_unstale":"2023-12-07T10:00:13.439161+0000","last_undegraded":"2023-12-07T10:00:13.439161+0000","last_fullsized":"2023-12-07T10:00:13.439161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447958+0000","last_change":"2023-12-07T09:59:57.240863+0000","last_active":"2023-12-07T10:00:13.447958+0000","last_peered":"2023-12-07T10:00:13.447958+0000","last_clean":"2023-12-07T10:00:13.447958+0000","last_became_active":"2023-12-07T09:59:57.239236+0000","last_became_peered":"2023-12-07T09:59:57.239236+0000","last_unstale":"2023-12-07T10:00:13.447958+0000","last_undegraded":"2023-12-07T10:00:13.447958+0000","last_fullsized":"2023-12-07T10:00:13.447958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.510479+0000","last_change":"2023-12-07T10:00:13.459468+0000","last_active":"2023-12-07T10:00:14.510479+0000","last_peered":"2023-12-07T10:00:14.510479+0000","last_clean":"2023-12-07T10:00:14.510479+0000","last_became_active":"2023-12-07T10:00:13.459134+0000","last_became_peered":"2023-12-07T10:00:13.459134+0000","last_unstale":"2023-12-07T10:00:14.510479+0000","last_undegraded":"2023-12-07T10:00:14.510479+0000","last_fullsized":"2023-12-07T10:00:14.510479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:55.736579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.481768+0000","last_change":"2023-12-07T10:00:14.472891+0000","last_active":"2023-12-07T10:00:14.481768+0000","last_peered":"2023-12-07T10:00:14.481768+0000","last_clean":"2023-12-07T10:00:14.481768+0000","last_became_active":"2023-12-07T10:00:14.472583+0000","last_became_peered":"2023-12-07T10:00:14.472583+0000","last_unstale":"2023-12-07T10:00:14.481768+0000","last_undegraded":"2023-12-07T10:00:14.481768+0000","last_fullsized":"2023-12-07T10:00:14.481768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:39:11.563410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438646+0000","last_change":"2023-12-07T09:59:56.243609+0000","last_active":"2023-12-07T10:00:13.438646+0000","last_peered":"2023-12-07T10:00:13.438646+0000","last_clean":"2023-12-07T10:00:13.438646+0000","last_became_active":"2023-12-07T09:59:56.243310+0000","last_became_peered":"2023-12-07T09:59:56.243310+0000","last_unstale":"2023-12-07T10:00:13.438646+0000","last_undegraded":"2023-12-07T10:00:13.438646+0000","last_fullsized":"2023-12-07T10:00:13.438646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448854+0000","last_change":"2023-12-07T09:59:57.222118+0000","last_active":"2023-12-07T10:00:13.448854+0000","last_peered":"2023-12-07T10:00:13.448854+0000","last_clean":"2023-12-07T10:00:13.448854+0000","last_became_active":"2023-12-07T09:59:57.221427+0000","last_became_peered":"2023-12-07T09:59:57.221427+0000","last_unstale":"2023-12-07T10:00:13.448854+0000","last_undegraded":"2023-12-07T10:00:13.448854+0000","last_fullsized":"2023-12-07T10:00:13.448854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460710+0000","last_change":"2023-12-07T10:00:13.463302+0000","last_active":"2023-12-07T10:00:14.460710+0000","last_peered":"2023-12-07T10:00:14.460710+0000","last_clean":"2023-12-07T10:00:14.460710+0000","last_became_active":"2023-12-07T10:00:13.462639+0000","last_became_peered":"2023-12-07T10:00:13.462639+0000","last_unstale":"2023-12-07T10:00:14.460710+0000","last_undegraded":"2023-12-07T10:00:14.460710+0000","last_fullsized":"2023-12-07T10:00:14.460710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:10:29.576843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.471167+0000","last_change":"2023-12-07T10:00:14.464887+0000","last_active":"2023-12-07T10:00:14.471167+0000","last_peered":"2023-12-07T10:00:14.471167+0000","last_clean":"2023-12-07T10:00:14.471167+0000","last_became_active":"2023-12-07T10:00:14.464454+0000","last_became_peered":"2023-12-07T10:00:14.464454+0000","last_unstale":"2023-12-07T10:00:14.471167+0000","last_undegraded":"2023-12-07T10:00:14.471167+0000","last_fullsized":"2023-12-07T10:00:14.471167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:35:07.418491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448751+0000","last_change":"2023-12-07T09:59:56.258524+0000","last_active":"2023-12-07T10:00:13.448751+0000","last_peered":"2023-12-07T10:00:13.448751+0000","last_clean":"2023-12-07T10:00:13.448751+0000","last_became_active":"2023-12-07T09:59:56.258272+0000","last_became_peered":"2023-12-07T09:59:56.258272+0000","last_unstale":"2023-12-07T10:00:13.448751+0000","last_undegraded":"2023-12-07T10:00:13.448751+0000","last_fullsized":"2023-12-07T10:00:13.448751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438530+0000","last_change":"2023-12-07T09:59:57.224125+0000","last_active":"2023-12-07T10:00:13.438530+0000","last_peered":"2023-12-07T10:00:13.438530+0000","last_clean":"2023-12-07T10:00:13.438530+0000","last_became_active":"2023-12-07T09:59:57.223773+0000","last_became_peered":"2023-12-07T09:59:57.223773+0000","last_unstale":"2023-12-07T10:00:13.438530+0000","last_undegraded":"2023-12-07T10:00:13.438530+0000","last_fullsized":"2023-12-07T10:00:13.438530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.504082+0000","last_change":"2023-12-07T10:00:13.458197+0000","last_active":"2023-12-07T10:00:14.504082+0000","last_peered":"2023-12-07T10:00:14.504082+0000","last_clean":"2023-12-07T10:00:14.504082+0000","last_became_active":"2023-12-07T10:00:13.457884+0000","last_became_peered":"2023-12-07T10:00:13.457884+0000","last_unstale":"2023-12-07T10:00:14.504082+0000","last_undegraded":"2023-12-07T10:00:14.504082+0000","last_fullsized":"2023-12-07T10:00:14.504082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:32:58.002435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492446+0000","last_change":"2023-12-07T10:00:14.481765+0000","last_active":"2023-12-07T10:00:14.492446+0000","last_peered":"2023-12-07T10:00:14.492446+0000","last_clean":"2023-12-07T10:00:14.492446+0000","last_became_active":"2023-12-07T10:00:14.481480+0000","last_became_peered":"2023-12-07T10:00:14.481480+0000","last_unstale":"2023-12-07T10:00:14.492446+0000","last_undegraded":"2023-12-07T10:00:14.492446+0000","last_fullsized":"2023-12-07T10:00:14.492446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:59.720998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.455029+0000","last_change":"2023-12-07T09:59:56.252633+0000","last_active":"2023-12-07T10:00:13.455029+0000","last_peered":"2023-12-07T10:00:13.455029+0000","last_clean":"2023-12-07T10:00:13.455029+0000","last_became_active":"2023-12-07T09:59:56.252316+0000","last_became_peered":"2023-12-07T09:59:56.252316+0000","last_unstale":"2023-12-07T10:00:13.455029+0000","last_undegraded":"2023-12-07T10:00:13.455029+0000","last_fullsized":"2023-12-07T10:00:13.455029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:29.900543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.456854+0000","last_change":"2023-12-07T09:59:57.239368+0000","last_active":"2023-12-07T10:00:13.456854+0000","last_peered":"2023-12-07T10:00:13.456854+0000","last_clean":"2023-12-07T10:00:13.456854+0000","last_became_active":"2023-12-07T09:59:57.238640+0000","last_became_peered":"2023-12-07T09:59:57.238640+0000","last_unstale":"2023-12-07T10:00:13.456854+0000","last_undegraded":"2023-12-07T10:00:13.456854+0000","last_fullsized":"2023-12-07T10:00:13.456854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:17.962783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460445+0000","last_change":"2023-12-07T10:00:13.452353+0000","last_active":"2023-12-07T10:00:14.460445+0000","last_peered":"2023-12-07T10:00:14.460445+0000","last_clean":"2023-12-07T10:00:14.460445+0000","last_became_active":"2023-12-07T10:00:13.452059+0000","last_became_peered":"2023-12-07T10:00:13.452059+0000","last_unstale":"2023-12-07T10:00:14.460445+0000","last_undegraded":"2023-12-07T10:00:14.460445+0000","last_fullsized":"2023-12-07T10:00:14.460445+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:25.740476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492008+0000","last_change":"2023-12-07T10:00:14.489395+0000","last_active":"2023-12-07T10:00:14.492008+0000","last_peered":"2023-12-07T10:00:14.492008+0000","last_clean":"2023-12-07T10:00:14.492008+0000","last_became_active":"2023-12-07T10:00:14.489120+0000","last_became_peered":"2023-12-07T10:00:14.489120+0000","last_unstale":"2023-12-07T10:00:14.492008+0000","last_undegraded":"2023-12-07T10:00:14.492008+0000","last_fullsized":"2023-12-07T10:00:14.492008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:57:16.761439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.454942+0000","last_change":"2023-12-07T09:59:56.249076+0000","last_active":"2023-12-07T10:00:13.454942+0000","last_peered":"2023-12-07T10:00:13.454942+0000","last_clean":"2023-12-07T10:00:13.454942+0000","last_became_active":"2023-12-07T09:59:56.248779+0000","last_became_peered":"2023-12-07T09:59:56.248779+0000","last_unstale":"2023-12-07T10:00:13.454942+0000","last_undegraded":"2023-12-07T10:00:13.454942+0000","last_fullsized":"2023-12-07T10:00:13.454942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440555+0000","last_change":"2023-12-07T09:59:57.231869+0000","last_active":"2023-12-07T10:00:13.440555+0000","last_peered":"2023-12-07T10:00:13.440555+0000","last_clean":"2023-12-07T10:00:13.440555+0000","last_became_active":"2023-12-07T09:59:57.231357+0000","last_became_peered":"2023-12-07T09:59:57.231357+0000","last_unstale":"2023-12-07T10:00:13.440555+0000","last_undegraded":"2023-12-07T10:00:13.440555+0000","last_fullsized":"2023-12-07T10:00:13.440555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.511358+0000","last_change":"2023-12-07T10:00:13.461947+0000","last_active":"2023-12-07T10:00:14.511358+0000","last_peered":"2023-12-07T10:00:14.511358+0000","last_clean":"2023-12-07T10:00:14.511358+0000","last_became_active":"2023-12-07T10:00:13.461685+0000","last_became_peered":"2023-12-07T10:00:13.461685+0000","last_unstale":"2023-12-07T10:00:14.511358+0000","last_undegraded":"2023-12-07T10:00:14.511358+0000","last_fullsized":"2023-12-07T10:00:14.511358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:48:59.777929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486865+0000","last_change":"2023-12-07T10:00:14.479848+0000","last_active":"2023-12-07T10:00:14.486865+0000","last_peered":"2023-12-07T10:00:14.486865+0000","last_clean":"2023-12-07T10:00:14.486865+0000","last_became_active":"2023-12-07T10:00:14.479544+0000","last_became_peered":"2023-12-07T10:00:14.479544+0000","last_unstale":"2023-12-07T10:00:14.486865+0000","last_undegraded":"2023-12-07T10:00:14.486865+0000","last_fullsized":"2023-12-07T10:00:14.486865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:13:26.039586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447371+0000","last_change":"2023-12-07T09:59:56.245266+0000","last_active":"2023-12-07T10:00:13.447371+0000","last_peered":"2023-12-07T10:00:13.447371+0000","last_clean":"2023-12-07T10:00:13.447371+0000","last_became_active":"2023-12-07T09:59:56.244990+0000","last_became_peered":"2023-12-07T09:59:56.244990+0000","last_unstale":"2023-12-07T10:00:13.447371+0000","last_undegraded":"2023-12-07T10:00:13.447371+0000","last_fullsized":"2023-12-07T10:00:13.447371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457969+0000","last_change":"2023-12-07T09:59:57.226535+0000","last_active":"2023-12-07T10:00:13.457969+0000","last_peered":"2023-12-07T10:00:13.457969+0000","last_clean":"2023-12-07T10:00:13.457969+0000","last_became_active":"2023-12-07T09:59:57.226242+0000","last_became_peered":"2023-12-07T09:59:57.226242+0000","last_unstale":"2023-12-07T10:00:13.457969+0000","last_undegraded":"2023-12-07T10:00:13.457969+0000","last_fullsized":"2023-12-07T10:00:13.457969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.512193+0000","last_change":"2023-12-07T10:00:13.451012+0000","last_active":"2023-12-07T10:00:14.512193+0000","last_peered":"2023-12-07T10:00:14.512193+0000","last_clean":"2023-12-07T10:00:14.512193+0000","last_became_active":"2023-12-07T10:00:13.450709+0000","last_became_peered":"2023-12-07T10:00:13.450709+0000","last_unstale":"2023-12-07T10:00:14.512193+0000","last_undegraded":"2023-12-07T10:00:14.512193+0000","last_fullsized":"2023-12-07T10:00:14.512193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:26.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.480745+0000","last_change":"2023-12-07T10:00:14.476919+0000","last_active":"2023-12-07T10:00:14.480745+0000","last_peered":"2023-12-07T10:00:14.480745+0000","last_clean":"2023-12-07T10:00:14.480745+0000","last_became_active":"2023-12-07T10:00:14.476603+0000","last_became_peered":"2023-12-07T10:00:14.476603+0000","last_unstale":"2023-12-07T10:00:14.480745+0000","last_undegraded":"2023-12-07T10:00:14.480745+0000","last_fullsized":"2023-12-07T10:00:14.480745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:20.031808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438875+0000","last_change":"2023-12-07T09:59:56.244124+0000","last_active":"2023-12-07T10:00:13.438875+0000","last_peered":"2023-12-07T10:00:13.438875+0000","last_clean":"2023-12-07T10:00:13.438875+0000","last_became_active":"2023-12-07T09:59:56.243879+0000","last_became_peered":"2023-12-07T09:59:56.243879+0000","last_unstale":"2023-12-07T10:00:13.438875+0000","last_undegraded":"2023-12-07T10:00:13.438875+0000","last_fullsized":"2023-12-07T10:00:13.438875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:03.809080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447387+0000","last_change":"2023-12-07T09:59:57.233881+0000","last_active":"2023-12-07T10:00:13.447387+0000","last_peered":"2023-12-07T10:00:13.447387+0000","last_clean":"2023-12-07T10:00:13.447387+0000","last_became_active":"2023-12-07T09:59:57.233618+0000","last_became_peered":"2023-12-07T09:59:57.233618+0000","last_unstale":"2023-12-07T10:00:13.447387+0000","last_undegraded":"2023-12-07T10:00:13.447387+0000","last_fullsized":"2023-12-07T10:00:13.447387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460658+0000","last_change":"2023-12-07T10:00:13.460965+0000","last_active":"2023-12-07T10:00:14.460658+0000","last_peered":"2023-12-07T10:00:14.460658+0000","last_clean":"2023-12-07T10:00:14.460658+0000","last_became_active":"2023-12-07T10:00:13.460717+0000","last_became_peered":"2023-12-07T10:00:13.460717+0000","last_unstale":"2023-12-07T10:00:14.460658+0000","last_undegraded":"2023-12-07T10:00:14.460658+0000","last_fullsized":"2023-12-07T10:00:14.460658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:13.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479975+0000","last_change":"2023-12-07T10:00:14.475226+0000","last_active":"2023-12-07T10:00:14.479975+0000","last_peered":"2023-12-07T10:00:14.479975+0000","last_clean":"2023-12-07T10:00:14.479975+0000","last_became_active":"2023-12-07T10:00:14.474622+0000","last_became_peered":"2023-12-07T10:00:14.474622+0000","last_unstale":"2023-12-07T10:00:14.479975+0000","last_undegraded":"2023-12-07T10:00:14.479975+0000","last_fullsized":"2023-12-07T10:00:14.479975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:02.643290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457863+0000","last_change":"2023-12-07T09:59:56.256946+0000","last_active":"2023-12-07T10:00:13.457863+0000","last_peered":"2023-12-07T10:00:13.457863+0000","last_clean":"2023-12-07T10:00:13.457863+0000","last_became_active":"2023-12-07T09:59:56.256514+0000","last_became_peered":"2023-12-07T09:59:56.256514+0000","last_unstale":"2023-12-07T10:00:13.457863+0000","last_undegraded":"2023-12-07T10:00:13.457863+0000","last_fullsized":"2023-12-07T10:00:13.457863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:25.242109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.450137+0000","last_change":"2023-12-07T09:59:57.240066+0000","last_active":"2023-12-07T10:00:13.450137+0000","last_peered":"2023-12-07T10:00:13.450137+0000","last_clean":"2023-12-07T10:00:13.450137+0000","last_became_active":"2023-12-07T09:59:57.239795+0000","last_became_peered":"2023-12-07T09:59:57.239795+0000","last_unstale":"2023-12-07T10:00:13.450137+0000","last_undegraded":"2023-12-07T10:00:13.450137+0000","last_fullsized":"2023-12-07T10:00:13.450137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.489428+0000","last_change":"2023-12-07T10:00:13.452488+0000","last_active":"2023-12-07T10:00:14.489428+0000","last_peered":"2023-12-07T10:00:14.489428+0000","last_clean":"2023-12-07T10:00:14.489428+0000","last_became_active":"2023-12-07T10:00:13.450697+0000","last_became_peered":"2023-12-07T10:00:13.450697+0000","last_unstale":"2023-12-07T10:00:14.489428+0000","last_undegraded":"2023-12-07T10:00:14.489428+0000","last_fullsized":"2023-12-07T10:00:14.489428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:45:12.054481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.493356+0000","last_change":"2023-12-07T10:00:14.492209+0000","last_active":"2023-12-07T10:00:14.493356+0000","last_peered":"2023-12-07T10:00:14.493356+0000","last_clean":"2023-12-07T10:00:14.493356+0000","last_became_active":"2023-12-07T10:00:14.491879+0000","last_became_peered":"2023-12-07T10:00:14.491879+0000","last_unstale":"2023-12-07T10:00:14.493356+0000","last_undegraded":"2023-12-07T10:00:14.493356+0000","last_fullsized":"2023-12-07T10:00:14.493356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:43.374001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.449993+0000","last_change":"2023-12-07T09:59:56.245272+0000","last_active":"2023-12-07T10:00:13.449993+0000","last_peered":"2023-12-07T10:00:13.449993+0000","last_clean":"2023-12-07T10:00:13.449993+0000","last_became_active":"2023-12-07T09:59:56.244612+0000","last_became_peered":"2023-12-07T09:59:56.244612+0000","last_unstale":"2023-12-07T10:00:13.449993+0000","last_undegraded":"2023-12-07T10:00:13.449993+0000","last_fullsized":"2023-12-07T10:00:13.449993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.459861+0000","last_change":"2023-12-07T09:59:57.232163+0000","last_active":"2023-12-07T10:00:13.459861+0000","last_peered":"2023-12-07T10:00:13.459861+0000","last_clean":"2023-12-07T10:00:13.459861+0000","last_became_active":"2023-12-07T09:59:57.231401+0000","last_became_peered":"2023-12-07T09:59:57.231401+0000","last_unstale":"2023-12-07T10:00:13.459861+0000","last_undegraded":"2023-12-07T10:00:13.459861+0000","last_fullsized":"2023-12-07T10:00:13.459861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:01:46.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.475940+0000","last_change":"2023-12-07T10:00:13.447920+0000","last_active":"2023-12-07T10:00:14.475940+0000","last_peered":"2023-12-07T10:00:14.475940+0000","last_clean":"2023-12-07T10:00:14.475940+0000","last_became_active":"2023-12-07T10:00:13.447623+0000","last_became_peered":"2023-12-07T10:00:13.447623+0000","last_unstale":"2023-12-07T10:00:14.475940+0000","last_undegraded":"2023-12-07T10:00:14.475940+0000","last_fullsized":"2023-12-07T10:00:14.475940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:26.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479480+0000","last_change":"2023-12-07T10:00:14.472250+0000","last_active":"2023-12-07T10:00:14.479480+0000","last_peered":"2023-12-07T10:00:14.479480+0000","last_clean":"2023-12-07T10:00:14.479480+0000","last_became_active":"2023-12-07T10:00:14.471933+0000","last_became_peered":"2023-12-07T10:00:14.471933+0000","last_unstale":"2023-12-07T10:00:14.479480+0000","last_undegraded":"2023-12-07T10:00:14.479480+0000","last_fullsized":"2023-12-07T10:00:14.479480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:52.735101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446843+0000","last_change":"2023-12-07T09:59:56.257460+0000","last_active":"2023-12-07T10:00:13.446843+0000","last_peered":"2023-12-07T10:00:13.446843+0000","last_clean":"2023-12-07T10:00:13.446843+0000","last_became_active":"2023-12-07T09:59:56.257108+0000","last_became_peered":"2023-12-07T09:59:56.257108+0000","last_unstale":"2023-12-07T10:00:13.446843+0000","last_undegraded":"2023-12-07T10:00:13.446843+0000","last_fullsized":"2023-12-07T10:00:13.446843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460650+0000","last_change":"2023-12-07T09:59:57.237888+0000","last_active":"2023-12-07T10:00:13.460650+0000","last_peered":"2023-12-07T10:00:13.460650+0000","last_clean":"2023-12-07T10:00:13.460650+0000","last_became_active":"2023-12-07T09:59:57.237543+0000","last_became_peered":"2023-12-07T09:59:57.237543+0000","last_unstale":"2023-12-07T10:00:13.460650+0000","last_undegraded":"2023-12-07T10:00:13.460650+0000","last_fullsized":"2023-12-07T10:00:13.460650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:26.165219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.512845+0000","last_change":"2023-12-07T10:00:13.442388+0000","last_active":"2023-12-07T10:00:14.512845+0000","last_peered":"2023-12-07T10:00:14.512845+0000","last_clean":"2023-12-07T10:00:14.512845+0000","last_became_active":"2023-12-07T10:00:13.442126+0000","last_became_peered":"2023-12-07T10:00:13.442126+0000","last_unstale":"2023-12-07T10:00:14.512845+0000","last_undegraded":"2023-12-07T10:00:14.512845+0000","last_fullsized":"2023-12-07T10:00:14.512845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:35:06.415988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.497567+0000","last_change":"2023-12-07T10:00:14.486342+0000","last_active":"2023-12-07T10:00:14.497567+0000","last_peered":"2023-12-07T10:00:14.497567+0000","last_clean":"2023-12-07T10:00:14.497567+0000","last_became_active":"2023-12-07T10:00:14.486040+0000","last_became_peered":"2023-12-07T10:00:14.486040+0000","last_unstale":"2023-12-07T10:00:14.497567+0000","last_undegraded":"2023-12-07T10:00:14.497567+0000","last_fullsized":"2023-12-07T10:00:14.497567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:02.643290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460742+0000","last_change":"2023-12-07T09:59:56.249207+0000","last_active":"2023-12-07T10:00:13.460742+0000","last_peered":"2023-12-07T10:00:13.460742+0000","last_clean":"2023-12-07T10:00:13.460742+0000","last_became_active":"2023-12-07T09:59:56.248795+0000","last_became_peered":"2023-12-07T09:59:56.248795+0000","last_unstale":"2023-12-07T10:00:13.460742+0000","last_undegraded":"2023-12-07T10:00:13.460742+0000","last_fullsized":"2023-12-07T10:00:13.460742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:39.635874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.449441+0000","last_change":"2023-12-07T09:59:57.239958+0000","last_active":"2023-12-07T10:00:13.449441+0000","last_peered":"2023-12-07T10:00:13.449441+0000","last_clean":"2023-12-07T10:00:13.449441+0000","last_became_active":"2023-12-07T09:59:57.239590+0000","last_became_peered":"2023-12-07T09:59:57.239590+0000","last_unstale":"2023-12-07T10:00:13.449441+0000","last_undegraded":"2023-12-07T10:00:13.449441+0000","last_fullsized":"2023-12-07T10:00:13.449441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.501435+0000","last_change":"2023-12-07T10:00:13.464324+0000","last_active":"2023-12-07T10:00:14.501435+0000","last_peered":"2023-12-07T10:00:14.501435+0000","last_clean":"2023-12-07T10:00:14.501435+0000","last_became_active":"2023-12-07T10:00:13.463840+0000","last_became_peered":"2023-12-07T10:00:13.463840+0000","last_unstale":"2023-12-07T10:00:14.501435+0000","last_undegraded":"2023-12-07T10:00:14.501435+0000","last_fullsized":"2023-12-07T10:00:14.501435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:19.029305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496148+0000","last_change":"2023-12-07T10:00:14.485622+0000","last_active":"2023-12-07T10:00:14.496148+0000","last_peered":"2023-12-07T10:00:14.496148+0000","last_clean":"2023-12-07T10:00:14.496148+0000","last_became_active":"2023-12-07T10:00:14.485159+0000","last_became_peered":"2023-12-07T10:00:14.485159+0000","last_unstale":"2023-12-07T10:00:14.496148+0000","last_undegraded":"2023-12-07T10:00:14.496148+0000","last_fullsized":"2023-12-07T10:00:14.496148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:43.374001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438853+0000","last_change":"2023-12-07T09:59:56.240171+0000","last_active":"2023-12-07T10:00:13.438853+0000","last_peered":"2023-12-07T10:00:13.438853+0000","last_clean":"2023-12-07T10:00:13.438853+0000","last_became_active":"2023-12-07T09:59:56.239779+0000","last_became_peered":"2023-12-07T09:59:56.239779+0000","last_unstale":"2023-12-07T10:00:13.438853+0000","last_undegraded":"2023-12-07T10:00:13.438853+0000","last_fullsized":"2023-12-07T10:00:13.438853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447315+0000","last_change":"2023-12-07T09:59:57.233603+0000","last_active":"2023-12-07T10:00:13.447315+0000","last_peered":"2023-12-07T10:00:13.447315+0000","last_clean":"2023-12-07T10:00:13.447315+0000","last_became_active":"2023-12-07T09:59:57.233247+0000","last_became_peered":"2023-12-07T09:59:57.233247+0000","last_unstale":"2023-12-07T10:00:13.447315+0000","last_undegraded":"2023-12-07T10:00:13.447315+0000","last_fullsized":"2023-12-07T10:00:13.447315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.508268+0000","last_change":"2023-12-07T10:00:13.450498+0000","last_active":"2023-12-07T10:00:14.508268+0000","last_peered":"2023-12-07T10:00:14.508268+0000","last_clean":"2023-12-07T10:00:14.508268+0000","last_became_active":"2023-12-07T10:00:13.450233+0000","last_became_peered":"2023-12-07T10:00:13.450233+0000","last_unstale":"2023-12-07T10:00:14.508268+0000","last_undegraded":"2023-12-07T10:00:14.508268+0000","last_fullsized":"2023-12-07T10:00:14.508268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:13:40.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.487847+0000","last_change":"2023-12-07T10:00:14.485393+0000","last_active":"2023-12-07T10:00:14.487847+0000","last_peered":"2023-12-07T10:00:14.487847+0000","last_clean":"2023-12-07T10:00:14.487847+0000","last_became_active":"2023-12-07T10:00:14.485072+0000","last_became_peered":"2023-12-07T10:00:14.485072+0000","last_unstale":"2023-12-07T10:00:14.487847+0000","last_undegraded":"2023-12-07T10:00:14.487847+0000","last_fullsized":"2023-12-07T10:00:14.487847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:02:03.948567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457586+0000","last_change":"2023-12-07T09:59:56.254460+0000","last_active":"2023-12-07T10:00:13.457586+0000","last_peered":"2023-12-07T10:00:13.457586+0000","last_clean":"2023-12-07T10:00:13.457586+0000","last_became_active":"2023-12-07T09:59:56.254187+0000","last_became_peered":"2023-12-07T09:59:56.254187+0000","last_unstale":"2023-12-07T10:00:13.457586+0000","last_undegraded":"2023-12-07T10:00:13.457586+0000","last_fullsized":"2023-12-07T10:00:13.457586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:04.346155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.439236+0000","last_change":"2023-12-07T09:59:57.241610+0000","last_active":"2023-12-07T10:00:13.439236+0000","last_peered":"2023-12-07T10:00:13.439236+0000","last_clean":"2023-12-07T10:00:13.439236+0000","last_became_active":"2023-12-07T09:59:57.241339+0000","last_became_peered":"2023-12-07T09:59:57.241339+0000","last_unstale":"2023-12-07T10:00:13.439236+0000","last_undegraded":"2023-12-07T10:00:13.439236+0000","last_fullsized":"2023-12-07T10:00:13.439236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.509782+0000","last_change":"2023-12-07T10:00:13.460054+0000","last_active":"2023-12-07T10:00:14.509782+0000","last_peered":"2023-12-07T10:00:14.509782+0000","last_clean":"2023-12-07T10:00:14.509782+0000","last_became_active":"2023-12-07T10:00:13.458561+0000","last_became_peered":"2023-12-07T10:00:13.458561+0000","last_unstale":"2023-12-07T10:00:14.509782+0000","last_undegraded":"2023-12-07T10:00:14.509782+0000","last_fullsized":"2023-12-07T10:00:14.509782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:00:23.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.476778+0000","last_change":"2023-12-07T10:00:14.468457+0000","last_active":"2023-12-07T10:00:14.476778+0000","last_peered":"2023-12-07T10:00:14.476778+0000","last_clean":"2023-12-07T10:00:14.476778+0000","last_became_active":"2023-12-07T10:00:14.468114+0000","last_became_peered":"2023-12-07T10:00:14.468114+0000","last_unstale":"2023-12-07T10:00:14.476778+0000","last_undegraded":"2023-12-07T10:00:14.476778+0000","last_fullsized":"2023-12-07T10:00:14.476778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:48.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438314+0000","last_change":"2023-12-07T09:59:56.255384+0000","last_active":"2023-12-07T10:00:13.438314+0000","last_peered":"2023-12-07T10:00:13.438314+0000","last_clean":"2023-12-07T10:00:13.438314+0000","last_became_active":"2023-12-07T09:59:56.255104+0000","last_became_peered":"2023-12-07T09:59:56.255104+0000","last_unstale":"2023-12-07T10:00:13.438314+0000","last_undegraded":"2023-12-07T10:00:13.438314+0000","last_fullsized":"2023-12-07T10:00:13.438314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.450464+0000","last_change":"2023-12-07T09:59:57.228028+0000","last_active":"2023-12-07T10:00:13.450464+0000","last_peered":"2023-12-07T10:00:13.450464+0000","last_clean":"2023-12-07T10:00:13.450464+0000","last_became_active":"2023-12-07T09:59:57.227746+0000","last_became_peered":"2023-12-07T09:59:57.227746+0000","last_unstale":"2023-12-07T10:00:13.450464+0000","last_undegraded":"2023-12-07T10:00:13.450464+0000","last_fullsized":"2023-12-07T10:00:13.450464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479879+0000","last_change":"2023-12-07T10:00:13.455674+0000","last_active":"2023-12-07T10:00:14.479879+0000","last_peered":"2023-12-07T10:00:14.479879+0000","last_clean":"2023-12-07T10:00:14.479879+0000","last_became_active":"2023-12-07T10:00:13.454943+0000","last_became_peered":"2023-12-07T10:00:13.454943+0000","last_unstale":"2023-12-07T10:00:14.479879+0000","last_undegraded":"2023-12-07T10:00:14.479879+0000","last_fullsized":"2023-12-07T10:00:14.479879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:08:52.766136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.494163+0000","last_change":"2023-12-07T10:00:14.482964+0000","last_active":"2023-12-07T10:00:14.494163+0000","last_peered":"2023-12-07T10:00:14.494163+0000","last_clean":"2023-12-07T10:00:14.494163+0000","last_became_active":"2023-12-07T10:00:14.482358+0000","last_became_peered":"2023-12-07T10:00:14.482358+0000","last_unstale":"2023-12-07T10:00:14.494163+0000","last_undegraded":"2023-12-07T10:00:14.494163+0000","last_fullsized":"2023-12-07T10:00:14.494163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:27.066740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438836+0000","last_change":"2023-12-07T09:59:56.257431+0000","last_active":"2023-12-07T10:00:13.438836+0000","last_peered":"2023-12-07T10:00:13.438836+0000","last_clean":"2023-12-07T10:00:13.438836+0000","last_became_active":"2023-12-07T09:59:56.257143+0000","last_became_peered":"2023-12-07T09:59:56.257143+0000","last_unstale":"2023-12-07T10:00:13.438836+0000","last_undegraded":"2023-12-07T10:00:13.438836+0000","last_fullsized":"2023-12-07T10:00:13.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.441633+0000","last_change":"2023-12-07T09:59:57.232971+0000","last_active":"2023-12-07T10:00:13.441633+0000","last_peered":"2023-12-07T10:00:13.441633+0000","last_clean":"2023-12-07T10:00:13.441633+0000","last_became_active":"2023-12-07T09:59:57.232675+0000","last_became_peered":"2023-12-07T09:59:57.232675+0000","last_unstale":"2023-12-07T10:00:13.441633+0000","last_undegraded":"2023-12-07T10:00:13.441633+0000","last_fullsized":"2023-12-07T10:00:13.441633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484535+0000","last_change":"2023-12-07T10:00:13.456710+0000","last_active":"2023-12-07T10:00:14.484535+0000","last_peered":"2023-12-07T10:00:14.484535+0000","last_clean":"2023-12-07T10:00:14.484535+0000","last_became_active":"2023-12-07T10:00:13.455774+0000","last_became_peered":"2023-12-07T10:00:13.455774+0000","last_unstale":"2023-12-07T10:00:14.484535+0000","last_undegraded":"2023-12-07T10:00:14.484535+0000","last_fullsized":"2023-12-07T10:00:14.484535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:19.029305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488118+0000","last_change":"2023-12-07T10:00:14.481896+0000","last_active":"2023-12-07T10:00:14.488118+0000","last_peered":"2023-12-07T10:00:14.488118+0000","last_clean":"2023-12-07T10:00:14.488118+0000","last_became_active":"2023-12-07T10:00:14.481540+0000","last_became_peered":"2023-12-07T10:00:14.481540+0000","last_unstale":"2023-12-07T10:00:14.488118+0000","last_undegraded":"2023-12-07T10:00:14.488118+0000","last_fullsized":"2023-12-07T10:00:14.488118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:55.703291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.508691+0000","last_change":"2023-12-07T10:00:13.464332+0000","last_active":"2023-12-07T10:00:14.508691+0000","last_peered":"2023-12-07T10:00:14.508691+0000","last_clean":"2023-12-07T10:00:14.508691+0000","last_became_active":"2023-12-07T10:00:13.464043+0000","last_became_peered":"2023-12-07T10:00:13.464043+0000","last_unstale":"2023-12-07T10:00:14.508691+0000","last_undegraded":"2023-12-07T10:00:14.508691+0000","last_fullsized":"2023-12-07T10:00:14.508691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:00.736597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434908+0000","last_change":"2023-12-07T09:59:56.251685+0000","last_active":"2023-12-07T10:00:13.434908+0000","last_peered":"2023-12-07T10:00:13.434908+0000","last_clean":"2023-12-07T10:00:13.434908+0000","last_became_active":"2023-12-07T09:59:56.251379+0000","last_became_peered":"2023-12-07T09:59:56.251379+0000","last_unstale":"2023-12-07T10:00:13.434908+0000","last_undegraded":"2023-12-07T10:00:13.434908+0000","last_fullsized":"2023-12-07T10:00:13.434908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:45.496128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448354+0000","last_change":"2023-12-07T09:59:57.245223+0000","last_active":"2023-12-07T10:00:13.448354+0000","last_peered":"2023-12-07T10:00:13.448354+0000","last_clean":"2023-12-07T10:00:13.448354+0000","last_became_active":"2023-12-07T09:59:57.245009+0000","last_became_peered":"2023-12-07T09:59:57.245009+0000","last_unstale":"2023-12-07T10:00:13.448354+0000","last_undegraded":"2023-12-07T10:00:13.448354+0000","last_fullsized":"2023-12-07T10:00:13.448354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484649+0000","last_change":"2023-12-07T10:00:14.477811+0000","last_active":"2023-12-07T10:00:14.484649+0000","last_peered":"2023-12-07T10:00:14.484649+0000","last_clean":"2023-12-07T10:00:14.484649+0000","last_became_active":"2023-12-07T10:00:14.476390+0000","last_became_peered":"2023-12-07T10:00:14.476390+0000","last_unstale":"2023-12-07T10:00:14.484649+0000","last_undegraded":"2023-12-07T10:00:14.484649+0000","last_fullsized":"2023-12-07T10:00:14.484649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:59.720998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.505914+0000","last_change":"2023-12-07T10:00:13.463577+0000","last_active":"2023-12-07T10:00:14.505914+0000","last_peered":"2023-12-07T10:00:14.505914+0000","last_clean":"2023-12-07T10:00:14.505914+0000","last_became_active":"2023-12-07T10:00:13.462720+0000","last_became_peered":"2023-12-07T10:00:13.462720+0000","last_unstale":"2023-12-07T10:00:14.505914+0000","last_undegraded":"2023-12-07T10:00:14.505914+0000","last_fullsized":"2023-12-07T10:00:14.505914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:40:56.910976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.458083+0000","last_change":"2023-12-07T09:59:56.254732+0000","last_active":"2023-12-07T10:00:13.458083+0000","last_peered":"2023-12-07T10:00:13.458083+0000","last_clean":"2023-12-07T10:00:13.458083+0000","last_became_active":"2023-12-07T09:59:56.254439+0000","last_became_peered":"2023-12-07T09:59:56.254439+0000","last_unstale":"2023-12-07T10:00:13.458083+0000","last_undegraded":"2023-12-07T10:00:13.458083+0000","last_fullsized":"2023-12-07T10:00:13.458083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437014+0000","last_change":"2023-12-07T09:59:57.239310+0000","last_active":"2023-12-07T10:00:13.437014+0000","last_peered":"2023-12-07T10:00:13.437014+0000","last_clean":"2023-12-07T10:00:13.437014+0000","last_became_active":"2023-12-07T09:59:57.239006+0000","last_became_peered":"2023-12-07T09:59:57.239006+0000","last_unstale":"2023-12-07T10:00:13.437014+0000","last_undegraded":"2023-12-07T10:00:13.437014+0000","last_fullsized":"2023-12-07T10:00:13.437014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.477592+0000","last_change":"2023-12-07T10:00:14.472144+0000","last_active":"2023-12-07T10:00:14.477592+0000","last_peered":"2023-12-07T10:00:14.477592+0000","last_clean":"2023-12-07T10:00:14.477592+0000","last_became_active":"2023-12-07T10:00:14.471695+0000","last_became_peered":"2023-12-07T10:00:14.471695+0000","last_unstale":"2023-12-07T10:00:14.477592+0000","last_undegraded":"2023-12-07T10:00:14.477592+0000","last_fullsized":"2023-12-07T10:00:14.477592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:25.380801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446767+0000","last_change":"2023-12-07T09:59:56.235235+0000","last_active":"2023-12-07T10:00:13.446767+0000","last_peered":"2023-12-07T10:00:13.446767+0000","last_clean":"2023-12-07T10:00:13.446767+0000","last_became_active":"2023-12-07T09:59:56.234964+0000","last_became_peered":"2023-12-07T09:59:56.234964+0000","last_unstale":"2023-12-07T10:00:13.446767+0000","last_undegraded":"2023-12-07T10:00:13.446767+0000","last_fullsized":"2023-12-07T10:00:13.446767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457369+0000","last_change":"2023-12-07T09:59:57.240365+0000","last_active":"2023-12-07T10:00:13.457369+0000","last_peered":"2023-12-07T10:00:13.457369+0000","last_clean":"2023-12-07T10:00:13.457369+0000","last_became_active":"2023-12-07T09:59:57.240064+0000","last_became_peered":"2023-12-07T09:59:57.240064+0000","last_unstale":"2023-12-07T10:00:13.457369+0000","last_undegraded":"2023-12-07T10:00:13.457369+0000","last_fullsized":"2023-12-07T10:00:13.457369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.500688+0000","last_change":"2023-12-07T10:00:13.455036+0000","last_active":"2023-12-07T10:00:14.500688+0000","last_peered":"2023-12-07T10:00:14.500688+0000","last_clean":"2023-12-07T10:00:14.500688+0000","last_became_active":"2023-12-07T10:00:13.454781+0000","last_became_peered":"2023-12-07T10:00:13.454781+0000","last_unstale":"2023-12-07T10:00:14.500688+0000","last_undegraded":"2023-12-07T10:00:14.500688+0000","last_fullsized":"2023-12-07T10:00:14.500688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:32:58.002435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.477592+0000","last_change":"2023-12-07T10:00:14.472856+0000","last_active":"2023-12-07T10:00:14.477592+0000","last_peered":"2023-12-07T10:00:14.477592+0000","last_clean":"2023-12-07T10:00:14.477592+0000","last_became_active":"2023-12-07T10:00:14.472507+0000","last_became_peered":"2023-12-07T10:00:14.472507+0000","last_unstale":"2023-12-07T10:00:14.477592+0000","last_undegraded":"2023-12-07T10:00:14.477592+0000","last_fullsized":"2023-12-07T10:00:14.477592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:08:53.768639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457455+0000","last_change":"2023-12-07T09:59:56.247813+0000","last_active":"2023-12-07T10:00:13.457455+0000","last_peered":"2023-12-07T10:00:13.457455+0000","last_clean":"2023-12-07T10:00:13.457455+0000","last_became_active":"2023-12-07T09:59:56.247138+0000","last_became_peered":"2023-12-07T09:59:56.247138+0000","last_unstale":"2023-12-07T10:00:13.457455+0000","last_undegraded":"2023-12-07T10:00:13.457455+0000","last_fullsized":"2023-12-07T10:00:13.457455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446754+0000","last_change":"2023-12-07T09:59:57.229840+0000","last_active":"2023-12-07T10:00:13.446754+0000","last_peered":"2023-12-07T10:00:13.446754+0000","last_clean":"2023-12-07T10:00:13.446754+0000","last_became_active":"2023-12-07T09:59:57.229062+0000","last_became_peered":"2023-12-07T09:59:57.229062+0000","last_unstale":"2023-12-07T10:00:13.446754+0000","last_undegraded":"2023-12-07T10:00:13.446754+0000","last_fullsized":"2023-12-07T10:00:13.446754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.508611+0000","last_change":"2023-12-07T10:00:13.454435+0000","last_active":"2023-12-07T10:00:14.508611+0000","last_peered":"2023-12-07T10:00:14.508611+0000","last_clean":"2023-12-07T10:00:14.508611+0000","last_became_active":"2023-12-07T10:00:13.454159+0000","last_became_peered":"2023-12-07T10:00:13.454159+0000","last_unstale":"2023-12-07T10:00:14.508611+0000","last_undegraded":"2023-12-07T10:00:14.508611+0000","last_fullsized":"2023-12-07T10:00:14.508611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:15.065633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486489+0000","last_change":"2023-12-07T10:00:14.479855+0000","last_active":"2023-12-07T10:00:14.486489+0000","last_peered":"2023-12-07T10:00:14.486489+0000","last_clean":"2023-12-07T10:00:14.486489+0000","last_became_active":"2023-12-07T10:00:14.477718+0000","last_became_peered":"2023-12-07T10:00:14.477718+0000","last_unstale":"2023-12-07T10:00:14.486489+0000","last_undegraded":"2023-12-07T10:00:14.486489+0000","last_fullsized":"2023-12-07T10:00:14.486489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:16.068136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440476+0000","last_change":"2023-12-07T09:59:57.230613+0000","last_active":"2023-12-07T10:00:13.440476+0000","last_peered":"2023-12-07T10:00:13.440476+0000","last_clean":"2023-12-07T10:00:13.440476+0000","last_became_active":"2023-12-07T09:59:57.228342+0000","last_became_peered":"2023-12-07T09:59:57.228342+0000","last_unstale":"2023-12-07T10:00:13.440476+0000","last_undegraded":"2023-12-07T10:00:13.440476+0000","last_fullsized":"2023-12-07T10:00:13.440476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.478655+0000","last_change":"2023-12-07T10:00:14.472820+0000","last_active":"2023-12-07T10:00:14.478655+0000","last_peered":"2023-12-07T10:00:14.478655+0000","last_clean":"2023-12-07T10:00:14.478655+0000","last_became_active":"2023-12-07T10:00:14.472570+0000","last_became_peered":"2023-12-07T10:00:14.472570+0000","last_unstale":"2023-12-07T10:00:14.478655+0000","last_undegraded":"2023-12-07T10:00:14.478655+0000","last_fullsized":"2023-12-07T10:00:14.478655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:56:07.297854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.456737+0000","last_change":"2023-12-07T09:59:57.239542+0000","last_active":"2023-12-07T10:00:13.456737+0000","last_peered":"2023-12-07T10:00:13.456737+0000","last_clean":"2023-12-07T10:00:13.456737+0000","last_became_active":"2023-12-07T09:59:57.238943+0000","last_became_peered":"2023-12-07T09:59:57.238943+0000","last_unstale":"2023-12-07T10:00:13.456737+0000","last_undegraded":"2023-12-07T10:00:13.456737+0000","last_fullsized":"2023-12-07T10:00:13.456737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:31.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.483996+0000","last_change":"2023-12-07T10:00:14.475622+0000","last_active":"2023-12-07T10:00:14.483996+0000","last_peered":"2023-12-07T10:00:14.483996+0000","last_clean":"2023-12-07T10:00:14.483996+0000","last_became_active":"2023-12-07T10:00:14.475326+0000","last_became_peered":"2023-12-07T10:00:14.475326+0000","last_unstale":"2023-12-07T10:00:14.483996+0000","last_undegraded":"2023-12-07T10:00:14.483996+0000","last_fullsized":"2023-12-07T10:00:14.483996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:21.396770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.441515+0000","last_change":"2023-12-07T09:59:57.244392+0000","last_active":"2023-12-07T10:00:13.441515+0000","last_peered":"2023-12-07T10:00:13.441515+0000","last_clean":"2023-12-07T10:00:13.441515+0000","last_became_active":"2023-12-07T09:59:57.244056+0000","last_became_peered":"2023-12-07T09:59:57.244056+0000","last_unstale":"2023-12-07T10:00:13.441515+0000","last_undegraded":"2023-12-07T10:00:13.441515+0000","last_fullsized":"2023-12-07T10:00:13.441515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.497624+0000","last_change":"2023-12-07T10:00:14.492261+0000","last_active":"2023-12-07T10:00:14.497624+0000","last_peered":"2023-12-07T10:00:14.497624+0000","last_clean":"2023-12-07T10:00:14.497624+0000","last_became_active":"2023-12-07T10:00:14.491973+0000","last_became_peered":"2023-12-07T10:00:14.491973+0000","last_unstale":"2023-12-07T10:00:14.497624+0000","last_undegraded":"2023-12-07T10:00:14.497624+0000","last_fullsized":"2023-12-07T10:00:14.497624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:18.734440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438744+0000","last_change":"2023-12-07T09:59:57.236890+0000","last_active":"2023-12-07T10:00:13.438744+0000","last_peered":"2023-12-07T10:00:13.438744+0000","last_clean":"2023-12-07T10:00:13.438744+0000","last_became_active":"2023-12-07T09:59:57.236640+0000","last_became_peered":"2023-12-07T09:59:57.236640+0000","last_unstale":"2023-12-07T10:00:13.438744+0000","last_undegraded":"2023-12-07T10:00:13.438744+0000","last_fullsized":"2023-12-07T10:00:13.438744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.493369+0000","last_change":"2023-12-07T10:00:14.484279+0000","last_active":"2023-12-07T10:00:14.493369+0000","last_peered":"2023-12-07T10:00:14.493369+0000","last_clean":"2023-12-07T10:00:14.493369+0000","last_became_active":"2023-12-07T10:00:14.484004+0000","last_became_peered":"2023-12-07T10:00:14.484004+0000","last_unstale":"2023-12-07T10:00:14.493369+0000","last_undegraded":"2023-12-07T10:00:14.493369+0000","last_fullsized":"2023-12-07T10:00:14.493369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:53.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448441+0000","last_change":"2023-12-07T09:59:57.227268+0000","last_active":"2023-12-07T10:00:13.448441+0000","last_peered":"2023-12-07T10:00:13.448441+0000","last_clean":"2023-12-07T10:00:13.448441+0000","last_became_active":"2023-12-07T09:59:57.226493+0000","last_became_peered":"2023-12-07T09:59:57.226493+0000","last_unstale":"2023-12-07T10:00:13.448441+0000","last_undegraded":"2023-12-07T10:00:13.448441+0000","last_fullsized":"2023-12-07T10:00:13.448441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.478742+0000","last_change":"2023-12-07T10:00:14.473632+0000","last_active":"2023-12-07T10:00:14.478742+0000","last_peered":"2023-12-07T10:00:14.478742+0000","last_clean":"2023-12-07T10:00:14.478742+0000","last_became_active":"2023-12-07T10:00:14.473177+0000","last_became_peered":"2023-12-07T10:00:14.473177+0000","last_unstale":"2023-12-07T10:00:14.478742+0000","last_undegraded":"2023-12-07T10:00:14.478742+0000","last_fullsized":"2023-12-07T10:00:14.478742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:05.417730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448322+0000","last_change":"2023-12-07T09:59:57.245295+0000","last_active":"2023-12-07T10:00:13.448322+0000","last_peered":"2023-12-07T10:00:13.448322+0000","last_clean":"2023-12-07T10:00:13.448322+0000","last_became_active":"2023-12-07T09:59:57.245030+0000","last_became_peered":"2023-12-07T09:59:57.245030+0000","last_unstale":"2023-12-07T10:00:13.448322+0000","last_undegraded":"2023-12-07T10:00:13.448322+0000","last_fullsized":"2023-12-07T10:00:13.448322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488446+0000","last_change":"2023-12-07T10:00:14.486125+0000","last_active":"2023-12-07T10:00:14.488446+0000","last_peered":"2023-12-07T10:00:14.488446+0000","last_clean":"2023-12-07T10:00:14.488446+0000","last_became_active":"2023-12-07T10:00:14.485834+0000","last_became_peered":"2023-12-07T10:00:14.485834+0000","last_unstale":"2023-12-07T10:00:14.488446+0000","last_undegraded":"2023-12-07T10:00:14.488446+0000","last_fullsized":"2023-12-07T10:00:14.488446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:49.869369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460701+0000","last_change":"2023-12-07T09:59:57.228494+0000","last_active":"2023-12-07T10:00:13.460701+0000","last_peered":"2023-12-07T10:00:13.460701+0000","last_clean":"2023-12-07T10:00:13.460701+0000","last_became_active":"2023-12-07T09:59:57.228210+0000","last_became_peered":"2023-12-07T09:59:57.228210+0000","last_unstale":"2023-12-07T10:00:13.460701+0000","last_undegraded":"2023-12-07T10:00:13.460701+0000","last_fullsized":"2023-12-07T10:00:13.460701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:58.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486689+0000","last_change":"2023-12-07T10:00:14.481540+0000","last_active":"2023-12-07T10:00:14.486689+0000","last_peered":"2023-12-07T10:00:14.486689+0000","last_clean":"2023-12-07T10:00:14.486689+0000","last_became_active":"2023-12-07T10:00:14.480908+0000","last_became_peered":"2023-12-07T10:00:14.480908+0000","last_unstale":"2023-12-07T10:00:14.486689+0000","last_undegraded":"2023-12-07T10:00:14.486689+0000","last_fullsized":"2023-12-07T10:00:14.486689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:02:32.023383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448625+0000","last_change":"2023-12-07T09:59:57.235369+0000","last_active":"2023-12-07T10:00:13.448625+0000","last_peered":"2023-12-07T10:00:13.448625+0000","last_clean":"2023-12-07T10:00:13.448625+0000","last_became_active":"2023-12-07T09:59:57.235129+0000","last_became_peered":"2023-12-07T09:59:57.235129+0000","last_unstale":"2023-12-07T10:00:13.448625+0000","last_undegraded":"2023-12-07T10:00:13.448625+0000","last_fullsized":"2023-12-07T10:00:13.448625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492192+0000","last_change":"2023-12-07T10:00:14.480300+0000","last_active":"2023-12-07T10:00:14.492192+0000","last_peered":"2023-12-07T10:00:14.492192+0000","last_clean":"2023-12-07T10:00:14.492192+0000","last_became_active":"2023-12-07T10:00:14.479868+0000","last_became_peered":"2023-12-07T10:00:14.479868+0000","last_unstale":"2023-12-07T10:00:14.492192+0000","last_undegraded":"2023-12-07T10:00:14.492192+0000","last_fullsized":"2023-12-07T10:00:14.492192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:24.264647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448402+0000","last_change":"2023-12-07T09:59:57.223628+0000","last_active":"2023-12-07T10:00:13.448402+0000","last_peered":"2023-12-07T10:00:13.448402+0000","last_clean":"2023-12-07T10:00:13.448402+0000","last_became_active":"2023-12-07T09:59:57.223315+0000","last_became_peered":"2023-12-07T09:59:57.223315+0000","last_unstale":"2023-12-07T10:00:13.448402+0000","last_undegraded":"2023-12-07T10:00:13.448402+0000","last_fullsized":"2023-12-07T10:00:13.448402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.471043+0000","last_change":"2023-12-07T10:00:14.469384+0000","last_active":"2023-12-07T10:00:14.471043+0000","last_peered":"2023-12-07T10:00:14.471043+0000","last_clean":"2023-12-07T10:00:14.471043+0000","last_became_active":"2023-12-07T10:00:14.469031+0000","last_became_peered":"2023-12-07T10:00:14.469031+0000","last_unstale":"2023-12-07T10:00:14.471043+0000","last_undegraded":"2023-12-07T10:00:14.471043+0000","last_fullsized":"2023-12-07T10:00:14.471043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:39:05.174152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445073+0000","last_change":"2023-12-07T09:59:57.230638+0000","last_active":"2023-12-07T10:00:13.445073+0000","last_peered":"2023-12-07T10:00:13.445073+0000","last_clean":"2023-12-07T10:00:13.445073+0000","last_became_active":"2023-12-07T09:59:57.230319+0000","last_became_peered":"2023-12-07T09:59:57.230319+0000","last_unstale":"2023-12-07T10:00:13.445073+0000","last_undegraded":"2023-12-07T10:00:13.445073+0000","last_fullsized":"2023-12-07T10:00:13.445073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.487245+0000","last_change":"2023-12-07T10:00:14.477873+0000","last_active":"2023-12-07T10:00:14.487245+0000","last_peered":"2023-12-07T10:00:14.487245+0000","last_clean":"2023-12-07T10:00:14.487245+0000","last_became_active":"2023-12-07T10:00:14.469283+0000","last_became_peered":"2023-12-07T10:00:14.469283+0000","last_unstale":"2023-12-07T10:00:14.487245+0000","last_undegraded":"2023-12-07T10:00:14.487245+0000","last_fullsized":"2023-12-07T10:00:14.487245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:19.999369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438115+0000","last_change":"2023-12-07T09:59:57.237863+0000","last_active":"2023-12-07T10:00:13.438115+0000","last_peered":"2023-12-07T10:00:13.438115+0000","last_clean":"2023-12-07T10:00:13.438115+0000","last_became_active":"2023-12-07T09:59:57.237612+0000","last_became_peered":"2023-12-07T09:59:57.237612+0000","last_unstale":"2023-12-07T10:00:13.438115+0000","last_undegraded":"2023-12-07T10:00:13.438115+0000","last_fullsized":"2023-12-07T10:00:13.438115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484937+0000","last_change":"2023-12-07T10:00:14.477321+0000","last_active":"2023-12-07T10:00:14.484937+0000","last_peered":"2023-12-07T10:00:14.484937+0000","last_clean":"2023-12-07T10:00:14.484937+0000","last_became_active":"2023-12-07T10:00:14.476962+0000","last_became_peered":"2023-12-07T10:00:14.476962+0000","last_unstale":"2023-12-07T10:00:14.484937+0000","last_undegraded":"2023-12-07T10:00:14.484937+0000","last_fullsized":"2023-12-07T10:00:14.484937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:24.264647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438638+0000","last_change":"2023-12-07T09:59:57.229394+0000","last_active":"2023-12-07T10:00:13.438638+0000","last_peered":"2023-12-07T10:00:13.438638+0000","last_clean":"2023-12-07T10:00:13.438638+0000","last_became_active":"2023-12-07T09:59:57.229071+0000","last_became_peered":"2023-12-07T09:59:57.229071+0000","last_unstale":"2023-12-07T10:00:13.438638+0000","last_undegraded":"2023-12-07T10:00:13.438638+0000","last_fullsized":"2023-12-07T10:00:13.438638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.493365+0000","last_change":"2023-12-07T10:00:14.492399+0000","last_active":"2023-12-07T10:00:14.493365+0000","last_peered":"2023-12-07T10:00:14.493365+0000","last_clean":"2023-12-07T10:00:14.493365+0000","last_became_active":"2023-12-07T10:00:14.492179+0000","last_became_peered":"2023-12-07T10:00:14.492179+0000","last_unstale":"2023-12-07T10:00:14.493365+0000","last_undegraded":"2023-12-07T10:00:14.493365+0000","last_fullsized":"2023-12-07T10:00:14.493365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:37:05.508848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434817+0000","last_change":"2023-12-07T09:59:57.224514+0000","last_active":"2023-12-07T10:00:13.434817+0000","last_peered":"2023-12-07T10:00:13.434817+0000","last_clean":"2023-12-07T10:00:13.434817+0000","last_became_active":"2023-12-07T09:59:57.223056+0000","last_became_peered":"2023-12-07T09:59:57.223056+0000","last_unstale":"2023-12-07T10:00:13.434817+0000","last_undegraded":"2023-12-07T10:00:13.434817+0000","last_fullsized":"2023-12-07T10:00:13.434817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:12.564625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486620+0000","last_change":"2023-12-07T10:00:14.481429+0000","last_active":"2023-12-07T10:00:14.486620+0000","last_peered":"2023-12-07T10:00:14.486620+0000","last_clean":"2023-12-07T10:00:14.486620+0000","last_became_active":"2023-12-07T10:00:14.480469+0000","last_became_peered":"2023-12-07T10:00:14.480469+0000","last_unstale":"2023-12-07T10:00:14.486620+0000","last_undegraded":"2023-12-07T10:00:14.486620+0000","last_fullsized":"2023-12-07T10:00:14.486620+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:54:14.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457993+0000","last_change":"2023-12-07T09:59:57.237336+0000","last_active":"2023-12-07T10:00:13.457993+0000","last_peered":"2023-12-07T10:00:13.457993+0000","last_clean":"2023-12-07T10:00:13.457993+0000","last_became_active":"2023-12-07T09:59:57.237105+0000","last_became_peered":"2023-12-07T09:59:57.237105+0000","last_unstale":"2023-12-07T10:00:13.457993+0000","last_undegraded":"2023-12-07T10:00:13.457993+0000","last_fullsized":"2023-12-07T10:00:13.457993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496665+0000","last_change":"2023-12-07T10:00:14.488708+0000","last_active":"2023-12-07T10:00:14.496665+0000","last_peered":"2023-12-07T10:00:14.496665+0000","last_clean":"2023-12-07T10:00:14.496665+0000","last_became_active":"2023-12-07T10:00:14.486360+0000","last_became_peered":"2023-12-07T10:00:14.486360+0000","last_unstale":"2023-12-07T10:00:14.496665+0000","last_undegraded":"2023-12-07T10:00:14.496665+0000","last_fullsized":"2023-12-07T10:00:14.496665+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:22.561858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460613+0000","last_change":"2023-12-07T09:59:57.239271+0000","last_active":"2023-12-07T10:00:13.460613+0000","last_peered":"2023-12-07T10:00:13.460613+0000","last_clean":"2023-12-07T10:00:13.460613+0000","last_became_active":"2023-12-07T09:59:57.238981+0000","last_became_peered":"2023-12-07T09:59:57.238981+0000","last_unstale":"2023-12-07T10:00:13.460613+0000","last_undegraded":"2023-12-07T10:00:13.460613+0000","last_fullsized":"2023-12-07T10:00:13.460613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:36:48.300066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492076+0000","last_change":"2023-12-07T10:00:14.489659+0000","last_active":"2023-12-07T10:00:14.492076+0000","last_peered":"2023-12-07T10:00:14.492076+0000","last_clean":"2023-12-07T10:00:14.492076+0000","last_became_active":"2023-12-07T10:00:14.489379+0000","last_became_peered":"2023-12-07T10:00:14.489379+0000","last_unstale":"2023-12-07T10:00:14.492076+0000","last_undegraded":"2023-12-07T10:00:14.492076+0000","last_fullsized":"2023-12-07T10:00:14.492076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:43.457812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.442648+0000","last_change":"2023-12-07T09:59:57.245997+0000","last_active":"2023-12-07T10:00:13.442648+0000","last_peered":"2023-12-07T10:00:13.442648+0000","last_clean":"2023-12-07T10:00:13.442648+0000","last_became_active":"2023-12-07T09:59:57.244225+0000","last_became_peered":"2023-12-07T09:59:57.244225+0000","last_unstale":"2023-12-07T10:00:13.442648+0000","last_undegraded":"2023-12-07T10:00:13.442648+0000","last_fullsized":"2023-12-07T10:00:13.442648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496313+0000","last_change":"2023-12-07T10:00:14.490134+0000","last_active":"2023-12-07T10:00:14.496313+0000","last_peered":"2023-12-07T10:00:14.496313+0000","last_clean":"2023-12-07T10:00:14.496313+0000","last_became_active":"2023-12-07T10:00:14.489893+0000","last_became_peered":"2023-12-07T10:00:14.489893+0000","last_unstale":"2023-12-07T10:00:14.496313+0000","last_undegraded":"2023-12-07T10:00:14.496313+0000","last_fullsized":"2023-12-07T10:00:14.496313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:02:03.948567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440835+0000","last_change":"2023-12-07T09:59:57.238463+0000","last_active":"2023-12-07T10:00:13.440835+0000","last_peered":"2023-12-07T10:00:13.440835+0000","last_clean":"2023-12-07T10:00:13.440835+0000","last_became_active":"2023-12-07T09:59:57.238172+0000","last_became_peered":"2023-12-07T09:59:57.238172+0000","last_unstale":"2023-12-07T10:00:13.440835+0000","last_undegraded":"2023-12-07T10:00:13.440835+0000","last_fullsized":"2023-12-07T10:00:13.440835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492478+0000","last_change":"2023-12-07T10:00:14.484734+0000","last_active":"2023-12-07T10:00:14.492478+0000","last_peered":"2023-12-07T10:00:14.492478+0000","last_clean":"2023-12-07T10:00:14.492478+0000","last_became_active":"2023-12-07T10:00:14.484416+0000","last_became_peered":"2023-12-07T10:00:14.484416+0000","last_unstale":"2023-12-07T10:00:14.492478+0000","last_undegraded":"2023-12-07T10:00:14.492478+0000","last_fullsized":"2023-12-07T10:00:14.492478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:37.726795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448566+0000","last_change":"2023-12-07T09:59:57.242046+0000","last_active":"2023-12-07T10:00:13.448566+0000","last_peered":"2023-12-07T10:00:13.448566+0000","last_clean":"2023-12-07T10:00:13.448566+0000","last_became_active":"2023-12-07T09:59:57.241392+0000","last_became_peered":"2023-12-07T09:59:57.241392+0000","last_unstale":"2023-12-07T10:00:13.448566+0000","last_undegraded":"2023-12-07T10:00:13.448566+0000","last_fullsized":"2023-12-07T10:00:13.448566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488218+0000","last_change":"2023-12-07T10:00:14.477152+0000","last_active":"2023-12-07T10:00:14.488218+0000","last_peered":"2023-12-07T10:00:14.488218+0000","last_clean":"2023-12-07T10:00:14.488218+0000","last_became_active":"2023-12-07T10:00:14.476852+0000","last_became_peered":"2023-12-07T10:00:14.476852+0000","last_unstale":"2023-12-07T10:00:14.488218+0000","last_undegraded":"2023-12-07T10:00:14.488218+0000","last_fullsized":"2023-12-07T10:00:14.488218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:56.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457957+0000","last_change":"2023-12-07T09:59:57.227431+0000","last_active":"2023-12-07T10:00:13.457957+0000","last_peered":"2023-12-07T10:00:13.457957+0000","last_clean":"2023-12-07T10:00:13.457957+0000","last_became_active":"2023-12-07T09:59:57.226781+0000","last_became_peered":"2023-12-07T09:59:57.226781+0000","last_unstale":"2023-12-07T10:00:13.457957+0000","last_undegraded":"2023-12-07T10:00:13.457957+0000","last_fullsized":"2023-12-07T10:00:13.457957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486540+0000","last_change":"2023-12-07T10:00:14.482028+0000","last_active":"2023-12-07T10:00:14.486540+0000","last_peered":"2023-12-07T10:00:14.486540+0000","last_clean":"2023-12-07T10:00:14.486540+0000","last_became_active":"2023-12-07T10:00:14.481500+0000","last_became_peered":"2023-12-07T10:00:14.481500+0000","last_unstale":"2023-12-07T10:00:14.486540+0000","last_undegraded":"2023-12-07T10:00:14.486540+0000","last_fullsized":"2023-12-07T10:00:14.486540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:12:59.308161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434585+0000","last_change":"2023-12-07T09:59:57.241629+0000","last_active":"2023-12-07T10:00:13.434585+0000","last_peered":"2023-12-07T10:00:13.434585+0000","last_clean":"2023-12-07T10:00:13.434585+0000","last_became_active":"2023-12-07T09:59:57.238255+0000","last_became_peered":"2023-12-07T09:59:57.238255+0000","last_unstale":"2023-12-07T10:00:13.434585+0000","last_undegraded":"2023-12-07T10:00:13.434585+0000","last_fullsized":"2023-12-07T10:00:13.434585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:23:31.673878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496200+0000","last_change":"2023-12-07T10:00:14.486162+0000","last_active":"2023-12-07T10:00:14.496200+0000","last_peered":"2023-12-07T10:00:14.496200+0000","last_clean":"2023-12-07T10:00:14.496200+0000","last_became_active":"2023-12-07T10:00:14.485829+0000","last_became_peered":"2023-12-07T10:00:14.485829+0000","last_unstale":"2023-12-07T10:00:14.496200+0000","last_undegraded":"2023-12-07T10:00:14.496200+0000","last_fullsized":"2023-12-07T10:00:14.496200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:02:32.023383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448389+0000","last_change":"2023-12-07T09:59:57.227453+0000","last_active":"2023-12-07T10:00:13.448389+0000","last_peered":"2023-12-07T10:00:13.448389+0000","last_clean":"2023-12-07T10:00:13.448389+0000","last_became_active":"2023-12-07T09:59:57.226914+0000","last_became_peered":"2023-12-07T09:59:57.226914+0000","last_unstale":"2023-12-07T10:00:13.448389+0000","last_undegraded":"2023-12-07T10:00:13.448389+0000","last_fullsized":"2023-12-07T10:00:13.448389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496341+0000","last_change":"2023-12-07T10:00:14.491384+0000","last_active":"2023-12-07T10:00:14.496341+0000","last_peered":"2023-12-07T10:00:14.496341+0000","last_clean":"2023-12-07T10:00:14.496341+0000","last_became_active":"2023-12-07T10:00:14.491029+0000","last_became_peered":"2023-12-07T10:00:14.491029+0000","last_unstale":"2023-12-07T10:00:14.496341+0000","last_undegraded":"2023-12-07T10:00:14.496341+0000","last_fullsized":"2023-12-07T10:00:14.496341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:13:41.270895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.443588+0000","last_change":"2023-12-07T09:59:57.242828+0000","last_active":"2023-12-07T10:00:13.443588+0000","last_peered":"2023-12-07T10:00:13.443588+0000","last_clean":"2023-12-07T10:00:13.443588+0000","last_became_active":"2023-12-07T09:59:57.242554+0000","last_became_peered":"2023-12-07T09:59:57.242554+0000","last_unstale":"2023-12-07T10:00:13.443588+0000","last_undegraded":"2023-12-07T10:00:13.443588+0000","last_fullsized":"2023-12-07T10:00:13.443588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496369+0000","last_change":"2023-12-07T10:00:14.494261+0000","last_active":"2023-12-07T10:00:14.496369+0000","last_peered":"2023-12-07T10:00:14.496369+0000","last_clean":"2023-12-07T10:00:14.496369+0000","last_became_active":"2023-12-07T10:00:14.493999+0000","last_became_peered":"2023-12-07T10:00:14.493999+0000","last_unstale":"2023-12-07T10:00:14.496369+0000","last_undegraded":"2023-12-07T10:00:14.496369+0000","last_fullsized":"2023-12-07T10:00:14.496369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:01.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448384+0000","last_change":"2023-12-07T09:59:57.236999+0000","last_active":"2023-12-07T10:00:13.448384+0000","last_peered":"2023-12-07T10:00:13.448384+0000","last_clean":"2023-12-07T10:00:13.448384+0000","last_became_active":"2023-12-07T09:59:57.236732+0000","last_became_peered":"2023-12-07T09:59:57.236732+0000","last_unstale":"2023-12-07T10:00:13.448384+0000","last_undegraded":"2023-12-07T10:00:13.448384+0000","last_fullsized":"2023-12-07T10:00:13.448384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492212+0000","last_change":"2023-12-07T10:00:14.481144+0000","last_active":"2023-12-07T10:00:14.492212+0000","last_peered":"2023-12-07T10:00:14.492212+0000","last_clean":"2023-12-07T10:00:14.492212+0000","last_became_active":"2023-12-07T10:00:14.480887+0000","last_became_peered":"2023-12-07T10:00:14.480887+0000","last_unstale":"2023-12-07T10:00:14.492212+0000","last_undegraded":"2023-12-07T10:00:14.492212+0000","last_fullsized":"2023-12-07T10:00:14.492212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:56:07.297854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.439261+0000","last_change":"2023-12-07T09:59:57.238932+0000","last_active":"2023-12-07T10:00:13.439261+0000","last_peered":"2023-12-07T10:00:13.439261+0000","last_clean":"2023-12-07T10:00:13.439261+0000","last_became_active":"2023-12-07T09:59:57.238605+0000","last_became_peered":"2023-12-07T09:59:57.238605+0000","last_unstale":"2023-12-07T10:00:13.439261+0000","last_undegraded":"2023-12-07T10:00:13.439261+0000","last_fullsized":"2023-12-07T10:00:13.439261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.468973+0000","last_change":"2023-12-07T10:00:14.465799+0000","last_active":"2023-12-07T10:00:14.468973+0000","last_peered":"2023-12-07T10:00:14.468973+0000","last_clean":"2023-12-07T10:00:14.468973+0000","last_became_active":"2023-12-07T10:00:14.465461+0000","last_became_peered":"2023-12-07T10:00:14.465461+0000","last_unstale":"2023-12-07T10:00:14.468973+0000","last_undegraded":"2023-12-07T10:00:14.468973+0000","last_fullsized":"2023-12-07T10:00:14.468973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:26.742979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440396+0000","last_change":"2023-12-07T09:59:57.230825+0000","last_active":"2023-12-07T10:00:13.440396+0000","last_peered":"2023-12-07T10:00:13.440396+0000","last_clean":"2023-12-07T10:00:13.440396+0000","last_became_active":"2023-12-07T09:59:57.230278+0000","last_became_peered":"2023-12-07T09:59:57.230278+0000","last_unstale":"2023-12-07T10:00:13.440396+0000","last_undegraded":"2023-12-07T10:00:13.440396+0000","last_fullsized":"2023-12-07T10:00:13.440396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488376+0000","last_change":"2023-12-07T10:00:14.483469+0000","last_active":"2023-12-07T10:00:14.488376+0000","last_peered":"2023-12-07T10:00:14.488376+0000","last_clean":"2023-12-07T10:00:14.488376+0000","last_became_active":"2023-12-07T10:00:14.483210+0000","last_became_peered":"2023-12-07T10:00:14.483210+0000","last_unstale":"2023-12-07T10:00:14.488376+0000","last_undegraded":"2023-12-07T10:00:14.488376+0000","last_fullsized":"2023-12-07T10:00:14.488376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:27.780070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440944+0000","last_change":"2023-12-07T09:59:57.246474+0000","last_active":"2023-12-07T10:00:13.440944+0000","last_peered":"2023-12-07T10:00:13.440944+0000","last_clean":"2023-12-07T10:00:13.440944+0000","last_became_active":"2023-12-07T09:59:57.246185+0000","last_became_peered":"2023-12-07T09:59:57.246185+0000","last_unstale":"2023-12-07T10:00:13.440944+0000","last_undegraded":"2023-12-07T10:00:13.440944+0000","last_fullsized":"2023-12-07T10:00:13.440944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.494337+0000","last_change":"2023-12-07T10:00:14.483173+0000","last_active":"2023-12-07T10:00:14.494337+0000","last_peered":"2023-12-07T10:00:14.494337+0000","last_clean":"2023-12-07T10:00:14.494337+0000","last_became_active":"2023-12-07T10:00:14.482704+0000","last_became_peered":"2023-12-07T10:00:14.482704+0000","last_unstale":"2023-12-07T10:00:14.494337+0000","last_undegraded":"2023-12-07T10:00:14.494337+0000","last_fullsized":"2023-12-07T10:00:14.494337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:25.380801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457873+0000","last_change":"2023-12-07T09:59:57.233976+0000","last_active":"2023-12-07T10:00:13.457873+0000","last_peered":"2023-12-07T10:00:13.457873+0000","last_clean":"2023-12-07T10:00:13.457873+0000","last_became_active":"2023-12-07T09:59:57.233707+0000","last_became_peered":"2023-12-07T09:59:57.233707+0000","last_unstale":"2023-12-07T10:00:13.457873+0000","last_undegraded":"2023-12-07T10:00:13.457873+0000","last_fullsized":"2023-12-07T10:00:13.457873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479762+0000","last_change":"2023-12-07T10:00:14.472549+0000","last_active":"2023-12-07T10:00:14.479762+0000","last_peered":"2023-12-07T10:00:14.479762+0000","last_clean":"2023-12-07T10:00:14.479762+0000","last_became_active":"2023-12-07T10:00:14.472239+0000","last_became_peered":"2023-12-07T10:00:14.472239+0000","last_unstale":"2023-12-07T10:00:14.479762+0000","last_undegraded":"2023-12-07T10:00:14.479762+0000","last_fullsized":"2023-12-07T10:00:14.479762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:01.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434579+0000","last_change":"2023-12-07T09:59:57.236855+0000","last_active":"2023-12-07T10:00:13.434579+0000","last_peered":"2023-12-07T10:00:13.434579+0000","last_clean":"2023-12-07T10:00:13.434579+0000","last_became_active":"2023-12-07T09:59:57.236380+0000","last_became_peered":"2023-12-07T09:59:57.236380+0000","last_unstale":"2023-12-07T10:00:13.434579+0000","last_undegraded":"2023-12-07T10:00:13.434579+0000","last_fullsized":"2023-12-07T10:00:13.434579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:18:14.300474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.491359+0000","last_change":"2023-12-07T10:00:14.490226+0000","last_active":"2023-12-07T10:00:14.491359+0000","last_peered":"2023-12-07T10:00:14.491359+0000","last_clean":"2023-12-07T10:00:14.491359+0000","last_became_active":"2023-12-07T10:00:14.489966+0000","last_became_peered":"2023-12-07T10:00:14.489966+0000","last_unstale":"2023-12-07T10:00:14.491359+0000","last_undegraded":"2023-12-07T10:00:14.491359+0000","last_fullsized":"2023-12-07T10:00:14.491359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:45:13.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447886+0000","last_change":"2023-12-07T09:59:57.243320+0000","last_active":"2023-12-07T10:00:13.447886+0000","last_peered":"2023-12-07T10:00:13.447886+0000","last_clean":"2023-12-07T10:00:13.447886+0000","last_became_active":"2023-12-07T09:59:57.243117+0000","last_became_peered":"2023-12-07T09:59:57.243117+0000","last_unstale":"2023-12-07T10:00:13.447886+0000","last_undegraded":"2023-12-07T10:00:13.447886+0000","last_fullsized":"2023-12-07T10:00:13.447886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.487296+0000","last_change":"2023-12-07T10:00:14.481119+0000","last_active":"2023-12-07T10:00:14.487296+0000","last_peered":"2023-12-07T10:00:14.487296+0000","last_clean":"2023-12-07T10:00:14.487296+0000","last_became_active":"2023-12-07T10:00:14.480840+0000","last_became_peered":"2023-12-07T10:00:14.480840+0000","last_unstale":"2023-12-07T10:00:14.487296+0000","last_undegraded":"2023-12-07T10:00:14.487296+0000","last_fullsized":"2023-12-07T10:00:14.487296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:50.063311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.449905+0000","last_change":"2023-12-07T09:59:57.238691+0000","last_active":"2023-12-07T10:00:13.449905+0000","last_peered":"2023-12-07T10:00:13.449905+0000","last_clean":"2023-12-07T10:00:13.449905+0000","last_became_active":"2023-12-07T09:59:57.238414+0000","last_became_peered":"2023-12-07T09:59:57.238414+0000","last_unstale":"2023-12-07T10:00:13.449905+0000","last_undegraded":"2023-12-07T10:00:13.449905+0000","last_fullsized":"2023-12-07T10:00:13.449905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496151+0000","last_change":"2023-12-07T10:00:14.487267+0000","last_active":"2023-12-07T10:00:14.496151+0000","last_peered":"2023-12-07T10:00:14.496151+0000","last_clean":"2023-12-07T10:00:14.496151+0000","last_became_active":"2023-12-07T10:00:14.480078+0000","last_became_peered":"2023-12-07T10:00:14.480078+0000","last_unstale":"2023-12-07T10:00:14.496151+0000","last_undegraded":"2023-12-07T10:00:14.496151+0000","last_fullsized":"2023-12-07T10:00:14.496151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:16.068136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460536+0000","last_change":"2023-12-07T09:59:57.229817+0000","last_active":"2023-12-07T10:00:13.460536+0000","last_peered":"2023-12-07T10:00:13.460536+0000","last_clean":"2023-12-07T10:00:13.460536+0000","last_became_active":"2023-12-07T09:59:57.229526+0000","last_became_peered":"2023-12-07T09:59:57.229526+0000","last_unstale":"2023-12-07T10:00:13.460536+0000","last_undegraded":"2023-12-07T10:00:13.460536+0000","last_fullsized":"2023-12-07T10:00:13.460536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:15:58.859354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.489939+0000","last_change":"2023-12-07T10:00:14.487431+0000","last_active":"2023-12-07T10:00:14.489939+0000","last_peered":"2023-12-07T10:00:14.489939+0000","last_clean":"2023-12-07T10:00:14.489939+0000","last_became_active":"2023-12-07T10:00:14.487037+0000","last_became_peered":"2023-12-07T10:00:14.487037+0000","last_unstale":"2023-12-07T10:00:14.489939+0000","last_undegraded":"2023-12-07T10:00:14.489939+0000","last_fullsized":"2023-12-07T10:00:14.489939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:15.880384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457252+0000","last_change":"2023-12-07T09:59:57.243490+0000","last_active":"2023-12-07T10:00:13.457252+0000","last_peered":"2023-12-07T10:00:13.457252+0000","last_clean":"2023-12-07T10:00:13.457252+0000","last_became_active":"2023-12-07T09:59:57.242850+0000","last_became_peered":"2023-12-07T09:59:57.242850+0000","last_unstale":"2023-12-07T10:00:13.457252+0000","last_undegraded":"2023-12-07T10:00:13.457252+0000","last_fullsized":"2023-12-07T10:00:13.457252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":746076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.81200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":156816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.5},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.623},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.437}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":148567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.434},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.63},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.628},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.52200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":159295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.516,"5min":5.516,"15min":5.516},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.374},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.752},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.5030000000000001,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.468,"5min":3.468,"15min":3.468},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":157232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":13.016,"5min":13.016,"15min":13.016},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":13.166,"5min":13.166,"15min":13.166},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.1690000000000005,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.0809999999999995,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.7680000000000007,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":5.75,"5min":5.75,"15min":5.75},"last":0.746}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7050000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":158727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.37},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.439}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":745930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.434},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.498}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:18.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.721+0000 7fd7c03b8640 1 Processor -- start 2023-12-07T10:00:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.721+0000 7fd7c03b8640 1 -- start start 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7c03b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7c03b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7b80700a0 0x7fd7b81546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7c03b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b8072780 con 0x7fd7b80ab7a0 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7c03b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80ac160 con 0x7fd7b80700a0 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7c03b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80abe80 con 0x7fd7b80aacd0 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7b80700a0 0x7fd7b81546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7b80700a0 0x7fd7b81546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57058/0 (socket says 172.21.15.89:57058) 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 -- 172.21.15.89:0/201893327 learned_addr learned my addr 172.21.15.89:0/201893327 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7be154640 1 --2- 172.21.15.89:0/201893327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 -- 172.21.15.89:0/201893327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 msgr2=0x7fd7b8154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 --2- 172.21.15.89:0/201893327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 -- 172.21.15.89:0/201893327 >> v1:172.21.15.97:6789/0 conn(0x7fd7b80ab7a0 legacy=0x7fd7b806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:18.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.725+0000 7fd7bd953640 1 -- 172.21.15.89:0/201893327 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b8154cf0 con 0x7fd7b80700a0 2023-12-07T10:00:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7bd953640 1 --2- 172.21.15.89:0/201893327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b81546a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8006fd0 tx=0x7fd7a801e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f7ced414789b6a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7bd152640 1 -- 172.21.15.89:0/201893327 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8004230 con 0x7fd7b80700a0 2023-12-07T10:00:18.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7bd152640 1 -- 172.21.15.89:0/201893327 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a80ab070 con 0x7fd7b80700a0 2023-12-07T10:00:18.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7bd152640 1 -- 172.21.15.89:0/201893327 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80a7760 con 0x7fd7b80700a0 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 -- 172.21.15.89:0/201893327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 msgr2=0x7fd7b81546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/201893327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b81546a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8006fd0 tx=0x7fd7a801e8d0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 -- 172.21.15.89:0/201893327 shutdown_connections 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/201893327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b81546a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/201893327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 -- 172.21.15.89:0/201893327 >> 172.21.15.89:0/201893327 conn(0x7fd7b80c2ad0 msgr2=0x7fd7b80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 -- 172.21.15.89:0/201893327 shutdown_connections 2023-12-07T10:00:18.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 -- 172.21.15.89:0/201893327 wait complete. 2023-12-07T10:00:18.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 Processor -- start 2023-12-07T10:00:18.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.729+0000 7fd7c03b8640 1 -- start start 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7b80ab7a0 0x7fd7b81442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b814dbf0 con 0x7fd7b80700a0 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b814bda0 con 0x7fd7b80ab7a0 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b814cdc0 con 0x7fd7b80aacd0 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b814d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57066/0 (socket says 172.21.15.89:57066) 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 -- 172.21.15.89:0/1853772887 learned_addr learned my addr 172.21.15.89:0/1853772887 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be955640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7b80ab7a0 0x7fd7b81442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7bd953640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 -- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 msgr2=0x7fd7b8143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 -- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7b80ab7a0 msgr2=0x7fd7b81442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7b80ab7a0 0x7fd7b81442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 -- 172.21.15.89:0/1853772887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a800b780 con 0x7fd7b80700a0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7be154640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b814d6b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d800 tx=0x7fd7b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400b6c0 con 0x7fd7b80700a0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400b820 con 0x7fd7b80700a0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b814de20 con 0x7fd7b80700a0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400bb90 con 0x7fd7b80700a0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b814c2e0 con 0x7fd7b80700a0 2023-12-07T10:00:18.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b804e890 con 0x7fd7b80700a0 2023-12-07T10:00:18.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.733+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd7b400bcf0 con 0x7fd7b80700a0 2023-12-07T10:00:18.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.737+0000 7fd7aeffd640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd79c0668d0 0x7fd79c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:18.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.737+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd7b4084d30 con 0x7fd7b80700a0 2023-12-07T10:00:18.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.737+0000 7fd7bd953640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd79c0668d0 0x7fd79c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:18.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.737+0000 7fd7bd953640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd79c0668d0 0x7fd79c068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80b1000 tx=0x7fd7a80a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:18.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.741+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7b4051c00 con 0x7fd7b80700a0 2023-12-07T10:00:18.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.885+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7b806d680 con 0x7fd79c0668d0 2023-12-07T10:00:18.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.897+0000 7fd7aeffd640 1 -- 172.21.15.89:0/1853772887 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527129 (secure 0 0 0) 0x7fd7a8006da0 con 0x7fd79c0668d0 2023-12-07T10:00:18.911 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:18.918 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd79c0668d0 msgr2=0x7fd79c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd79c0668d0 0x7fd79c068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80b1000 tx=0x7fd7a80a9070 comp rx=0 tx=0).stop 2023-12-07T10:00:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 msgr2=0x7fd7b814d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:18.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b814d6b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d800 tx=0x7fd7b400dcc0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 shutdown_connections 2023-12-07T10:00:18.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7b80ab7a0 0x7fd7b81442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd79c0668d0 0x7fd79c068d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7b80aacd0 0x7fd7b8143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 --2- 172.21.15.89:0/1853772887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b80700a0 0x7fd7b814d6b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:18.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 >> 172.21.15.89:0/1853772887 conn(0x7fd7b80c2ad0 msgr2=0x7fd7b80c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:18.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 shutdown_connections 2023-12-07T10:00:18.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:18.905+0000 7fd7c03b8640 1 -- 172.21.15.89:0/1853772887 wait complete. 2023-12-07T10:00:18.930 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-12-07T10:00:18.354504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":351,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220464,"kb_used_data":4280,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754256,"statfs":{"total":773094113280,"available":772868358144,"internally_reserved":0,"allocated":4382720,"data_stored":2429887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924472"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496222+0000","last_change":"2023-12-07T10:00:14.489920+0000","last_active":"2023-12-07T10:00:14.496222+0000","last_peered":"2023-12-07T10:00:14.496222+0000","last_clean":"2023-12-07T10:00:14.496222+0000","last_became_active":"2023-12-07T10:00:14.489224+0000","last_became_peered":"2023-12-07T10:00:14.489224+0000","last_unstale":"2023-12-07T10:00:14.496222+0000","last_undegraded":"2023-12-07T10:00:14.496222+0000","last_fullsized":"2023-12-07T10:00:14.496222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:37:05.508848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440926+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:00:13.440926+0000","last_peered":"2023-12-07T10:00:13.440926+0000","last_clean":"2023-12-07T10:00:13.440926+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:00:13.440926+0000","last_undegraded":"2023-12-07T10:00:13.440926+0000","last_fullsized":"2023-12-07T10:00:13.440926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457052+0000","last_change":"2023-12-07T09:59:56.247518+0000","last_active":"2023-12-07T10:00:13.457052+0000","last_peered":"2023-12-07T10:00:13.457052+0000","last_clean":"2023-12-07T10:00:13.457052+0000","last_became_active":"2023-12-07T09:59:56.246103+0000","last_became_peered":"2023-12-07T09:59:56.246103+0000","last_unstale":"2023-12-07T10:00:13.457052+0000","last_undegraded":"2023-12-07T10:00:13.457052+0000","last_fullsized":"2023-12-07T10:00:13.457052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.441342+0000","last_change":"2023-12-07T09:59:57.228735+0000","last_active":"2023-12-07T10:00:13.441342+0000","last_peered":"2023-12-07T10:00:13.441342+0000","last_clean":"2023-12-07T10:00:13.441342+0000","last_became_active":"2023-12-07T09:59:57.228440+0000","last_became_peered":"2023-12-07T09:59:57.228440+0000","last_unstale":"2023-12-07T10:00:13.441342+0000","last_undegraded":"2023-12-07T10:00:13.441342+0000","last_fullsized":"2023-12-07T10:00:13.441342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.504142+0000","last_change":"2023-12-07T10:00:13.459981+0000","last_active":"2023-12-07T10:00:14.504142+0000","last_peered":"2023-12-07T10:00:14.504142+0000","last_clean":"2023-12-07T10:00:14.504142+0000","last_became_active":"2023-12-07T10:00:13.459053+0000","last_became_peered":"2023-12-07T10:00:13.459053+0000","last_unstale":"2023-12-07T10:00:14.504142+0000","last_undegraded":"2023-12-07T10:00:14.504142+0000","last_fullsized":"2023-12-07T10:00:14.504142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:03:41.315208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.497553+0000","last_change":"2023-12-07T10:00:14.487526+0000","last_active":"2023-12-07T10:00:14.497553+0000","last_peered":"2023-12-07T10:00:14.497553+0000","last_clean":"2023-12-07T10:00:14.497553+0000","last_became_active":"2023-12-07T10:00:14.486985+0000","last_became_peered":"2023-12-07T10:00:14.486985+0000","last_unstale":"2023-12-07T10:00:14.497553+0000","last_undegraded":"2023-12-07T10:00:14.497553+0000","last_fullsized":"2023-12-07T10:00:14.497553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:50.063311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.454943+0000","last_change":"2023-12-07T09:59:56.249073+0000","last_active":"2023-12-07T10:00:13.454943+0000","last_peered":"2023-12-07T10:00:13.454943+0000","last_clean":"2023-12-07T10:00:13.454943+0000","last_became_active":"2023-12-07T09:59:56.248772+0000","last_became_peered":"2023-12-07T09:59:56.248772+0000","last_unstale":"2023-12-07T10:00:13.454943+0000","last_undegraded":"2023-12-07T10:00:13.454943+0000","last_fullsized":"2023-12-07T10:00:13.454943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:47.202027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437858+0000","last_change":"2023-12-07T09:59:57.231677+0000","last_active":"2023-12-07T10:00:13.437858+0000","last_peered":"2023-12-07T10:00:13.437858+0000","last_clean":"2023-12-07T10:00:13.437858+0000","last_became_active":"2023-12-07T09:59:57.231321+0000","last_became_peered":"2023-12-07T09:59:57.231321+0000","last_unstale":"2023-12-07T10:00:13.437858+0000","last_undegraded":"2023-12-07T10:00:13.437858+0000","last_fullsized":"2023-12-07T10:00:13.437858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.474517+0000","last_change":"2023-12-07T10:00:13.456978+0000","last_active":"2023-12-07T10:00:14.474517+0000","last_peered":"2023-12-07T10:00:14.474517+0000","last_clean":"2023-12-07T10:00:14.474517+0000","last_became_active":"2023-12-07T10:00:13.456590+0000","last_became_peered":"2023-12-07T10:00:13.456590+0000","last_unstale":"2023-12-07T10:00:14.474517+0000","last_undegraded":"2023-12-07T10:00:14.474517+0000","last_fullsized":"2023-12-07T10:00:14.474517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:08:52.766136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.476683+0000","last_change":"2023-12-07T10:00:14.475069+0000","last_active":"2023-12-07T10:00:14.476683+0000","last_peered":"2023-12-07T10:00:14.476683+0000","last_clean":"2023-12-07T10:00:14.476683+0000","last_became_active":"2023-12-07T10:00:14.474781+0000","last_became_peered":"2023-12-07T10:00:14.474781+0000","last_unstale":"2023-12-07T10:00:14.476683+0000","last_undegraded":"2023-12-07T10:00:14.476683+0000","last_fullsized":"2023-12-07T10:00:14.476683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:03:11.618769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438121+0000","last_change":"2023-12-07T09:59:56.244136+0000","last_active":"2023-12-07T10:00:13.438121+0000","last_peered":"2023-12-07T10:00:13.438121+0000","last_clean":"2023-12-07T10:00:13.438121+0000","last_became_active":"2023-12-07T09:59:56.243848+0000","last_became_peered":"2023-12-07T09:59:56.243848+0000","last_unstale":"2023-12-07T10:00:13.438121+0000","last_undegraded":"2023-12-07T10:00:13.438121+0000","last_fullsized":"2023-12-07T10:00:13.438121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.454861+0000","last_change":"2023-12-07T09:59:57.239076+0000","last_active":"2023-12-07T10:00:13.454861+0000","last_peered":"2023-12-07T10:00:13.454861+0000","last_clean":"2023-12-07T10:00:13.454861+0000","last_became_active":"2023-12-07T09:59:57.238794+0000","last_became_peered":"2023-12-07T09:59:57.238794+0000","last_unstale":"2023-12-07T10:00:13.454861+0000","last_undegraded":"2023-12-07T10:00:13.454861+0000","last_fullsized":"2023-12-07T10:00:13.454861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.458492+0000","last_change":"2023-12-07T10:00:13.464851+0000","last_active":"2023-12-07T10:00:14.458492+0000","last_peered":"2023-12-07T10:00:14.458492+0000","last_clean":"2023-12-07T10:00:14.458492+0000","last_became_active":"2023-12-07T10:00:13.464524+0000","last_became_peered":"2023-12-07T10:00:13.464524+0000","last_unstale":"2023-12-07T10:00:14.458492+0000","last_undegraded":"2023-12-07T10:00:14.458492+0000","last_fullsized":"2023-12-07T10:00:14.458492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:48.866866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486239+0000","last_change":"2023-12-07T10:00:14.477930+0000","last_active":"2023-12-07T10:00:14.486239+0000","last_peered":"2023-12-07T10:00:14.486239+0000","last_clean":"2023-12-07T10:00:14.486239+0000","last_became_active":"2023-12-07T10:00:14.477633+0000","last_became_peered":"2023-12-07T10:00:14.477633+0000","last_unstale":"2023-12-07T10:00:14.486239+0000","last_undegraded":"2023-12-07T10:00:14.486239+0000","last_fullsized":"2023-12-07T10:00:14.486239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:59.720998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447456+0000","last_change":"2023-12-07T09:59:56.248618+0000","last_active":"2023-12-07T10:00:13.447456+0000","last_peered":"2023-12-07T10:00:13.447456+0000","last_clean":"2023-12-07T10:00:13.447456+0000","last_became_active":"2023-12-07T09:59:56.245467+0000","last_became_peered":"2023-12-07T09:59:56.245467+0000","last_unstale":"2023-12-07T10:00:13.447456+0000","last_undegraded":"2023-12-07T10:00:13.447456+0000","last_fullsized":"2023-12-07T10:00:13.447456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445353+0000","last_change":"2023-12-07T09:59:57.242678+0000","last_active":"2023-12-07T10:00:13.445353+0000","last_peered":"2023-12-07T10:00:13.445353+0000","last_clean":"2023-12-07T10:00:13.445353+0000","last_became_active":"2023-12-07T09:59:57.242415+0000","last_became_peered":"2023-12-07T09:59:57.242415+0000","last_unstale":"2023-12-07T10:00:13.445353+0000","last_undegraded":"2023-12-07T10:00:13.445353+0000","last_fullsized":"2023-12-07T10:00:13.445353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.481000+0000","last_change":"2023-12-07T10:00:13.459770+0000","last_active":"2023-12-07T10:00:14.481000+0000","last_peered":"2023-12-07T10:00:14.481000+0000","last_clean":"2023-12-07T10:00:14.481000+0000","last_became_active":"2023-12-07T10:00:13.459406+0000","last_became_peered":"2023-12-07T10:00:13.459406+0000","last_unstale":"2023-12-07T10:00:14.481000+0000","last_undegraded":"2023-12-07T10:00:14.481000+0000","last_fullsized":"2023-12-07T10:00:14.481000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:00.736597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488386+0000","last_change":"2023-12-07T10:00:14.483259+0000","last_active":"2023-12-07T10:00:14.488386+0000","last_peered":"2023-12-07T10:00:14.488386+0000","last_clean":"2023-12-07T10:00:14.488386+0000","last_became_active":"2023-12-07T10:00:14.482350+0000","last_became_peered":"2023-12-07T10:00:14.482350+0000","last_unstale":"2023-12-07T10:00:14.488386+0000","last_undegraded":"2023-12-07T10:00:14.488386+0000","last_fullsized":"2023-12-07T10:00:14.488386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:52.735101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445584+0000","last_change":"2023-12-07T09:59:56.244982+0000","last_active":"2023-12-07T10:00:13.445584+0000","last_peered":"2023-12-07T10:00:13.445584+0000","last_clean":"2023-12-07T10:00:13.445584+0000","last_became_active":"2023-12-07T09:59:56.244390+0000","last_became_peered":"2023-12-07T09:59:56.244390+0000","last_unstale":"2023-12-07T10:00:13.445584+0000","last_undegraded":"2023-12-07T10:00:13.445584+0000","last_fullsized":"2023-12-07T10:00:13.445584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457827+0000","last_change":"2023-12-07T09:59:57.238384+0000","last_active":"2023-12-07T10:00:13.457827+0000","last_peered":"2023-12-07T10:00:13.457827+0000","last_clean":"2023-12-07T10:00:13.457827+0000","last_became_active":"2023-12-07T09:59:57.238044+0000","last_became_peered":"2023-12-07T09:59:57.238044+0000","last_unstale":"2023-12-07T10:00:13.457827+0000","last_undegraded":"2023-12-07T10:00:13.457827+0000","last_fullsized":"2023-12-07T10:00:13.457827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:54.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.467241+0000","last_change":"2023-12-07T10:00:13.457101+0000","last_active":"2023-12-07T10:00:14.467241+0000","last_peered":"2023-12-07T10:00:14.467241+0000","last_clean":"2023-12-07T10:00:14.467241+0000","last_became_active":"2023-12-07T10:00:13.456581+0000","last_became_peered":"2023-12-07T10:00:13.456581+0000","last_unstale":"2023-12-07T10:00:14.467241+0000","last_undegraded":"2023-12-07T10:00:14.467241+0000","last_fullsized":"2023-12-07T10:00:14.467241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:42.371498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.500057+0000","last_change":"2023-12-07T10:00:14.498086+0000","last_active":"2023-12-07T10:00:14.500057+0000","last_peered":"2023-12-07T10:00:14.500057+0000","last_clean":"2023-12-07T10:00:14.500057+0000","last_became_active":"2023-12-07T10:00:14.497784+0000","last_became_peered":"2023-12-07T10:00:14.497784+0000","last_unstale":"2023-12-07T10:00:14.500057+0000","last_undegraded":"2023-12-07T10:00:14.500057+0000","last_fullsized":"2023-12-07T10:00:14.500057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:57.851577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448032+0000","last_change":"2023-12-07T09:59:56.247423+0000","last_active":"2023-12-07T10:00:13.448032+0000","last_peered":"2023-12-07T10:00:13.448032+0000","last_clean":"2023-12-07T10:00:13.448032+0000","last_became_active":"2023-12-07T09:59:56.247188+0000","last_became_peered":"2023-12-07T09:59:56.247188+0000","last_unstale":"2023-12-07T10:00:13.448032+0000","last_undegraded":"2023-12-07T10:00:13.448032+0000","last_fullsized":"2023-12-07T10:00:13.448032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446135+0000","last_change":"2023-12-07T09:59:57.234589+0000","last_active":"2023-12-07T10:00:13.446135+0000","last_peered":"2023-12-07T10:00:13.446135+0000","last_clean":"2023-12-07T10:00:13.446135+0000","last_became_active":"2023-12-07T09:59:57.234320+0000","last_became_peered":"2023-12-07T09:59:57.234320+0000","last_unstale":"2023-12-07T10:00:13.446135+0000","last_undegraded":"2023-12-07T10:00:13.446135+0000","last_fullsized":"2023-12-07T10:00:13.446135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:04.187988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.461050+0000","last_change":"2023-12-07T10:00:13.460260+0000","last_active":"2023-12-07T10:00:14.461050+0000","last_peered":"2023-12-07T10:00:14.461050+0000","last_clean":"2023-12-07T10:00:14.461050+0000","last_became_active":"2023-12-07T10:00:13.459945+0000","last_became_peered":"2023-12-07T10:00:13.459945+0000","last_unstale":"2023-12-07T10:00:14.461050+0000","last_undegraded":"2023-12-07T10:00:14.461050+0000","last_fullsized":"2023-12-07T10:00:14.461050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:59.524554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.490235+0000","last_change":"2023-12-07T10:00:14.485920+0000","last_active":"2023-12-07T10:00:14.490235+0000","last_peered":"2023-12-07T10:00:14.490235+0000","last_clean":"2023-12-07T10:00:14.490235+0000","last_became_active":"2023-12-07T10:00:14.485654+0000","last_became_peered":"2023-12-07T10:00:14.485654+0000","last_unstale":"2023-12-07T10:00:14.490235+0000","last_undegraded":"2023-12-07T10:00:14.490235+0000","last_fullsized":"2023-12-07T10:00:14.490235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:03:42.317711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446875+0000","last_change":"2023-12-07T09:59:56.246751+0000","last_active":"2023-12-07T10:00:13.446875+0000","last_peered":"2023-12-07T10:00:13.446875+0000","last_clean":"2023-12-07T10:00:13.446875+0000","last_became_active":"2023-12-07T09:59:56.246313+0000","last_became_peered":"2023-12-07T09:59:56.246313+0000","last_unstale":"2023-12-07T10:00:13.446875+0000","last_undegraded":"2023-12-07T10:00:13.446875+0000","last_fullsized":"2023-12-07T10:00:13.446875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448927+0000","last_change":"2023-12-07T09:59:57.239649+0000","last_active":"2023-12-07T10:00:13.448927+0000","last_peered":"2023-12-07T10:00:13.448927+0000","last_clean":"2023-12-07T10:00:13.448927+0000","last_became_active":"2023-12-07T09:59:57.239278+0000","last_became_peered":"2023-12-07T09:59:57.239278+0000","last_unstale":"2023-12-07T10:00:13.448927+0000","last_undegraded":"2023-12-07T10:00:13.448927+0000","last_fullsized":"2023-12-07T10:00:13.448927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.466433+0000","last_change":"2023-12-07T10:00:13.454591+0000","last_active":"2023-12-07T10:00:14.466433+0000","last_peered":"2023-12-07T10:00:14.466433+0000","last_clean":"2023-12-07T10:00:14.466433+0000","last_became_active":"2023-12-07T10:00:13.453993+0000","last_became_peered":"2023-12-07T10:00:13.453993+0000","last_unstale":"2023-12-07T10:00:14.466433+0000","last_undegraded":"2023-12-07T10:00:14.466433+0000","last_fullsized":"2023-12-07T10:00:14.466433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:02:02.946064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496174+0000","last_change":"2023-12-07T10:00:14.487983+0000","last_active":"2023-12-07T10:00:14.496174+0000","last_peered":"2023-12-07T10:00:14.496174+0000","last_clean":"2023-12-07T10:00:14.496174+0000","last_became_active":"2023-12-07T10:00:14.487643+0000","last_became_peered":"2023-12-07T10:00:14.487643+0000","last_unstale":"2023-12-07T10:00:14.496174+0000","last_undegraded":"2023-12-07T10:00:14.496174+0000","last_fullsized":"2023-12-07T10:00:14.496174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:15.880384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448835+0000","last_change":"2023-12-07T09:59:56.244977+0000","last_active":"2023-12-07T10:00:13.448835+0000","last_peered":"2023-12-07T10:00:13.448835+0000","last_clean":"2023-12-07T10:00:13.448835+0000","last_became_active":"2023-12-07T09:59:56.244693+0000","last_became_peered":"2023-12-07T09:59:56.244693+0000","last_unstale":"2023-12-07T10:00:13.448835+0000","last_undegraded":"2023-12-07T10:00:13.448835+0000","last_fullsized":"2023-12-07T10:00:13.448835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:40.487500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434785+0000","last_change":"2023-12-07T09:59:57.223699+0000","last_active":"2023-12-07T10:00:13.434785+0000","last_peered":"2023-12-07T10:00:13.434785+0000","last_clean":"2023-12-07T10:00:13.434785+0000","last_became_active":"2023-12-07T09:59:57.223208+0000","last_became_peered":"2023-12-07T09:59:57.223208+0000","last_unstale":"2023-12-07T10:00:13.434785+0000","last_undegraded":"2023-12-07T10:00:13.434785+0000","last_fullsized":"2023-12-07T10:00:13.434785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:08.149324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460089+0000","last_change":"2023-12-07T10:00:13.464128+0000","last_active":"2023-12-07T10:00:14.460089+0000","last_peered":"2023-12-07T10:00:14.460089+0000","last_clean":"2023-12-07T10:00:14.460089+0000","last_became_active":"2023-12-07T10:00:13.463467+0000","last_became_peered":"2023-12-07T10:00:13.463467+0000","last_unstale":"2023-12-07T10:00:14.460089+0000","last_undegraded":"2023-12-07T10:00:14.460089+0000","last_fullsized":"2023-12-07T10:00:14.460089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:12:58.305658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484587+0000","last_change":"2023-12-07T10:00:14.477637+0000","last_active":"2023-12-07T10:00:14.484587+0000","last_peered":"2023-12-07T10:00:14.484587+0000","last_clean":"2023-12-07T10:00:14.484587+0000","last_became_active":"2023-12-07T10:00:14.477358+0000","last_became_peered":"2023-12-07T10:00:14.477358+0000","last_unstale":"2023-12-07T10:00:14.484587+0000","last_undegraded":"2023-12-07T10:00:14.484587+0000","last_fullsized":"2023-12-07T10:00:14.484587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:27.066740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448512+0000","last_change":"2023-12-07T09:59:56.250231+0000","last_active":"2023-12-07T10:00:13.448512+0000","last_peered":"2023-12-07T10:00:13.448512+0000","last_clean":"2023-12-07T10:00:13.448512+0000","last_became_active":"2023-12-07T09:59:56.249795+0000","last_became_peered":"2023-12-07T09:59:56.249795+0000","last_unstale":"2023-12-07T10:00:13.448512+0000","last_undegraded":"2023-12-07T10:00:13.448512+0000","last_fullsized":"2023-12-07T10:00:13.448512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440804+0000","last_change":"2023-12-07T09:59:57.244429+0000","last_active":"2023-12-07T10:00:13.440804+0000","last_peered":"2023-12-07T10:00:13.440804+0000","last_clean":"2023-12-07T10:00:13.440804+0000","last_became_active":"2023-12-07T09:59:57.244108+0000","last_became_peered":"2023-12-07T09:59:57.244108+0000","last_unstale":"2023-12-07T10:00:13.440804+0000","last_undegraded":"2023-12-07T10:00:13.440804+0000","last_fullsized":"2023-12-07T10:00:13.440804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.467446+0000","last_change":"2023-12-07T10:00:13.463586+0000","last_active":"2023-12-07T10:00:14.467446+0000","last_peered":"2023-12-07T10:00:14.467446+0000","last_clean":"2023-12-07T10:00:14.467446+0000","last_became_active":"2023-12-07T10:00:13.463304+0000","last_became_peered":"2023-12-07T10:00:13.463304+0000","last_unstale":"2023-12-07T10:00:14.467446+0000","last_undegraded":"2023-12-07T10:00:14.467446+0000","last_fullsized":"2023-12-07T10:00:14.467446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:13:25.037083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.491500+0000","last_change":"2023-12-07T10:00:14.486211+0000","last_active":"2023-12-07T10:00:14.491500+0000","last_peered":"2023-12-07T10:00:14.491500+0000","last_clean":"2023-12-07T10:00:14.491500+0000","last_became_active":"2023-12-07T10:00:14.485872+0000","last_became_peered":"2023-12-07T10:00:14.485872+0000","last_unstale":"2023-12-07T10:00:14.491500+0000","last_undegraded":"2023-12-07T10:00:14.491500+0000","last_fullsized":"2023-12-07T10:00:14.491500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:01.011443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437959+0000","last_change":"2023-12-07T09:59:56.248159+0000","last_active":"2023-12-07T10:00:13.437959+0000","last_peered":"2023-12-07T10:00:13.437959+0000","last_clean":"2023-12-07T10:00:13.437959+0000","last_became_active":"2023-12-07T09:59:56.247890+0000","last_became_peered":"2023-12-07T09:59:56.247890+0000","last_unstale":"2023-12-07T10:00:13.437959+0000","last_undegraded":"2023-12-07T10:00:13.437959+0000","last_fullsized":"2023-12-07T10:00:13.437959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:11.557704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434556+0000","last_change":"2023-12-07T09:59:57.222557+0000","last_active":"2023-12-07T10:00:13.434556+0000","last_peered":"2023-12-07T10:00:13.434556+0000","last_clean":"2023-12-07T10:00:13.434556+0000","last_became_active":"2023-12-07T09:59:57.221911+0000","last_became_peered":"2023-12-07T09:59:57.221911+0000","last_unstale":"2023-12-07T10:00:13.434556+0000","last_undegraded":"2023-12-07T10:00:13.434556+0000","last_fullsized":"2023-12-07T10:00:13.434556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:08.918724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.509843+0000","last_change":"2023-12-07T10:00:13.458506+0000","last_active":"2023-12-07T10:00:14.509843+0000","last_peered":"2023-12-07T10:00:14.509843+0000","last_clean":"2023-12-07T10:00:14.509843+0000","last_became_active":"2023-12-07T10:00:13.458231+0000","last_became_peered":"2023-12-07T10:00:13.458231+0000","last_unstale":"2023-12-07T10:00:14.509843+0000","last_undegraded":"2023-12-07T10:00:14.509843+0000","last_fullsized":"2023-12-07T10:00:14.509843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:56:17.622330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.494311+0000","last_change":"2023-12-07T10:00:14.482697+0000","last_active":"2023-12-07T10:00:14.494311+0000","last_peered":"2023-12-07T10:00:14.494311+0000","last_clean":"2023-12-07T10:00:14.494311+0000","last_became_active":"2023-12-07T10:00:14.482415+0000","last_became_peered":"2023-12-07T10:00:14.482415+0000","last_unstale":"2023-12-07T10:00:14.494311+0000","last_undegraded":"2023-12-07T10:00:14.494311+0000","last_fullsized":"2023-12-07T10:00:14.494311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:55.703291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457901+0000","last_change":"2023-12-07T09:59:56.250622+0000","last_active":"2023-12-07T10:00:13.457901+0000","last_peered":"2023-12-07T10:00:13.457901+0000","last_clean":"2023-12-07T10:00:13.457901+0000","last_became_active":"2023-12-07T09:59:56.250318+0000","last_became_peered":"2023-12-07T09:59:56.250318+0000","last_unstale":"2023-12-07T10:00:13.457901+0000","last_undegraded":"2023-12-07T10:00:13.457901+0000","last_fullsized":"2023-12-07T10:00:13.457901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434787+0000","last_change":"2023-12-07T09:59:57.226382+0000","last_active":"2023-12-07T10:00:13.434787+0000","last_peered":"2023-12-07T10:00:13.434787+0000","last_clean":"2023-12-07T10:00:13.434787+0000","last_became_active":"2023-12-07T09:59:57.226109+0000","last_became_peered":"2023-12-07T09:59:57.226109+0000","last_unstale":"2023-12-07T10:00:13.434787+0000","last_undegraded":"2023-12-07T10:00:13.434787+0000","last_fullsized":"2023-12-07T10:00:13.434787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:33.099334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.458578+0000","last_change":"2023-12-07T10:00:13.453976+0000","last_active":"2023-12-07T10:00:14.458578+0000","last_peered":"2023-12-07T10:00:14.458578+0000","last_clean":"2023-12-07T10:00:14.458578+0000","last_became_active":"2023-12-07T10:00:13.452164+0000","last_became_peered":"2023-12-07T10:00:13.452164+0000","last_unstale":"2023-12-07T10:00:14.458578+0000","last_undegraded":"2023-12-07T10:00:14.458578+0000","last_fullsized":"2023-12-07T10:00:14.458578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:45:12.054481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496146+0000","last_change":"2023-12-07T10:00:14.486647+0000","last_active":"2023-12-07T10:00:14.496146+0000","last_peered":"2023-12-07T10:00:14.496146+0000","last_clean":"2023-12-07T10:00:14.496146+0000","last_became_active":"2023-12-07T10:00:14.484392+0000","last_became_peered":"2023-12-07T10:00:14.484392+0000","last_unstale":"2023-12-07T10:00:14.496146+0000","last_undegraded":"2023-12-07T10:00:14.496146+0000","last_fullsized":"2023-12-07T10:00:14.496146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:58.703203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445387+0000","last_change":"2023-12-07T09:59:56.245087+0000","last_active":"2023-12-07T10:00:13.445387+0000","last_peered":"2023-12-07T10:00:13.445387+0000","last_clean":"2023-12-07T10:00:13.445387+0000","last_became_active":"2023-12-07T09:59:56.244700+0000","last_became_peered":"2023-12-07T09:59:56.244700+0000","last_unstale":"2023-12-07T10:00:13.445387+0000","last_undegraded":"2023-12-07T10:00:13.445387+0000","last_fullsized":"2023-12-07T10:00:13.445387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434570+0000","last_change":"2023-12-07T09:59:57.229233+0000","last_active":"2023-12-07T10:00:13.434570+0000","last_peered":"2023-12-07T10:00:13.434570+0000","last_clean":"2023-12-07T10:00:13.434570+0000","last_became_active":"2023-12-07T09:59:57.228954+0000","last_became_peered":"2023-12-07T09:59:57.228954+0000","last_unstale":"2023-12-07T10:00:13.434570+0000","last_undegraded":"2023-12-07T10:00:13.434570+0000","last_fullsized":"2023-12-07T10:00:13.434570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:10:27.580956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.480053+0000","last_change":"2023-12-07T10:00:13.448982+0000","last_active":"2023-12-07T10:00:14.480053+0000","last_peered":"2023-12-07T10:00:14.480053+0000","last_clean":"2023-12-07T10:00:14.480053+0000","last_became_active":"2023-12-07T10:00:13.448751+0000","last_became_peered":"2023-12-07T10:00:13.448751+0000","last_unstale":"2023-12-07T10:00:14.480053+0000","last_undegraded":"2023-12-07T10:00:14.480053+0000","last_fullsized":"2023-12-07T10:00:14.480053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:48.866866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496321+0000","last_change":"2023-12-07T10:00:14.488737+0000","last_active":"2023-12-07T10:00:14.496321+0000","last_peered":"2023-12-07T10:00:14.496321+0000","last_clean":"2023-12-07T10:00:14.496321+0000","last_became_active":"2023-12-07T10:00:14.488450+0000","last_became_peered":"2023-12-07T10:00:14.488450+0000","last_unstale":"2023-12-07T10:00:14.496321+0000","last_undegraded":"2023-12-07T10:00:14.496321+0000","last_fullsized":"2023-12-07T10:00:14.496321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:54:14.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437136+0000","last_change":"2023-12-07T09:59:56.257331+0000","last_active":"2023-12-07T10:00:13.437136+0000","last_peered":"2023-12-07T10:00:13.437136+0000","last_clean":"2023-12-07T10:00:13.437136+0000","last_became_active":"2023-12-07T09:59:56.257002+0000","last_became_peered":"2023-12-07T09:59:56.257002+0000","last_unstale":"2023-12-07T10:00:13.437136+0000","last_undegraded":"2023-12-07T10:00:13.437136+0000","last_fullsized":"2023-12-07T10:00:13.437136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434665+0000","last_change":"2023-12-07T09:59:57.230224+0000","last_active":"2023-12-07T10:00:13.434665+0000","last_peered":"2023-12-07T10:00:13.434665+0000","last_clean":"2023-12-07T10:00:13.434665+0000","last_became_active":"2023-12-07T09:59:57.229926+0000","last_became_peered":"2023-12-07T09:59:57.229926+0000","last_unstale":"2023-12-07T10:00:13.434665+0000","last_undegraded":"2023-12-07T10:00:13.434665+0000","last_fullsized":"2023-12-07T10:00:13.434665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:14.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.509184+0000","last_change":"2023-12-07T10:00:13.455854+0000","last_active":"2023-12-07T10:00:14.509184+0000","last_peered":"2023-12-07T10:00:14.509184+0000","last_clean":"2023-12-07T10:00:14.509184+0000","last_became_active":"2023-12-07T10:00:13.455591+0000","last_became_peered":"2023-12-07T10:00:13.455591+0000","last_unstale":"2023-12-07T10:00:14.509184+0000","last_undegraded":"2023-12-07T10:00:14.509184+0000","last_fullsized":"2023-12-07T10:00:14.509184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:48.866866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.504007+0000","last_change":"2023-12-07T10:00:14.492941+0000","last_active":"2023-12-07T10:00:14.504007+0000","last_peered":"2023-12-07T10:00:14.504007+0000","last_clean":"2023-12-07T10:00:14.504007+0000","last_became_active":"2023-12-07T10:00:14.492667+0000","last_became_peered":"2023-12-07T10:00:14.492667+0000","last_unstale":"2023-12-07T10:00:14.504007+0000","last_undegraded":"2023-12-07T10:00:14.504007+0000","last_fullsized":"2023-12-07T10:00:14.504007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:19.999369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.439161+0000","last_change":"2023-12-07T09:59:56.247923+0000","last_active":"2023-12-07T10:00:13.439161+0000","last_peered":"2023-12-07T10:00:13.439161+0000","last_clean":"2023-12-07T10:00:13.439161+0000","last_became_active":"2023-12-07T09:59:56.247372+0000","last_became_peered":"2023-12-07T09:59:56.247372+0000","last_unstale":"2023-12-07T10:00:13.439161+0000","last_undegraded":"2023-12-07T10:00:13.439161+0000","last_fullsized":"2023-12-07T10:00:13.439161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:11.165853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447958+0000","last_change":"2023-12-07T09:59:57.240863+0000","last_active":"2023-12-07T10:00:13.447958+0000","last_peered":"2023-12-07T10:00:13.447958+0000","last_clean":"2023-12-07T10:00:13.447958+0000","last_became_active":"2023-12-07T09:59:57.239236+0000","last_became_peered":"2023-12-07T09:59:57.239236+0000","last_unstale":"2023-12-07T10:00:13.447958+0000","last_undegraded":"2023-12-07T10:00:13.447958+0000","last_fullsized":"2023-12-07T10:00:13.447958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.510479+0000","last_change":"2023-12-07T10:00:13.459468+0000","last_active":"2023-12-07T10:00:14.510479+0000","last_peered":"2023-12-07T10:00:14.510479+0000","last_clean":"2023-12-07T10:00:14.510479+0000","last_became_active":"2023-12-07T10:00:13.459134+0000","last_became_peered":"2023-12-07T10:00:13.459134+0000","last_unstale":"2023-12-07T10:00:14.510479+0000","last_undegraded":"2023-12-07T10:00:14.510479+0000","last_fullsized":"2023-12-07T10:00:14.510479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:55.736579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.481768+0000","last_change":"2023-12-07T10:00:14.472891+0000","last_active":"2023-12-07T10:00:14.481768+0000","last_peered":"2023-12-07T10:00:14.481768+0000","last_clean":"2023-12-07T10:00:14.481768+0000","last_became_active":"2023-12-07T10:00:14.472583+0000","last_became_peered":"2023-12-07T10:00:14.472583+0000","last_unstale":"2023-12-07T10:00:14.481768+0000","last_undegraded":"2023-12-07T10:00:14.481768+0000","last_fullsized":"2023-12-07T10:00:14.481768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:39:11.563410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438646+0000","last_change":"2023-12-07T09:59:56.243609+0000","last_active":"2023-12-07T10:00:13.438646+0000","last_peered":"2023-12-07T10:00:13.438646+0000","last_clean":"2023-12-07T10:00:13.438646+0000","last_became_active":"2023-12-07T09:59:56.243310+0000","last_became_peered":"2023-12-07T09:59:56.243310+0000","last_unstale":"2023-12-07T10:00:13.438646+0000","last_undegraded":"2023-12-07T10:00:13.438646+0000","last_fullsized":"2023-12-07T10:00:13.438646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448854+0000","last_change":"2023-12-07T09:59:57.222118+0000","last_active":"2023-12-07T10:00:13.448854+0000","last_peered":"2023-12-07T10:00:13.448854+0000","last_clean":"2023-12-07T10:00:13.448854+0000","last_became_active":"2023-12-07T09:59:57.221427+0000","last_became_peered":"2023-12-07T09:59:57.221427+0000","last_unstale":"2023-12-07T10:00:13.448854+0000","last_undegraded":"2023-12-07T10:00:13.448854+0000","last_fullsized":"2023-12-07T10:00:13.448854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460710+0000","last_change":"2023-12-07T10:00:13.463302+0000","last_active":"2023-12-07T10:00:14.460710+0000","last_peered":"2023-12-07T10:00:14.460710+0000","last_clean":"2023-12-07T10:00:14.460710+0000","last_became_active":"2023-12-07T10:00:13.462639+0000","last_became_peered":"2023-12-07T10:00:13.462639+0000","last_unstale":"2023-12-07T10:00:14.460710+0000","last_undegraded":"2023-12-07T10:00:14.460710+0000","last_fullsized":"2023-12-07T10:00:14.460710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:10:29.576843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.471167+0000","last_change":"2023-12-07T10:00:14.464887+0000","last_active":"2023-12-07T10:00:14.471167+0000","last_peered":"2023-12-07T10:00:14.471167+0000","last_clean":"2023-12-07T10:00:14.471167+0000","last_became_active":"2023-12-07T10:00:14.464454+0000","last_became_peered":"2023-12-07T10:00:14.464454+0000","last_unstale":"2023-12-07T10:00:14.471167+0000","last_undegraded":"2023-12-07T10:00:14.471167+0000","last_fullsized":"2023-12-07T10:00:14.471167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:35:07.418491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448751+0000","last_change":"2023-12-07T09:59:56.258524+0000","last_active":"2023-12-07T10:00:13.448751+0000","last_peered":"2023-12-07T10:00:13.448751+0000","last_clean":"2023-12-07T10:00:13.448751+0000","last_became_active":"2023-12-07T09:59:56.258272+0000","last_became_peered":"2023-12-07T09:59:56.258272+0000","last_unstale":"2023-12-07T10:00:13.448751+0000","last_undegraded":"2023-12-07T10:00:13.448751+0000","last_fullsized":"2023-12-07T10:00:13.448751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438530+0000","last_change":"2023-12-07T09:59:57.224125+0000","last_active":"2023-12-07T10:00:13.438530+0000","last_peered":"2023-12-07T10:00:13.438530+0000","last_clean":"2023-12-07T10:00:13.438530+0000","last_became_active":"2023-12-07T09:59:57.223773+0000","last_became_peered":"2023-12-07T09:59:57.223773+0000","last_unstale":"2023-12-07T10:00:13.438530+0000","last_undegraded":"2023-12-07T10:00:13.438530+0000","last_fullsized":"2023-12-07T10:00:13.438530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.504082+0000","last_change":"2023-12-07T10:00:13.458197+0000","last_active":"2023-12-07T10:00:14.504082+0000","last_peered":"2023-12-07T10:00:14.504082+0000","last_clean":"2023-12-07T10:00:14.504082+0000","last_became_active":"2023-12-07T10:00:13.457884+0000","last_became_peered":"2023-12-07T10:00:13.457884+0000","last_unstale":"2023-12-07T10:00:14.504082+0000","last_undegraded":"2023-12-07T10:00:14.504082+0000","last_fullsized":"2023-12-07T10:00:14.504082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:32:58.002435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492446+0000","last_change":"2023-12-07T10:00:14.481765+0000","last_active":"2023-12-07T10:00:14.492446+0000","last_peered":"2023-12-07T10:00:14.492446+0000","last_clean":"2023-12-07T10:00:14.492446+0000","last_became_active":"2023-12-07T10:00:14.481480+0000","last_became_peered":"2023-12-07T10:00:14.481480+0000","last_unstale":"2023-12-07T10:00:14.492446+0000","last_undegraded":"2023-12-07T10:00:14.492446+0000","last_fullsized":"2023-12-07T10:00:14.492446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:59.720998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.455029+0000","last_change":"2023-12-07T09:59:56.252633+0000","last_active":"2023-12-07T10:00:13.455029+0000","last_peered":"2023-12-07T10:00:13.455029+0000","last_clean":"2023-12-07T10:00:13.455029+0000","last_became_active":"2023-12-07T09:59:56.252316+0000","last_became_peered":"2023-12-07T09:59:56.252316+0000","last_unstale":"2023-12-07T10:00:13.455029+0000","last_undegraded":"2023-12-07T10:00:13.455029+0000","last_fullsized":"2023-12-07T10:00:13.455029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:29.900543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.456854+0000","last_change":"2023-12-07T09:59:57.239368+0000","last_active":"2023-12-07T10:00:13.456854+0000","last_peered":"2023-12-07T10:00:13.456854+0000","last_clean":"2023-12-07T10:00:13.456854+0000","last_became_active":"2023-12-07T09:59:57.238640+0000","last_became_peered":"2023-12-07T09:59:57.238640+0000","last_unstale":"2023-12-07T10:00:13.456854+0000","last_undegraded":"2023-12-07T10:00:13.456854+0000","last_fullsized":"2023-12-07T10:00:13.456854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:17.962783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460445+0000","last_change":"2023-12-07T10:00:13.452353+0000","last_active":"2023-12-07T10:00:14.460445+0000","last_peered":"2023-12-07T10:00:14.460445+0000","last_clean":"2023-12-07T10:00:14.460445+0000","last_became_active":"2023-12-07T10:00:13.452059+0000","last_became_peered":"2023-12-07T10:00:13.452059+0000","last_unstale":"2023-12-07T10:00:14.460445+0000","last_undegraded":"2023-12-07T10:00:14.460445+0000","last_fullsized":"2023-12-07T10:00:14.460445+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:25.740476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492008+0000","last_change":"2023-12-07T10:00:14.489395+0000","last_active":"2023-12-07T10:00:14.492008+0000","last_peered":"2023-12-07T10:00:14.492008+0000","last_clean":"2023-12-07T10:00:14.492008+0000","last_became_active":"2023-12-07T10:00:14.489120+0000","last_became_peered":"2023-12-07T10:00:14.489120+0000","last_unstale":"2023-12-07T10:00:14.492008+0000","last_undegraded":"2023-12-07T10:00:14.492008+0000","last_fullsized":"2023-12-07T10:00:14.492008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:57:16.761439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.454942+0000","last_change":"2023-12-07T09:59:56.249076+0000","last_active":"2023-12-07T10:00:13.454942+0000","last_peered":"2023-12-07T10:00:13.454942+0000","last_clean":"2023-12-07T10:00:13.454942+0000","last_became_active":"2023-12-07T09:59:56.248779+0000","last_became_peered":"2023-12-07T09:59:56.248779+0000","last_unstale":"2023-12-07T10:00:13.454942+0000","last_undegraded":"2023-12-07T10:00:13.454942+0000","last_fullsized":"2023-12-07T10:00:13.454942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:03.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440555+0000","last_change":"2023-12-07T09:59:57.231869+0000","last_active":"2023-12-07T10:00:13.440555+0000","last_peered":"2023-12-07T10:00:13.440555+0000","last_clean":"2023-12-07T10:00:13.440555+0000","last_became_active":"2023-12-07T09:59:57.231357+0000","last_became_peered":"2023-12-07T09:59:57.231357+0000","last_unstale":"2023-12-07T10:00:13.440555+0000","last_undegraded":"2023-12-07T10:00:13.440555+0000","last_fullsized":"2023-12-07T10:00:13.440555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.511358+0000","last_change":"2023-12-07T10:00:13.461947+0000","last_active":"2023-12-07T10:00:14.511358+0000","last_peered":"2023-12-07T10:00:14.511358+0000","last_clean":"2023-12-07T10:00:14.511358+0000","last_became_active":"2023-12-07T10:00:13.461685+0000","last_became_peered":"2023-12-07T10:00:13.461685+0000","last_unstale":"2023-12-07T10:00:14.511358+0000","last_undegraded":"2023-12-07T10:00:14.511358+0000","last_fullsized":"2023-12-07T10:00:14.511358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:48:59.777929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486865+0000","last_change":"2023-12-07T10:00:14.479848+0000","last_active":"2023-12-07T10:00:14.486865+0000","last_peered":"2023-12-07T10:00:14.486865+0000","last_clean":"2023-12-07T10:00:14.486865+0000","last_became_active":"2023-12-07T10:00:14.479544+0000","last_became_peered":"2023-12-07T10:00:14.479544+0000","last_unstale":"2023-12-07T10:00:14.486865+0000","last_undegraded":"2023-12-07T10:00:14.486865+0000","last_fullsized":"2023-12-07T10:00:14.486865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:13:26.039586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447371+0000","last_change":"2023-12-07T09:59:56.245266+0000","last_active":"2023-12-07T10:00:13.447371+0000","last_peered":"2023-12-07T10:00:13.447371+0000","last_clean":"2023-12-07T10:00:13.447371+0000","last_became_active":"2023-12-07T09:59:56.244990+0000","last_became_peered":"2023-12-07T09:59:56.244990+0000","last_unstale":"2023-12-07T10:00:13.447371+0000","last_undegraded":"2023-12-07T10:00:13.447371+0000","last_fullsized":"2023-12-07T10:00:13.447371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:00:07.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457969+0000","last_change":"2023-12-07T09:59:57.226535+0000","last_active":"2023-12-07T10:00:13.457969+0000","last_peered":"2023-12-07T10:00:13.457969+0000","last_clean":"2023-12-07T10:00:13.457969+0000","last_became_active":"2023-12-07T09:59:57.226242+0000","last_became_peered":"2023-12-07T09:59:57.226242+0000","last_unstale":"2023-12-07T10:00:13.457969+0000","last_undegraded":"2023-12-07T10:00:13.457969+0000","last_fullsized":"2023-12-07T10:00:13.457969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:08.172019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.512193+0000","last_change":"2023-12-07T10:00:13.451012+0000","last_active":"2023-12-07T10:00:14.512193+0000","last_peered":"2023-12-07T10:00:14.512193+0000","last_clean":"2023-12-07T10:00:14.512193+0000","last_became_active":"2023-12-07T10:00:13.450709+0000","last_became_peered":"2023-12-07T10:00:13.450709+0000","last_unstale":"2023-12-07T10:00:14.512193+0000","last_undegraded":"2023-12-07T10:00:14.512193+0000","last_fullsized":"2023-12-07T10:00:14.512193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:26.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.480745+0000","last_change":"2023-12-07T10:00:14.476919+0000","last_active":"2023-12-07T10:00:14.480745+0000","last_peered":"2023-12-07T10:00:14.480745+0000","last_clean":"2023-12-07T10:00:14.480745+0000","last_became_active":"2023-12-07T10:00:14.476603+0000","last_became_peered":"2023-12-07T10:00:14.476603+0000","last_unstale":"2023-12-07T10:00:14.480745+0000","last_undegraded":"2023-12-07T10:00:14.480745+0000","last_fullsized":"2023-12-07T10:00:14.480745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:20.031808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438875+0000","last_change":"2023-12-07T09:59:56.244124+0000","last_active":"2023-12-07T10:00:13.438875+0000","last_peered":"2023-12-07T10:00:13.438875+0000","last_clean":"2023-12-07T10:00:13.438875+0000","last_became_active":"2023-12-07T09:59:56.243879+0000","last_became_peered":"2023-12-07T09:59:56.243879+0000","last_unstale":"2023-12-07T10:00:13.438875+0000","last_undegraded":"2023-12-07T10:00:13.438875+0000","last_fullsized":"2023-12-07T10:00:13.438875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:03.809080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447387+0000","last_change":"2023-12-07T09:59:57.233881+0000","last_active":"2023-12-07T10:00:13.447387+0000","last_peered":"2023-12-07T10:00:13.447387+0000","last_clean":"2023-12-07T10:00:13.447387+0000","last_became_active":"2023-12-07T09:59:57.233618+0000","last_became_peered":"2023-12-07T09:59:57.233618+0000","last_unstale":"2023-12-07T10:00:13.447387+0000","last_undegraded":"2023-12-07T10:00:13.447387+0000","last_fullsized":"2023-12-07T10:00:13.447387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.460658+0000","last_change":"2023-12-07T10:00:13.460965+0000","last_active":"2023-12-07T10:00:14.460658+0000","last_peered":"2023-12-07T10:00:14.460658+0000","last_clean":"2023-12-07T10:00:14.460658+0000","last_became_active":"2023-12-07T10:00:13.460717+0000","last_became_peered":"2023-12-07T10:00:13.460717+0000","last_unstale":"2023-12-07T10:00:14.460658+0000","last_undegraded":"2023-12-07T10:00:14.460658+0000","last_fullsized":"2023-12-07T10:00:14.460658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:13.649371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479975+0000","last_change":"2023-12-07T10:00:14.475226+0000","last_active":"2023-12-07T10:00:14.479975+0000","last_peered":"2023-12-07T10:00:14.479975+0000","last_clean":"2023-12-07T10:00:14.479975+0000","last_became_active":"2023-12-07T10:00:14.474622+0000","last_became_peered":"2023-12-07T10:00:14.474622+0000","last_unstale":"2023-12-07T10:00:14.479975+0000","last_undegraded":"2023-12-07T10:00:14.479975+0000","last_fullsized":"2023-12-07T10:00:14.479975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:02.643290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457863+0000","last_change":"2023-12-07T09:59:56.256946+0000","last_active":"2023-12-07T10:00:13.457863+0000","last_peered":"2023-12-07T10:00:13.457863+0000","last_clean":"2023-12-07T10:00:13.457863+0000","last_became_active":"2023-12-07T09:59:56.256514+0000","last_became_peered":"2023-12-07T09:59:56.256514+0000","last_unstale":"2023-12-07T10:00:13.457863+0000","last_undegraded":"2023-12-07T10:00:13.457863+0000","last_fullsized":"2023-12-07T10:00:13.457863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:25.242109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.450137+0000","last_change":"2023-12-07T09:59:57.240066+0000","last_active":"2023-12-07T10:00:13.450137+0000","last_peered":"2023-12-07T10:00:13.450137+0000","last_clean":"2023-12-07T10:00:13.450137+0000","last_became_active":"2023-12-07T09:59:57.239795+0000","last_became_peered":"2023-12-07T09:59:57.239795+0000","last_unstale":"2023-12-07T10:00:13.450137+0000","last_undegraded":"2023-12-07T10:00:13.450137+0000","last_fullsized":"2023-12-07T10:00:13.450137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.489428+0000","last_change":"2023-12-07T10:00:13.452488+0000","last_active":"2023-12-07T10:00:14.489428+0000","last_peered":"2023-12-07T10:00:14.489428+0000","last_clean":"2023-12-07T10:00:14.489428+0000","last_became_active":"2023-12-07T10:00:13.450697+0000","last_became_peered":"2023-12-07T10:00:13.450697+0000","last_unstale":"2023-12-07T10:00:14.489428+0000","last_undegraded":"2023-12-07T10:00:14.489428+0000","last_fullsized":"2023-12-07T10:00:14.489428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:45:12.054481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.493356+0000","last_change":"2023-12-07T10:00:14.492209+0000","last_active":"2023-12-07T10:00:14.493356+0000","last_peered":"2023-12-07T10:00:14.493356+0000","last_clean":"2023-12-07T10:00:14.493356+0000","last_became_active":"2023-12-07T10:00:14.491879+0000","last_became_peered":"2023-12-07T10:00:14.491879+0000","last_unstale":"2023-12-07T10:00:14.493356+0000","last_undegraded":"2023-12-07T10:00:14.493356+0000","last_fullsized":"2023-12-07T10:00:14.493356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:43.374001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.449993+0000","last_change":"2023-12-07T09:59:56.245272+0000","last_active":"2023-12-07T10:00:13.449993+0000","last_peered":"2023-12-07T10:00:13.449993+0000","last_clean":"2023-12-07T10:00:13.449993+0000","last_became_active":"2023-12-07T09:59:56.244612+0000","last_became_peered":"2023-12-07T09:59:56.244612+0000","last_unstale":"2023-12-07T10:00:13.449993+0000","last_undegraded":"2023-12-07T10:00:13.449993+0000","last_fullsized":"2023-12-07T10:00:13.449993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.459861+0000","last_change":"2023-12-07T09:59:57.232163+0000","last_active":"2023-12-07T10:00:13.459861+0000","last_peered":"2023-12-07T10:00:13.459861+0000","last_clean":"2023-12-07T10:00:13.459861+0000","last_became_active":"2023-12-07T09:59:57.231401+0000","last_became_peered":"2023-12-07T09:59:57.231401+0000","last_unstale":"2023-12-07T10:00:13.459861+0000","last_undegraded":"2023-12-07T10:00:13.459861+0000","last_fullsized":"2023-12-07T10:00:13.459861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:01:46.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.475940+0000","last_change":"2023-12-07T10:00:13.447920+0000","last_active":"2023-12-07T10:00:14.475940+0000","last_peered":"2023-12-07T10:00:14.475940+0000","last_clean":"2023-12-07T10:00:14.475940+0000","last_became_active":"2023-12-07T10:00:13.447623+0000","last_became_peered":"2023-12-07T10:00:13.447623+0000","last_unstale":"2023-12-07T10:00:14.475940+0000","last_undegraded":"2023-12-07T10:00:14.475940+0000","last_fullsized":"2023-12-07T10:00:14.475940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:26.777567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479480+0000","last_change":"2023-12-07T10:00:14.472250+0000","last_active":"2023-12-07T10:00:14.479480+0000","last_peered":"2023-12-07T10:00:14.479480+0000","last_clean":"2023-12-07T10:00:14.479480+0000","last_became_active":"2023-12-07T10:00:14.471933+0000","last_became_peered":"2023-12-07T10:00:14.471933+0000","last_unstale":"2023-12-07T10:00:14.479480+0000","last_undegraded":"2023-12-07T10:00:14.479480+0000","last_fullsized":"2023-12-07T10:00:14.479480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:52.735101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446843+0000","last_change":"2023-12-07T09:59:56.257460+0000","last_active":"2023-12-07T10:00:13.446843+0000","last_peered":"2023-12-07T10:00:13.446843+0000","last_clean":"2023-12-07T10:00:13.446843+0000","last_became_active":"2023-12-07T09:59:56.257108+0000","last_became_peered":"2023-12-07T09:59:56.257108+0000","last_unstale":"2023-12-07T10:00:13.446843+0000","last_undegraded":"2023-12-07T10:00:13.446843+0000","last_fullsized":"2023-12-07T10:00:13.446843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:30.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460650+0000","last_change":"2023-12-07T09:59:57.237888+0000","last_active":"2023-12-07T10:00:13.460650+0000","last_peered":"2023-12-07T10:00:13.460650+0000","last_clean":"2023-12-07T10:00:13.460650+0000","last_became_active":"2023-12-07T09:59:57.237543+0000","last_became_peered":"2023-12-07T09:59:57.237543+0000","last_unstale":"2023-12-07T10:00:13.460650+0000","last_undegraded":"2023-12-07T10:00:13.460650+0000","last_fullsized":"2023-12-07T10:00:13.460650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:26.165219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.512845+0000","last_change":"2023-12-07T10:00:13.442388+0000","last_active":"2023-12-07T10:00:14.512845+0000","last_peered":"2023-12-07T10:00:14.512845+0000","last_clean":"2023-12-07T10:00:14.512845+0000","last_became_active":"2023-12-07T10:00:13.442126+0000","last_became_peered":"2023-12-07T10:00:13.442126+0000","last_unstale":"2023-12-07T10:00:14.512845+0000","last_undegraded":"2023-12-07T10:00:14.512845+0000","last_fullsized":"2023-12-07T10:00:14.512845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:35:06.415988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.497567+0000","last_change":"2023-12-07T10:00:14.486342+0000","last_active":"2023-12-07T10:00:14.497567+0000","last_peered":"2023-12-07T10:00:14.497567+0000","last_clean":"2023-12-07T10:00:14.497567+0000","last_became_active":"2023-12-07T10:00:14.486040+0000","last_became_peered":"2023-12-07T10:00:14.486040+0000","last_unstale":"2023-12-07T10:00:14.497567+0000","last_undegraded":"2023-12-07T10:00:14.497567+0000","last_fullsized":"2023-12-07T10:00:14.497567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:02.643290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460742+0000","last_change":"2023-12-07T09:59:56.249207+0000","last_active":"2023-12-07T10:00:13.460742+0000","last_peered":"2023-12-07T10:00:13.460742+0000","last_clean":"2023-12-07T10:00:13.460742+0000","last_became_active":"2023-12-07T09:59:56.248795+0000","last_became_peered":"2023-12-07T09:59:56.248795+0000","last_unstale":"2023-12-07T10:00:13.460742+0000","last_undegraded":"2023-12-07T10:00:13.460742+0000","last_fullsized":"2023-12-07T10:00:13.460742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:39.635874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.449441+0000","last_change":"2023-12-07T09:59:57.239958+0000","last_active":"2023-12-07T10:00:13.449441+0000","last_peered":"2023-12-07T10:00:13.449441+0000","last_clean":"2023-12-07T10:00:13.449441+0000","last_became_active":"2023-12-07T09:59:57.239590+0000","last_became_peered":"2023-12-07T09:59:57.239590+0000","last_unstale":"2023-12-07T10:00:13.449441+0000","last_undegraded":"2023-12-07T10:00:13.449441+0000","last_fullsized":"2023-12-07T10:00:13.449441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.501435+0000","last_change":"2023-12-07T10:00:13.464324+0000","last_active":"2023-12-07T10:00:14.501435+0000","last_peered":"2023-12-07T10:00:14.501435+0000","last_clean":"2023-12-07T10:00:14.501435+0000","last_became_active":"2023-12-07T10:00:13.463840+0000","last_became_peered":"2023-12-07T10:00:13.463840+0000","last_unstale":"2023-12-07T10:00:14.501435+0000","last_undegraded":"2023-12-07T10:00:14.501435+0000","last_fullsized":"2023-12-07T10:00:14.501435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:19.029305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496148+0000","last_change":"2023-12-07T10:00:14.485622+0000","last_active":"2023-12-07T10:00:14.496148+0000","last_peered":"2023-12-07T10:00:14.496148+0000","last_clean":"2023-12-07T10:00:14.496148+0000","last_became_active":"2023-12-07T10:00:14.485159+0000","last_became_peered":"2023-12-07T10:00:14.485159+0000","last_unstale":"2023-12-07T10:00:14.496148+0000","last_undegraded":"2023-12-07T10:00:14.496148+0000","last_fullsized":"2023-12-07T10:00:14.496148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:01:43.374001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438853+0000","last_change":"2023-12-07T09:59:56.240171+0000","last_active":"2023-12-07T10:00:13.438853+0000","last_peered":"2023-12-07T10:00:13.438853+0000","last_clean":"2023-12-07T10:00:13.438853+0000","last_became_active":"2023-12-07T09:59:56.239779+0000","last_became_peered":"2023-12-07T09:59:56.239779+0000","last_unstale":"2023-12-07T10:00:13.438853+0000","last_undegraded":"2023-12-07T10:00:13.438853+0000","last_fullsized":"2023-12-07T10:00:13.438853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447315+0000","last_change":"2023-12-07T09:59:57.233603+0000","last_active":"2023-12-07T10:00:13.447315+0000","last_peered":"2023-12-07T10:00:13.447315+0000","last_clean":"2023-12-07T10:00:13.447315+0000","last_became_active":"2023-12-07T09:59:57.233247+0000","last_became_peered":"2023-12-07T09:59:57.233247+0000","last_unstale":"2023-12-07T10:00:13.447315+0000","last_undegraded":"2023-12-07T10:00:13.447315+0000","last_fullsized":"2023-12-07T10:00:13.447315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.353076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.508268+0000","last_change":"2023-12-07T10:00:13.450498+0000","last_active":"2023-12-07T10:00:14.508268+0000","last_peered":"2023-12-07T10:00:14.508268+0000","last_clean":"2023-12-07T10:00:14.508268+0000","last_became_active":"2023-12-07T10:00:13.450233+0000","last_became_peered":"2023-12-07T10:00:13.450233+0000","last_unstale":"2023-12-07T10:00:14.508268+0000","last_undegraded":"2023-12-07T10:00:14.508268+0000","last_fullsized":"2023-12-07T10:00:14.508268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:13:40.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.487847+0000","last_change":"2023-12-07T10:00:14.485393+0000","last_active":"2023-12-07T10:00:14.487847+0000","last_peered":"2023-12-07T10:00:14.487847+0000","last_clean":"2023-12-07T10:00:14.487847+0000","last_became_active":"2023-12-07T10:00:14.485072+0000","last_became_peered":"2023-12-07T10:00:14.485072+0000","last_unstale":"2023-12-07T10:00:14.487847+0000","last_undegraded":"2023-12-07T10:00:14.487847+0000","last_fullsized":"2023-12-07T10:00:14.487847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:02:03.948567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457586+0000","last_change":"2023-12-07T09:59:56.254460+0000","last_active":"2023-12-07T10:00:13.457586+0000","last_peered":"2023-12-07T10:00:13.457586+0000","last_clean":"2023-12-07T10:00:13.457586+0000","last_became_active":"2023-12-07T09:59:56.254187+0000","last_became_peered":"2023-12-07T09:59:56.254187+0000","last_unstale":"2023-12-07T10:00:13.457586+0000","last_undegraded":"2023-12-07T10:00:13.457586+0000","last_fullsized":"2023-12-07T10:00:13.457586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:04.346155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.439236+0000","last_change":"2023-12-07T09:59:57.241610+0000","last_active":"2023-12-07T10:00:13.439236+0000","last_peered":"2023-12-07T10:00:13.439236+0000","last_clean":"2023-12-07T10:00:13.439236+0000","last_became_active":"2023-12-07T09:59:57.241339+0000","last_became_peered":"2023-12-07T09:59:57.241339+0000","last_unstale":"2023-12-07T10:00:13.439236+0000","last_undegraded":"2023-12-07T10:00:13.439236+0000","last_fullsized":"2023-12-07T10:00:13.439236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.509782+0000","last_change":"2023-12-07T10:00:13.460054+0000","last_active":"2023-12-07T10:00:14.509782+0000","last_peered":"2023-12-07T10:00:14.509782+0000","last_clean":"2023-12-07T10:00:14.509782+0000","last_became_active":"2023-12-07T10:00:13.458561+0000","last_became_peered":"2023-12-07T10:00:13.458561+0000","last_unstale":"2023-12-07T10:00:14.509782+0000","last_undegraded":"2023-12-07T10:00:14.509782+0000","last_fullsized":"2023-12-07T10:00:14.509782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:00:23.750785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.476778+0000","last_change":"2023-12-07T10:00:14.468457+0000","last_active":"2023-12-07T10:00:14.476778+0000","last_peered":"2023-12-07T10:00:14.476778+0000","last_clean":"2023-12-07T10:00:14.476778+0000","last_became_active":"2023-12-07T10:00:14.468114+0000","last_became_peered":"2023-12-07T10:00:14.468114+0000","last_unstale":"2023-12-07T10:00:14.476778+0000","last_undegraded":"2023-12-07T10:00:14.476778+0000","last_fullsized":"2023-12-07T10:00:14.476778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:48.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438314+0000","last_change":"2023-12-07T09:59:56.255384+0000","last_active":"2023-12-07T10:00:13.438314+0000","last_peered":"2023-12-07T10:00:13.438314+0000","last_clean":"2023-12-07T10:00:13.438314+0000","last_became_active":"2023-12-07T09:59:56.255104+0000","last_became_peered":"2023-12-07T09:59:56.255104+0000","last_unstale":"2023-12-07T10:00:13.438314+0000","last_undegraded":"2023-12-07T10:00:13.438314+0000","last_fullsized":"2023-12-07T10:00:13.438314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:06:16.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.450464+0000","last_change":"2023-12-07T09:59:57.228028+0000","last_active":"2023-12-07T10:00:13.450464+0000","last_peered":"2023-12-07T10:00:13.450464+0000","last_clean":"2023-12-07T10:00:13.450464+0000","last_became_active":"2023-12-07T09:59:57.227746+0000","last_became_peered":"2023-12-07T09:59:57.227746+0000","last_unstale":"2023-12-07T10:00:13.450464+0000","last_undegraded":"2023-12-07T10:00:13.450464+0000","last_fullsized":"2023-12-07T10:00:13.450464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:22:30.907464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479879+0000","last_change":"2023-12-07T10:00:13.455674+0000","last_active":"2023-12-07T10:00:14.479879+0000","last_peered":"2023-12-07T10:00:14.479879+0000","last_clean":"2023-12-07T10:00:14.479879+0000","last_became_active":"2023-12-07T10:00:13.454943+0000","last_became_peered":"2023-12-07T10:00:13.454943+0000","last_unstale":"2023-12-07T10:00:14.479879+0000","last_undegraded":"2023-12-07T10:00:14.479879+0000","last_fullsized":"2023-12-07T10:00:14.479879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:08:52.766136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.494163+0000","last_change":"2023-12-07T10:00:14.482964+0000","last_active":"2023-12-07T10:00:14.494163+0000","last_peered":"2023-12-07T10:00:14.494163+0000","last_clean":"2023-12-07T10:00:14.494163+0000","last_became_active":"2023-12-07T10:00:14.482358+0000","last_became_peered":"2023-12-07T10:00:14.482358+0000","last_unstale":"2023-12-07T10:00:14.494163+0000","last_undegraded":"2023-12-07T10:00:14.494163+0000","last_fullsized":"2023-12-07T10:00:14.494163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:27.066740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438836+0000","last_change":"2023-12-07T09:59:56.257431+0000","last_active":"2023-12-07T10:00:13.438836+0000","last_peered":"2023-12-07T10:00:13.438836+0000","last_clean":"2023-12-07T10:00:13.438836+0000","last_became_active":"2023-12-07T09:59:56.257143+0000","last_became_peered":"2023-12-07T09:59:56.257143+0000","last_unstale":"2023-12-07T10:00:13.438836+0000","last_undegraded":"2023-12-07T10:00:13.438836+0000","last_fullsized":"2023-12-07T10:00:13.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:08.942440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.441633+0000","last_change":"2023-12-07T09:59:57.232971+0000","last_active":"2023-12-07T10:00:13.441633+0000","last_peered":"2023-12-07T10:00:13.441633+0000","last_clean":"2023-12-07T10:00:13.441633+0000","last_became_active":"2023-12-07T09:59:57.232675+0000","last_became_peered":"2023-12-07T09:59:57.232675+0000","last_unstale":"2023-12-07T10:00:13.441633+0000","last_undegraded":"2023-12-07T10:00:13.441633+0000","last_fullsized":"2023-12-07T10:00:13.441633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484535+0000","last_change":"2023-12-07T10:00:13.456710+0000","last_active":"2023-12-07T10:00:14.484535+0000","last_peered":"2023-12-07T10:00:14.484535+0000","last_clean":"2023-12-07T10:00:14.484535+0000","last_became_active":"2023-12-07T10:00:13.455774+0000","last_became_peered":"2023-12-07T10:00:13.455774+0000","last_unstale":"2023-12-07T10:00:14.484535+0000","last_undegraded":"2023-12-07T10:00:14.484535+0000","last_fullsized":"2023-12-07T10:00:14.484535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:19.029305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488118+0000","last_change":"2023-12-07T10:00:14.481896+0000","last_active":"2023-12-07T10:00:14.488118+0000","last_peered":"2023-12-07T10:00:14.488118+0000","last_clean":"2023-12-07T10:00:14.488118+0000","last_became_active":"2023-12-07T10:00:14.481540+0000","last_became_peered":"2023-12-07T10:00:14.481540+0000","last_unstale":"2023-12-07T10:00:14.488118+0000","last_undegraded":"2023-12-07T10:00:14.488118+0000","last_fullsized":"2023-12-07T10:00:14.488118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:55.703291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.508691+0000","last_change":"2023-12-07T10:00:13.464332+0000","last_active":"2023-12-07T10:00:14.508691+0000","last_peered":"2023-12-07T10:00:14.508691+0000","last_clean":"2023-12-07T10:00:14.508691+0000","last_became_active":"2023-12-07T10:00:13.464043+0000","last_became_peered":"2023-12-07T10:00:13.464043+0000","last_unstale":"2023-12-07T10:00:14.508691+0000","last_undegraded":"2023-12-07T10:00:14.508691+0000","last_fullsized":"2023-12-07T10:00:14.508691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:00.736597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434908+0000","last_change":"2023-12-07T09:59:56.251685+0000","last_active":"2023-12-07T10:00:13.434908+0000","last_peered":"2023-12-07T10:00:13.434908+0000","last_clean":"2023-12-07T10:00:13.434908+0000","last_became_active":"2023-12-07T09:59:56.251379+0000","last_became_peered":"2023-12-07T09:59:56.251379+0000","last_unstale":"2023-12-07T10:00:13.434908+0000","last_undegraded":"2023-12-07T10:00:13.434908+0000","last_fullsized":"2023-12-07T10:00:13.434908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:43:45.496128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448354+0000","last_change":"2023-12-07T09:59:57.245223+0000","last_active":"2023-12-07T10:00:13.448354+0000","last_peered":"2023-12-07T10:00:13.448354+0000","last_clean":"2023-12-07T10:00:13.448354+0000","last_became_active":"2023-12-07T09:59:57.245009+0000","last_became_peered":"2023-12-07T09:59:57.245009+0000","last_unstale":"2023-12-07T10:00:13.448354+0000","last_undegraded":"2023-12-07T10:00:13.448354+0000","last_fullsized":"2023-12-07T10:00:13.448354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484649+0000","last_change":"2023-12-07T10:00:14.477811+0000","last_active":"2023-12-07T10:00:14.484649+0000","last_peered":"2023-12-07T10:00:14.484649+0000","last_clean":"2023-12-07T10:00:14.484649+0000","last_became_active":"2023-12-07T10:00:14.476390+0000","last_became_peered":"2023-12-07T10:00:14.476390+0000","last_unstale":"2023-12-07T10:00:14.484649+0000","last_undegraded":"2023-12-07T10:00:14.484649+0000","last_fullsized":"2023-12-07T10:00:14.484649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:59.720998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.505914+0000","last_change":"2023-12-07T10:00:13.463577+0000","last_active":"2023-12-07T10:00:14.505914+0000","last_peered":"2023-12-07T10:00:14.505914+0000","last_clean":"2023-12-07T10:00:14.505914+0000","last_became_active":"2023-12-07T10:00:13.462720+0000","last_became_peered":"2023-12-07T10:00:13.462720+0000","last_unstale":"2023-12-07T10:00:14.505914+0000","last_undegraded":"2023-12-07T10:00:14.505914+0000","last_fullsized":"2023-12-07T10:00:14.505914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:40:56.910976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.458083+0000","last_change":"2023-12-07T09:59:56.254732+0000","last_active":"2023-12-07T10:00:13.458083+0000","last_peered":"2023-12-07T10:00:13.458083+0000","last_clean":"2023-12-07T10:00:13.458083+0000","last_became_active":"2023-12-07T09:59:56.254439+0000","last_became_peered":"2023-12-07T09:59:56.254439+0000","last_unstale":"2023-12-07T10:00:13.458083+0000","last_undegraded":"2023-12-07T10:00:13.458083+0000","last_fullsized":"2023-12-07T10:00:13.458083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:34.888684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.437014+0000","last_change":"2023-12-07T09:59:57.239310+0000","last_active":"2023-12-07T10:00:13.437014+0000","last_peered":"2023-12-07T10:00:13.437014+0000","last_clean":"2023-12-07T10:00:13.437014+0000","last_became_active":"2023-12-07T09:59:57.239006+0000","last_became_peered":"2023-12-07T09:59:57.239006+0000","last_unstale":"2023-12-07T10:00:13.437014+0000","last_undegraded":"2023-12-07T10:00:13.437014+0000","last_fullsized":"2023-12-07T10:00:13.437014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:34:50.209709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.477592+0000","last_change":"2023-12-07T10:00:14.472144+0000","last_active":"2023-12-07T10:00:14.477592+0000","last_peered":"2023-12-07T10:00:14.477592+0000","last_clean":"2023-12-07T10:00:14.477592+0000","last_became_active":"2023-12-07T10:00:14.471695+0000","last_became_peered":"2023-12-07T10:00:14.471695+0000","last_unstale":"2023-12-07T10:00:14.477592+0000","last_undegraded":"2023-12-07T10:00:14.477592+0000","last_fullsized":"2023-12-07T10:00:14.477592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:25.380801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446767+0000","last_change":"2023-12-07T09:59:56.235235+0000","last_active":"2023-12-07T10:00:13.446767+0000","last_peered":"2023-12-07T10:00:13.446767+0000","last_clean":"2023-12-07T10:00:13.446767+0000","last_became_active":"2023-12-07T09:59:56.234964+0000","last_became_peered":"2023-12-07T09:59:56.234964+0000","last_unstale":"2023-12-07T10:00:13.446767+0000","last_undegraded":"2023-12-07T10:00:13.446767+0000","last_fullsized":"2023-12-07T10:00:13.446767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:53.378458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457369+0000","last_change":"2023-12-07T09:59:57.240365+0000","last_active":"2023-12-07T10:00:13.457369+0000","last_peered":"2023-12-07T10:00:13.457369+0000","last_clean":"2023-12-07T10:00:13.457369+0000","last_became_active":"2023-12-07T09:59:57.240064+0000","last_became_peered":"2023-12-07T09:59:57.240064+0000","last_unstale":"2023-12-07T10:00:13.457369+0000","last_undegraded":"2023-12-07T10:00:13.457369+0000","last_fullsized":"2023-12-07T10:00:13.457369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:04.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.500688+0000","last_change":"2023-12-07T10:00:13.455036+0000","last_active":"2023-12-07T10:00:14.500688+0000","last_peered":"2023-12-07T10:00:14.500688+0000","last_clean":"2023-12-07T10:00:14.500688+0000","last_became_active":"2023-12-07T10:00:13.454781+0000","last_became_peered":"2023-12-07T10:00:13.454781+0000","last_unstale":"2023-12-07T10:00:14.500688+0000","last_undegraded":"2023-12-07T10:00:14.500688+0000","last_fullsized":"2023-12-07T10:00:14.500688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:32:58.002435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.477592+0000","last_change":"2023-12-07T10:00:14.472856+0000","last_active":"2023-12-07T10:00:14.477592+0000","last_peered":"2023-12-07T10:00:14.477592+0000","last_clean":"2023-12-07T10:00:14.477592+0000","last_became_active":"2023-12-07T10:00:14.472507+0000","last_became_peered":"2023-12-07T10:00:14.472507+0000","last_unstale":"2023-12-07T10:00:14.477592+0000","last_undegraded":"2023-12-07T10:00:14.477592+0000","last_fullsized":"2023-12-07T10:00:14.477592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:08:53.768639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457455+0000","last_change":"2023-12-07T09:59:56.247813+0000","last_active":"2023-12-07T10:00:13.457455+0000","last_peered":"2023-12-07T10:00:13.457455+0000","last_clean":"2023-12-07T10:00:13.457455+0000","last_became_active":"2023-12-07T09:59:56.247138+0000","last_became_peered":"2023-12-07T09:59:56.247138+0000","last_unstale":"2023-12-07T10:00:13.457455+0000","last_undegraded":"2023-12-07T10:00:13.457455+0000","last_fullsized":"2023-12-07T10:00:13.457455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:55.210586+0000","last_clean_scrub_stamp":"2023-12-07T09:59:55.210586+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:17.345414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.446754+0000","last_change":"2023-12-07T09:59:57.229840+0000","last_active":"2023-12-07T10:00:13.446754+0000","last_peered":"2023-12-07T10:00:13.446754+0000","last_clean":"2023-12-07T10:00:13.446754+0000","last_became_active":"2023-12-07T09:59:57.229062+0000","last_became_peered":"2023-12-07T09:59:57.229062+0000","last_unstale":"2023-12-07T10:00:13.446754+0000","last_undegraded":"2023-12-07T10:00:13.446754+0000","last_fullsized":"2023-12-07T10:00:13.446754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.494421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.508611+0000","last_change":"2023-12-07T10:00:13.454435+0000","last_active":"2023-12-07T10:00:14.508611+0000","last_peered":"2023-12-07T10:00:14.508611+0000","last_clean":"2023-12-07T10:00:14.508611+0000","last_became_active":"2023-12-07T10:00:13.454159+0000","last_became_peered":"2023-12-07T10:00:13.454159+0000","last_unstale":"2023-12-07T10:00:14.508611+0000","last_undegraded":"2023-12-07T10:00:14.508611+0000","last_fullsized":"2023-12-07T10:00:14.508611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:12.423786+0000","last_clean_scrub_stamp":"2023-12-07T10:00:12.423786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:15.065633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486489+0000","last_change":"2023-12-07T10:00:14.479855+0000","last_active":"2023-12-07T10:00:14.486489+0000","last_peered":"2023-12-07T10:00:14.486489+0000","last_clean":"2023-12-07T10:00:14.486489+0000","last_became_active":"2023-12-07T10:00:14.477718+0000","last_became_peered":"2023-12-07T10:00:14.477718+0000","last_unstale":"2023-12-07T10:00:14.486489+0000","last_undegraded":"2023-12-07T10:00:14.486489+0000","last_fullsized":"2023-12-07T10:00:14.486489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:16.068136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440476+0000","last_change":"2023-12-07T09:59:57.230613+0000","last_active":"2023-12-07T10:00:13.440476+0000","last_peered":"2023-12-07T10:00:13.440476+0000","last_clean":"2023-12-07T10:00:13.440476+0000","last_became_active":"2023-12-07T09:59:57.228342+0000","last_became_peered":"2023-12-07T09:59:57.228342+0000","last_unstale":"2023-12-07T10:00:13.440476+0000","last_undegraded":"2023-12-07T10:00:13.440476+0000","last_fullsized":"2023-12-07T10:00:13.440476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:56:59.552657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.478655+0000","last_change":"2023-12-07T10:00:14.472820+0000","last_active":"2023-12-07T10:00:14.478655+0000","last_peered":"2023-12-07T10:00:14.478655+0000","last_clean":"2023-12-07T10:00:14.478655+0000","last_became_active":"2023-12-07T10:00:14.472570+0000","last_became_peered":"2023-12-07T10:00:14.472570+0000","last_unstale":"2023-12-07T10:00:14.478655+0000","last_undegraded":"2023-12-07T10:00:14.478655+0000","last_fullsized":"2023-12-07T10:00:14.478655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:56:07.297854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.456737+0000","last_change":"2023-12-07T09:59:57.239542+0000","last_active":"2023-12-07T10:00:13.456737+0000","last_peered":"2023-12-07T10:00:13.456737+0000","last_clean":"2023-12-07T10:00:13.456737+0000","last_became_active":"2023-12-07T09:59:57.238943+0000","last_became_peered":"2023-12-07T09:59:57.238943+0000","last_unstale":"2023-12-07T10:00:13.456737+0000","last_undegraded":"2023-12-07T10:00:13.456737+0000","last_fullsized":"2023-12-07T10:00:13.456737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:36:31.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.483996+0000","last_change":"2023-12-07T10:00:14.475622+0000","last_active":"2023-12-07T10:00:14.483996+0000","last_peered":"2023-12-07T10:00:14.483996+0000","last_clean":"2023-12-07T10:00:14.483996+0000","last_became_active":"2023-12-07T10:00:14.475326+0000","last_became_peered":"2023-12-07T10:00:14.475326+0000","last_unstale":"2023-12-07T10:00:14.483996+0000","last_undegraded":"2023-12-07T10:00:14.483996+0000","last_fullsized":"2023-12-07T10:00:14.483996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:59:21.396770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.441515+0000","last_change":"2023-12-07T09:59:57.244392+0000","last_active":"2023-12-07T10:00:13.441515+0000","last_peered":"2023-12-07T10:00:13.441515+0000","last_clean":"2023-12-07T10:00:13.441515+0000","last_became_active":"2023-12-07T09:59:57.244056+0000","last_became_peered":"2023-12-07T09:59:57.244056+0000","last_unstale":"2023-12-07T10:00:13.441515+0000","last_undegraded":"2023-12-07T10:00:13.441515+0000","last_fullsized":"2023-12-07T10:00:13.441515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:38:54.354628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.497624+0000","last_change":"2023-12-07T10:00:14.492261+0000","last_active":"2023-12-07T10:00:14.497624+0000","last_peered":"2023-12-07T10:00:14.497624+0000","last_clean":"2023-12-07T10:00:14.497624+0000","last_became_active":"2023-12-07T10:00:14.491973+0000","last_became_peered":"2023-12-07T10:00:14.491973+0000","last_unstale":"2023-12-07T10:00:14.497624+0000","last_undegraded":"2023-12-07T10:00:14.497624+0000","last_fullsized":"2023-12-07T10:00:14.497624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:18.734440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438744+0000","last_change":"2023-12-07T09:59:57.236890+0000","last_active":"2023-12-07T10:00:13.438744+0000","last_peered":"2023-12-07T10:00:13.438744+0000","last_clean":"2023-12-07T10:00:13.438744+0000","last_became_active":"2023-12-07T09:59:57.236640+0000","last_became_peered":"2023-12-07T09:59:57.236640+0000","last_unstale":"2023-12-07T10:00:13.438744+0000","last_undegraded":"2023-12-07T10:00:13.438744+0000","last_fullsized":"2023-12-07T10:00:13.438744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.493369+0000","last_change":"2023-12-07T10:00:14.484279+0000","last_active":"2023-12-07T10:00:14.493369+0000","last_peered":"2023-12-07T10:00:14.493369+0000","last_clean":"2023-12-07T10:00:14.493369+0000","last_became_active":"2023-12-07T10:00:14.484004+0000","last_became_peered":"2023-12-07T10:00:14.484004+0000","last_unstale":"2023-12-07T10:00:14.493369+0000","last_undegraded":"2023-12-07T10:00:14.493369+0000","last_fullsized":"2023-12-07T10:00:14.493369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:53.104386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448441+0000","last_change":"2023-12-07T09:59:57.227268+0000","last_active":"2023-12-07T10:00:13.448441+0000","last_peered":"2023-12-07T10:00:13.448441+0000","last_clean":"2023-12-07T10:00:13.448441+0000","last_became_active":"2023-12-07T09:59:57.226493+0000","last_became_peered":"2023-12-07T09:59:57.226493+0000","last_unstale":"2023-12-07T10:00:13.448441+0000","last_undegraded":"2023-12-07T10:00:13.448441+0000","last_fullsized":"2023-12-07T10:00:13.448441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.478742+0000","last_change":"2023-12-07T10:00:14.473632+0000","last_active":"2023-12-07T10:00:14.478742+0000","last_peered":"2023-12-07T10:00:14.478742+0000","last_clean":"2023-12-07T10:00:14.478742+0000","last_became_active":"2023-12-07T10:00:14.473177+0000","last_became_peered":"2023-12-07T10:00:14.473177+0000","last_unstale":"2023-12-07T10:00:14.478742+0000","last_undegraded":"2023-12-07T10:00:14.478742+0000","last_fullsized":"2023-12-07T10:00:14.478742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:05.417730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448322+0000","last_change":"2023-12-07T09:59:57.245295+0000","last_active":"2023-12-07T10:00:13.448322+0000","last_peered":"2023-12-07T10:00:13.448322+0000","last_clean":"2023-12-07T10:00:13.448322+0000","last_became_active":"2023-12-07T09:59:57.245030+0000","last_became_peered":"2023-12-07T09:59:57.245030+0000","last_unstale":"2023-12-07T10:00:13.448322+0000","last_undegraded":"2023-12-07T10:00:13.448322+0000","last_fullsized":"2023-12-07T10:00:13.448322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:39.530300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488446+0000","last_change":"2023-12-07T10:00:14.486125+0000","last_active":"2023-12-07T10:00:14.488446+0000","last_peered":"2023-12-07T10:00:14.488446+0000","last_clean":"2023-12-07T10:00:14.488446+0000","last_became_active":"2023-12-07T10:00:14.485834+0000","last_became_peered":"2023-12-07T10:00:14.485834+0000","last_unstale":"2023-12-07T10:00:14.488446+0000","last_undegraded":"2023-12-07T10:00:14.488446+0000","last_fullsized":"2023-12-07T10:00:14.488446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:42:49.869369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460701+0000","last_change":"2023-12-07T09:59:57.228494+0000","last_active":"2023-12-07T10:00:13.460701+0000","last_peered":"2023-12-07T10:00:13.460701+0000","last_clean":"2023-12-07T10:00:13.460701+0000","last_became_active":"2023-12-07T09:59:57.228210+0000","last_became_peered":"2023-12-07T09:59:57.228210+0000","last_unstale":"2023-12-07T10:00:13.460701+0000","last_undegraded":"2023-12-07T10:00:13.460701+0000","last_fullsized":"2023-12-07T10:00:13.460701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:58.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486689+0000","last_change":"2023-12-07T10:00:14.481540+0000","last_active":"2023-12-07T10:00:14.486689+0000","last_peered":"2023-12-07T10:00:14.486689+0000","last_clean":"2023-12-07T10:00:14.486689+0000","last_became_active":"2023-12-07T10:00:14.480908+0000","last_became_peered":"2023-12-07T10:00:14.480908+0000","last_unstale":"2023-12-07T10:00:14.486689+0000","last_undegraded":"2023-12-07T10:00:14.486689+0000","last_fullsized":"2023-12-07T10:00:14.486689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:02:32.023383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448625+0000","last_change":"2023-12-07T09:59:57.235369+0000","last_active":"2023-12-07T10:00:13.448625+0000","last_peered":"2023-12-07T10:00:13.448625+0000","last_clean":"2023-12-07T10:00:13.448625+0000","last_became_active":"2023-12-07T09:59:57.235129+0000","last_became_peered":"2023-12-07T09:59:57.235129+0000","last_unstale":"2023-12-07T10:00:13.448625+0000","last_undegraded":"2023-12-07T10:00:13.448625+0000","last_fullsized":"2023-12-07T10:00:13.448625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492192+0000","last_change":"2023-12-07T10:00:14.480300+0000","last_active":"2023-12-07T10:00:14.492192+0000","last_peered":"2023-12-07T10:00:14.492192+0000","last_clean":"2023-12-07T10:00:14.492192+0000","last_became_active":"2023-12-07T10:00:14.479868+0000","last_became_peered":"2023-12-07T10:00:14.479868+0000","last_unstale":"2023-12-07T10:00:14.492192+0000","last_undegraded":"2023-12-07T10:00:14.492192+0000","last_fullsized":"2023-12-07T10:00:14.492192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:24.264647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448402+0000","last_change":"2023-12-07T09:59:57.223628+0000","last_active":"2023-12-07T10:00:13.448402+0000","last_peered":"2023-12-07T10:00:13.448402+0000","last_clean":"2023-12-07T10:00:13.448402+0000","last_became_active":"2023-12-07T09:59:57.223315+0000","last_became_peered":"2023-12-07T09:59:57.223315+0000","last_unstale":"2023-12-07T10:00:13.448402+0000","last_undegraded":"2023-12-07T10:00:13.448402+0000","last_fullsized":"2023-12-07T10:00:13.448402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:40.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.471043+0000","last_change":"2023-12-07T10:00:14.469384+0000","last_active":"2023-12-07T10:00:14.471043+0000","last_peered":"2023-12-07T10:00:14.471043+0000","last_clean":"2023-12-07T10:00:14.471043+0000","last_became_active":"2023-12-07T10:00:14.469031+0000","last_became_peered":"2023-12-07T10:00:14.469031+0000","last_unstale":"2023-12-07T10:00:14.471043+0000","last_undegraded":"2023-12-07T10:00:14.471043+0000","last_fullsized":"2023-12-07T10:00:14.471043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:39:05.174152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.445073+0000","last_change":"2023-12-07T09:59:57.230638+0000","last_active":"2023-12-07T10:00:13.445073+0000","last_peered":"2023-12-07T10:00:13.445073+0000","last_clean":"2023-12-07T10:00:13.445073+0000","last_became_active":"2023-12-07T09:59:57.230319+0000","last_became_peered":"2023-12-07T09:59:57.230319+0000","last_unstale":"2023-12-07T10:00:13.445073+0000","last_undegraded":"2023-12-07T10:00:13.445073+0000","last_fullsized":"2023-12-07T10:00:13.445073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.487245+0000","last_change":"2023-12-07T10:00:14.477873+0000","last_active":"2023-12-07T10:00:14.487245+0000","last_peered":"2023-12-07T10:00:14.487245+0000","last_clean":"2023-12-07T10:00:14.487245+0000","last_became_active":"2023-12-07T10:00:14.469283+0000","last_became_peered":"2023-12-07T10:00:14.469283+0000","last_unstale":"2023-12-07T10:00:14.487245+0000","last_undegraded":"2023-12-07T10:00:14.487245+0000","last_fullsized":"2023-12-07T10:00:14.487245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:19.999369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438115+0000","last_change":"2023-12-07T09:59:57.237863+0000","last_active":"2023-12-07T10:00:13.438115+0000","last_peered":"2023-12-07T10:00:13.438115+0000","last_clean":"2023-12-07T10:00:13.438115+0000","last_became_active":"2023-12-07T09:59:57.237612+0000","last_became_peered":"2023-12-07T09:59:57.237612+0000","last_unstale":"2023-12-07T10:00:13.438115+0000","last_undegraded":"2023-12-07T10:00:13.438115+0000","last_fullsized":"2023-12-07T10:00:13.438115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:20.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.484937+0000","last_change":"2023-12-07T10:00:14.477321+0000","last_active":"2023-12-07T10:00:14.484937+0000","last_peered":"2023-12-07T10:00:14.484937+0000","last_clean":"2023-12-07T10:00:14.484937+0000","last_became_active":"2023-12-07T10:00:14.476962+0000","last_became_peered":"2023-12-07T10:00:14.476962+0000","last_unstale":"2023-12-07T10:00:14.484937+0000","last_undegraded":"2023-12-07T10:00:14.484937+0000","last_fullsized":"2023-12-07T10:00:14.484937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:24.264647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.438638+0000","last_change":"2023-12-07T09:59:57.229394+0000","last_active":"2023-12-07T10:00:13.438638+0000","last_peered":"2023-12-07T10:00:13.438638+0000","last_clean":"2023-12-07T10:00:13.438638+0000","last_became_active":"2023-12-07T09:59:57.229071+0000","last_became_peered":"2023-12-07T09:59:57.229071+0000","last_unstale":"2023-12-07T10:00:13.438638+0000","last_undegraded":"2023-12-07T10:00:13.438638+0000","last_fullsized":"2023-12-07T10:00:13.438638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.493365+0000","last_change":"2023-12-07T10:00:14.492399+0000","last_active":"2023-12-07T10:00:14.493365+0000","last_peered":"2023-12-07T10:00:14.493365+0000","last_clean":"2023-12-07T10:00:14.493365+0000","last_became_active":"2023-12-07T10:00:14.492179+0000","last_became_peered":"2023-12-07T10:00:14.492179+0000","last_unstale":"2023-12-07T10:00:14.493365+0000","last_undegraded":"2023-12-07T10:00:14.493365+0000","last_fullsized":"2023-12-07T10:00:14.493365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:37:05.508848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434817+0000","last_change":"2023-12-07T09:59:57.224514+0000","last_active":"2023-12-07T10:00:13.434817+0000","last_peered":"2023-12-07T10:00:13.434817+0000","last_clean":"2023-12-07T10:00:13.434817+0000","last_became_active":"2023-12-07T09:59:57.223056+0000","last_became_peered":"2023-12-07T09:59:57.223056+0000","last_unstale":"2023-12-07T10:00:13.434817+0000","last_undegraded":"2023-12-07T10:00:13.434817+0000","last_fullsized":"2023-12-07T10:00:13.434817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:38:12.564625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486620+0000","last_change":"2023-12-07T10:00:14.481429+0000","last_active":"2023-12-07T10:00:14.486620+0000","last_peered":"2023-12-07T10:00:14.486620+0000","last_clean":"2023-12-07T10:00:14.486620+0000","last_became_active":"2023-12-07T10:00:14.480469+0000","last_became_peered":"2023-12-07T10:00:14.480469+0000","last_unstale":"2023-12-07T10:00:14.486620+0000","last_undegraded":"2023-12-07T10:00:14.486620+0000","last_fullsized":"2023-12-07T10:00:14.486620+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:54:14.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457993+0000","last_change":"2023-12-07T09:59:57.237336+0000","last_active":"2023-12-07T10:00:13.457993+0000","last_peered":"2023-12-07T10:00:13.457993+0000","last_clean":"2023-12-07T10:00:13.457993+0000","last_became_active":"2023-12-07T09:59:57.237105+0000","last_became_peered":"2023-12-07T09:59:57.237105+0000","last_unstale":"2023-12-07T10:00:13.457993+0000","last_undegraded":"2023-12-07T10:00:13.457993+0000","last_fullsized":"2023-12-07T10:00:13.457993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:37:42.512216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496665+0000","last_change":"2023-12-07T10:00:14.488708+0000","last_active":"2023-12-07T10:00:14.496665+0000","last_peered":"2023-12-07T10:00:14.496665+0000","last_clean":"2023-12-07T10:00:14.496665+0000","last_became_active":"2023-12-07T10:00:14.486360+0000","last_became_peered":"2023-12-07T10:00:14.486360+0000","last_unstale":"2023-12-07T10:00:14.496665+0000","last_undegraded":"2023-12-07T10:00:14.496665+0000","last_fullsized":"2023-12-07T10:00:14.496665+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:22.561858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460613+0000","last_change":"2023-12-07T09:59:57.239271+0000","last_active":"2023-12-07T10:00:13.460613+0000","last_peered":"2023-12-07T10:00:13.460613+0000","last_clean":"2023-12-07T10:00:13.460613+0000","last_became_active":"2023-12-07T09:59:57.238981+0000","last_became_peered":"2023-12-07T09:59:57.238981+0000","last_unstale":"2023-12-07T10:00:13.460613+0000","last_undegraded":"2023-12-07T10:00:13.460613+0000","last_fullsized":"2023-12-07T10:00:13.460613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:36:48.300066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492076+0000","last_change":"2023-12-07T10:00:14.489659+0000","last_active":"2023-12-07T10:00:14.492076+0000","last_peered":"2023-12-07T10:00:14.492076+0000","last_clean":"2023-12-07T10:00:14.492076+0000","last_became_active":"2023-12-07T10:00:14.489379+0000","last_became_peered":"2023-12-07T10:00:14.489379+0000","last_unstale":"2023-12-07T10:00:14.492076+0000","last_undegraded":"2023-12-07T10:00:14.492076+0000","last_fullsized":"2023-12-07T10:00:14.492076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:43.457812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.442648+0000","last_change":"2023-12-07T09:59:57.245997+0000","last_active":"2023-12-07T10:00:13.442648+0000","last_peered":"2023-12-07T10:00:13.442648+0000","last_clean":"2023-12-07T10:00:13.442648+0000","last_became_active":"2023-12-07T09:59:57.244225+0000","last_became_peered":"2023-12-07T09:59:57.244225+0000","last_unstale":"2023-12-07T10:00:13.442648+0000","last_undegraded":"2023-12-07T10:00:13.442648+0000","last_fullsized":"2023-12-07T10:00:13.442648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496313+0000","last_change":"2023-12-07T10:00:14.490134+0000","last_active":"2023-12-07T10:00:14.496313+0000","last_peered":"2023-12-07T10:00:14.496313+0000","last_clean":"2023-12-07T10:00:14.496313+0000","last_became_active":"2023-12-07T10:00:14.489893+0000","last_became_peered":"2023-12-07T10:00:14.489893+0000","last_unstale":"2023-12-07T10:00:14.496313+0000","last_undegraded":"2023-12-07T10:00:14.496313+0000","last_fullsized":"2023-12-07T10:00:14.496313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:02:03.948567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440835+0000","last_change":"2023-12-07T09:59:57.238463+0000","last_active":"2023-12-07T10:00:13.440835+0000","last_peered":"2023-12-07T10:00:13.440835+0000","last_clean":"2023-12-07T10:00:13.440835+0000","last_became_active":"2023-12-07T09:59:57.238172+0000","last_became_peered":"2023-12-07T09:59:57.238172+0000","last_unstale":"2023-12-07T10:00:13.440835+0000","last_undegraded":"2023-12-07T10:00:13.440835+0000","last_fullsized":"2023-12-07T10:00:13.440835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:38.494509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492478+0000","last_change":"2023-12-07T10:00:14.484734+0000","last_active":"2023-12-07T10:00:14.492478+0000","last_peered":"2023-12-07T10:00:14.492478+0000","last_clean":"2023-12-07T10:00:14.492478+0000","last_became_active":"2023-12-07T10:00:14.484416+0000","last_became_peered":"2023-12-07T10:00:14.484416+0000","last_unstale":"2023-12-07T10:00:14.492478+0000","last_undegraded":"2023-12-07T10:00:14.492478+0000","last_fullsized":"2023-12-07T10:00:14.492478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:05:37.726795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448566+0000","last_change":"2023-12-07T09:59:57.242046+0000","last_active":"2023-12-07T10:00:13.448566+0000","last_peered":"2023-12-07T10:00:13.448566+0000","last_clean":"2023-12-07T10:00:13.448566+0000","last_became_active":"2023-12-07T09:59:57.241392+0000","last_became_peered":"2023-12-07T09:59:57.241392+0000","last_unstale":"2023-12-07T10:00:13.448566+0000","last_undegraded":"2023-12-07T10:00:13.448566+0000","last_fullsized":"2023-12-07T10:00:13.448566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488218+0000","last_change":"2023-12-07T10:00:14.477152+0000","last_active":"2023-12-07T10:00:14.488218+0000","last_peered":"2023-12-07T10:00:14.488218+0000","last_clean":"2023-12-07T10:00:14.488218+0000","last_became_active":"2023-12-07T10:00:14.476852+0000","last_became_peered":"2023-12-07T10:00:14.476852+0000","last_unstale":"2023-12-07T10:00:14.488218+0000","last_undegraded":"2023-12-07T10:00:14.488218+0000","last_fullsized":"2023-12-07T10:00:14.488218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:30:56.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457957+0000","last_change":"2023-12-07T09:59:57.227431+0000","last_active":"2023-12-07T10:00:13.457957+0000","last_peered":"2023-12-07T10:00:13.457957+0000","last_clean":"2023-12-07T10:00:13.457957+0000","last_became_active":"2023-12-07T09:59:57.226781+0000","last_became_peered":"2023-12-07T09:59:57.226781+0000","last_unstale":"2023-12-07T10:00:13.457957+0000","last_undegraded":"2023-12-07T10:00:13.457957+0000","last_fullsized":"2023-12-07T10:00:13.457957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.486540+0000","last_change":"2023-12-07T10:00:14.482028+0000","last_active":"2023-12-07T10:00:14.486540+0000","last_peered":"2023-12-07T10:00:14.486540+0000","last_clean":"2023-12-07T10:00:14.486540+0000","last_became_active":"2023-12-07T10:00:14.481500+0000","last_became_peered":"2023-12-07T10:00:14.481500+0000","last_unstale":"2023-12-07T10:00:14.486540+0000","last_undegraded":"2023-12-07T10:00:14.486540+0000","last_fullsized":"2023-12-07T10:00:14.486540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:12:59.308161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434585+0000","last_change":"2023-12-07T09:59:57.241629+0000","last_active":"2023-12-07T10:00:13.434585+0000","last_peered":"2023-12-07T10:00:13.434585+0000","last_clean":"2023-12-07T10:00:13.434585+0000","last_became_active":"2023-12-07T09:59:57.238255+0000","last_became_peered":"2023-12-07T09:59:57.238255+0000","last_unstale":"2023-12-07T10:00:13.434585+0000","last_undegraded":"2023-12-07T10:00:13.434585+0000","last_fullsized":"2023-12-07T10:00:13.434585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:23:31.673878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496200+0000","last_change":"2023-12-07T10:00:14.486162+0000","last_active":"2023-12-07T10:00:14.496200+0000","last_peered":"2023-12-07T10:00:14.496200+0000","last_clean":"2023-12-07T10:00:14.496200+0000","last_became_active":"2023-12-07T10:00:14.485829+0000","last_became_peered":"2023-12-07T10:00:14.485829+0000","last_unstale":"2023-12-07T10:00:14.496200+0000","last_undegraded":"2023-12-07T10:00:14.496200+0000","last_fullsized":"2023-12-07T10:00:14.496200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:02:32.023383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448389+0000","last_change":"2023-12-07T09:59:57.227453+0000","last_active":"2023-12-07T10:00:13.448389+0000","last_peered":"2023-12-07T10:00:13.448389+0000","last_clean":"2023-12-07T10:00:13.448389+0000","last_became_active":"2023-12-07T09:59:57.226914+0000","last_became_peered":"2023-12-07T09:59:57.226914+0000","last_unstale":"2023-12-07T10:00:13.448389+0000","last_undegraded":"2023-12-07T10:00:13.448389+0000","last_fullsized":"2023-12-07T10:00:13.448389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:34:09.857958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496341+0000","last_change":"2023-12-07T10:00:14.491384+0000","last_active":"2023-12-07T10:00:14.496341+0000","last_peered":"2023-12-07T10:00:14.496341+0000","last_clean":"2023-12-07T10:00:14.496341+0000","last_became_active":"2023-12-07T10:00:14.491029+0000","last_became_peered":"2023-12-07T10:00:14.491029+0000","last_unstale":"2023-12-07T10:00:14.496341+0000","last_undegraded":"2023-12-07T10:00:14.496341+0000","last_fullsized":"2023-12-07T10:00:14.496341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:13:41.270895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.443588+0000","last_change":"2023-12-07T09:59:57.242828+0000","last_active":"2023-12-07T10:00:13.443588+0000","last_peered":"2023-12-07T10:00:13.443588+0000","last_clean":"2023-12-07T10:00:13.443588+0000","last_became_active":"2023-12-07T09:59:57.242554+0000","last_became_peered":"2023-12-07T09:59:57.242554+0000","last_unstale":"2023-12-07T10:00:13.443588+0000","last_undegraded":"2023-12-07T10:00:13.443588+0000","last_fullsized":"2023-12-07T10:00:13.443588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496369+0000","last_change":"2023-12-07T10:00:14.494261+0000","last_active":"2023-12-07T10:00:14.496369+0000","last_peered":"2023-12-07T10:00:14.496369+0000","last_clean":"2023-12-07T10:00:14.496369+0000","last_became_active":"2023-12-07T10:00:14.493999+0000","last_became_peered":"2023-12-07T10:00:14.493999+0000","last_unstale":"2023-12-07T10:00:14.496369+0000","last_undegraded":"2023-12-07T10:00:14.496369+0000","last_fullsized":"2023-12-07T10:00:14.496369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:01.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.448384+0000","last_change":"2023-12-07T09:59:57.236999+0000","last_active":"2023-12-07T10:00:13.448384+0000","last_peered":"2023-12-07T10:00:13.448384+0000","last_clean":"2023-12-07T10:00:13.448384+0000","last_became_active":"2023-12-07T09:59:57.236732+0000","last_became_peered":"2023-12-07T09:59:57.236732+0000","last_unstale":"2023-12-07T10:00:13.448384+0000","last_undegraded":"2023-12-07T10:00:13.448384+0000","last_fullsized":"2023-12-07T10:00:13.448384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.492212+0000","last_change":"2023-12-07T10:00:14.481144+0000","last_active":"2023-12-07T10:00:14.492212+0000","last_peered":"2023-12-07T10:00:14.492212+0000","last_clean":"2023-12-07T10:00:14.492212+0000","last_became_active":"2023-12-07T10:00:14.480887+0000","last_became_peered":"2023-12-07T10:00:14.480887+0000","last_unstale":"2023-12-07T10:00:14.492212+0000","last_undegraded":"2023-12-07T10:00:14.492212+0000","last_fullsized":"2023-12-07T10:00:14.492212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:56:07.297854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.439261+0000","last_change":"2023-12-07T09:59:57.238932+0000","last_active":"2023-12-07T10:00:13.439261+0000","last_peered":"2023-12-07T10:00:13.439261+0000","last_clean":"2023-12-07T10:00:13.439261+0000","last_became_active":"2023-12-07T09:59:57.238605+0000","last_became_peered":"2023-12-07T09:59:57.238605+0000","last_unstale":"2023-12-07T10:00:13.439261+0000","last_undegraded":"2023-12-07T10:00:13.439261+0000","last_fullsized":"2023-12-07T10:00:13.439261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:27:02.790587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.468973+0000","last_change":"2023-12-07T10:00:14.465799+0000","last_active":"2023-12-07T10:00:14.468973+0000","last_peered":"2023-12-07T10:00:14.468973+0000","last_clean":"2023-12-07T10:00:14.468973+0000","last_became_active":"2023-12-07T10:00:14.465461+0000","last_became_peered":"2023-12-07T10:00:14.465461+0000","last_unstale":"2023-12-07T10:00:14.468973+0000","last_undegraded":"2023-12-07T10:00:14.468973+0000","last_fullsized":"2023-12-07T10:00:14.468973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:26.742979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440396+0000","last_change":"2023-12-07T09:59:57.230825+0000","last_active":"2023-12-07T10:00:13.440396+0000","last_peered":"2023-12-07T10:00:13.440396+0000","last_clean":"2023-12-07T10:00:13.440396+0000","last_became_active":"2023-12-07T09:59:57.230278+0000","last_became_peered":"2023-12-07T09:59:57.230278+0000","last_unstale":"2023-12-07T10:00:13.440396+0000","last_undegraded":"2023-12-07T10:00:13.440396+0000","last_fullsized":"2023-12-07T10:00:13.440396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:49:26.249030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.488376+0000","last_change":"2023-12-07T10:00:14.483469+0000","last_active":"2023-12-07T10:00:14.488376+0000","last_peered":"2023-12-07T10:00:14.488376+0000","last_clean":"2023-12-07T10:00:14.488376+0000","last_became_active":"2023-12-07T10:00:14.483210+0000","last_became_peered":"2023-12-07T10:00:14.483210+0000","last_unstale":"2023-12-07T10:00:14.488376+0000","last_undegraded":"2023-12-07T10:00:14.488376+0000","last_fullsized":"2023-12-07T10:00:14.488376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:27.780070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.440944+0000","last_change":"2023-12-07T09:59:57.246474+0000","last_active":"2023-12-07T10:00:13.440944+0000","last_peered":"2023-12-07T10:00:13.440944+0000","last_clean":"2023-12-07T10:00:13.440944+0000","last_became_active":"2023-12-07T09:59:57.246185+0000","last_became_peered":"2023-12-07T09:59:57.246185+0000","last_unstale":"2023-12-07T10:00:13.440944+0000","last_undegraded":"2023-12-07T10:00:13.440944+0000","last_fullsized":"2023-12-07T10:00:13.440944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:55:50.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.494337+0000","last_change":"2023-12-07T10:00:14.483173+0000","last_active":"2023-12-07T10:00:14.494337+0000","last_peered":"2023-12-07T10:00:14.494337+0000","last_clean":"2023-12-07T10:00:14.494337+0000","last_became_active":"2023-12-07T10:00:14.482704+0000","last_became_peered":"2023-12-07T10:00:14.482704+0000","last_unstale":"2023-12-07T10:00:14.494337+0000","last_undegraded":"2023-12-07T10:00:14.494337+0000","last_fullsized":"2023-12-07T10:00:14.494337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:14:25.380801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457873+0000","last_change":"2023-12-07T09:59:57.233976+0000","last_active":"2023-12-07T10:00:13.457873+0000","last_peered":"2023-12-07T10:00:13.457873+0000","last_clean":"2023-12-07T10:00:13.457873+0000","last_became_active":"2023-12-07T09:59:57.233707+0000","last_became_peered":"2023-12-07T09:59:57.233707+0000","last_unstale":"2023-12-07T10:00:13.457873+0000","last_undegraded":"2023-12-07T10:00:13.457873+0000","last_fullsized":"2023-12-07T10:00:13.457873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:14:07.055865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.479762+0000","last_change":"2023-12-07T10:00:14.472549+0000","last_active":"2023-12-07T10:00:14.479762+0000","last_peered":"2023-12-07T10:00:14.479762+0000","last_clean":"2023-12-07T10:00:14.479762+0000","last_became_active":"2023-12-07T10:00:14.472239+0000","last_became_peered":"2023-12-07T10:00:14.472239+0000","last_unstale":"2023-12-07T10:00:14.479762+0000","last_undegraded":"2023-12-07T10:00:14.479762+0000","last_fullsized":"2023-12-07T10:00:14.479762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:01.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.434579+0000","last_change":"2023-12-07T09:59:57.236855+0000","last_active":"2023-12-07T10:00:13.434579+0000","last_peered":"2023-12-07T10:00:13.434579+0000","last_clean":"2023-12-07T10:00:13.434579+0000","last_became_active":"2023-12-07T09:59:57.236380+0000","last_became_peered":"2023-12-07T09:59:57.236380+0000","last_unstale":"2023-12-07T10:00:13.434579+0000","last_undegraded":"2023-12-07T10:00:13.434579+0000","last_fullsized":"2023-12-07T10:00:13.434579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:18:14.300474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.491359+0000","last_change":"2023-12-07T10:00:14.490226+0000","last_active":"2023-12-07T10:00:14.491359+0000","last_peered":"2023-12-07T10:00:14.491359+0000","last_clean":"2023-12-07T10:00:14.491359+0000","last_became_active":"2023-12-07T10:00:14.489966+0000","last_became_peered":"2023-12-07T10:00:14.489966+0000","last_unstale":"2023-12-07T10:00:14.491359+0000","last_undegraded":"2023-12-07T10:00:14.491359+0000","last_fullsized":"2023-12-07T10:00:14.491359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:45:13.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.447886+0000","last_change":"2023-12-07T09:59:57.243320+0000","last_active":"2023-12-07T10:00:13.447886+0000","last_peered":"2023-12-07T10:00:13.447886+0000","last_clean":"2023-12-07T10:00:13.447886+0000","last_became_active":"2023-12-07T09:59:57.243117+0000","last_became_peered":"2023-12-07T09:59:57.243117+0000","last_unstale":"2023-12-07T10:00:13.447886+0000","last_undegraded":"2023-12-07T10:00:13.447886+0000","last_fullsized":"2023-12-07T10:00:13.447886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:00:35.895604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.487296+0000","last_change":"2023-12-07T10:00:14.481119+0000","last_active":"2023-12-07T10:00:14.487296+0000","last_peered":"2023-12-07T10:00:14.487296+0000","last_clean":"2023-12-07T10:00:14.487296+0000","last_became_active":"2023-12-07T10:00:14.480840+0000","last_became_peered":"2023-12-07T10:00:14.480840+0000","last_unstale":"2023-12-07T10:00:14.487296+0000","last_undegraded":"2023-12-07T10:00:14.487296+0000","last_fullsized":"2023-12-07T10:00:14.487296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:50.063311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.449905+0000","last_change":"2023-12-07T09:59:57.238691+0000","last_active":"2023-12-07T10:00:13.449905+0000","last_peered":"2023-12-07T10:00:13.449905+0000","last_clean":"2023-12-07T10:00:13.449905+0000","last_became_active":"2023-12-07T09:59:57.238414+0000","last_became_peered":"2023-12-07T09:59:57.238414+0000","last_unstale":"2023-12-07T10:00:13.449905+0000","last_undegraded":"2023-12-07T10:00:13.449905+0000","last_fullsized":"2023-12-07T10:00:13.449905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:39:48.208948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.496151+0000","last_change":"2023-12-07T10:00:14.487267+0000","last_active":"2023-12-07T10:00:14.496151+0000","last_peered":"2023-12-07T10:00:14.496151+0000","last_clean":"2023-12-07T10:00:14.496151+0000","last_became_active":"2023-12-07T10:00:14.480078+0000","last_became_peered":"2023-12-07T10:00:14.480078+0000","last_unstale":"2023-12-07T10:00:14.496151+0000","last_undegraded":"2023-12-07T10:00:14.496151+0000","last_fullsized":"2023-12-07T10:00:14.496151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:16.068136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.460536+0000","last_change":"2023-12-07T09:59:57.229817+0000","last_active":"2023-12-07T10:00:13.460536+0000","last_peered":"2023-12-07T10:00:13.460536+0000","last_clean":"2023-12-07T10:00:13.460536+0000","last_became_active":"2023-12-07T09:59:57.229526+0000","last_became_peered":"2023-12-07T09:59:57.229526+0000","last_unstale":"2023-12-07T10:00:13.460536+0000","last_undegraded":"2023-12-07T10:00:13.460536+0000","last_fullsized":"2023-12-07T10:00:13.460536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:15:58.859354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-07T10:00:14.489939+0000","last_change":"2023-12-07T10:00:14.487431+0000","last_active":"2023-12-07T10:00:14.489939+0000","last_peered":"2023-12-07T10:00:14.489939+0000","last_clean":"2023-12-07T10:00:14.489939+0000","last_became_active":"2023-12-07T10:00:14.487037+0000","last_became_peered":"2023-12-07T10:00:14.487037+0000","last_unstale":"2023-12-07T10:00:14.489939+0000","last_undegraded":"2023-12-07T10:00:14.489939+0000","last_fullsized":"2023-12-07T10:00:14.489939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:13.426289+0000","last_clean_scrub_stamp":"2023-12-07T10:00:13.426289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:15.880384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T10:00:13.457252+0000","last_change":"2023-12-07T09:59:57.243490+0000","last_active":"2023-12-07T10:00:13.457252+0000","last_peered":"2023-12-07T10:00:13.457252+0000","last_clean":"2023-12-07T10:00:13.457252+0000","last_became_active":"2023-12-07T09:59:57.242850+0000","last_became_peered":"2023-12-07T09:59:57.242850+0000","last_unstale":"2023-12-07T10:00:13.457252+0000","last_undegraded":"2023-12-07T10:00:13.457252+0000","last_fullsized":"2023-12-07T10:00:13.457252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:56.217507+0000","last_clean_scrub_stamp":"2023-12-07T09:59:56.217507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:08:09.949361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":746076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.81200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":156816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.5},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.623},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.437}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":148567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.434},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.63},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.628},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.52200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":159295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.516,"5min":5.516,"15min":5.516},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.374},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.752},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.5030000000000001,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.468,"5min":3.468,"15min":3.468},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":157232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":13.016,"5min":13.016,"15min":13.016},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":13.166,"5min":13.166,"15min":13.166},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.1690000000000005,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.0809999999999995,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.7680000000000007,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":5.75,"5min":5.75,"15min":5.75},"last":0.746}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7050000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":158727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.37},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.439}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":745930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.434},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.498}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:18.945 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T10:00:18.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-07T10:00:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a4079640 1 Processor -- start 2023-12-07T10:00:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a4079640 1 -- start start 2023-12-07T10:00:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a4079640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f109c1561d0 0x7f109c0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a4079640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c071020 con 0x7f109c070760 2023-12-07T10:00:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a4079640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c071300 con 0x7f109c158ff0 2023-12-07T10:00:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a4079640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c0715e0 con 0x7f109c1561d0 2023-12-07T10:00:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a1614640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f109c070760 0x7f109c06d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55380/0 (socket says 172.21.15.89:55380) 2023-12-07T10:00:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a1614640 1 -- 172.21.15.89:0/1260857302 learned_addr learned my addr 172.21.15.89:0/1260857302 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a1e15640 1 --2- 172.21.15.89:0/1260857302 >> v2:172.21.15.97:3300/0 conn(0x7f109c1561d0 0x7f109c0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891772962 0 0) 0x7f109c071020 con 0x7f109c070760 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1088003530 con 0x7f109c070760 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2147889485 0 0) 0x7f1088003530 con 0x7f109c070760 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 >> v2:172.21.15.97:3300/0 conn(0x7f109c1561d0 msgr2=0x7f109c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 --2- 172.21.15.89:0/1260857302 >> v2:172.21.15.97:3300/0 conn(0x7f109c1561d0 0x7f109c0701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 >> v1:172.21.15.97:6789/0 conn(0x7f109c158ff0 legacy=0x7f109c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0718c0 con 0x7f109c070760 2023-12-07T10:00:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f108c001680 con 0x7f109c070760 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 >> v1:172.21.15.89:6789/0 conn(0x7f109c070760 legacy=0x7f109c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1088003980 0x7f1088003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10880047d0 0x7f1088004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f108800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0715e0 con 0x7f1088005190 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108800c130 con 0x7f1088003980 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108800c2f0 con 0x7f10880047d0 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a2616640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f108800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a1e15640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1088003980 0x7f1088003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a1614640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10880047d0 0x7f1088004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a2616640 1 -- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10880047d0 msgr2=0x7f1088004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a2616640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10880047d0 0x7f1088004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a2616640 1 -- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1088003980 msgr2=0x7f1088003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a2616640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1088003980 0x7f1088003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.117+0000 7f10a2616640 1 -- 172.21.15.89:0/1260857302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088003530 con 0x7f1088005190 2023-12-07T10:00:19.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a2616640 1 -- 172.21.15.89:0/1260857302 reap_dead start 2023-12-07T10:00:19.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a2616640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f108800b990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1094001e70 tx=0x7f109401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e95e1ac49d04b74 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094003b80 con 0x7f1088005190 2023-12-07T10:00:19.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1094003d00 con 0x7f1088005190 2023-12-07T10:00:19.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a0e13640 1 -- 172.21.15.89:0/1260857302 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094005310 con 0x7f1088005190 2023-12-07T10:00:19.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 -- 172.21.15.89:0/1260857302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 msgr2=0x7f108800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f108800b990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1094001e70 tx=0x7f109401c760 comp rx=0 tx=0).stop 2023-12-07T10:00:19.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 -- 172.21.15.89:0/1260857302 shutdown_connections 2023-12-07T10:00:19.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 --2- 172.21.15.89:0/1260857302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f108800b990 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 -- 172.21.15.89:0/1260857302 >> 172.21.15.89:0/1260857302 conn(0x7f109c0c2a60 msgr2=0x7f109c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:19.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 -- 172.21.15.89:0/1260857302 shutdown_connections 2023-12-07T10:00:19.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.121+0000 7f10a4079640 1 -- 172.21.15.89:0/1260857302 wait complete. 2023-12-07T10:00:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 Processor -- start 2023-12-07T10:00:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 -- start start 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f109c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f109c159df0 0x7f109c15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f109c0c3b10 0x7f109c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c15c450 con 0x7f1088005190 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c15be70 con 0x7f109c159df0 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c15ce20 con 0x7f109c0c3b10 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f109c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f109c15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57082/0 (socket says 172.21.15.89:57082) 2023-12-07T10:00:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 -- 172.21.15.89:0/775021968 learned_addr learned my addr 172.21.15.89:0/775021968 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a2616640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f109c0c3b10 0x7f109c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1614640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f109c159df0 0x7f109c15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 -- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f109c0c3b10 msgr2=0x7f109c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f109c0c3b10 0x7f109c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 -- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f109c159df0 msgr2=0x7f109c15c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f109c159df0 0x7f109c15c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 -- 172.21.15.89:0/775021968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c1523f0 con 0x7f1088005190 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a1e15640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f109c15a4b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1098011990 tx=0x7f1098011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109800fad0 con 0x7f1088005190 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109800fc30 con 0x7f1088005190 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098014440 con 0x7f1088005190 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c1526d0 con 0x7f1088005190 2023-12-07T10:00:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.125+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c15b660 con 0x7f1088005190 2023-12-07T10:00:19.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.129+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c04e890 con 0x7f1088005190 2023-12-07T10:00:19.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.129+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f10980145a0 con 0x7f1088005190 2023-12-07T10:00:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.129+0000 7f10927fc640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1080066900 0x7f1080068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.129+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1098084f10 con 0x7f1088005190 2023-12-07T10:00:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.129+0000 7f10a1614640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1080066900 0x7f1080068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.129+0000 7f10a1614640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1080066900 0x7f1080068dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f109c1573b0 tx=0x7f108c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.133+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1098051e80 con 0x7f1088005190 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.333+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f109c0c2770 con 0x7f1088005190 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.337+0000 7f10927fc640 1 -- 172.21.15.89:0/775021968 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f10980554a0 con 0x7f1088005190 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA== 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:00:19.344 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-07T10:00:19.345 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.1 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1080066900 msgr2=0x7f1080068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1080066900 0x7f1080068dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f109c1573b0 tx=0x7f108c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 msgr2=0x7f109c15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f109c15a4b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1098011990 tx=0x7f1098011e50 comp rx=0 tx=0).stop 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 shutdown_connections 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1080066900 0x7f1080068dc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f109c0c3b10 0x7f109c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f109c159df0 0x7f109c15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 --2- 172.21.15.89:0/775021968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1088005190 0x7f109c15a4b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 >> 172.21.15.89:0/775021968 conn(0x7f109c0c2a60 msgr2=0x7f109c0c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:19.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 shutdown_connections 2023-12-07T10:00:19.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.341+0000 7f10a4079640 1 -- 172.21.15.89:0/775021968 wait complete. 2023-12-07T10:00:19.364 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:19.364 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:19.375 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:19.375 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:19.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7f030f640 1 Processor -- start 2023-12-07T10:00:19.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7f030f640 1 -- start start 2023-12-07T10:00:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7f030f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe7e806cd90 0x7fe7e8160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7f030f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e8155790 con 0x7fe7e80ca610 2023-12-07T10:00:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7f030f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e80c4b00 con 0x7fe7e80bd720 2023-12-07T10:00:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7f030f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e80c4de0 con 0x7fe7e806cd90 2023-12-07T10:00:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ee0ab640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe7e80ca610 0x7fe7e80c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34396/0 (socket says 172.21.15.89:34396) 2023-12-07T10:00:19.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ee0ab640 1 -- 172.21.15.89:0/2482856649 learned_addr learned my addr 172.21.15.89:0/2482856649 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:19.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ee8ac640 1 --2- 172.21.15.89:0/2482856649 >> v2:172.21.15.97:3300/0 conn(0x7fe7e806cd90 0x7fe7e8160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463177650 0 0) 0x7fe7e8155790 con 0x7fe7e80ca610 2023-12-07T10:00:19.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d4003530 con 0x7fe7e80ca610 2023-12-07T10:00:19.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397849161 0 0) 0x7fe7e80c4b00 con 0x7fe7e80bd720 2023-12-07T10:00:19.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e8155790 con 0x7fe7e80bd720 2023-12-07T10:00:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ee8ac640 1 -- 172.21.15.89:0/2482856649 >> v1:172.21.15.97:6789/0 conn(0x7fe7e80bd720 legacy=0x7fe7e8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ee8ac640 1 -- 172.21.15.89:0/2482856649 >> v1:172.21.15.89:6789/0 conn(0x7fe7e80ca610 legacy=0x7fe7e80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3163287990 0 0) 0x7fe7d4003530 con 0x7fe7e80ca610 2023-12-07T10:00:19.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.561+0000 7fe7ee8ac640 1 -- 172.21.15.89:0/2482856649 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8157e30 con 0x7fe7e806cd90 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7ee8ac640 1 --2- 172.21.15.89:0/2482856649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e8160130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009d90 tx=0x7fe7e001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b84819f42a37b14 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80c52d0 con 0x7fe7e806cd90 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e00a4b00 con 0x7fe7e806cd90 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7ed0a9640 1 -- 172.21.15.89:0/2482856649 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4001680 con 0x7fe7e806cd90 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 -- 172.21.15.89:0/2482856649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 msgr2=0x7fe7e8160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 --2- 172.21.15.89:0/2482856649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e8160130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009d90 tx=0x7fe7e001c430 comp rx=0 tx=0).stop 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 -- 172.21.15.89:0/2482856649 shutdown_connections 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 --2- 172.21.15.89:0/2482856649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e8160130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 -- 172.21.15.89:0/2482856649 >> 172.21.15.89:0/2482856649 conn(0x7fe7e8071ea0 msgr2=0x7fe7e80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 -- 172.21.15.89:0/2482856649 shutdown_connections 2023-12-07T10:00:19.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.565+0000 7fe7f030f640 1 -- 172.21.15.89:0/2482856649 wait complete. 2023-12-07T10:00:19.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 Processor -- start 2023-12-07T10:00:19.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- start start 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e80c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 0x7fe7e81471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e80ca610 0x7fe7e8147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814dd10 con 0x7fe7e80bd720 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814d190 con 0x7fe7e806cd90 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814d470 con 0x7fe7e80ca610 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 0x7fe7e81471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 0x7fe7e81471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43306/0 (socket says 172.21.15.89:43306) 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 -- 172.21.15.89:0/4075163098 learned_addr learned my addr 172.21.15.89:0/4075163098 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:19.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ee0ab640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e80c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ee8ac640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e80ca610 0x7fe7e8147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 -- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e80ca610 msgr2=0x7fe7e8147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e80ca610 0x7fe7e8147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 -- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 msgr2=0x7fe7e80c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e80c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 -- 172.21.15.89:0/4075163098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0009a70 con 0x7fe7e80bd720 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7ed8aa640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 0x7fe7e81471c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c490 tx=0x7fe7d800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80052d0 con 0x7fe7e80bd720 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d8005430 con 0x7fe7e80bd720 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e814d750 con 0x7fe7e80bd720 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8012870 con 0x7fe7e80bd720 2023-12-07T10:00:19.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e80c7200 con 0x7fe7e80bd720 2023-12-07T10:00:19.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.569+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e814b370 con 0x7fe7e80bd720 2023-12-07T10:00:19.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.573+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe7d80129d0 con 0x7fe7e80bd720 2023-12-07T10:00:19.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.573+0000 7fe7deffd640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7cc0668d0 0x7fe7cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.573+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe7d8084220 con 0x7fe7e80bd720 2023-12-07T10:00:19.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.573+0000 7fe7ee0ab640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7cc0668d0 0x7fe7cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.573+0000 7fe7ee0ab640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7cc0668d0 0x7fe7cc068d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4000f70 tx=0x7fe7e40016c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.577+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7e814b370 con 0x7fe7e80bd720 2023-12-07T10:00:19.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.725+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7e814b370 con 0x7fe7e80bd720 2023-12-07T10:00:19.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7deffd640 1 -- 172.21.15.89:0/4075163098 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7fe7e814b370 con 0x7fe7e80bd720 2023-12-07T10:00:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:19.733 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7cc0668d0 msgr2=0x7fe7cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7cc0668d0 0x7fe7cc068d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4000f70 tx=0x7fe7e40016c0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 msgr2=0x7fe7e81471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 0x7fe7e81471c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c490 tx=0x7fe7d800c950 comp rx=0 tx=0).stop 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 shutdown_connections 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7cc0668d0 0x7fe7cc068d90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe7e80ca610 0x7fe7e8147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7e80bd720 0x7fe7e81471c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 --2- 172.21.15.89:0/4075163098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7e806cd90 0x7fe7e80c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 >> 172.21.15.89:0/4075163098 conn(0x7fe7e8071ea0 msgr2=0x7fe7e8149550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:19.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 shutdown_connections 2023-12-07T10:00:19.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.729+0000 7fe7f030f640 1 -- 172.21.15.89:0/4075163098 wait complete. 2023-12-07T10:00:19.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:55.032694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:55.602397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:00:12.010823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:00:12.808546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:19.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:19.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 Processor -- start 2023-12-07T10:00:19.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 -- start start 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2c940a86d0 0x7f2c940a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c9414fd00 0x7f2c940aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c94152d90 con 0x7f2c94156600 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c94152480 con 0x7f2c9414fd00 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9c32a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940a9760 con 0x7f2c940a86d0 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c9414fd00 0x7f2c940aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c9414fd00 0x7f2c940aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43314/0 (socket says 172.21.15.89:43314) 2023-12-07T10:00:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 -- 172.21.15.89:0/4173947587 learned_addr learned my addr 172.21.15.89:0/4173947587 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a0c6640 1 --2- 172.21.15.89:0/4173947587 >> v2:172.21.15.97:3300/0 conn(0x7f2c940a86d0 0x7f2c940a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 -- 172.21.15.89:0/4173947587 >> v2:172.21.15.97:3300/0 conn(0x7f2c940a86d0 msgr2=0x7f2c940a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 --2- 172.21.15.89:0/4173947587 >> v2:172.21.15.97:3300/0 conn(0x7f2c940a86d0 0x7f2c940a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 -- 172.21.15.89:0/4173947587 >> v1:172.21.15.97:6789/0 conn(0x7f2c94156600 legacy=0x7f2c9414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.893+0000 7f2c9a8c7640 1 -- 172.21.15.89:0/4173947587 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94152740 con 0x7f2c9414fd00 2023-12-07T10:00:19.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9a8c7640 1 --2- 172.21.15.89:0/4173947587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9414fd00 0x7f2c940aae40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009e50 tx=0x7f2c8c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2fe86cc7cb449 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c990c4640 1 -- 172.21.15.89:0/4173947587 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c0a5780 con 0x7f2c9414fd00 2023-12-07T10:00:19.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c990c4640 1 -- 172.21.15.89:0/4173947587 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c0a58e0 con 0x7f2c9414fd00 2023-12-07T10:00:19.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c990c4640 1 -- 172.21.15.89:0/4173947587 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c0a5c70 con 0x7f2c9414fd00 2023-12-07T10:00:19.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 -- 172.21.15.89:0/4173947587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9414fd00 msgr2=0x7f2c940aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/4173947587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9414fd00 0x7f2c940aae40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009e50 tx=0x7f2c8c01c9d0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 -- 172.21.15.89:0/4173947587 shutdown_connections 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/4173947587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c9414fd00 0x7f2c940aae40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/4173947587 >> v2:172.21.15.97:3300/0 conn(0x7f2c940a86d0 0x7f2c940a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 -- 172.21.15.89:0/4173947587 >> 172.21.15.89:0/4173947587 conn(0x7f2c940c2a60 msgr2=0x7f2c940c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 -- 172.21.15.89:0/4173947587 shutdown_connections 2023-12-07T10:00:19.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 -- 172.21.15.89:0/4173947587 wait complete. 2023-12-07T10:00:19.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 Processor -- start 2023-12-07T10:00:19.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.897+0000 7f2c9c32a640 1 -- start start 2023-12-07T10:00:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 0x7f2c94071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c9414fd00 0x7f2c94154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c94156600 0x7f2c941f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94072470 con 0x7f2c940a86d0 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94148190 con 0x7f2c94156600 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940716d0 con 0x7f2c9414fd00 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 0x7f2c94071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 0x7f2c94071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43330/0 (socket says 172.21.15.89:43330) 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 -- 172.21.15.89:0/548626046 learned_addr learned my addr 172.21.15.89:0/548626046 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c998c5640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c9414fd00 0x7f2c94154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a8c7640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c94156600 0x7f2c941f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 -- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c9414fd00 msgr2=0x7f2c94154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c9414fd00 0x7f2c94154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 -- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c94156600 msgr2=0x7f2c941f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c94156600 0x7f2c941f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 -- 172.21.15.89:0/548626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009b30 con 0x7f2c940a86d0 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9a0c6640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 0x7f2c94071190 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000d5f0 tx=0x7f2c9000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900125f0 con 0x7f2c940a86d0 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90012750 con 0x7f2c940a86d0 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90012ae0 con 0x7f2c940a86d0 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c94071f40 con 0x7f2c940a86d0 2023-12-07T10:00:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c941f1570 con 0x7f2c940a86d0 2023-12-07T10:00:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.901+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9404e890 con 0x7f2c940a86d0 2023-12-07T10:00:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.905+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2c90012c40 con 0x7f2c940a86d0 2023-12-07T10:00:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.905+0000 7f2c8affd640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2c780668d0 0x7f2c78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.905+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2c90084a20 con 0x7f2c940a86d0 2023-12-07T10:00:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.905+0000 7f2c998c5640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2c780668d0 0x7f2c78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:19.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.905+0000 7f2c998c5640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2c780668d0 0x7f2c78068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c9414c470 tx=0x7f2c84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:19.909+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c90051a40 con 0x7f2c940a86d0 2023-12-07T10:00:20.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c940a9100 con 0x7f2c940a86d0 2023-12-07T10:00:20.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c8affd640 1 -- 172.21.15.89:0/548626046 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c90055060 con 0x7f2c940a86d0 2023-12-07T10:00:20.065 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2c780668d0 msgr2=0x7f2c78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2c780668d0 0x7f2c78068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c9414c470 tx=0x7f2c84009040 comp rx=0 tx=0).stop 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 msgr2=0x7f2c94071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 0x7f2c94071190 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000d5f0 tx=0x7f2c9000dab0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 shutdown_connections 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c94156600 0x7f2c941f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2c780668d0 0x7f2c78068d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2c9414fd00 0x7f2c94154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 --2- 172.21.15.89:0/548626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c940a86d0 0x7f2c94071190 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 >> 172.21.15.89:0/548626046 conn(0x7f2c940c2a60 msgr2=0x7f2c940c1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:20.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 shutdown_connections 2023-12-07T10:00:20.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.061+0000 7f2c9c32a640 1 -- 172.21.15.89:0/548626046 wait complete. 2023-12-07T10:00:20.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:00:20.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 Processor -- start 2023-12-07T10:00:20.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 -- start start 2023-12-07T10:00:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc154000 0x7fb9bc1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9bc06df30 0x7fb9bc0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc154920 con 0x7fb9bc0700f0 2023-12-07T10:00:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc0a8710 con 0x7fb9bc06df30 2023-12-07T10:00:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.221+0000 7fb9c4772640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc071be0 con 0x7fb9bc154000 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9bc06df30 0x7fb9bc0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c250e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc154000 0x7fb9bc1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9bc06df30 0x7fb9bc0716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:53682/0 (socket says 172.21.15.89:53682) 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/887198015 learned_addr learned my addr 172.21.15.89:0/887198015 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc154000 msgr2=0x7fb9bc1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 --2- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc154000 0x7fb9bc1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/887198015 >> v1:172.21.15.97:6789/0 conn(0x7fb9bc0700f0 legacy=0x7fb9bc070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/887198015 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc154b90 con 0x7fb9bc06df30 2023-12-07T10:00:20.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.225+0000 7fb9c2d0f640 1 --2- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc06df30 0x7fb9bc0716a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009e50 tx=0x7fb9b401c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=620a1b3102d79bf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c150c640 1 -- 172.21.15.89:0/887198015 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40a5730 con 0x7fb9bc06df30 2023-12-07T10:00:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c150c640 1 -- 172.21.15.89:0/887198015 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40a5890 con 0x7fb9bc06df30 2023-12-07T10:00:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c150c640 1 -- 172.21.15.89:0/887198015 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40a5c20 con 0x7fb9bc06df30 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc06df30 msgr2=0x7fb9bc0716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 --2- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc06df30 0x7fb9bc0716a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009e50 tx=0x7fb9b401c8f0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- 172.21.15.89:0/887198015 shutdown_connections 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 --2- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc06df30 0x7fb9bc0716a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 --2- 172.21.15.89:0/887198015 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc154000 0x7fb9bc1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- 172.21.15.89:0/887198015 >> 172.21.15.89:0/887198015 conn(0x7fb9bc0c2a60 msgr2=0x7fb9bc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- 172.21.15.89:0/887198015 shutdown_connections 2023-12-07T10:00:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- 172.21.15.89:0/887198015 wait complete. 2023-12-07T10:00:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 Processor -- start 2023-12-07T10:00:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- start start 2023-12-07T10:00:20.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc06df30 0x7fb9bc1ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc0700f0 0x7fb9bc0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 0x7fb9bc150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1edec0 con 0x7fb9bc154000 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc14d040 con 0x7fb9bc0700f0 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c4772640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc153be0 con 0x7fb9bc06df30 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c2d0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 0x7fb9bc150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c2d0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 0x7fb9bc150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43336/0 (socket says 172.21.15.89:43336) 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/2522049943 learned_addr learned my addr 172.21.15.89:0/2522049943 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.229+0000 7fb9c1d0d640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc0700f0 0x7fb9bc0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c250e640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc06df30 0x7fb9bc1ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc06df30 msgr2=0x7fb9bc1ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c2d0f640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc06df30 0x7fb9bc1ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc0700f0 msgr2=0x7fb9bc0bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c2d0f640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc0700f0 0x7fb9bc0bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c2d0f640 1 -- 172.21.15.89:0/2522049943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009b30 con 0x7fb9bc154000 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c250e640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc06df30 0x7fb9bc1ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c2d0f640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 0x7fb9bc150640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40af040 tx=0x7fb9b4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b8670 con 0x7fb9bc154000 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40b87d0 con 0x7fb9bc154000 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc14d290 con 0x7fb9bc154000 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b8b80 con 0x7fb9bc154000 2023-12-07T10:00:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc0bfb30 con 0x7fb9bc154000 2023-12-07T10:00:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc14ba60 con 0x7fb9bc154000 2023-12-07T10:00:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb9b40b8ce0 con 0x7fb9bc154000 2023-12-07T10:00:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9b2ffd640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb9a00668d0 0x7fb9a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.233+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb9b411fba0 con 0x7fb9bc154000 2023-12-07T10:00:20.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.237+0000 7fb9c250e640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb9a00668d0 0x7fb9a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.237+0000 7fb9c250e640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb9a00668d0 0x7fb9a0068d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0aacd0 tx=0x7fb9b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.237+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9bc14ba60 con 0x7fb9bc154000 2023-12-07T10:00:20.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.393+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9bc14ba60 con 0x7fb9bc154000 2023-12-07T10:00:20.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.393+0000 7fb9b2ffd640 1 -- 172.21.15.89:0/2522049943 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9b40bc020 con 0x7fb9bc154000 2023-12-07T10:00:20.400 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb9a00668d0 msgr2=0x7fb9a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb9a00668d0 0x7fb9a0068d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0aacd0 tx=0x7fb9b8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 msgr2=0x7fb9bc150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 0x7fb9bc150640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40af040 tx=0x7fb9b4019690 comp rx=0 tx=0).stop 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 shutdown_connections 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc154000 0x7fb9bc150640 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9bc0700f0 0x7fb9bc0bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb9a00668d0 0x7fb9a0068d90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 --2- 172.21.15.89:0/2522049943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9bc06df30 0x7fb9bc1ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 >> 172.21.15.89:0/2522049943 conn(0x7fb9bc0c2a60 msgr2=0x7fb9bc070560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 shutdown_connections 2023-12-07T10:00:20.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.397+0000 7fb9c4772640 1 -- 172.21.15.89:0/2522049943 wait complete. 2023-12-07T10:00:20.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:00:20.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.557+0000 7fb5c44fe640 1 Processor -- start 2023-12-07T10:00:20.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.557+0000 7fb5c44fe640 1 -- start start 2023-12-07T10:00:20.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c44fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc156600 0x7fb5bc14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c44fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5bc14fb30 0x7fb5bc0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c44fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc152d90 con 0x7fb5bc0a86d0 2023-12-07T10:00:20.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c44fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc152480 con 0x7fb5bc14fb30 2023-12-07T10:00:20.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c44fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0a9760 con 0x7fb5bc156600 2023-12-07T10:00:20.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c2a9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5bc14fb30 0x7fb5bc0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c229a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb5bc0a86d0 0x7fb5bc0a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34408/0 (socket says 172.21.15.89:34408) 2023-12-07T10:00:20.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c229a640 1 -- 172.21.15.89:0/2081568621 learned_addr learned my addr 172.21.15.89:0/2081568621 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:20.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c1a99640 1 --2- 172.21.15.89:0/2081568621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc156600 0x7fb5bc14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/2081568621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc156600 msgr2=0x7fb5bc14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:20.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c2a9b640 1 --2- 172.21.15.89:0/2081568621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc156600 0x7fb5bc14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/2081568621 >> v1:172.21.15.89:6789/0 conn(0x7fb5bc0a86d0 legacy=0x7fb5bc0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.561+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/2081568621 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc152740 con 0x7fb5bc14fb30 2023-12-07T10:00:20.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c2a9b640 1 --2- 172.21.15.89:0/2081568621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc0aae40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009d90 tx=0x7fb5b401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7180492f748a32e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c1298640 1 -- 172.21.15.89:0/2081568621 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40a5920 con 0x7fb5bc14fb30 2023-12-07T10:00:20.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c1298640 1 -- 172.21.15.89:0/2081568621 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b40a5a80 con 0x7fb5bc14fb30 2023-12-07T10:00:20.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c1298640 1 -- 172.21.15.89:0/2081568621 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40a5e10 con 0x7fb5bc14fb30 2023-12-07T10:00:20.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- 172.21.15.89:0/2081568621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc14fb30 msgr2=0x7fb5bc0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/2081568621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc0aae40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009d90 tx=0x7fb5b401c950 comp rx=0 tx=0).stop 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- 172.21.15.89:0/2081568621 shutdown_connections 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/2081568621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc0aae40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/2081568621 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc156600 0x7fb5bc14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- 172.21.15.89:0/2081568621 >> 172.21.15.89:0/2081568621 conn(0x7fb5bc0c2a60 msgr2=0x7fb5bc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- 172.21.15.89:0/2081568621 shutdown_connections 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- 172.21.15.89:0/2081568621 wait complete. 2023-12-07T10:00:20.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 Processor -- start 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- start start 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc0a86d0 0x7fb5bc147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 0x7fb5bc071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc06c480 con 0x7fb5bc156600 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc148140 con 0x7fb5bc14fb30 2023-12-07T10:00:20.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.565+0000 7fb5c44fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1ed970 con 0x7fb5bc0a86d0 2023-12-07T10:00:20.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 0x7fb5bc071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 0x7fb5bc071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43344/0 (socket says 172.21.15.89:43344) 2023-12-07T10:00:20.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/17489272 learned_addr learned my addr 172.21.15.89:0/17489272 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:20.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c229a640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc0a86d0 0x7fb5bc147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c1a99640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc0a86d0 msgr2=0x7fb5bc147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc0a86d0 0x7fb5bc147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc14fb30 msgr2=0x7fb5bc15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc15b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 -- 172.21.15.89:0/17489272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009a70 con 0x7fb5bc156600 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c2a9b640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 0x7fb5bc071100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009d90 tx=0x7fb5b40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40aee30 con 0x7fb5bc156600 2023-12-07T10:00:20.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4009450 con 0x7fb5bc156600 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc1edc50 con 0x7fb5bc156600 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40b7650 con 0x7fb5bc156600 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc14b430 con 0x7fb5bc156600 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc04e890 con 0x7fb5bc156600 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.569+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb5b40b4050 con 0x7fb5bc156600 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.573+0000 7fb5b2ffd640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a00668d0 0x7fb5a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.573+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb5b411f870 con 0x7fb5bc156600 2023-12-07T10:00:20.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.573+0000 7fb5c229a640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a00668d0 0x7fb5a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.573+0000 7fb5c229a640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a00668d0 0x7fb5a0068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8000f70 tx=0x7fb5b8007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.573+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5b40ec760 con 0x7fb5bc156600 2023-12-07T10:00:20.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.721+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5bc1ede10 con 0x7fb5bc156600 2023-12-07T10:00:20.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5b2ffd640 1 -- 172.21.15.89:0/17489272 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5b40efd80 con 0x7fb5bc156600 2023-12-07T10:00:20.729 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:20.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a00668d0 msgr2=0x7fb5a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a00668d0 0x7fb5a0068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8000f70 tx=0x7fb5b8007e90 comp rx=0 tx=0).stop 2023-12-07T10:00:20.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 msgr2=0x7fb5bc071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 0x7fb5bc071100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009d90 tx=0x7fb5b40196f0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 shutdown_connections 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5bc156600 0x7fb5bc071100 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5bc14fb30 0x7fb5bc15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb5a00668d0 0x7fb5a0068d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 --2- 172.21.15.89:0/17489272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb5bc0a86d0 0x7fb5bc147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 >> 172.21.15.89:0/17489272 conn(0x7fb5bc0c2a60 msgr2=0x7fb5bc0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 shutdown_connections 2023-12-07T10:00:20.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.725+0000 7fb5c44fe640 1 -- 172.21.15.89:0/17489272 wait complete. 2023-12-07T10:00:20.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:00:20.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 Processor -- start 2023-12-07T10:00:20.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 -- start start 2023-12-07T10:00:20.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5b0414eaf0 0x7f5b04151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b040c0370 0x7f5b0406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0406de00 con 0x7f5b04151f90 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b04070390 con 0x7f5b040c0370 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b08db8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0414eed0 con 0x7f5b0414eaf0 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b02d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b040c0370 0x7f5b0406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5af9d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5b04151f90 0x7f5b0406d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34418/0 (socket says 172.21.15.89:34418) 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5af9d9b640 1 -- 172.21.15.89:0/2575841845 learned_addr learned my addr 172.21.15.89:0/2575841845 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b0259c640 1 --2- 172.21.15.89:0/2575841845 >> v2:172.21.15.97:3300/0 conn(0x7f5b0414eaf0 0x7f5b04151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b02d9d640 1 -- 172.21.15.89:0/2575841845 >> v2:172.21.15.97:3300/0 conn(0x7f5b0414eaf0 msgr2=0x7f5b04151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b02d9d640 1 --2- 172.21.15.89:0/2575841845 >> v2:172.21.15.97:3300/0 conn(0x7f5b0414eaf0 0x7f5b04151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b02d9d640 1 -- 172.21.15.89:0/2575841845 >> v1:172.21.15.89:6789/0 conn(0x7f5b04151f90 legacy=0x7f5b0406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b02d9d640 1 -- 172.21.15.89:0/2575841845 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04151270 con 0x7f5b040c0370 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b0259c640 1 --2- 172.21.15.89:0/2575841845 >> v2:172.21.15.97:3300/0 conn(0x7f5b0414eaf0 0x7f5b04151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:20.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.885+0000 7f5b01d9b640 1 -- 172.21.15.89:0/2575841845 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269764338 0 0) 0x7f5b0406de00 con 0x7f5b04151f90 2023-12-07T10:00:20.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b02d9d640 1 --2- 172.21.15.89:0/2575841845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b040c0370 0x7f5b0406d820 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5b040c3b00 tx=0x7f5afc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44223640b3a7fca1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b01d9b640 1 -- 172.21.15.89:0/2575841845 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0ac640 con 0x7f5b040c0370 2023-12-07T10:00:20.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b01d9b640 1 -- 172.21.15.89:0/2575841845 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0ac7a0 con 0x7f5b040c0370 2023-12-07T10:00:20.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b01d9b640 1 -- 172.21.15.89:0/2575841845 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0acb30 con 0x7f5b040c0370 2023-12-07T10:00:20.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 -- 172.21.15.89:0/2575841845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b040c0370 msgr2=0x7f5b0406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 --2- 172.21.15.89:0/2575841845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b040c0370 0x7f5b0406d820 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5b040c3b00 tx=0x7f5afc01c310 comp rx=0 tx=0).stop 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 -- 172.21.15.89:0/2575841845 shutdown_connections 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 --2- 172.21.15.89:0/2575841845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b040c0370 0x7f5b0406d820 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 --2- 172.21.15.89:0/2575841845 >> v2:172.21.15.97:3300/0 conn(0x7f5b0414eaf0 0x7f5b04151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 -- 172.21.15.89:0/2575841845 >> 172.21.15.89:0/2575841845 conn(0x7f5b040c2a60 msgr2=0x7f5b040c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 -- 172.21.15.89:0/2575841845 shutdown_connections 2023-12-07T10:00:20.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.889+0000 7f5b08db8640 1 -- 172.21.15.89:0/2575841845 wait complete. 2023-12-07T10:00:20.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 Processor -- start 2023-12-07T10:00:20.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- start start 2023-12-07T10:00:20.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b040c0370 0x7f5b040c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 0x7f5b040ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b040c0ba0 0x7f5b040c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040c1570 con 0x7f5b0414eaf0 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040c58a0 con 0x7f5b040c0370 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b041f4900 con 0x7f5b040c0ba0 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 0x7f5b040ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 0x7f5b040ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43364/0 (socket says 172.21.15.89:43364) 2023-12-07T10:00:20.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 -- 172.21.15.89:0/1956089988 learned_addr learned my addr 172.21.15.89:0/1956089988 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b02d9d640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b040c0ba0 0x7f5b040c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b0259c640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b040c0370 0x7f5b040c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 -- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b040c0ba0 msgr2=0x7f5b040c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b040c0ba0 0x7f5b040c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 -- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b040c0370 msgr2=0x7f5b040c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b040c0370 0x7f5b040c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 -- 172.21.15.89:0/1956089988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009420 con 0x7f5b0414eaf0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b02d9d640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b040c0ba0 0x7f5b040c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b0259c640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b040c0370 0x7f5b040c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5af9d9b640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 0x7f5b040ab130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c480 tx=0x7f5aec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0074e0 con 0x7f5b0414eaf0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec007660 con 0x7f5b0414eaf0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec004a30 con 0x7f5b0414eaf0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b041f4ba0 con 0x7f5b0414eaf0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b041f5160 con 0x7f5b0414eaf0 2023-12-07T10:00:20.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.893+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b041f5380 con 0x7f5b0414eaf0 2023-12-07T10:00:20.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.897+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5aec004b90 con 0x7f5b0414eaf0 2023-12-07T10:00:20.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.897+0000 7f5afb7fe640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ae4066900 0x7f5ae4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:20.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.897+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5aec083950 con 0x7f5b0414eaf0 2023-12-07T10:00:20.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.897+0000 7f5b0259c640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ae4066900 0x7f5ae4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:20.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.897+0000 7f5b0259c640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ae4066900 0x7f5ae4068dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009540 tx=0x7f5af400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:20.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:20.901+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5aec0542b0 con 0x7f5b0414eaf0 2023-12-07T10:00:21.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.049+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b0404e890 con 0x7f5b0414eaf0 2023-12-07T10:00:21.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.049+0000 7f5afb7fe640 1 -- 172.21.15.89:0/1956089988 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5aec018020 con 0x7f5b0414eaf0 2023-12-07T10:00:21.055 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ae4066900 msgr2=0x7f5ae4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ae4066900 0x7f5ae4068dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009540 tx=0x7f5af400b040 comp rx=0 tx=0).stop 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 msgr2=0x7f5b040ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 0x7f5b040ab130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c480 tx=0x7f5aec00c940 comp rx=0 tx=0).stop 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 shutdown_connections 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ae4066900 0x7f5ae4068dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5b040c0ba0 0x7f5b040c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b0414eaf0 0x7f5b040ab130 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 --2- 172.21.15.89:0/1956089988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b040c0370 0x7f5b040c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 >> 172.21.15.89:0/1956089988 conn(0x7f5b040c2a60 msgr2=0x7f5b04150080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:21.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 shutdown_connections 2023-12-07T10:00:21.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.053+0000 7f5b08db8640 1 -- 172.21.15.89:0/1956089988 wait complete. 2023-12-07T10:00:21.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:00:21.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 Processor -- start 2023-12-07T10:00:21.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 -- start start 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9804156600 0x7f980414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f980414fb30 0x7f98040aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9804152d90 con 0x7f98040a86d0 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980414ffa0 con 0x7f9804156600 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f98088e3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804152480 con 0x7f980414fb30 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f97f9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9804156600 0x7f980414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f980259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f98040a86d0 0x7f98040a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34430/0 (socket says 172.21.15.89:34430) 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f97f9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9804156600 0x7f980414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43368/0 (socket says 172.21.15.89:43368) 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f980259c640 1 -- 172.21.15.89:0/1419571095 learned_addr learned my addr 172.21.15.89:0/1419571095 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:21.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f9802d9d640 1 --2- 172.21.15.89:0/1419571095 >> v2:172.21.15.97:3300/0 conn(0x7f980414fb30 0x7f98040aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f97f9d9b640 1 -- 172.21.15.89:0/1419571095 >> v2:172.21.15.97:3300/0 conn(0x7f980414fb30 msgr2=0x7f98040aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:21.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f97f9d9b640 1 --2- 172.21.15.89:0/1419571095 >> v2:172.21.15.97:3300/0 conn(0x7f980414fb30 0x7f98040aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f97f9d9b640 1 -- 172.21.15.89:0/1419571095 >> v1:172.21.15.89:6789/0 conn(0x7f98040a86d0 legacy=0x7f98040a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f97f9d9b640 1 -- 172.21.15.89:0/1419571095 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040a9760 con 0x7f9804156600 2023-12-07T10:00:21.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.213+0000 7f9802d9d640 1 --2- 172.21.15.89:0/1419571095 >> v2:172.21.15.97:3300/0 conn(0x7f980414fb30 0x7f98040aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:21.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f97f9d9b640 1 --2- 172.21.15.89:0/1419571095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9804156600 0x7f980414f5f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0097c0 tx=0x7f97ec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1976b6979bc0ebb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:21.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f9801d9b640 1 -- 172.21.15.89:0/1419571095 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0ab600 con 0x7f9804156600 2023-12-07T10:00:21.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f9801d9b640 1 -- 172.21.15.89:0/1419571095 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec0a7050 con 0x7f9804156600 2023-12-07T10:00:21.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f9801d9b640 1 -- 172.21.15.89:0/1419571095 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0ab980 con 0x7f9804156600 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 -- 172.21.15.89:0/1419571095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9804156600 msgr2=0x7f980414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 --2- 172.21.15.89:0/1419571095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9804156600 0x7f980414f5f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0097c0 tx=0x7f97ec01c440 comp rx=0 tx=0).stop 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 -- 172.21.15.89:0/1419571095 shutdown_connections 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 --2- 172.21.15.89:0/1419571095 >> v2:172.21.15.97:3300/0 conn(0x7f980414fb30 0x7f98040aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 --2- 172.21.15.89:0/1419571095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9804156600 0x7f980414f5f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 -- 172.21.15.89:0/1419571095 >> 172.21.15.89:0/1419571095 conn(0x7f98040c2a60 msgr2=0x7f98040c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:21.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 -- 172.21.15.89:0/1419571095 shutdown_connections 2023-12-07T10:00:21.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.217+0000 7f98088e3640 1 -- 172.21.15.89:0/1419571095 wait complete. 2023-12-07T10:00:21.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 Processor -- start 2023-12-07T10:00:21.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- start start 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 0x7f980415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980414fb30 0x7f98041467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9804156600 0x7f9804146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980414f650 con 0x7f98040a86d0 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980414edb0 con 0x7f9804156600 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9804147a40 con 0x7f980414fb30 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 0x7f980415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 0x7f980415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43370/0 (socket says 172.21.15.89:43370) 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 -- 172.21.15.89:0/1795214834 learned_addr learned my addr 172.21.15.89:0/1795214834 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f97f9d9b640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980414fb30 0x7f98041467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 -- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980414fb30 msgr2=0x7f98041467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f9802d9d640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9804156600 0x7f9804146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980414fb30 0x7f98041467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 -- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9804156600 msgr2=0x7f9804146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9804156600 0x7f9804146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 -- 172.21.15.89:0/1795214834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec009420 con 0x7f98040a86d0 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f97f9d9b640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980414fb30 0x7f98041467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f9802d9d640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9804156600 0x7f9804146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f980259c640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 0x7f980415b360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f97f400cbd0 tx=0x7f97f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400ad40 con 0x7f98040a86d0 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f4012400 con 0x7f98040a86d0 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804147220 con 0x7f98040a86d0 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400aea0 con 0x7f98040a86d0 2023-12-07T10:00:21.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980414f000 con 0x7f98040a86d0 2023-12-07T10:00:21.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.221+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980404e890 con 0x7f98040a86d0 2023-12-07T10:00:21.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.225+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f97f4007070 con 0x7f98040a86d0 2023-12-07T10:00:21.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.225+0000 7f97fb7fe640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f97e40668d0 0x7f97e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.225+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f97f4084920 con 0x7f98040a86d0 2023-12-07T10:00:21.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.225+0000 7f97f9d9b640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f97e40668d0 0x7f97e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.225+0000 7f97f9d9b640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f97e40668d0 0x7f97e4068d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0ad000 tx=0x7f97ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:21.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.229+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97f4051810 con 0x7f98040a86d0 2023-12-07T10:00:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f980406e700 con 0x7f98040a86d0 2023-12-07T10:00:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f97fb7fe640 1 -- 172.21.15.89:0/1795214834 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f980406e700 con 0x7f98040a86d0 2023-12-07T10:00:21.385 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:21.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f97e40668d0 msgr2=0x7f97e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f97e40668d0 0x7f97e4068d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0ad000 tx=0x7f97ec008040 comp rx=0 tx=0).stop 2023-12-07T10:00:21.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 msgr2=0x7f980415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 0x7f980415b360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f97f400cbd0 tx=0x7f97f400a430 comp rx=0 tx=0).stop 2023-12-07T10:00:21.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 shutdown_connections 2023-12-07T10:00:21.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9804156600 0x7f9804146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f97e40668d0 0x7f97e4068d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f980414fb30 0x7f98041467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 --2- 172.21.15.89:0/1795214834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040a86d0 0x7f980415b360 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 >> 172.21.15.89:0/1795214834 conn(0x7f98040c2a60 msgr2=0x7f98040c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:21.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 shutdown_connections 2023-12-07T10:00:21.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.381+0000 7f98088e3640 1 -- 172.21.15.89:0/1795214834 wait complete. 2023-12-07T10:00:21.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:00:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.541+0000 7fcc6485a640 1 Processor -- start 2023-12-07T10:00:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.541+0000 7fcc6485a640 1 -- start start 2023-12-07T10:00:21.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc6485a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc6014e9d0 0x7fcc60151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc6485a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6006d320 con 0x7fcc60070b80 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc6485a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600721b0 con 0x7fcc600a8470 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc6485a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc600c2830 con 0x7fcc6014e9d0 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc5e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc6014e9d0 0x7fcc60151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc55d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcc60070b80 0x7fcc600c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34434/0 (socket says 172.21.15.89:34434) 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc55d9b640 1 -- 172.21.15.89:0/2976353539 learned_addr learned my addr 172.21.15.89:0/2976353539 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc5e59c640 1 -- 172.21.15.89:0/2976353539 >> v1:172.21.15.97:6789/0 conn(0x7fcc600a8470 legacy=0x7fcc6006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc5e59c640 1 -- 172.21.15.89:0/2976353539 >> v1:172.21.15.89:6789/0 conn(0x7fcc60070b80 legacy=0x7fcc600c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc5dd9b640 1 -- 172.21.15.89:0/2976353539 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397817731 0 0) 0x7fcc6006d320 con 0x7fcc60070b80 2023-12-07T10:00:21.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.545+0000 7fcc5e59c640 1 -- 172.21.15.89:0/2976353539 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc60072450 con 0x7fcc6014e9d0 2023-12-07T10:00:21.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc5e59c640 1 --2- 172.21.15.89:0/2976353539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc6014e9d0 0x7fcc60151e60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009d90 tx=0x7fcc5001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faecdd923dddd75f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:21.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc5dd9b640 1 -- 172.21.15.89:0/2976353539 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500a5890 con 0x7fcc6014e9d0 2023-12-07T10:00:21.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc5dd9b640 1 -- 172.21.15.89:0/2976353539 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc500a59f0 con 0x7fcc6014e9d0 2023-12-07T10:00:21.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc5dd9b640 1 -- 172.21.15.89:0/2976353539 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500a5d80 con 0x7fcc6014e9d0 2023-12-07T10:00:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 -- 172.21.15.89:0/2976353539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc6014e9d0 msgr2=0x7fcc60151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 --2- 172.21.15.89:0/2976353539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc6014e9d0 0x7fcc60151e60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009d90 tx=0x7fcc5001c8c0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 -- 172.21.15.89:0/2976353539 shutdown_connections 2023-12-07T10:00:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 --2- 172.21.15.89:0/2976353539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc6014e9d0 0x7fcc60151e60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 -- 172.21.15.89:0/2976353539 >> 172.21.15.89:0/2976353539 conn(0x7fcc600c2ad0 msgr2=0x7fcc600c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 -- 172.21.15.89:0/2976353539 shutdown_connections 2023-12-07T10:00:21.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 -- 172.21.15.89:0/2976353539 wait complete. 2023-12-07T10:00:21.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 Processor -- start 2023-12-07T10:00:21.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.549+0000 7fcc6485a640 1 -- start start 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 0x7fcc600aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc600a8470 0x7fcc600c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc6014e9d0 0x7fcc601ec960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60153ac0 con 0x7fcc60070b80 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc601f0cb0 con 0x7fcc600a8470 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc601f0980 con 0x7fcc6014e9d0 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 0x7fcc600aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 0x7fcc600aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43390/0 (socket says 172.21.15.89:43390) 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 -- 172.21.15.89:0/1150206055 learned_addr learned my addr 172.21.15.89:0/1150206055 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc55d9b640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc600a8470 0x7fcc600c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5ed9d640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc6014e9d0 0x7fcc601ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 -- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc6014e9d0 msgr2=0x7fcc601ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc6014e9d0 0x7fcc601ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 -- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc600a8470 msgr2=0x7fcc600c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc600a8470 0x7fcc600c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 -- 172.21.15.89:0/1150206055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50009a70 con 0x7fcc60070b80 2023-12-07T10:00:21.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc5e59c640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 0x7fcc600aa010 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009d90 tx=0x7fcc50019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500ad710 con 0x7fcc60070b80 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc500ad870 con 0x7fcc60070b80 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500adbe0 con 0x7fcc60070b80 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc60151170 con 0x7fcc60070b80 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc60155520 con 0x7fcc60070b80 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc60067a40 con 0x7fcc60070b80 2023-12-07T10:00:21.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.553+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc500add40 con 0x7fcc60070b80 2023-12-07T10:00:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.557+0000 7fcc577fe640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc400668d0 0x7fcc40068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.557+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcc5011f800 con 0x7fcc60070b80 2023-12-07T10:00:21.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.557+0000 7fcc55d9b640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc400668d0 0x7fcc40068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:21.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.557+0000 7fcc55d9b640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc400668d0 0x7fcc40068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc600aa770 tx=0x7fcc48007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:21.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.561+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc500ec820 con 0x7fcc60070b80 2023-12-07T10:00:21.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcc600709e0 con 0x7fcc60070b80 2023-12-07T10:00:21.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc577fe640 1 -- 172.21.15.89:0/1150206055 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcc600709e0 con 0x7fcc60070b80 2023-12-07T10:00:21.725 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc400668d0 msgr2=0x7fcc40068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc400668d0 0x7fcc40068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc600aa770 tx=0x7fcc48007240 comp rx=0 tx=0).stop 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 msgr2=0x7fcc600aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 0x7fcc600aa010 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009d90 tx=0x7fcc50019660 comp rx=0 tx=0).stop 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 shutdown_connections 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc400668d0 0x7fcc40068d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc6014e9d0 0x7fcc601ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc600a8470 0x7fcc600c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 --2- 172.21.15.89:0/1150206055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc60070b80 0x7fcc600aa010 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 >> 172.21.15.89:0/1150206055 conn(0x7fcc600c2ad0 msgr2=0x7fcc600c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:21.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 shutdown_connections 2023-12-07T10:00:21.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:21.721+0000 7fcc6485a640 1 -- 172.21.15.89:0/1150206055 wait complete. 2023-12-07T10:00:21.746 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T10:00:21.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:21.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:21.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:00:21.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:21.777 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:00:21.830 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:21.830 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:21.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:00:21.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:00:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.017+0000 7fa4d329c640 1 Processor -- start 2023-12-07T10:00:22.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d329c640 1 -- start start 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d329c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d329c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4cc06b4e0 0x7fa4cc15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d329c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc1559f0 con 0x7fa4cc06b100 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d329c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc157930 con 0x7fa4cc06b4e0 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d329c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc151f20 con 0x7fa4cc0bd5e0 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d229a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa4cc06b100 0x7fa4cc0c8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34436/0 (socket says 172.21.15.89:34436) 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d229a640 1 -- 172.21.15.89:0/3862053490 learned_addr learned my addr 172.21.15.89:0/3862053490 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d2a9b640 1 --2- 172.21.15.89:0/3862053490 >> v2:172.21.15.89:3300/0 conn(0x7fa4cc06b4e0 0x7fa4cc15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d1a99640 1 --2- 172.21.15.89:0/3862053490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d1298640 1 -- 172.21.15.89:0/3862053490 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085596467 0 0) 0x7fa4cc1559f0 con 0x7fa4cc06b100 2023-12-07T10:00:22.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d1298640 1 -- 172.21.15.89:0/3862053490 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b8003530 con 0x7fa4cc06b100 2023-12-07T10:00:22.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d2a9b640 1 -- 172.21.15.89:0/3862053490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 msgr2=0x7fa4cc0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:22.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d2a9b640 1 --2- 172.21.15.89:0/3862053490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc0c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d2a9b640 1 -- 172.21.15.89:0/3862053490 >> v1:172.21.15.89:6789/0 conn(0x7fa4cc06b100 legacy=0x7fa4cc0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:22.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.021+0000 7fa4d2a9b640 1 -- 172.21.15.89:0/3862053490 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc06b960 con 0x7fa4cc06b4e0 2023-12-07T10:00:22.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d2a9b640 1 --2- 172.21.15.89:0/3862053490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc15ee80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009d90 tx=0x7fa4c401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afde278104712fe0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:22.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d1298640 1 -- 172.21.15.89:0/3862053490 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40a5810 con 0x7fa4cc06b4e0 2023-12-07T10:00:22.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d1298640 1 -- 172.21.15.89:0/3862053490 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c40a5970 con 0x7fa4cc06b4e0 2023-12-07T10:00:22.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d1298640 1 -- 172.21.15.89:0/3862053490 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40a5ce0 con 0x7fa4cc06b4e0 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 -- 172.21.15.89:0/3862053490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b4e0 msgr2=0x7fa4cc15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 --2- 172.21.15.89:0/3862053490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc15ee80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009d90 tx=0x7fa4c401c950 comp rx=0 tx=0).stop 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 -- 172.21.15.89:0/3862053490 shutdown_connections 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 --2- 172.21.15.89:0/3862053490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc15ee80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 --2- 172.21.15.89:0/3862053490 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 -- 172.21.15.89:0/3862053490 >> 172.21.15.89:0/3862053490 conn(0x7fa4cc0ca550 msgr2=0x7fa4cc0abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 -- 172.21.15.89:0/3862053490 shutdown_connections 2023-12-07T10:00:22.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 -- 172.21.15.89:0/3862053490 wait complete. 2023-12-07T10:00:22.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 Processor -- start 2023-12-07T10:00:22.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.025+0000 7fa4d329c640 1 -- start start 2023-12-07T10:00:22.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 0x7fa4cc0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:22.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:22.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:22.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc150780 con 0x7fa4cc06b100 2023-12-07T10:00:22.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0ad740 con 0x7fa4cc06b4e0 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc150130 con 0x7fa4cc0bd5e0 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 0x7fa4cc0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 0x7fa4cc0a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43410/0 (socket says 172.21.15.89:43410) 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 -- 172.21.15.89:0/2865267160 learned_addr learned my addr 172.21.15.89:0/2865267160 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d2a9b640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d1a99640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 -- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 msgr2=0x7fa4cc148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 -- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4cc06b4e0 msgr2=0x7fa4cc150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 -- 172.21.15.89:0/2865267160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4009a70 con 0x7fa4cc06b100 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d1a99640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:22.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d229a640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 0x7fa4cc0a9930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c450 tx=0x7fa4c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:22.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8005cf0 con 0x7fa4cc06b100 2023-12-07T10:00:22.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8005e50 con 0x7fa4cc06b100 2023-12-07T10:00:22.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc150410 con 0x7fa4cc06b100 2023-12-07T10:00:22.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007290 con 0x7fa4cc06b100 2023-12-07T10:00:22.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc0ada20 con 0x7fa4cc06b100 2023-12-07T10:00:22.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.029+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc04e890 con 0x7fa4cc06b100 2023-12-07T10:00:22.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.033+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa4c80073f0 con 0x7fa4cc06b100 2023-12-07T10:00:22.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.033+0000 7fa4c2ffd640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4b00668d0 0x7fa4b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:22.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.033+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa4c8083cc0 con 0x7fa4cc06b100 2023-12-07T10:00:22.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.033+0000 7fa4d1a99640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4b00668d0 0x7fa4b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:22.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.033+0000 7fa4d1a99640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4b00668d0 0x7fa4b0068d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc151780 tx=0x7fa4bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.037+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4c808a080 con 0x7fa4cc06b100 2023-12-07T10:00:22.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.217+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa4cc0ac620 con 0x7fa4cc06b100 2023-12-07T10:00:22.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.217+0000 7fa4c2ffd640 1 -- 172.21.15.89:0/2865267160 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa4c8017070 con 0x7fa4cc06b100 2023-12-07T10:00:22.224 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:00:22.224 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:00:22.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4b00668d0 msgr2=0x7fa4b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4b00668d0 0x7fa4b0068d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc151780 tx=0x7fa4bc008040 comp rx=0 tx=0).stop 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 msgr2=0x7fa4cc0a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 0x7fa4cc0a9930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c450 tx=0x7fa4c800c910 comp rx=0 tx=0).stop 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 shutdown_connections 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa4b00668d0 0x7fa4b0068d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4cc0bd5e0 0x7fa4cc148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4cc06b4e0 0x7fa4cc150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 --2- 172.21.15.89:0/2865267160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4cc06b100 0x7fa4cc0a9930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 >> 172.21.15.89:0/2865267160 conn(0x7fa4cc0ca550 msgr2=0x7fa4cc156150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 shutdown_connections 2023-12-07T10:00:22.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:22.221+0000 7fa4d329c640 1 -- 172.21.15.89:0/2865267160 wait complete. 2023-12-07T10:00:22.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:00:22.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:00:22.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.245 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:00:22.256 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:00:22.256 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:00:22.257 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42353sec preferred_lft 42353sec 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:00:22.258 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.259 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:00:22.259 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:00:22.259 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:00:22.259 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:22.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.260 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:00:22.330 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:00:22.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.331 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:00:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:00:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:00:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:00:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:00:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:00:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:00:22.390 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:22.390 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:22.390 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:22.390 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:00:22.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.391 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:00:22.391 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:00:22.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:00:22.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:00:22.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:00:22.391 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:00:22.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.494 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:00:22.503 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:00:22.504 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:00:22.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:00:22.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:22.566 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:22.621 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:00:22.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:22.622 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:22.676 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-07T10:00:22.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.677 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:22.766 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:22.766 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:00:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs2=/ 2023-12-07T10:00:22.779 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:00:22.783 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:00:22.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.783 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:22.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:22.805 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:00:22.871 INFO:teuthology.orchestra.run.smithi097.stdout:client4976 2023-12-07T10:00:22.871 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:22.871 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:22.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-07T10:00:23.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 Processor -- start 2023-12-07T10:00:23.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 -- start start 2023-12-07T10:00:23.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180bff20 0x7fef180c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef180c08f0 0x7fef18151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef180a5ce0 con 0x7fef180c2da0 2023-12-07T10:00:23.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180a6210 con 0x7fef180c08f0 2023-12-07T10:00:23.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.057+0000 7fef1fa5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180a5f30 con 0x7fef180bff20 2023-12-07T10:00:23.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef180c08f0 0x7fef18151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef180c08f0 0x7fef18151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43424/0 (socket says 172.21.15.89:43424) 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 -- 172.21.15.89:0/2381886895 learned_addr learned my addr 172.21.15.89:0/2381886895 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1cff5640 1 --1- 172.21.15.89:0/2381886895 >> v1:172.21.15.97:6789/0 conn(0x7fef180c2da0 0x7fef1806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:41750/0 (socket says 172.21.15.89:41750) 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1d7f6640 1 --2- 172.21.15.89:0/2381886895 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180bff20 0x7fef180c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 -- 172.21.15.89:0/2381886895 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180bff20 msgr2=0x7fef180c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 --2- 172.21.15.89:0/2381886895 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180bff20 0x7fef180c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 -- 172.21.15.89:0/2381886895 >> v1:172.21.15.97:6789/0 conn(0x7fef180c2da0 legacy=0x7fef1806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 -- 172.21.15.89:0/2381886895 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef181554d0 con 0x7fef180c08f0 2023-12-07T10:00:23.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef0ffff640 1 -- 172.21.15.89:0/2381886895 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520560489 0 0) 0x7fef180a5ce0 con 0x7fef180c2da0 2023-12-07T10:00:23.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef1dff7640 1 --2- 172.21.15.89:0/2381886895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef18151a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef1001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce4df7b58882edc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef0ffff640 1 -- 172.21.15.89:0/2381886895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100a5710 con 0x7fef180c08f0 2023-12-07T10:00:23.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef0ffff640 1 -- 172.21.15.89:0/2381886895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef100a5870 con 0x7fef180c08f0 2023-12-07T10:00:23.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.061+0000 7fef0ffff640 1 -- 172.21.15.89:0/2381886895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100a5c00 con 0x7fef180c08f0 2023-12-07T10:00:23.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2381886895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 msgr2=0x7fef18151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2381886895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef18151a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef1001c980 comp rx=0 tx=0).stop 2023-12-07T10:00:23.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2381886895 shutdown_connections 2023-12-07T10:00:23.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2381886895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef18151a80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2381886895 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180bff20 0x7fef180c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2381886895 >> 172.21.15.89:0/2381886895 conn(0x7fef180a8640 msgr2=0x7fef180a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:23.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2381886895 shutdown_connections 2023-12-07T10:00:23.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2381886895 wait complete. 2023-12-07T10:00:23.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 Processor -- start 2023-12-07T10:00:23.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- start start 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef180bff20 0x7fef180aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef1814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180c2da0 0x7fef18152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180aa100 con 0x7fef180c08f0 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180a97d0 con 0x7fef180bff20 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1fa5a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180a9ab0 con 0x7fef180c2da0 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef1814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef1814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43436/0 (socket says 172.21.15.89:43436) 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 -- 172.21.15.89:0/2614328636 learned_addr learned my addr 172.21.15.89:0/2614328636 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1dff7640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180c2da0 0x7fef18152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1d7f6640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef180bff20 0x7fef180aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 -- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180c2da0 msgr2=0x7fef18152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180c2da0 0x7fef18152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 -- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef180bff20 msgr2=0x7fef180aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef180bff20 0x7fef180aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 -- 172.21.15.89:0/2614328636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009b30 con 0x7fef180c08f0 2023-12-07T10:00:23.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.065+0000 7fef1cff5640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef1814d180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c480 tx=0x7fef0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080074e0 con 0x7fef180c08f0 2023-12-07T10:00:23.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08007660 con 0x7fef180c08f0 2023-12-07T10:00:23.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08004a30 con 0x7fef180c08f0 2023-12-07T10:00:23.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef180a9d90 con 0x7fef180c08f0 2023-12-07T10:00:23.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef181f0fb0 con 0x7fef180c08f0 2023-12-07T10:00:23.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180aa270 con 0x7fef180c08f0 2023-12-07T10:00:23.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fef08004b90 con 0x7fef180c08f0 2023-12-07T10:00:23.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef0dffb640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feefc066900 0x7feefc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fef08083880 con 0x7fef180c08f0 2023-12-07T10:00:23.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef1d7f6640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feefc066900 0x7feefc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.069+0000 7fef1d7f6640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feefc066900 0x7feefc068dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef14009b60 tx=0x7fef14009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.073+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef08050800 con 0x7fef180c08f0 2023-12-07T10:00:23.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.257+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7fef1804e890 con 0x7fef180c08f0 2023-12-07T10:00:23.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.261+0000 7fef0dffb640 1 -- 172.21.15.89:0/2614328636 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7fef08053e20 con 0x7fef180c08f0 2023-12-07T10:00:23.266 INFO:teuthology.orchestra.run.smithi089.stdout:[client.testuser] 2023-12-07T10:00:23.266 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQC3l3Fl6/iADxAA8LuRMu2019crYDu6LFmRsw== 2023-12-07T10:00:23.267 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-07T10:00:23.267 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r fsname=cephfs" 2023-12-07T10:00:23.267 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feefc066900 msgr2=0x7feefc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feefc066900 0x7feefc068dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef14009b60 tx=0x7fef14009190 comp rx=0 tx=0).stop 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 msgr2=0x7fef1814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef1814d180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c480 tx=0x7fef0800c940 comp rx=0 tx=0).stop 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 shutdown_connections 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feefc066900 0x7feefc068dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef180c2da0 0x7fef18152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef180c08f0 0x7fef1814d180 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 --2- 172.21.15.89:0/2614328636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef180bff20 0x7fef180aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 >> 172.21.15.89:0/2614328636 conn(0x7fef180a8640 msgr2=0x7fef180c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 shutdown_connections 2023-12-07T10:00:23.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.265+0000 7fef1fa5a640 1 -- 172.21.15.89:0/2614328636 wait complete. 2023-12-07T10:00:23.286 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:00:23.295 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.TxJfFX8xG7 2023-12-07T10:00:23.296 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:23.296 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/tmp/tmp.TxJfFX8xG7 2023-12-07T10:00:23.348 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:23.348 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:23.404 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:23.404 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:23.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:23.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b50279640 1 Processor -- start 2023-12-07T10:00:23.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b50279640 1 -- start start 2023-12-07T10:00:23.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b50279640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8b480bd720 0x7f8b48158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b50279640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b48155790 con 0x7f8b480ca610 2023-12-07T10:00:23.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b50279640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480c4b00 con 0x7f8b4806cd90 2023-12-07T10:00:23.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b50279640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480c4de0 con 0x7f8b480bd720 2023-12-07T10:00:23.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4e015640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8b480ca610 0x7f8b480c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34446/0 (socket says 172.21.15.89:34446) 2023-12-07T10:00:23.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4e015640 1 -- 172.21.15.89:0/3616103636 learned_addr learned my addr 172.21.15.89:0/3616103636 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:23.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d814640 1 --2- 172.21.15.89:0/3616103636 >> v2:172.21.15.97:3300/0 conn(0x7f8b480bd720 0x7f8b48158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549977554 0 0) 0x7f8b48155790 con 0x7f8b480ca610 2023-12-07T10:00:23.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b34003530 con 0x7f8b480ca610 2023-12-07T10:00:23.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319773620 0 0) 0x7f8b480c4b00 con 0x7f8b4806cd90 2023-12-07T10:00:23.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b48155790 con 0x7f8b4806cd90 2023-12-07T10:00:23.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d814640 1 -- 172.21.15.89:0/3616103636 >> v1:172.21.15.97:6789/0 conn(0x7f8b4806cd90 legacy=0x7f8b480c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d814640 1 -- 172.21.15.89:0/3616103636 >> v1:172.21.15.89:6789/0 conn(0x7f8b480ca610 legacy=0x7f8b480c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.633+0000 7f8b4d814640 1 -- 172.21.15.89:0/3616103636 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48157e30 con 0x7f8b480bd720 2023-12-07T10:00:23.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b4d814640 1 --2- 172.21.15.89:0/3616103636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480bd720 0x7f8b48158350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097c0 tx=0x7f8b3801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb25a4263c0ef85 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480c52d0 con 0x7f8b480bd720 2023-12-07T10:00:23.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b380a4840 con 0x7f8b480bd720 2023-12-07T10:00:23.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b4d013640 1 -- 172.21.15.89:0/3616103636 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380a4bb0 con 0x7f8b480bd720 2023-12-07T10:00:23.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 -- 172.21.15.89:0/3616103636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480bd720 msgr2=0x7f8b48158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 --2- 172.21.15.89:0/3616103636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480bd720 0x7f8b48158350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097c0 tx=0x7f8b3801c040 comp rx=0 tx=0).stop 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 -- 172.21.15.89:0/3616103636 shutdown_connections 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 --2- 172.21.15.89:0/3616103636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480bd720 0x7f8b48158350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 -- 172.21.15.89:0/3616103636 >> 172.21.15.89:0/3616103636 conn(0x7f8b48071ea0 msgr2=0x7f8b480722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 -- 172.21.15.89:0/3616103636 shutdown_connections 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.637+0000 7f8b50279640 1 -- 172.21.15.89:0/3616103636 wait complete. 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 Processor -- start 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- start start 2023-12-07T10:00:23.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 0x7f8b480ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b480bd720 0x7f8b48147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480ca610 0x7f8b48151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481f0f10 con 0x7f8b4806cd90 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48154150 con 0x7f8b480ca610 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480ac9f0 con 0x7f8b480bd720 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 0x7f8b480ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 0x7f8b480ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43442/0 (socket says 172.21.15.89:43442) 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 -- 172.21.15.89:0/1366511120 learned_addr learned my addr 172.21.15.89:0/1366511120 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:23.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e816640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480ca610 0x7f8b48151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4d814640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b480bd720 0x7f8b48147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 -- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b480bd720 msgr2=0x7f8b48147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b480bd720 0x7f8b48147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 -- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480ca610 msgr2=0x7f8b48151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480ca610 0x7f8b48151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 -- 172.21.15.89:0/1366511120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009420 con 0x7f8b4806cd90 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b4e015640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 0x7f8b480ac4b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c420 tx=0x7f8b4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44005cf0 con 0x7f8b4806cd90 2023-12-07T10:00:23.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44005e50 con 0x7f8b4806cd90 2023-12-07T10:00:23.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4814f9f0 con 0x7f8b4806cd90 2023-12-07T10:00:23.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44007310 con 0x7f8b4806cd90 2023-12-07T10:00:23.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4814ffb0 con 0x7f8b4806cd90 2023-12-07T10:00:23.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.641+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4804e890 con 0x7f8b4806cd90 2023-12-07T10:00:23.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.645+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8b44007470 con 0x7f8b4806cd90 2023-12-07T10:00:23.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.645+0000 7f8b3effd640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.645+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8b44083cd0 con 0x7f8b4806cd90 2023-12-07T10:00:23.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.645+0000 7f8b4d814640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.645+0000 7f8b4d814640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b380ae000 tx=0x7f8b380a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.649+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b44050c60 con 0x7f8b4806cd90 2023-12-07T10:00:23.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.801+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b4806cb70 con 0x7f8b4806cd90 2023-12-07T10:00:23.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.801+0000 7f8b3effd640 1 -- 172.21.15.89:0/1366511120 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f8b44017020 con 0x7f8b4806cd90 2023-12-07T10:00:23.807 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:23.807 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 msgr2=0x7f8b2c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b380ae000 tx=0x7f8b380a6070 comp rx=0 tx=0).stop 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 msgr2=0x7f8b480ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 0x7f8b480ac4b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c420 tx=0x7f8b4400c8e0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 shutdown_connections 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b480ca610 0x7f8b48151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b480bd720 0x7f8b48147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 --2- 172.21.15.89:0/1366511120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b4806cd90 0x7f8b480ac4b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 >> 172.21.15.89:0/1366511120 conn(0x7f8b48071ea0 msgr2=0x7f8b481538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 shutdown_connections 2023-12-07T10:00:23.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.805+0000 7f8b50279640 1 -- 172.21.15.89:0/1366511120 wait complete. 2023-12-07T10:00:23.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:55.032694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:55.602397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:00:12.010823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:00:12.808546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:23.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:23.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 Processor -- start 2023-12-07T10:00:23.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 -- start start 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3280c8430 0x7fe32806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3280c7f20 0x7fe32806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32806cf70 con 0x7fe328151d80 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe328152160 con 0x7fe3280c8430 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe32d89c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c6a30 con 0x7fe3280c7f20 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3280c8430 0x7fe32806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3280c8430 0x7fe32806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43448/0 (socket says 172.21.15.89:43448) 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 -- 172.21.15.89:0/683053691 learned_addr learned my addr 172.21.15.89:0/683053691 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3277fe640 1 --2- 172.21.15.89:0/683053691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3280c7f20 0x7fe32806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 -- 172.21.15.89:0/683053691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3280c7f20 msgr2=0x7fe32806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 --2- 172.21.15.89:0/683053691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3280c7f20 0x7fe32806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 -- 172.21.15.89:0/683053691 >> v1:172.21.15.97:6789/0 conn(0x7fe328151d80 legacy=0x7fe3280c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.965+0000 7fe3267fc640 1 -- 172.21.15.89:0/683053691 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280c72d0 con 0x7fe3280c8430 2023-12-07T10:00:23.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe3267fc640 1 --2- 172.21.15.89:0/683053691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c8430 0x7fe32806b720 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009870 tx=0x7fe31c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8f01d125482cc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe325ffb640 1 -- 172.21.15.89:0/683053691 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0ab680 con 0x7fe3280c8430 2023-12-07T10:00:23.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe325ffb640 1 -- 172.21.15.89:0/683053691 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c0ab7e0 con 0x7fe3280c8430 2023-12-07T10:00:23.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe325ffb640 1 -- 172.21.15.89:0/683053691 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0abb70 con 0x7fe3280c8430 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 -- 172.21.15.89:0/683053691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c8430 msgr2=0x7fe32806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 --2- 172.21.15.89:0/683053691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c8430 0x7fe32806b720 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009870 tx=0x7fe31c01c480 comp rx=0 tx=0).stop 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 -- 172.21.15.89:0/683053691 shutdown_connections 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 --2- 172.21.15.89:0/683053691 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3280c7f20 0x7fe32806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 --2- 172.21.15.89:0/683053691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c8430 0x7fe32806b720 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 -- 172.21.15.89:0/683053691 >> 172.21.15.89:0/683053691 conn(0x7fe3280abd00 msgr2=0x7fe3280ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 -- 172.21.15.89:0/683053691 shutdown_connections 2023-12-07T10:00:23.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 -- 172.21.15.89:0/683053691 wait complete. 2023-12-07T10:00:23.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.969+0000 7fe32d89c640 1 Processor -- start 2023-12-07T10:00:23.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- start start 2023-12-07T10:00:23.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 0x7fe3280c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3280c8430 0x7fe32814d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe328151d80 0x7fe32814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c01f0 con 0x7fe3280c7f20 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280bdf10 con 0x7fe3280c8430 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c3040 con 0x7fe328151d80 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 0x7fe3280c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 0x7fe3280c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43460/0 (socket says 172.21.15.89:43460) 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 -- 172.21.15.89:0/1617809014 learned_addr learned my addr 172.21.15.89:0/1617809014 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe3267fc640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3280c8430 0x7fe32814d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe3277fe640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe328151d80 0x7fe32814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 -- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe328151d80 msgr2=0x7fe32814b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe328151d80 0x7fe32814b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 -- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3280c8430 msgr2=0x7fe32814d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3280c8430 0x7fe32814d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 -- 172.21.15.89:0/1617809014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0094d0 con 0x7fe3280c7f20 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe326ffd640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 0x7fe3280c2b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c3c0 tx=0x7fe31800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180052d0 con 0x7fe3280c7f20 2023-12-07T10:00:23.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318005430 con 0x7fe3280c7f20 2023-12-07T10:00:23.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3280c3270 con 0x7fe3280c7f20 2023-12-07T10:00:23.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318003840 con 0x7fe3280c7f20 2023-12-07T10:00:23.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3280c3810 con 0x7fe3280c7f20 2023-12-07T10:00:23.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.973+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32804e890 con 0x7fe3280c7f20 2023-12-07T10:00:23.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.977+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe3180039a0 con 0x7fe3280c7f20 2023-12-07T10:00:23.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.977+0000 7fe30ffff640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe314066900 0x7fe314068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:23.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.977+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe318083bd0 con 0x7fe3280c7f20 2023-12-07T10:00:23.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.977+0000 7fe3267fc640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe314066900 0x7fe314068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:23.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.977+0000 7fe3267fc640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe314066900 0x7fe314068dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0af000 tx=0x7fe31c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:23.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:23.981+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe318050bd0 con 0x7fe3280c7f20 2023-12-07T10:00:24.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.129+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe328153760 con 0x7fe3280c7f20 2023-12-07T10:00:24.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.129+0000 7fe30ffff640 1 -- 172.21.15.89:0/1617809014 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe318017020 con 0x7fe3280c7f20 2023-12-07T10:00:24.135 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe314066900 msgr2=0x7fe314068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe314066900 0x7fe314068dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0af000 tx=0x7fe31c0b6040 comp rx=0 tx=0).stop 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 msgr2=0x7fe3280c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 0x7fe3280c2b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c3c0 tx=0x7fe31800c880 comp rx=0 tx=0).stop 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 shutdown_connections 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe314066900 0x7fe314068dc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe328151d80 0x7fe32814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3280c8430 0x7fe32814d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 --2- 172.21.15.89:0/1617809014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3280c7f20 0x7fe3280c2b00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 >> 172.21.15.89:0/1617809014 conn(0x7fe3280abd00 msgr2=0x7fe3280c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:24.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 shutdown_connections 2023-12-07T10:00:24.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.133+0000 7fe32d89c640 1 -- 172.21.15.89:0/1617809014 wait complete. 2023-12-07T10:00:24.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:00:24.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.293+0000 7f9c0ff80640 1 Processor -- start 2023-12-07T10:00:24.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.293+0000 7f9c0ff80640 1 -- start start 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0ff80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0814eaf0 0x7f9c08151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0ff80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c080c0370 0x7f9c0806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0ff80640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0806de00 con 0x7f9c08151f90 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0ff80640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c08070390 con 0x7f9c080c0370 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0ff80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0814eed0 con 0x7f9c0814eaf0 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0e51d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c080c0370 0x7f9c0806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0d51b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9c08151f90 0x7f9c0806d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34448/0 (socket says 172.21.15.89:34448) 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0d51b640 1 -- 172.21.15.89:0/35242149 learned_addr learned my addr 172.21.15.89:0/35242149 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0dd1c640 1 --2- 172.21.15.89:0/35242149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0814eaf0 0x7f9c08151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0e51d640 1 -- 172.21.15.89:0/35242149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0814eaf0 msgr2=0x7f9c08151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0e51d640 1 --2- 172.21.15.89:0/35242149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0814eaf0 0x7f9c08151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0e51d640 1 -- 172.21.15.89:0/35242149 >> v1:172.21.15.89:6789/0 conn(0x7f9c08151f90 legacy=0x7f9c0806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.297+0000 7f9c0e51d640 1 -- 172.21.15.89:0/35242149 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08151270 con 0x7f9c080c0370 2023-12-07T10:00:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0e51d640 1 --2- 172.21.15.89:0/35242149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c080c0370 0x7f9c0806d820 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009d90 tx=0x7f9c0001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3f2d5be87bef7e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0cd1a640 1 -- 172.21.15.89:0/35242149 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000a4c40 con 0x7f9c080c0370 2023-12-07T10:00:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0cd1a640 1 -- 172.21.15.89:0/35242149 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c000a4da0 con 0x7f9c080c0370 2023-12-07T10:00:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0cd1a640 1 -- 172.21.15.89:0/35242149 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000ac660 con 0x7f9c080c0370 2023-12-07T10:00:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 -- 172.21.15.89:0/35242149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c080c0370 msgr2=0x7f9c0806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/35242149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c080c0370 0x7f9c0806d820 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009d90 tx=0x7f9c0001c3d0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 -- 172.21.15.89:0/35242149 shutdown_connections 2023-12-07T10:00:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/35242149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c080c0370 0x7f9c0806d820 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/35242149 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c0814eaf0 0x7f9c08151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 -- 172.21.15.89:0/35242149 >> 172.21.15.89:0/35242149 conn(0x7f9c080c2a60 msgr2=0x7f9c080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 -- 172.21.15.89:0/35242149 shutdown_connections 2023-12-07T10:00:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 -- 172.21.15.89:0/35242149 wait complete. 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 Processor -- start 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.301+0000 7f9c0ff80640 1 -- start start 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c080c0370 0x7f9c080c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0814eaf0 0x7f9c0813d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 0x7f9c081f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c2670 con 0x7f9c0815cc00 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c1fa0 con 0x7f9c0814eaf0 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c1740 con 0x7f9c080c0370 2023-12-07T10:00:24.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 0x7f9c081f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 0x7f9c081f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43486/0 (socket says 172.21.15.89:43486) 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 -- 172.21.15.89:0/3804301350 learned_addr learned my addr 172.21.15.89:0/3804301350 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 -- 172.21.15.89:0/3804301350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c080c0370 msgr2=0x7f9c080c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c080c0370 0x7f9c080c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 -- 172.21.15.89:0/3804301350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0814eaf0 msgr2=0x7f9c0813d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0814eaf0 0x7f9c0813d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 -- 172.21.15.89:0/3804301350 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00009a70 con 0x7f9c0815cc00 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0e51d640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 0x7f9c081f11e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9c000af040 tx=0x7f9c000194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000ace40 con 0x7f9c0815cc00 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00009450 con 0x7f9c0815cc00 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c080c19e0 con 0x7f9c0815cc00 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000b8690 con 0x7f9c0815cc00 2023-12-07T10:00:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0814a5d0 con 0x7f9c0815cc00 2023-12-07T10:00:24.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0804e890 con 0x7f9c0815cc00 2023-12-07T10:00:24.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.305+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c000b87f0 con 0x7f9c0815cc00 2023-12-07T10:00:24.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.309+0000 7f9bfe7fc640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9bec0668d0 0x7f9bec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.309+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9c0011f050 con 0x7f9c0815cc00 2023-12-07T10:00:24.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.309+0000 7f9c0dd1c640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9bec0668d0 0x7f9bec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.309+0000 7f9c0dd1c640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9bec0668d0 0x7f9bec068d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9c081406d0 tx=0x7f9c04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.313+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c000ebfc0 con 0x7f9c0815cc00 2023-12-07T10:00:24.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.461+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c0814a7c0 con 0x7f9c0815cc00 2023-12-07T10:00:24.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.461+0000 7f9bfe7fc640 1 -- 172.21.15.89:0/3804301350 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c000ef5e0 con 0x7f9c0815cc00 2023-12-07T10:00:24.467 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9bec0668d0 msgr2=0x7f9bec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9bec0668d0 0x7f9bec068d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9c081406d0 tx=0x7f9c04008040 comp rx=0 tx=0).stop 2023-12-07T10:00:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 msgr2=0x7f9c081f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 0x7f9c081f11e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9c000af040 tx=0x7f9c000194c0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 shutdown_connections 2023-12-07T10:00:24.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c0815cc00 0x7f9c081f11e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c0814eaf0 0x7f9c0813d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9bec0668d0 0x7f9bec068d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 --2- 172.21.15.89:0/3804301350 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c080c0370 0x7f9c080c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 >> 172.21.15.89:0/3804301350 conn(0x7f9c080c2a60 msgr2=0x7f9c0814f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 shutdown_connections 2023-12-07T10:00:24.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.465+0000 7f9c0ff80640 1 -- 172.21.15.89:0/3804301350 wait complete. 2023-12-07T10:00:24.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:00:24.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 Processor -- start 2023-12-07T10:00:24.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 -- start start 2023-12-07T10:00:24.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f263014eaf0 0x7f2630151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2630151f90 0x7f263006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263006de00 con 0x7f26300c0370 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2630070390 con 0x7f263014eaf0 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f26360fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263014eed0 con 0x7f2630151f90 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f263014eaf0 0x7f2630151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f263014eaf0 0x7f2630151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43494/0 (socket says 172.21.15.89:43494) 2023-12-07T10:00:24.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 -- 172.21.15.89:0/1549092537 learned_addr learned my addr 172.21.15.89:0/1549092537 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 -- 172.21.15.89:0/1549092537 >> v2:172.21.15.97:3300/0 conn(0x7f2630151f90 msgr2=0x7f263006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 --2- 172.21.15.89:0/1549092537 >> v2:172.21.15.97:3300/0 conn(0x7f2630151f90 0x7f263006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 -- 172.21.15.89:0/1549092537 >> v1:172.21.15.89:6789/0 conn(0x7f26300c0370 legacy=0x7f263006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.625+0000 7f262f7fe640 1 -- 172.21.15.89:0/1549092537 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630151270 con 0x7f263014eaf0 2023-12-07T10:00:24.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f262f7fe640 1 --2- 172.21.15.89:0/1549092537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f263014eaf0 0x7f2630151a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f263006e2d0 tx=0x7f262001e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c70eab160bf0769 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f262effd640 1 -- 172.21.15.89:0/1549092537 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200ac430 con 0x7f263014eaf0 2023-12-07T10:00:24.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f262effd640 1 -- 172.21.15.89:0/1549092537 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200ac590 con 0x7f263014eaf0 2023-12-07T10:00:24.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f262effd640 1 -- 172.21.15.89:0/1549092537 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200ac920 con 0x7f263014eaf0 2023-12-07T10:00:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 -- 172.21.15.89:0/1549092537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f263014eaf0 msgr2=0x7f2630151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 --2- 172.21.15.89:0/1549092537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f263014eaf0 0x7f2630151a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f263006e2d0 tx=0x7f262001e5c0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 -- 172.21.15.89:0/1549092537 shutdown_connections 2023-12-07T10:00:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 --2- 172.21.15.89:0/1549092537 >> v2:172.21.15.97:3300/0 conn(0x7f2630151f90 0x7f263006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 --2- 172.21.15.89:0/1549092537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f263014eaf0 0x7f2630151a50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 -- 172.21.15.89:0/1549092537 >> 172.21.15.89:0/1549092537 conn(0x7f26300c2a60 msgr2=0x7f26300c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 -- 172.21.15.89:0/1549092537 shutdown_connections 2023-12-07T10:00:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.629+0000 7f26360fe640 1 -- 172.21.15.89:0/1549092537 wait complete. 2023-12-07T10:00:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 Processor -- start 2023-12-07T10:00:24.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 -- start start 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 0x7f26300bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f263014eaf0 0x7f26301f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26301f0f00 0x7f2630141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300c0f50 con 0x7f26300c0370 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300c1c30 con 0x7f26301f0f00 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300c2490 con 0x7f263014eaf0 2023-12-07T10:00:24.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 0x7f26300bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 0x7f26300bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43506/0 (socket says 172.21.15.89:43506) 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 -- 172.21.15.89:0/3713769172 learned_addr learned my addr 172.21.15.89:0/3713769172 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 -- 172.21.15.89:0/3713769172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f263014eaf0 msgr2=0x7f26301f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f263014eaf0 0x7f26301f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 -- 172.21.15.89:0/3713769172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26301f0f00 msgr2=0x7f2630141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26301f0f00 0x7f2630141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 -- 172.21.15.89:0/3713769172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200094d0 con 0x7f26300c0370 2023-12-07T10:00:24.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262f7fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 0x7f26300bf5f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f262001b1d0 tx=0x7f262001ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200b7850 con 0x7f26300c0370 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200b79d0 con 0x7f26300c0370 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300c0900 con 0x7f26300c0370 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200b7d80 con 0x7f26300c0370 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.633+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300c18a0 con 0x7f26300c0370 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.637+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263004e890 con 0x7f26300c0370 2023-12-07T10:00:24.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.637+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f26200b5410 con 0x7f26300c0370 2023-12-07T10:00:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.637+0000 7f262cff9640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26100668d0 0x7f2610068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.637+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f262011f440 con 0x7f26300c0370 2023-12-07T10:00:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.637+0000 7f2627fff640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26100668d0 0x7f2610068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.637+0000 7f2627fff640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26100668d0 0x7f2610068d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2630072670 tx=0x7f2618006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.641+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26200ec310 con 0x7f26300c0370 2023-12-07T10:00:24.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.789+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26300706a0 con 0x7f26300c0370 2023-12-07T10:00:24.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.789+0000 7f262cff9640 1 -- 172.21.15.89:0/3713769172 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26200f4e60 con 0x7f26300c0370 2023-12-07T10:00:24.796 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26100668d0 msgr2=0x7f2610068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26100668d0 0x7f2610068d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2630072670 tx=0x7f2618006c00 comp rx=0 tx=0).stop 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 msgr2=0x7f26300bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 0x7f26300bf5f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f262001b1d0 tx=0x7f262001ce00 comp rx=0 tx=0).stop 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 shutdown_connections 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26301f0f00 0x7f2630141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f26100668d0 0x7f2610068d90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f263014eaf0 0x7f26301f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 --2- 172.21.15.89:0/3713769172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26300c0370 0x7f26300bf5f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 >> 172.21.15.89:0/3713769172 conn(0x7f26300c2a60 msgr2=0x7f2630144990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 shutdown_connections 2023-12-07T10:00:24.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.793+0000 7f26360fe640 1 -- 172.21.15.89:0/3713769172 wait complete. 2023-12-07T10:00:24.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:00:24.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 Processor -- start 2023-12-07T10:00:24.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 -- start start 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8100a86d0 0x7fe8100a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe810156600 0x7fe81014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe81014fb30 0x7fe8100aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe810152d90 con 0x7fe81014fb30 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe810152480 con 0x7fe810156600 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe8150fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100a9760 con 0x7fe8100a86d0 2023-12-07T10:00:24.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe81014fb30 0x7fe8100aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe81014fb30 0x7fe8100aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43518/0 (socket says 172.21.15.89:43518) 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 -- 172.21.15.89:0/2104985604 learned_addr learned my addr 172.21.15.89:0/2104985604 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80e59c640 1 --2- 172.21.15.89:0/2104985604 >> v2:172.21.15.97:3300/0 conn(0x7fe810156600 0x7fe81014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80ed9d640 1 --2- 172.21.15.89:0/2104985604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8100a86d0 0x7fe8100a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 -- 172.21.15.89:0/2104985604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8100a86d0 msgr2=0x7fe8100a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 --2- 172.21.15.89:0/2104985604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8100a86d0 0x7fe8100a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 -- 172.21.15.89:0/2104985604 >> v2:172.21.15.97:3300/0 conn(0x7fe810156600 msgr2=0x7fe81014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 --2- 172.21.15.89:0/2104985604 >> v2:172.21.15.97:3300/0 conn(0x7fe810156600 0x7fe81014f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80f59e640 1 -- 172.21.15.89:0/2104985604 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810152740 con 0x7fe81014fb30 2023-12-07T10:00:24.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.953+0000 7fe80e59c640 1 --2- 172.21.15.89:0/2104985604 >> v2:172.21.15.97:3300/0 conn(0x7fe810156600 0x7fe81014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:24.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe80f59e640 1 --2- 172.21.15.89:0/2104985604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81014fb30 0x7fe8100aae40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe810072770 tx=0x7fe80801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4e3a4442705f89 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe80dd9b640 1 -- 172.21.15.89:0/2104985604 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080a5760 con 0x7fe81014fb30 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe80dd9b640 1 -- 172.21.15.89:0/2104985604 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080a58c0 con 0x7fe81014fb30 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe80dd9b640 1 -- 172.21.15.89:0/2104985604 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080a5c50 con 0x7fe81014fb30 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 -- 172.21.15.89:0/2104985604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81014fb30 msgr2=0x7fe8100aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2104985604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81014fb30 0x7fe8100aae40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe810072770 tx=0x7fe80801c9d0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 -- 172.21.15.89:0/2104985604 shutdown_connections 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2104985604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81014fb30 0x7fe8100aae40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2104985604 >> v2:172.21.15.97:3300/0 conn(0x7fe810156600 0x7fe81014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2104985604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8100a86d0 0x7fe8100a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 -- 172.21.15.89:0/2104985604 >> 172.21.15.89:0/2104985604 conn(0x7fe8100c2a60 msgr2=0x7fe8100c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:24.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 -- 172.21.15.89:0/2104985604 shutdown_connections 2023-12-07T10:00:24.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.957+0000 7fe8150fe640 1 -- 172.21.15.89:0/2104985604 wait complete. 2023-12-07T10:00:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 Processor -- start 2023-12-07T10:00:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- start start 2023-12-07T10:00:24.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 0x7fe810156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe81014fb30 0x7fe81014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe810156600 0x7fe81015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101eb740 con 0x7fe810156600 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101ebc70 con 0x7fe8100a86d0 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81014d220 con 0x7fe81014fb30 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 0x7fe810156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe810156600 0x7fe81015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 0x7fe810156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:53818/0 (socket says 172.21.15.89:53818) 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80ed9d640 1 -- 172.21.15.89:0/2608479839 learned_addr learned my addr 172.21.15.89:0/2608479839 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80e59c640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe81014fb30 0x7fe81014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 -- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe81014fb30 msgr2=0x7fe81014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe81014fb30 0x7fe81014ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 -- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 msgr2=0x7fe810156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 0x7fe810156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 -- 172.21.15.89:0/2608479839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009b30 con 0x7fe810156600 2023-12-07T10:00:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80ed9d640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 0x7fe810156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe80f59e640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe810156600 0x7fe81015b370 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ab000 tx=0x7fe808019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080b8670 con 0x7fe810156600 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080b87d0 con 0x7fe810156600 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81014d500 con 0x7fe810156600 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080b8b80 con 0x7fe810156600 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81015ae50 con 0x7fe810156600 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.961+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81015ac90 con 0x7fe810156600 2023-12-07T10:00:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.965+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8080b8ce0 con 0x7fe810156600 2023-12-07T10:00:24.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.965+0000 7fe7f77fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7fc0668d0 0x7fe7fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:24.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.965+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe80811fa60 con 0x7fe810156600 2023-12-07T10:00:24.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.965+0000 7fe80ed9d640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7fc0668d0 0x7fe7fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:24.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.965+0000 7fe80ed9d640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7fc0668d0 0x7fe7fc068d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8100c01d0 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:24.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:24.969+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8080ec9e0 con 0x7fe810156600 2023-12-07T10:00:25.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.117+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8100725a0 con 0x7fe810156600 2023-12-07T10:00:25.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.117+0000 7fe7f77fe640 1 -- 172.21.15.89:0/2608479839 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe8080f0000 con 0x7fe810156600 2023-12-07T10:00:25.122 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7fc0668d0 msgr2=0x7fe7fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7fc0668d0 0x7fe7fc068d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8100c01d0 tx=0x7fe800008040 comp rx=0 tx=0).stop 2023-12-07T10:00:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe810156600 msgr2=0x7fe81015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe810156600 0x7fe81015b370 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ab000 tx=0x7fe808019770 comp rx=0 tx=0).stop 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 shutdown_connections 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe810156600 0x7fe81015b370 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7fc0668d0 0x7fe7fc068d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe81014fb30 0x7fe81014ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 --2- 172.21.15.89:0/2608479839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100a86d0 0x7fe810156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 >> 172.21.15.89:0/2608479839 conn(0x7fe8100c2a60 msgr2=0x7fe810151490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 shutdown_connections 2023-12-07T10:00:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.121+0000 7fe8150fe640 1 -- 172.21.15.89:0/2608479839 wait complete. 2023-12-07T10:00:25.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:00:25.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 Processor -- start 2023-12-07T10:00:25.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 -- start start 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40cc14eaf0 0x7f40cc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 0x7f40cc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc06de00 con 0x7f40cc0c0370 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc070390 con 0x7f40cc151f90 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d406b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc14eed0 con 0x7f40cc14eaf0 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1606640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 0x7f40cc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40cc14eaf0 0x7f40cc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40cc14eaf0 0x7f40cc151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:53826/0 (socket says 172.21.15.89:53826) 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 -- 172.21.15.89:0/132291266 learned_addr learned my addr 172.21.15.89:0/132291266 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1606640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 0x7f40cc06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43536/0 (socket says 172.21.15.89:43536) 2023-12-07T10:00:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 -- 172.21.15.89:0/132291266 >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 msgr2=0x7f40cc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 --2- 172.21.15.89:0/132291266 >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 0x7f40cc06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 -- 172.21.15.89:0/132291266 >> v1:172.21.15.97:6789/0 conn(0x7f40cc0c0370 legacy=0x7f40cc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1e07640 1 -- 172.21.15.89:0/132291266 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc151270 con 0x7f40cc14eaf0 2023-12-07T10:00:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.281+0000 7f40d1606640 1 --2- 172.21.15.89:0/132291266 >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 0x7f40cc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:25.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d1e07640 1 --2- 172.21.15.89:0/132291266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc151a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0c3b00 tx=0x7f40c801ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249e6cc9a777379b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d0e05640 1 -- 172.21.15.89:0/132291266 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80a7a50 con 0x7f40cc14eaf0 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d0e05640 1 -- 172.21.15.89:0/132291266 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80a7bb0 con 0x7f40cc14eaf0 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d0e05640 1 -- 172.21.15.89:0/132291266 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80af440 con 0x7f40cc14eaf0 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 -- 172.21.15.89:0/132291266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 msgr2=0x7f40cc151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 --2- 172.21.15.89:0/132291266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc151a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0c3b00 tx=0x7f40c801ea80 comp rx=0 tx=0).stop 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 -- 172.21.15.89:0/132291266 shutdown_connections 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 --2- 172.21.15.89:0/132291266 >> v2:172.21.15.89:3300/0 conn(0x7f40cc151f90 0x7f40cc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 --2- 172.21.15.89:0/132291266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc151a50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 -- 172.21.15.89:0/132291266 >> 172.21.15.89:0/132291266 conn(0x7f40cc0c2a60 msgr2=0x7f40cc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:25.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 -- 172.21.15.89:0/132291266 shutdown_connections 2023-12-07T10:00:25.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.285+0000 7f40d406b640 1 -- 172.21.15.89:0/132291266 wait complete. 2023-12-07T10:00:25.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 Processor -- start 2023-12-07T10:00:25.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 -- start start 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40cc0c0370 0x7f40cc148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 0x7f40cc0aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0aa660 con 0x7f40cc142db0 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0a9d50 con 0x7f40cc14eaf0 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1ee320 con 0x7f40cc0c0370 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 0x7f40cc0aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d1e07640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40cc0c0370 0x7f40cc148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 0x7f40cc0aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43550/0 (socket says 172.21.15.89:43550) 2023-12-07T10:00:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 -- 172.21.15.89:0/1962614354 learned_addr learned my addr 172.21.15.89:0/1962614354 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d1606640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 -- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40cc0c0370 msgr2=0x7f40cc148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40cc0c0370 0x7f40cc148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 -- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 msgr2=0x7f40cc1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 -- 172.21.15.89:0/1962614354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009420 con 0x7f40cc142db0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d1e07640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40cc0c0370 0x7f40cc148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d2608640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 0x7f40cc0aaaf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c770 tx=0x7f40c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4003b80 con 0x7f40cc142db0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4003ce0 con 0x7f40cc142db0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400aa90 con 0x7f40cc142db0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c800b770 con 0x7f40cc142db0 2023-12-07T10:00:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.289+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc0aa2f0 con 0x7f40cc142db0 2023-12-07T10:00:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.293+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc0aa810 con 0x7f40cc142db0 2023-12-07T10:00:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.293+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f40c400abf0 con 0x7f40cc142db0 2023-12-07T10:00:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.293+0000 7f40c27fc640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f40b0066900 0x7f40b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.293+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f40c40844e0 con 0x7f40cc142db0 2023-12-07T10:00:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.293+0000 7f40d1e07640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f40b0066900 0x7f40b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.293+0000 7f40d1e07640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f40b0066900 0x7f40b0068dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f40c80b1000 tx=0x7f40c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.297+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40cc0aa810 con 0x7f40cc142db0 2023-12-07T10:00:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f40cc0aa810 con 0x7f40cc142db0 2023-12-07T10:00:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40c27fc640 1 -- 172.21.15.89:0/1962614354 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f40cc0aa810 con 0x7f40cc142db0 2023-12-07T10:00:25.457 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:25.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f40b0066900 msgr2=0x7f40b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f40b0066900 0x7f40b0068dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f40c80b1000 tx=0x7f40c8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:25.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 msgr2=0x7f40cc0aaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 0x7f40cc0aaaf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c770 tx=0x7f40c400cc30 comp rx=0 tx=0).stop 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 shutdown_connections 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc142db0 0x7f40cc0aaaf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc14eaf0 0x7f40cc1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f40b0066900 0x7f40b0068dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 --2- 172.21.15.89:0/1962614354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f40cc0c0370 0x7f40cc148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 >> 172.21.15.89:0/1962614354 conn(0x7f40cc0c2a60 msgr2=0x7f40cc06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 shutdown_connections 2023-12-07T10:00:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.453+0000 7f40d406b640 1 -- 172.21.15.89:0/1962614354 wait complete. 2023-12-07T10:00:25.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:00:25.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 Processor -- start 2023-12-07T10:00:25.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 -- start start 2023-12-07T10:00:25.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ae014ea60 0x7f5ae0155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ae006bd00 0x7f5ae00700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae006c440 con 0x7f5ae00bf400 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae0154790 con 0x7f5ae014ea60 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae8165640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae006c6e0 con 0x7f5ae006bd00 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5f01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ae014ea60 0x7f5ae0155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae6702640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5ae00bf400 0x7f5ae00c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34454/0 (socket says 172.21.15.89:34454) 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5f01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ae014ea60 0x7f5ae0155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43556/0 (socket says 172.21.15.89:43556) 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae6702640 1 -- 172.21.15.89:0/484954216 learned_addr learned my addr 172.21.15.89:0/484954216 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5700640 1 --2- 172.21.15.89:0/484954216 >> v2:172.21.15.97:3300/0 conn(0x7f5ae006bd00 0x7f5ae00700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5f01640 1 -- 172.21.15.89:0/484954216 >> v2:172.21.15.97:3300/0 conn(0x7f5ae006bd00 msgr2=0x7f5ae00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5f01640 1 --2- 172.21.15.89:0/484954216 >> v2:172.21.15.97:3300/0 conn(0x7f5ae006bd00 0x7f5ae00700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5f01640 1 -- 172.21.15.89:0/484954216 >> v1:172.21.15.89:6789/0 conn(0x7f5ae00bf400 legacy=0x7f5ae00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.613+0000 7f5ae5f01640 1 -- 172.21.15.89:0/484954216 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0154a50 con 0x7f5ae014ea60 2023-12-07T10:00:25.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae5f01640 1 --2- 172.21.15.89:0/484954216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae014ea60 0x7f5ae0155250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5ae006b370 tx=0x7f5adc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799ec2ff65b1f53 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae4eff640 1 -- 172.21.15.89:0/484954216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0ab600 con 0x7f5ae014ea60 2023-12-07T10:00:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae4eff640 1 -- 172.21.15.89:0/484954216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc0a7050 con 0x7f5ae014ea60 2023-12-07T10:00:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae4eff640 1 -- 172.21.15.89:0/484954216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0ab980 con 0x7f5ae014ea60 2023-12-07T10:00:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 -- 172.21.15.89:0/484954216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae014ea60 msgr2=0x7f5ae0155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 --2- 172.21.15.89:0/484954216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae014ea60 0x7f5ae0155250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5ae006b370 tx=0x7f5adc01c310 comp rx=0 tx=0).stop 2023-12-07T10:00:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 -- 172.21.15.89:0/484954216 shutdown_connections 2023-12-07T10:00:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 --2- 172.21.15.89:0/484954216 >> v2:172.21.15.97:3300/0 conn(0x7f5ae006bd00 0x7f5ae00700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 --2- 172.21.15.89:0/484954216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae014ea60 0x7f5ae0155250 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 -- 172.21.15.89:0/484954216 >> 172.21.15.89:0/484954216 conn(0x7f5ae00c2ad0 msgr2=0x7f5ae00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 -- 172.21.15.89:0/484954216 shutdown_connections 2023-12-07T10:00:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.617+0000 7f5ae8165640 1 -- 172.21.15.89:0/484954216 wait complete. 2023-12-07T10:00:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 Processor -- start 2023-12-07T10:00:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- start start 2023-12-07T10:00:25.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ae006bd00 0x7f5ae01effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 0x7f5ae0145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ae014ea60 0x7f5ae014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00aa550 con 0x7f5ae00bf400 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01f05c0 con 0x7f5ae014ea60 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01f08a0 con 0x7f5ae006bd00 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 0x7f5ae0145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 0x7f5ae0145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43564/0 (socket says 172.21.15.89:43564) 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 -- 172.21.15.89:0/208064986 learned_addr learned my addr 172.21.15.89:0/208064986 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5f01640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ae006bd00 0x7f5ae01effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae6702640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ae014ea60 0x7f5ae014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 -- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ae006bd00 msgr2=0x7f5ae01effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ae006bd00 0x7f5ae01effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 -- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ae014ea60 msgr2=0x7f5ae014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ae014ea60 0x7f5ae014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 -- 172.21.15.89:0/208064986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc009420 con 0x7f5ae00bf400 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae5700640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 0x7f5ae0145d50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000d800 tx=0x7f5ad000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000b6c0 con 0x7f5ae00bf400 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000b820 con 0x7f5ae00bf400 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000bb90 con 0x7f5ae00bf400 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae01f0b80 con 0x7f5ae00bf400 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01ecb60 con 0x7f5ae00bf400 2023-12-07T10:00:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.621+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae01ecd20 con 0x7f5ae00bf400 2023-12-07T10:00:25.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.625+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5ad000bcf0 con 0x7f5ae00bf400 2023-12-07T10:00:25.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.625+0000 7f5ad67fc640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ac40668d0 0x7f5ac4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:25.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.625+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5ad0084c10 con 0x7f5ae00bf400 2023-12-07T10:00:25.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.625+0000 7f5ae5f01640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ac40668d0 0x7f5ac4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.625+0000 7f5ae5f01640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ac40668d0 0x7f5ac4068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0ad000 tx=0x7f5adc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:25.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.629+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ad0051b00 con 0x7f5ae00bf400 2023-12-07T10:00:25.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ae004e890 con 0x7f5ae00bf400 2023-12-07T10:00:25.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ad67fc640 1 -- 172.21.15.89:0/208064986 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5ad0055120 con 0x7f5ae00bf400 2023-12-07T10:00:25.793 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ac40668d0 msgr2=0x7f5ac4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ac40668d0 0x7f5ac4068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0ad000 tx=0x7f5adc0a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 msgr2=0x7f5ae0145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 0x7f5ae0145d50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000d800 tx=0x7f5ad000dcc0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 shutdown_connections 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ae014ea60 0x7f5ae014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ae00bf400 0x7f5ae0145d50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ac40668d0 0x7f5ac4068d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 --2- 172.21.15.89:0/208064986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5ae006bd00 0x7f5ae01effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:25.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 >> 172.21.15.89:0/208064986 conn(0x7f5ae00c2ad0 msgr2=0x7f5ae01524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:25.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 shutdown_connections 2023-12-07T10:00:25.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:25.789+0000 7f5ae8165640 1 -- 172.21.15.89:0/208064986 wait complete. 2023-12-07T10:00:25.814 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T10:00:25.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:25.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:25.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:00:25.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:25.841 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T10:00:25.893 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:25.893 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:25.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:00:25.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:00:26.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 Processor -- start 2023-12-07T10:00:26.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 -- start start 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880ca610 0x7fcb880c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb880bd720 0x7fcb880c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcb8806cd90 0x7fcb88158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb88155790 con 0x7fcb880bd720 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb880c4b00 con 0x7fcb8806cd90 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb8d3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880c4de0 con 0x7fcb880ca610 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb880bd720 0x7fcb880c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb880bd720 0x7fcb880c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43576/0 (socket says 172.21.15.89:43576) 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 -- 172.21.15.89:0/2177571945 learned_addr learned my addr 172.21.15.89:0/2177571945 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb877fe640 1 --2- 172.21.15.89:0/2177571945 >> v2:172.21.15.97:3300/0 conn(0x7fcb8806cd90 0x7fcb88158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/2177571945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880ca610 0x7fcb880c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 -- 172.21.15.89:0/2177571945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880ca610 msgr2=0x7fcb880c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/2177571945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880ca610 0x7fcb880c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 -- 172.21.15.89:0/2177571945 >> v2:172.21.15.97:3300/0 conn(0x7fcb8806cd90 msgr2=0x7fcb88158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/2177571945 >> v2:172.21.15.97:3300/0 conn(0x7fcb8806cd90 0x7fcb88158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.125+0000 7fcb7e7fc640 1 -- 172.21.15.89:0/2177571945 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88157e30 con 0x7fcb880bd720 2023-12-07T10:00:26.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/2177571945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880bd720 0x7fcb880c9a00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcb88152370 tx=0x7fcb7001c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7dedf5c343d1e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb867fc640 1 -- 172.21.15.89:0/2177571945 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880c52d0 con 0x7fcb880bd720 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb867fc640 1 -- 172.21.15.89:0/2177571945 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700a4880 con 0x7fcb880bd720 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb867fc640 1 -- 172.21.15.89:0/2177571945 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700a4c10 con 0x7fcb880bd720 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 -- 172.21.15.89:0/2177571945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880bd720 msgr2=0x7fcb880c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/2177571945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880bd720 0x7fcb880c9a00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcb88152370 tx=0x7fcb7001c0c0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 -- 172.21.15.89:0/2177571945 shutdown_connections 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/2177571945 >> v2:172.21.15.97:3300/0 conn(0x7fcb8806cd90 0x7fcb88158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/2177571945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880bd720 0x7fcb880c9a00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/2177571945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880ca610 0x7fcb880c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 -- 172.21.15.89:0/2177571945 >> 172.21.15.89:0/2177571945 conn(0x7fcb88071ea0 msgr2=0x7fcb880722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 -- 172.21.15.89:0/2177571945 shutdown_connections 2023-12-07T10:00:26.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.129+0000 7fcb8d3df640 1 -- 172.21.15.89:0/2177571945 wait complete. 2023-12-07T10:00:26.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 Processor -- start 2023-12-07T10:00:26.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- start start 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 0x7fcb88147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880bd720 0x7fcb880ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880ca610 0x7fcb880a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88149900 con 0x7fcb8806cd90 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88157bb0 con 0x7fcb880ca610 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88148550 con 0x7fcb880bd720 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 0x7fcb88147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 0x7fcb88147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43582/0 (socket says 172.21.15.89:43582) 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 -- 172.21.15.89:0/1702807721 learned_addr learned my addr 172.21.15.89:0/1702807721 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb877fe640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880ca610 0x7fcb880a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880bd720 0x7fcb880ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 -- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880bd720 msgr2=0x7fcb880ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880bd720 0x7fcb880ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 -- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880ca610 msgr2=0x7fcb880a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880ca610 0x7fcb880a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 -- 172.21.15.89:0/1702807721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700094d0 con 0x7fcb8806cd90 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb877fe640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880ca610 0x7fcb880a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880bd720 0x7fcb880ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 0x7fcb88147b20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800e870 tx=0x7fcb7800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78009510 con 0x7fcb8806cd90 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7800eec0 con 0x7fcb8806cd90 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb880aae00 con 0x7fcb8806cd90 2023-12-07T10:00:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800cb40 con 0x7fcb8806cd90 2023-12-07T10:00:26.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb880aab20 con 0x7fcb8806cd90 2023-12-07T10:00:26.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.133+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8804e890 con 0x7fcb8806cd90 2023-12-07T10:00:26.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.137+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb7800cca0 con 0x7fcb8806cd90 2023-12-07T10:00:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.137+0000 7fcb7ffff640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb68066900 0x7fcb68068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.137+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcb78084880 con 0x7fcb8806cd90 2023-12-07T10:00:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.137+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb68066900 0x7fcb68068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.137+0000 7fcb7e7fc640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb68066900 0x7fcb68068dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb700ae000 tx=0x7fcb70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.141+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb78051750 con 0x7fcb8806cd90 2023-12-07T10:00:26.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.325+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcb881577d0 con 0x7fcb8806cd90 2023-12-07T10:00:26.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb7ffff640 1 -- 172.21.15.89:0/1702807721 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fcb78054d70 con 0x7fcb8806cd90 2023-12-07T10:00:26.332 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:00:26.332 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb68066900 msgr2=0x7fcb68068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb68066900 0x7fcb68068dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb700ae000 tx=0x7fcb70008040 comp rx=0 tx=0).stop 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 msgr2=0x7fcb88147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 0x7fcb88147b20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800e870 tx=0x7fcb7800ec70 comp rx=0 tx=0).stop 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 shutdown_connections 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880ca610 0x7fcb880a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb68066900 0x7fcb68068dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb880bd720 0x7fcb880ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 --2- 172.21.15.89:0/1702807721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8806cd90 0x7fcb88147b20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:26.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 >> 172.21.15.89:0/1702807721 conn(0x7fcb88071ea0 msgr2=0x7fcb880c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:26.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 shutdown_connections 2023-12-07T10:00:26.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:26.329+0000 7fcb8d3df640 1 -- 172.21.15.89:0/1702807721 wait complete. 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:00:26.353 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.TxJfFX8xG7 2023-12-07T10:00:26.353 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:00:26.362 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.9prVnJCXUg 2023-12-07T10:00:26.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /tmp/tmp.TxJfFX8xG7 /tmp/tmp.9prVnJCXUg 2023-12-07T10:00:26.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.9prVnJCXUg 2023-12-07T10:00:26.544 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.9prVnJCXUg is 185B 2023-12-07T10:00:26.561 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.9prVnJCXUg 2023-12-07T10:00:26.570 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQC3l3Fl6/iADxAA8LuRMu2019crYDu6LFmRsw== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-07T10:00:26.570 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:00:26.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:26.571 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42333sec preferred_lft 42333sec 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:00:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:00:26.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:26.628 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:00:26.690 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T10:00:26.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:26.692 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T10:00:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T10:00:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:00:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:00:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:00:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:00:26.748 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:00:26.748 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:26.748 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:26.748 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:00:26.748 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:00:26.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:26.748 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T10:00:26.748 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T10:00:26.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:00:26.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:00:26.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:00:26.749 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T10:00:26.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:26.842 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:00:26.851 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:00:26.852 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:00:26.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:26.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T10:00:26.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:26.920 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:26.972 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:00:26.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:00:26.972 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:00:27.023 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:27.024 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/tmp/tmp.TxJfFX8xG7 of=/dev/stdout 2023-12-07T10:00:27.076 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-07T10:00:27.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:27.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQC3l3Fl6/iADxAA8LuRMu2019crYDu6LFmRsw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:27.170 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,secret=AQC3l3Fl6/iADxAA8LuRMu2019crYDu6LFmRsw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:27.170 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:27.170 INFO:teuthology.orchestra.run.smithi089.stdout:keyring.get_secret failed 2023-12-07T10:00:27.180 INFO:teuthology.orchestra.run.smithi089.stderr:mount.ceph: kernel BUG! 2023-12-07T10:00:27.181 INFO:teuthology.orchestra.run.smithi089.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-07T10:00:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,secret=AQC3l3Fl6/iADxAA8LuRMu2019crYDu6LFmRsw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:00:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:00:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:00:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: testuser@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs2=/ 2023-12-07T10:00:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:00:27.185 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-07T10:00:27.185 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-07T10:00:27.185 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T10:00:27.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:00:27.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:00:27.356 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T10:00:27.356 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:27.356 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:27.365 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:00:27.366 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:27.366 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:27.376 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:27.376 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:27.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9bcc05640 1 Processor -- start 2023-12-07T10:00:27.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9bcc05640 1 -- start start 2023-12-07T10:00:27.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9bcc05640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff9b8070b80 0x7ff9b8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9bcc05640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b806d320 con 0x7ff9b814e9d0 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9bcc05640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b80721b0 con 0x7ff9b80a8470 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9bcc05640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b80c2830 con 0x7ff9b8070b80 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff9b814e9d0 0x7ff9b80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34464/0 (socket says 172.21.15.89:34464) 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 -- 172.21.15.89:0/2419312345 learned_addr learned my addr 172.21.15.89:0/2419312345 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9add9b640 1 --2- 172.21.15.89:0/2419312345 >> v2:172.21.15.97:3300/0 conn(0x7ff9b8070b80 0x7ff9b8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284759646 0 0) 0x7ff9b806d320 con 0x7ff9b814e9d0 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a4003530 con 0x7ff9b814e9d0 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384836803 0 0) 0x7ff9a4003530 con 0x7ff9b814e9d0 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 >> v2:172.21.15.97:3300/0 conn(0x7ff9b8070b80 msgr2=0x7ff9b8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 --2- 172.21.15.89:0/2419312345 >> v2:172.21.15.97:3300/0 conn(0x7ff9b8070b80 0x7ff9b8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 >> v1:172.21.15.97:6789/0 conn(0x7ff9b80a8470 legacy=0x7ff9b806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8072450 con 0x7ff9b814e9d0 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7ff9a8001680 con 0x7ff9b814e9d0 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 >> v1:172.21.15.89:6789/0 conn(0x7ff9b814e9d0 legacy=0x7ff9b80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4003980 0x7ff9a4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4005190 0x7ff9a400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c2830 con 0x7ff9a4003980 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400e340 con 0x7ff9a40047d0 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400e500 con 0x7ff9a4005190 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4003980 0x7ff9a4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9add9b640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b6d9d640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4005190 0x7ff9a400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 -- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4005190 msgr2=0x7ff9a400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:27.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4005190 0x7ff9a400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 -- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a40047d0 msgr2=0x7ff9a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:27.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b659c640 1 -- 172.21.15.89:0/2419312345 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4003530 con 0x7ff9a4003980 2023-12-07T10:00:27.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9add9b640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:27.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.561+0000 7ff9b6d9d640 1 -- 172.21.15.89:0/2419312345 reap_dead start 2023-12-07T10:00:27.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9b659c640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4003980 0x7ff9a4003da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c1c0 tx=0x7ff9a801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d342a8cc318b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:27.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80058e0 con 0x7ff9a4003980 2023-12-07T10:00:27.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8005a40 con 0x7ff9a4003980 2023-12-07T10:00:27.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9b5d9b640 1 -- 172.21.15.89:0/2419312345 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8005e70 con 0x7ff9a4003980 2023-12-07T10:00:27.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 -- 172.21.15.89:0/2419312345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4003980 msgr2=0x7ff9a4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4003980 0x7ff9a4003da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c1c0 tx=0x7ff9a801cc20 comp rx=0 tx=0).stop 2023-12-07T10:00:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 -- 172.21.15.89:0/2419312345 shutdown_connections 2023-12-07T10:00:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/2419312345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4003980 0x7ff9a4003da0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 -- 172.21.15.89:0/2419312345 >> 172.21.15.89:0/2419312345 conn(0x7ff9b80c2ad0 msgr2=0x7ff9b80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 -- 172.21.15.89:0/2419312345 shutdown_connections 2023-12-07T10:00:27.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.565+0000 7ff9bcc05640 1 -- 172.21.15.89:0/2419312345 wait complete. 2023-12-07T10:00:27.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 Processor -- start 2023-12-07T10:00:27.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 -- start start 2023-12-07T10:00:27.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4003980 0x7ff9b81e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b81ecb10 0x7ff9b80c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 0x7ff9b81448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b81e91d0 con 0x7ff9b8149370 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80ab9b0 con 0x7ff9b81ecb10 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80abc90 con 0x7ff9a4003980 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 0x7ff9b81448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 0x7ff9b81448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43590/0 (socket says 172.21.15.89:43590) 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 -- 172.21.15.89:0/1459009454 learned_addr learned my addr 172.21.15.89:0/1459009454 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b659c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4003980 0x7ff9b81e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9add9b640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b81ecb10 0x7ff9b80c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 -- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4003980 msgr2=0x7ff9b81e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4003980 0x7ff9b81e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 -- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b81ecb10 msgr2=0x7ff9b80c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b81ecb10 0x7ff9b80c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 -- 172.21.15.89:0/1459009454 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b81e8e60 con 0x7ff9b8149370 2023-12-07T10:00:27.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9b6d9d640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 0x7ff9b81448f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80a9510 tx=0x7ff9b000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0003980 con 0x7ff9b8149370 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0003b00 con 0x7ff9b8149370 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b80c53b0 con 0x7ff9b8149370 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00050d0 con 0x7ff9b8149370 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.569+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b81e8b10 con 0x7ff9b8149370 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.573+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b8067a40 con 0x7ff9b8149370 2023-12-07T10:00:27.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.573+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff9b0005230 con 0x7ff9b8149370 2023-12-07T10:00:27.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.573+0000 7ff9af7fe640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff998066900 0x7ff998068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.573+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff9b00843b0 con 0x7ff9b8149370 2023-12-07T10:00:27.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.573+0000 7ff9b659c640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff998066900 0x7ff998068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.573+0000 7ff9b659c640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff998066900 0x7ff998068dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80ab000 tx=0x7ff9a80a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:27.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.577+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9b0051330 con 0x7ff9b8149370 2023-12-07T10:00:27.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.725+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b81e8ff0 con 0x7ff9b8149370 2023-12-07T10:00:27.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.725+0000 7ff9af7fe640 1 -- 172.21.15.89:0/1459009454 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7ff9b0054950 con 0x7ff9b8149370 2023-12-07T10:00:27.732 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:27.732 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff998066900 msgr2=0x7ff998068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff998066900 0x7ff998068dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80ab000 tx=0x7ff9a80a7070 comp rx=0 tx=0).stop 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 msgr2=0x7ff9b81448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 0x7ff9b81448f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80a9510 tx=0x7ff9b000ec10 comp rx=0 tx=0).stop 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 shutdown_connections 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b8149370 0x7ff9b81448f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9b81ecb10 0x7ff9b80c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff998066900 0x7ff998068dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 --2- 172.21.15.89:0/1459009454 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a4003980 0x7ff9b81e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 >> 172.21.15.89:0/1459009454 conn(0x7ff9b80c2ad0 msgr2=0x7ff9b814f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:27.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 shutdown_connections 2023-12-07T10:00:27.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.729+0000 7ff9bcc05640 1 -- 172.21.15.89:0/1459009454 wait complete. 2023-12-07T10:00:27.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:55.032694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:55.602397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:00:12.010823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:00:12.808546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:27.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.889+0000 7f4f7f501640 1 Processor -- start 2023-12-07T10:00:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.889+0000 7f4f7f501640 1 -- start start 2023-12-07T10:00:27.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7f501640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f7806c5c0 0x7f4f781581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7f501640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4f780c24a0 0x7f4f781586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7f501640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f78157d20 con 0x7f4f780c1bd0 2023-12-07T10:00:27.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7f501640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7806deb0 con 0x7f4f780c24a0 2023-12-07T10:00:27.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7f501640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78158c30 con 0x7f4f7806c5c0 2023-12-07T10:00:27.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7d29d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4f780c1bd0 0x7f4f78151c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34472/0 (socket says 172.21.15.89:34472) 2023-12-07T10:00:27.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7da9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4f780c24a0 0x7f4f781586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7d29d640 1 -- 172.21.15.89:0/3003455692 learned_addr learned my addr 172.21.15.89:0/3003455692 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:27.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7ca9c640 1 --2- 172.21.15.89:0/3003455692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f7806c5c0 0x7f4f781581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7da9e640 1 -- 172.21.15.89:0/3003455692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f7806c5c0 msgr2=0x7f4f781581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:27.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7da9e640 1 --2- 172.21.15.89:0/3003455692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f7806c5c0 0x7f4f781581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7da9e640 1 -- 172.21.15.89:0/3003455692 >> v1:172.21.15.89:6789/0 conn(0x7f4f780c1bd0 legacy=0x7f4f78151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.893+0000 7f4f7da9e640 1 -- 172.21.15.89:0/3003455692 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7806e100 con 0x7f4f780c24a0 2023-12-07T10:00:27.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7da9e640 1 --2- 172.21.15.89:0/3003455692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c24a0 0x7f4f781586f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009d90 tx=0x7f4f7001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11636a46e6469d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:27.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f6ffff640 1 -- 172.21.15.89:0/3003455692 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700a58f0 con 0x7f4f780c24a0 2023-12-07T10:00:27.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f6ffff640 1 -- 172.21.15.89:0/3003455692 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f700a5a50 con 0x7f4f780c24a0 2023-12-07T10:00:27.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f6ffff640 1 -- 172.21.15.89:0/3003455692 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700a5de0 con 0x7f4f780c24a0 2023-12-07T10:00:27.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- 172.21.15.89:0/3003455692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c24a0 msgr2=0x7f4f781586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3003455692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c24a0 0x7f4f781586f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009d90 tx=0x7f4f7001c830 comp rx=0 tx=0).stop 2023-12-07T10:00:27.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- 172.21.15.89:0/3003455692 shutdown_connections 2023-12-07T10:00:27.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3003455692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c24a0 0x7f4f781586f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3003455692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f7806c5c0 0x7f4f781581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- 172.21.15.89:0/3003455692 >> 172.21.15.89:0/3003455692 conn(0x7f4f780c2a60 msgr2=0x7f4f780c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- 172.21.15.89:0/3003455692 shutdown_connections 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- 172.21.15.89:0/3003455692 wait complete. 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 Processor -- start 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- start start 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f7806c5c0 0x7f4f78147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 0x7f4f7813f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f780c24a0 0x7f4f78155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7813ff40 con 0x7f4f780c1bd0 2023-12-07T10:00:27.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78145f00 con 0x7f4f7806c5c0 2023-12-07T10:00:27.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7f501640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781461e0 con 0x7f4f780c24a0 2023-12-07T10:00:27.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.897+0000 7f4f7ca9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 0x7f4f7813f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 0x7f4f7813f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43610/0 (socket says 172.21.15.89:43610) 2023-12-07T10:00:27.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 -- 172.21.15.89:0/3404514306 learned_addr learned my addr 172.21.15.89:0/3404514306 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:27.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7da9e640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f780c24a0 0x7f4f78155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7d29d640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f7806c5c0 0x7f4f78147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 -- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f780c24a0 msgr2=0x7f4f78155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f780c24a0 0x7f4f78155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 -- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f7806c5c0 msgr2=0x7f4f78147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f7806c5c0 0x7f4f78147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 -- 172.21.15.89:0/3404514306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009a70 con 0x7f4f780c1bd0 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7d29d640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f7806c5c0 0x7f4f78147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7ca9c640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 0x7f4f7813f610 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800d7d0 tx=0x7f4f6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6800b6c0 con 0x7f4f780c1bd0 2023-12-07T10:00:27.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6800b820 con 0x7f4f780c1bd0 2023-12-07T10:00:27.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f781464c0 con 0x7f4f780c1bd0 2023-12-07T10:00:27.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6800bbd0 con 0x7f4f780c1bd0 2023-12-07T10:00:27.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f781478b0 con 0x7f4f780c1bd0 2023-12-07T10:00:27.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7804e890 con 0x7f4f780c1bd0 2023-12-07T10:00:27.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4f6800bd30 con 0x7f4f780c1bd0 2023-12-07T10:00:27.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f6dffb640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f5c066900 0x7f4f5c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:27.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.901+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4f68084b70 con 0x7f4f780c1bd0 2023-12-07T10:00:27.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.905+0000 7f4f7d29d640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f5c066900 0x7f4f5c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:27.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.905+0000 7f4f7d29d640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f5c066900 0x7f4f5c068dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f74005890 tx=0x7f4f74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:27.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:27.905+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f68051ae0 con 0x7f4f780c1bd0 2023-12-07T10:00:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f780c02b0 con 0x7f4f780c1bd0 2023-12-07T10:00:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f6dffb640 1 -- 172.21.15.89:0/3404514306 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f68055100 con 0x7f4f780c1bd0 2023-12-07T10:00:28.062 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:28.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f5c066900 msgr2=0x7f4f5c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f5c066900 0x7f4f5c068dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f74005890 tx=0x7f4f74009040 comp rx=0 tx=0).stop 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 msgr2=0x7f4f7813f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 0x7f4f7813f610 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800d7d0 tx=0x7f4f6800dc90 comp rx=0 tx=0).stop 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 shutdown_connections 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4f5c066900 0x7f4f5c068dc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4f780c24a0 0x7f4f78155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f780c1bd0 0x7f4f7813f610 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 --2- 172.21.15.89:0/3404514306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4f7806c5c0 0x7f4f78147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 >> 172.21.15.89:0/3404514306 conn(0x7f4f780c2a60 msgr2=0x7f4f78154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:28.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 shutdown_connections 2023-12-07T10:00:28.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.057+0000 7f4f7f501640 1 -- 172.21.15.89:0/3404514306 wait complete. 2023-12-07T10:00:28.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:00:28.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 Processor -- start 2023-12-07T10:00:28.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 -- start start 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f973c0a86d0 0x7f973c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f973c156600 0x7f973c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c14fb30 0x7f973c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c152d90 con 0x7f973c0a86d0 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c152480 con 0x7f973c156600 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f974225f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0a9760 con 0x7f973c14fb30 2023-12-07T10:00:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f973c0a86d0 0x7f973c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f973c0a86d0 0x7f973c0a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43622/0 (socket says 172.21.15.89:43622) 2023-12-07T10:00:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 -- 172.21.15.89:0/2770652799 learned_addr learned my addr 172.21.15.89:0/2770652799 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973bfff640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c14fb30 0x7f973c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f9733fff640 1 --2- 172.21.15.89:0/2770652799 >> v2:172.21.15.97:3300/0 conn(0x7f973c156600 0x7f973c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 -- 172.21.15.89:0/2770652799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c14fb30 msgr2=0x7f973c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c14fb30 0x7f973c0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 -- 172.21.15.89:0/2770652799 >> v2:172.21.15.97:3300/0 conn(0x7f973c156600 msgr2=0x7f973c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 --2- 172.21.15.89:0/2770652799 >> v2:172.21.15.97:3300/0 conn(0x7f973c156600 0x7f973c14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973b7fe640 1 -- 172.21.15.89:0/2770652799 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c152740 con 0x7f973c0a86d0 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f973bfff640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c14fb30 0x7f973c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.217+0000 7f9733fff640 1 --2- 172.21.15.89:0/2770652799 >> v2:172.21.15.97:3300/0 conn(0x7f973c156600 0x7f973c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f973b7fe640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0a8f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f972c009870 tx=0x7f972c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656e3944b92c4b96 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f973affd640 1 -- 172.21.15.89:0/2770652799 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab600 con 0x7f973c0a86d0 2023-12-07T10:00:28.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f973affd640 1 -- 172.21.15.89:0/2770652799 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0a7050 con 0x7f973c0a86d0 2023-12-07T10:00:28.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f973affd640 1 -- 172.21.15.89:0/2770652799 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab980 con 0x7f973c0a86d0 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f974225f640 1 -- 172.21.15.89:0/2770652799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 msgr2=0x7f973c0a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f974225f640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0a8f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f972c009870 tx=0x7f972c01c500 comp rx=0 tx=0).stop 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f974225f640 1 -- 172.21.15.89:0/2770652799 shutdown_connections 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f974225f640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c14fb30 0x7f973c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f974225f640 1 --2- 172.21.15.89:0/2770652799 >> v2:172.21.15.97:3300/0 conn(0x7f973c156600 0x7f973c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.221+0000 7f974225f640 1 --2- 172.21.15.89:0/2770652799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0a8f30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- 172.21.15.89:0/2770652799 >> 172.21.15.89:0/2770652799 conn(0x7f973c0c2a60 msgr2=0x7f973c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- 172.21.15.89:0/2770652799 shutdown_connections 2023-12-07T10:00:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- 172.21.15.89:0/2770652799 wait complete. 2023-12-07T10:00:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 Processor -- start 2023-12-07T10:00:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- start start 2023-12-07T10:00:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f973c14fb30 0x7f973c1ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c156600 0x7f973c1eea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c14cc80 con 0x7f973c0a86d0 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c14c650 con 0x7f973c14fb30 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1577a0 con 0x7f973c156600 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43624/0 (socket says 172.21.15.89:43624) 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 -- 172.21.15.89:0/1791265636 learned_addr learned my addr 172.21.15.89:0/1791265636 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973bfff640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c156600 0x7f973c1eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 -- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c156600 msgr2=0x7f973c1eea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f9733fff640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f973c14fb30 0x7f973c1ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c156600 0x7f973c1eea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 -- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f973c14fb30 msgr2=0x7f973c1ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f973c14fb30 0x7f973c1ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 -- 172.21.15.89:0/1791265636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0094d0 con 0x7f973c0a86d0 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f9733fff640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f973c14fb30 0x7f973c1ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973bfff640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c156600 0x7f973c1eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f973b7fe640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0bfe20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f972c0ae040 tx=0x7f972c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0b6620 con 0x7f973c0a86d0 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0b67a0 con 0x7f973c0a86d0 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c1533a0 con 0x7f973c0a86d0 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0b6b50 con 0x7f973c0a86d0 2023-12-07T10:00:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.225+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1f10d0 con 0x7f973c0a86d0 2023-12-07T10:00:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.229+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c1ee340 con 0x7f973c0a86d0 2023-12-07T10:00:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.229+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f972c0b2040 con 0x7f973c0a86d0 2023-12-07T10:00:28.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.229+0000 7f9738ff9640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f971c0668d0 0x7f971c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.229+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f972c11eb30 con 0x7f973c0a86d0 2023-12-07T10:00:28.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.229+0000 7f9733fff640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f971c0668d0 0x7f971c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.229+0000 7f9733fff640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f971c0668d0 0x7f971c068d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f973c0c5d20 tx=0x7f9724008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.233+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f972c0ebaa0 con 0x7f973c0a86d0 2023-12-07T10:00:28.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.385+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f973c04e890 con 0x7f973c0a86d0 2023-12-07T10:00:28.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.385+0000 7f9738ff9640 1 -- 172.21.15.89:0/1791265636 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f972c0ba020 con 0x7f973c0a86d0 2023-12-07T10:00:28.392 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:28.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f971c0668d0 msgr2=0x7f971c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f971c0668d0 0x7f971c068d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f973c0c5d20 tx=0x7f9724008040 comp rx=0 tx=0).stop 2023-12-07T10:00:28.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 msgr2=0x7f973c0bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0bfe20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f972c0ae040 tx=0x7f972c01ad40 comp rx=0 tx=0).stop 2023-12-07T10:00:28.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 shutdown_connections 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f971c0668d0 0x7f971c068d90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f973c156600 0x7f973c1eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f973c14fb30 0x7f973c1ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 --2- 172.21.15.89:0/1791265636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f973c0a86d0 0x7f973c0bfe20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 >> 172.21.15.89:0/1791265636 conn(0x7f973c0c2a60 msgr2=0x7f973c151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 shutdown_connections 2023-12-07T10:00:28.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.389+0000 7f974225f640 1 -- 172.21.15.89:0/1791265636 wait complete. 2023-12-07T10:00:28.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:00:28.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 Processor -- start 2023-12-07T10:00:28.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 -- start start 2023-12-07T10:00:28.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2740151d80 0x7f27400c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27400c7f20 0x7f274006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274006cf70 con 0x7f27400c8430 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2740152160 con 0x7f27400c7f20 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f27475df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c6a30 con 0x7f2740151d80 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27400c7f20 0x7f274006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27400c7f20 0x7f274006be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43632/0 (socket says 172.21.15.89:43632) 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 -- 172.21.15.89:0/1072181423 learned_addr learned my addr 172.21.15.89:0/1072181423 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f274537b640 1 --2- 172.21.15.89:0/1072181423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2740151d80 0x7f27400c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 -- 172.21.15.89:0/1072181423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2740151d80 msgr2=0x7f27400c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 --2- 172.21.15.89:0/1072181423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2740151d80 0x7f27400c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 -- 172.21.15.89:0/1072181423 >> v1:172.21.15.97:6789/0 conn(0x7f27400c8430 legacy=0x7f274006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.549+0000 7f2745b7c640 1 -- 172.21.15.89:0/1072181423 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400c72d0 con 0x7f27400c7f20 2023-12-07T10:00:28.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f2745b7c640 1 --2- 172.21.15.89:0/1072181423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c7f20 0x7f274006be30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2738009e50 tx=0x7f273801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61e357e3a1e4c21 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f2737fff640 1 -- 172.21.15.89:0/1072181423 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380a5810 con 0x7f27400c7f20 2023-12-07T10:00:28.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f2737fff640 1 -- 172.21.15.89:0/1072181423 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380a5970 con 0x7f27400c7f20 2023-12-07T10:00:28.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f2737fff640 1 -- 172.21.15.89:0/1072181423 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380a5d00 con 0x7f27400c7f20 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 -- 172.21.15.89:0/1072181423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c7f20 msgr2=0x7f274006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 --2- 172.21.15.89:0/1072181423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c7f20 0x7f274006be30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2738009e50 tx=0x7f273801c950 comp rx=0 tx=0).stop 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 -- 172.21.15.89:0/1072181423 shutdown_connections 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 --2- 172.21.15.89:0/1072181423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c7f20 0x7f274006be30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 --2- 172.21.15.89:0/1072181423 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2740151d80 0x7f27400c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 -- 172.21.15.89:0/1072181423 >> 172.21.15.89:0/1072181423 conn(0x7f27400abd00 msgr2=0x7f27400ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 -- 172.21.15.89:0/1072181423 shutdown_connections 2023-12-07T10:00:28.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.553+0000 7f27475df640 1 -- 172.21.15.89:0/1072181423 wait complete. 2023-12-07T10:00:28.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 Processor -- start 2023-12-07T10:00:28.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 -- start start 2023-12-07T10:00:28.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27400c7f20 0x7f274014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 0x7f27400aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2740151d80 0x7f27400aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274014c860 con 0x7f27400c8430 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740145ea0 con 0x7f2740151d80 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2740154820 con 0x7f27400c7f20 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 0x7f27400aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 0x7f27400aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43642/0 (socket says 172.21.15.89:43642) 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 -- 172.21.15.89:0/2743661859 learned_addr learned my addr 172.21.15.89:0/2743661859 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2745b7c640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2740151d80 0x7f27400aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f274537b640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27400c7f20 0x7f274014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 -- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27400c7f20 msgr2=0x7f274014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27400c7f20 0x7f274014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 -- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2740151d80 msgr2=0x7f27400aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2740151d80 0x7f27400aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 -- 172.21.15.89:0/2743661859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009b30 con 0x7f27400c8430 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2744b7a640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 0x7f27400aaab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f273000c3f0 tx=0x7f273000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27300052d0 con 0x7f27400c8430 2023-12-07T10:00:28.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2730005430 con 0x7f27400c8430 2023-12-07T10:00:28.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27401526c0 con 0x7f27400c8430 2023-12-07T10:00:28.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730003840 con 0x7f27400c8430 2023-12-07T10:00:28.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.557+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27401544b0 con 0x7f27400c8430 2023-12-07T10:00:28.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.561+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27400aa7d0 con 0x7f27400c8430 2023-12-07T10:00:28.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.561+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f27300039a0 con 0x7f27400c8430 2023-12-07T10:00:28.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.561+0000 7f2735ffb640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f27240668d0 0x7f2724068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.561+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2730083d20 con 0x7f27400c8430 2023-12-07T10:00:28.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.561+0000 7f274537b640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f27240668d0 0x7f2724068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.561+0000 7f274537b640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f27240668d0 0x7f2724068d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f273c00b9d0 tx=0x7f273c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.565+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27400aa7d0 con 0x7f27400c8430 2023-12-07T10:00:28.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27400aa7d0 con 0x7f27400c8430 2023-12-07T10:00:28.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f2735ffb640 1 -- 172.21.15.89:0/2743661859 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27400aa7d0 con 0x7f27400c8430 2023-12-07T10:00:28.721 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f27240668d0 msgr2=0x7f2724068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f27240668d0 0x7f2724068d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f273c00b9d0 tx=0x7f273c008040 comp rx=0 tx=0).stop 2023-12-07T10:00:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 msgr2=0x7f27400aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 0x7f27400aaab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f273000c3f0 tx=0x7f273000c8b0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 shutdown_connections 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2740151d80 0x7f27400aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27400c8430 0x7f27400aaab0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f27240668d0 0x7f2724068d90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 --2- 172.21.15.89:0/2743661859 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27400c7f20 0x7f274014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 >> 172.21.15.89:0/2743661859 conn(0x7f27400abd00 msgr2=0x7f27400ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 shutdown_connections 2023-12-07T10:00:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.717+0000 7f27475df640 1 -- 172.21.15.89:0/2743661859 wait complete. 2023-12-07T10:00:28.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:00:28.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 Processor -- start 2023-12-07T10:00:28.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 -- start start 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f040c8430 0x7f8f0406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f040c7f20 0x7f8f0406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0406cf70 con 0x7f8f04151d80 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f04152160 con 0x7f8f040c7f20 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f092e4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f040c6a30 con 0x7f8f040c8430 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f037fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f040c7f20 0x7f8f0406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f037fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f040c7f20 0x7f8f0406bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43652/0 (socket says 172.21.15.89:43652) 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f037fe640 1 -- 172.21.15.89:0/2372164254 learned_addr learned my addr 172.21.15.89:0/2372164254 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8f02ffd640 1 --1- 172.21.15.89:0/2372164254 >> v1:172.21.15.89:6789/0 conn(0x7f8f04151d80 0x7f8f040c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:34486/0 (socket says 172.21.15.89:34486) 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.877+0000 7f8efa7fc640 1 --2- 172.21.15.89:0/2372164254 >> v2:172.21.15.97:3300/0 conn(0x7f8f040c8430 0x7f8f0406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f037fe640 1 -- 172.21.15.89:0/2372164254 >> v2:172.21.15.97:3300/0 conn(0x7f8f040c8430 msgr2=0x7f8f0406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:28.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f037fe640 1 --2- 172.21.15.89:0/2372164254 >> v2:172.21.15.97:3300/0 conn(0x7f8f040c8430 0x7f8f0406b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f037fe640 1 -- 172.21.15.89:0/2372164254 >> v1:172.21.15.89:6789/0 conn(0x7f8f04151d80 legacy=0x7f8f040c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f037fe640 1 -- 172.21.15.89:0/2372164254 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040c72d0 con 0x7f8f040c7f20 2023-12-07T10:00:28.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f037fe640 1 --2- 172.21.15.89:0/2372164254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f0406bc60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8f040c7a40 tx=0x7f8efc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6e215ffcea77a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f027fc640 1 -- 172.21.15.89:0/2372164254 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0ab640 con 0x7f8f040c7f20 2023-12-07T10:00:28.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f027fc640 1 -- 172.21.15.89:0/2372164254 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc0a7070 con 0x7f8f040c7f20 2023-12-07T10:00:28.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f027fc640 1 -- 172.21.15.89:0/2372164254 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0ab9c0 con 0x7f8f040c7f20 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 -- 172.21.15.89:0/2372164254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 msgr2=0x7f8f0406bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 --2- 172.21.15.89:0/2372164254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f0406bc60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8f040c7a40 tx=0x7f8efc01c440 comp rx=0 tx=0).stop 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 -- 172.21.15.89:0/2372164254 shutdown_connections 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 --2- 172.21.15.89:0/2372164254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f0406bc60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 --2- 172.21.15.89:0/2372164254 >> v2:172.21.15.97:3300/0 conn(0x7f8f040c8430 0x7f8f0406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 -- 172.21.15.89:0/2372164254 >> 172.21.15.89:0/2372164254 conn(0x7f8f040abd00 msgr2=0x7f8f040ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 -- 172.21.15.89:0/2372164254 shutdown_connections 2023-12-07T10:00:28.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.881+0000 7f8f092e4640 1 -- 172.21.15.89:0/2372164254 wait complete. 2023-12-07T10:00:28.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 Processor -- start 2023-12-07T10:00:28.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 -- start start 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f041f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f040c8430 0x7f8f04157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f04151d80 0x7f8f04157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041f2280 con 0x7f8f040c7f20 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0414be90 con 0x7f8f040c8430 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f092e4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040bdc40 con 0x7f8f04151d80 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f041f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f041f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43658/0 (socket says 172.21.15.89:43658) 2023-12-07T10:00:28.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3073134314 learned_addr learned my addr 172.21.15.89:0/3073134314 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8efa7fc640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f040c8430 0x7f8f04157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f037fe640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f04151d80 0x7f8f04157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f04151d80 msgr2=0x7f8f04157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f04151d80 0x7f8f04157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f040c8430 msgr2=0x7f8f04157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f040c8430 0x7f8f04157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3073134314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0094d0 con 0x7f8f040c7f20 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8efa7fc640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f040c8430 0x7f8f04157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f041f1d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c7f0 tx=0x7f8ef400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400a640 con 0x7f8f040c7f20 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400a7c0 con 0x7f8f040c7f20 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.885+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400ab70 con 0x7f8f040c7f20 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f040bdf20 con 0x7f8f040c7f20 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f040be4e0 con 0x7f8f040c7f20 2023-12-07T10:00:28.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0404e890 con 0x7f8f040c7f20 2023-12-07T10:00:28.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8ef400acd0 con 0x7f8f040c7f20 2023-12-07T10:00:28.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8efbfff640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ee40668d0 0x7f8ee4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:28.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ef40840c0 con 0x7f8f040c7f20 2023-12-07T10:00:28.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.889+0000 7f8efa7fc640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ee40668d0 0x7f8ee4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:28.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.893+0000 7f8efa7fc640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ee40668d0 0x7f8ee4068d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f040c5bb0 tx=0x7f8eec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:28.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:28.893+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ef4050f90 con 0x7f8f040c7f20 2023-12-07T10:00:29.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f0414f030 con 0x7f8f040c7f20 2023-12-07T10:00:29.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8efbfff640 1 -- 172.21.15.89:0/3073134314 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8ef40170b0 con 0x7f8f040c7f20 2023-12-07T10:00:29.049 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ee40668d0 msgr2=0x7f8ee4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ee40668d0 0x7f8ee4068d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f040c5bb0 tx=0x7f8eec008040 comp rx=0 tx=0).stop 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 msgr2=0x7f8f041f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f041f1d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c7f0 tx=0x7f8ef400ccb0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 shutdown_connections 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ee40668d0 0x7f8ee4068d90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f04151d80 0x7f8f04157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f040c8430 0x7f8f04157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 --2- 172.21.15.89:0/3073134314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040c7f20 0x7f8f041f1d40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 >> 172.21.15.89:0/3073134314 conn(0x7f8f040abd00 msgr2=0x7f8f040c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 shutdown_connections 2023-12-07T10:00:29.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.045+0000 7f8f092e4640 1 -- 172.21.15.89:0/3073134314 wait complete. 2023-12-07T10:00:29.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:00:29.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 Processor -- start 2023-12-07T10:00:29.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 -- start start 2023-12-07T10:00:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcabc14eaf0 0x7fcabc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc151f90 0x7fcabc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc06de00 con 0x7fcabc0c0370 2023-12-07T10:00:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc070390 con 0x7fcabc14eaf0 2023-12-07T10:00:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac2d2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc14eed0 con 0x7fcabc151f90 2023-12-07T10:00:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.205+0000 7fcac0ac6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcabc14eaf0 0x7fcabc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcabc14eaf0 0x7fcabc151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:53972/0 (socket says 172.21.15.89:53972) 2023-12-07T10:00:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 -- 172.21.15.89:0/3566935104 learned_addr learned my addr 172.21.15.89:0/3566935104 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac12c7640 1 --1- 172.21.15.89:0/3566935104 >> v1:172.21.15.97:6789/0 conn(0x7fcabc0c0370 0x7fcabc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:41790/0 (socket says 172.21.15.89:41790) 2023-12-07T10:00:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcab3fff640 1 --2- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc151f90 0x7fcabc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 -- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc151f90 msgr2=0x7fcabc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 --2- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc151f90 0x7fcabc06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 -- 172.21.15.89:0/3566935104 >> v1:172.21.15.97:6789/0 conn(0x7fcabc0c0370 legacy=0x7fcabc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 -- 172.21.15.89:0/3566935104 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc151270 con 0x7fcabc14eaf0 2023-12-07T10:00:29.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcac0ac6640 1 --2- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc151a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de602b06fdd4799d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcab37fe640 1 -- 172.21.15.89:0/3566935104 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80ab5f0 con 0x7fcabc14eaf0 2023-12-07T10:00:29.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcab37fe640 1 -- 172.21.15.89:0/3566935104 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab80ab750 con 0x7fcabc14eaf0 2023-12-07T10:00:29.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.209+0000 7fcab37fe640 1 -- 172.21.15.89:0/3566935104 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80abae0 con 0x7fcabc14eaf0 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 msgr2=0x7fcabc151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc151a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab801c3f0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- 172.21.15.89:0/3566935104 shutdown_connections 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc151f90 0x7fcabc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/3566935104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc151a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- 172.21.15.89:0/3566935104 >> 172.21.15.89:0/3566935104 conn(0x7fcabc0c2a60 msgr2=0x7fcabc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- 172.21.15.89:0/3566935104 shutdown_connections 2023-12-07T10:00:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- 172.21.15.89:0/3566935104 wait complete. 2023-12-07T10:00:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 Processor -- start 2023-12-07T10:00:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- start start 2023-12-07T10:00:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc0c0370 0x7fcabc0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 0x7fcabc140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc141150 con 0x7fcabc14a4c0 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc14a280 con 0x7fcabc14eaf0 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac2d2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc067520 con 0x7fcabc0c0370 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac12c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 0x7fcabc140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac12c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 0x7fcabc140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43660/0 (socket says 172.21.15.89:43660) 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac12c7640 1 -- 172.21.15.89:0/418836219 learned_addr learned my addr 172.21.15.89:0/418836219 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcac0ac6640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc0c0370 0x7fcabc0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.213+0000 7fcab3fff640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac12c7640 1 -- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc0c0370 msgr2=0x7fcabc0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac12c7640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc0c0370 0x7fcabc0c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac12c7640 1 -- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 msgr2=0x7fcabc1406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac12c7640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc1406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac12c7640 1 -- 172.21.15.89:0/418836219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80094d0 con 0x7fcabc14a4c0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac0ac6640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc0c0370 0x7fcabc0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac12c7640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 0x7fcabc140c10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcab400c700 tx=0x7fcab400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab400ce10 con 0x7fcabc14a4c0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab400a640 con 0x7fcabc14a4c0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcabc1491e0 con 0x7fcabc14a4c0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab400a9b0 con 0x7fcabc14a4c0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc1497a0 con 0x7fcabc14a4c0 2023-12-07T10:00:29.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcabc04e890 con 0x7fcabc14a4c0 2023-12-07T10:00:29.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcab400ab10 con 0x7fcabc14a4c0 2023-12-07T10:00:29.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcab17fa640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcaa80668d0 0x7fcaa8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcab4083e30 con 0x7fcabc14a4c0 2023-12-07T10:00:29.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.217+0000 7fcac0ac6640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcaa80668d0 0x7fcaa8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.221+0000 7fcac0ac6640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcaa80668d0 0x7fcaa8068d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcab80af000 tx=0x7fcab80b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.221+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcab4050dc0 con 0x7fcabc14a4c0 2023-12-07T10:00:29.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.373+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fcabc14f0e0 con 0x7fcabc14a4c0 2023-12-07T10:00:29.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.373+0000 7fcab17fa640 1 -- 172.21.15.89:0/418836219 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7fcab4017020 con 0x7fcabc14a4c0 2023-12-07T10:00:29.379 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcaa80668d0 msgr2=0x7fcaa8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcaa80668d0 0x7fcaa8068d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcab80af000 tx=0x7fcab80b6040 comp rx=0 tx=0).stop 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 msgr2=0x7fcabc140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 0x7fcabc140c10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcab400c700 tx=0x7fcab400cbc0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 shutdown_connections 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc14a4c0 0x7fcabc140c10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcabc14eaf0 0x7fcabc1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcaa80668d0 0x7fcaa8068d90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 --2- 172.21.15.89:0/418836219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcabc0c0370 0x7fcabc0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 >> 172.21.15.89:0/418836219 conn(0x7fcabc0c2a60 msgr2=0x7fcabc14ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:29.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 shutdown_connections 2023-12-07T10:00:29.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.377+0000 7fcac2d2a640 1 -- 172.21.15.89:0/418836219 wait complete. 2023-12-07T10:00:29.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:00:29.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 Processor -- start 2023-12-07T10:00:29.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 -- start start 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 0x7fe908158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe90806cd90 0x7fe908158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe908155790 con 0x7fe9080ca610 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080c4b00 con 0x7fe90806cd90 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90f4e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c4de0 con 0x7fe9080bd720 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90d27f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe9080ca610 0x7fe9080c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51684/0 (socket says 172.21.15.89:51684) 2023-12-07T10:00:29.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90d27f640 1 -- 172.21.15.89:0/2554293128 learned_addr learned my addr 172.21.15.89:0/2554293128 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90ca7e640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 0x7fe908158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 --2- 172.21.15.89:0/2554293128 >> v2:172.21.15.97:3300/0 conn(0x7fe90806cd90 0x7fe908158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021063315 0 0) 0x7fe908155790 con 0x7fe9080ca610 2023-12-07T10:00:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f4003530 con 0x7fe9080ca610 2023-12-07T10:00:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2904935371 0 0) 0x7fe8f4003530 con 0x7fe9080ca610 2023-12-07T10:00:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 msgr2=0x7fe908158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 0x7fe908158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 >> v2:172.21.15.97:3300/0 conn(0x7fe90806cd90 msgr2=0x7fe908158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 --2- 172.21.15.89:0/2554293128 >> v2:172.21.15.97:3300/0 conn(0x7fe90806cd90 0x7fe908158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908157e30 con 0x7fe9080ca610 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fe904001680 con 0x7fe9080ca610 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 >> v1:172.21.15.89:6789/0 conn(0x7fe9080ca610 legacy=0x7fe9080c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f4003980 0x7fe8f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 0x7fe8f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe8f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c4b00 con 0x7fe8f4004d10 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c4de0 con 0x7fe8f4003980 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f400ba60 con 0x7fe9080bd720 2023-12-07T10:00:29.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe8f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90d27f640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f4003980 0x7fe8f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90ca7e640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 0x7fe8f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 -- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 msgr2=0x7fe8f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9080bd720 0x7fe8f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 -- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f4003980 msgr2=0x7fe8f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f4003980 0x7fe8f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.537+0000 7fe90da80640 1 -- 172.21.15.89:0/2554293128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f4003530 con 0x7fe8f4004d10 2023-12-07T10:00:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90da80640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe8f4005190 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe900009fc0 tx=0x7fe90001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09bbd0d3ec65758 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080c52d0 con 0x7fe8f4004d10 2023-12-07T10:00:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000f040 con 0x7fe8f4004d10 2023-12-07T10:00:29.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe8fffff640 1 -- 172.21.15.89:0/2554293128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a5de0 con 0x7fe8f4004d10 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90f4e3640 1 -- 172.21.15.89:0/2554293128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 msgr2=0x7fe8f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/2554293128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe8f4005190 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe900009fc0 tx=0x7fe90001cca0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90da80640 1 -- 172.21.15.89:0/2554293128 reap_dead start 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90f4e3640 1 -- 172.21.15.89:0/2554293128 shutdown_connections 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90f4e3640 1 -- 172.21.15.89:0/2554293128 >> 172.21.15.89:0/2554293128 conn(0x7fe908071ea0 msgr2=0x7fe9080722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90f4e3640 1 -- 172.21.15.89:0/2554293128 shutdown_connections 2023-12-07T10:00:29.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.541+0000 7fe90f4e3640 1 -- 172.21.15.89:0/2554293128 wait complete. 2023-12-07T10:00:29.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 Processor -- start 2023-12-07T10:00:29.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 -- start start 2023-12-07T10:00:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe9080bec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe908151390 0x7fe9080bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9081f0760 0x7fe9081f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c09a0 con 0x7fe8f4004d10 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908150e60 con 0x7fe908151390 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080be760 con 0x7fe9081f0760 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe9080bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe9080bec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48048/0 (socket says 172.21.15.89:48048) 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 -- 172.21.15.89:0/970208647 learned_addr learned my addr 172.21.15.89:0/970208647 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 -- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9081f0760 msgr2=0x7fe9081f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9081f0760 0x7fe9081f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 -- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe908151390 msgr2=0x7fe9080bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90ca7e640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe908151390 0x7fe9080bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe908151390 0x7fe9080bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 -- 172.21.15.89:0/970208647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9081510b0 con 0x7fe8f4004d10 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90ca7e640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe908151390 0x7fe9080bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90d27f640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe9080bec70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe904004f00 tx=0x7fe904007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400f7b0 con 0x7fe8f4004d10 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90400f910 con 0x7fe8f4004d10 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9081f11f0 con 0x7fe8f4004d10 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400fcc0 con 0x7fe8f4004d10 2023-12-07T10:00:29.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.545+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90815b1a0 con 0x7fe8f4004d10 2023-12-07T10:00:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.549+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9080be550 con 0x7fe8f4004d10 2023-12-07T10:00:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.549+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe90401d460 con 0x7fe8f4004d10 2023-12-07T10:00:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.549+0000 7fe8fdffb640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8ec066900 0x7fe8ec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.549+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe904084860 con 0x7fe8f4004d10 2023-12-07T10:00:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.549+0000 7fe90ca7e640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8ec066900 0x7fe8ec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.549+0000 7fe90ca7e640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8ec066900 0x7fe8ec068dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe90815adc0 tx=0x7fe8f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.553+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9040517f0 con 0x7fe8f4004d10 2023-12-07T10:00:29.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe9080c9de0 con 0x7fe8f4004d10 2023-12-07T10:00:29.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe8fdffb640 1 -- 172.21.15.89:0/970208647 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe904054e10 con 0x7fe8f4004d10 2023-12-07T10:00:29.717 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:00:29.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8ec066900 msgr2=0x7fe8ec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8ec066900 0x7fe8ec068dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe90815adc0 tx=0x7fe8f8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 msgr2=0x7fe9080bec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe9080bec70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe904004f00 tx=0x7fe904007430 comp rx=0 tx=0).stop 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 shutdown_connections 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8ec066900 0x7fe8ec068dc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe9081f0760 0x7fe9081f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe908151390 0x7fe9080bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 --2- 172.21.15.89:0/970208647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f4004d10 0x7fe9080bec70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 >> 172.21.15.89:0/970208647 conn(0x7fe908071ea0 msgr2=0x7fe9080722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 shutdown_connections 2023-12-07T10:00:29.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.713+0000 7fe90f4e3640 1 -- 172.21.15.89:0/970208647 wait complete. 2023-12-07T10:00:29.738 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T10:00:29.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:29.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:00:29.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:00:29.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:00:29.769 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:00:29.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:29.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.957+0000 7fbeb1955640 1 Processor -- start 2023-12-07T10:00:29.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 -- start start 2023-12-07T10:00:29.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbeac1520f0 0x7fbeac0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbeac155660 0x7fbeac06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac06b650 0x7fbeac0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac06c020 con 0x7fbeac155660 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac1524d0 con 0x7fbeac1520f0 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeb1955640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0c5520 con 0x7fbeac06b650 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbeac155660 0x7fbeac06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbeac155660 0x7fbeac06b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48052/0 (socket says 172.21.15.89:48052) 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 -- 172.21.15.89:0/2012612828 learned_addr learned my addr 172.21.15.89:0/2012612828 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeaaffd640 1 --2- 172.21.15.89:0/2012612828 >> v2:172.21.15.97:3300/0 conn(0x7fbeac1520f0 0x7fbeac0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbeab7fe640 1 --2- 172.21.15.89:0/2012612828 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac06b650 0x7fbeac0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 -- 172.21.15.89:0/2012612828 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac06b650 msgr2=0x7fbeac0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 --2- 172.21.15.89:0/2012612828 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac06b650 0x7fbeac0c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 -- 172.21.15.89:0/2012612828 >> v2:172.21.15.97:3300/0 conn(0x7fbeac1520f0 msgr2=0x7fbeac0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:29.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 --2- 172.21.15.89:0/2012612828 >> v2:172.21.15.97:3300/0 conn(0x7fbeac1520f0 0x7fbeac0c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.961+0000 7fbea27fc640 1 -- 172.21.15.89:0/2012612828 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0c9a80 con 0x7fbeac155660 2023-12-07T10:00:29.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbea27fc640 1 --2- 172.21.15.89:0/2012612828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac155660 0x7fbeac06b110 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbeac06d200 tx=0x7fbe9c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06d3eee66cafe9a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeaa7fc640 1 -- 172.21.15.89:0/2012612828 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0ab600 con 0x7fbeac155660 2023-12-07T10:00:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeaa7fc640 1 -- 172.21.15.89:0/2012612828 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c0ab760 con 0x7fbeac155660 2023-12-07T10:00:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeaa7fc640 1 -- 172.21.15.89:0/2012612828 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0abaf0 con 0x7fbeac155660 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 -- 172.21.15.89:0/2012612828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac155660 msgr2=0x7fbeac06b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 --2- 172.21.15.89:0/2012612828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac155660 0x7fbeac06b110 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbeac06d200 tx=0x7fbe9c01c440 comp rx=0 tx=0).stop 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 -- 172.21.15.89:0/2012612828 shutdown_connections 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 --2- 172.21.15.89:0/2012612828 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac06b650 0x7fbeac0c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 --2- 172.21.15.89:0/2012612828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac155660 0x7fbeac06b110 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 --2- 172.21.15.89:0/2012612828 >> v2:172.21.15.97:3300/0 conn(0x7fbeac1520f0 0x7fbeac0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 -- 172.21.15.89:0/2012612828 >> 172.21.15.89:0/2012612828 conn(0x7fbeac0ca070 msgr2=0x7fbeac0ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 -- 172.21.15.89:0/2012612828 shutdown_connections 2023-12-07T10:00:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 -- 172.21.15.89:0/2012612828 wait complete. 2023-12-07T10:00:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 Processor -- start 2023-12-07T10:00:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.965+0000 7fbeb1955640 1 -- start start 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 0x7fbeac15e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbeac1520f0 0x7fbeac14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac155660 0x7fbeac0c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac14cb30 con 0x7fbeac06b650 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac15ec50 con 0x7fbeac1520f0 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0bcfe0 con 0x7fbeac155660 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 0x7fbeac15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 0x7fbeac15e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48066/0 (socket says 172.21.15.89:48066) 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 -- 172.21.15.89:0/1190455614 learned_addr learned my addr 172.21.15.89:0/1190455614 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbea27fc640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbeac1520f0 0x7fbeac14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeab7fe640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac155660 0x7fbeac0c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 -- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac155660 msgr2=0x7fbeac0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac155660 0x7fbeac0c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 -- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbeac1520f0 msgr2=0x7fbeac14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbeac1520f0 0x7fbeac14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 -- 172.21.15.89:0/1190455614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0094d0 con 0x7fbeac06b650 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeaaffd640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 0x7fbeac15e710 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400e960 tx=0x7fbe9400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94009690 con 0x7fbeac06b650 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9400ca00 con 0x7fbeac06b650 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac0bd470 con 0x7fbeac06b650 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9400cd70 con 0x7fbeac06b650 2023-12-07T10:00:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac1f1030 con 0x7fbeac06b650 2023-12-07T10:00:29.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.969+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac04e890 con 0x7fbeac06b650 2023-12-07T10:00:29.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.973+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbe94013470 con 0x7fbeac06b650 2023-12-07T10:00:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.973+0000 7fbea8ff9640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe8c0668d0 0x7fbe8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.973+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbe940849f0 con 0x7fbeac06b650 2023-12-07T10:00:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.973+0000 7fbea27fc640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe8c0668d0 0x7fbe8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.973+0000 7fbea27fc640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe8c0668d0 0x7fbe8c068d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0af000 tx=0x7fbe9c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:29.977+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe940518f0 con 0x7fbeac06b650 2023-12-07T10:00:30.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.157+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbeac0c5700 con 0x7fbeac06b650 2023-12-07T10:00:30.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.157+0000 7fbea8ff9640 1 -- 172.21.15.89:0/1190455614 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6124 (secure 0 0 0) 0x7fbe94054f10 con 0x7fbeac06b650 2023-12-07T10:00:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:30.164 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2023-12-07T10:00:30.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe8c0668d0 msgr2=0x7fbe8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe8c0668d0 0x7fbe8c068d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0af000 tx=0x7fbe9c0b6040 comp rx=0 tx=0).stop 2023-12-07T10:00:30.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 msgr2=0x7fbeac15e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 0x7fbeac15e710 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400e960 tx=0x7fbe9400ee20 comp rx=0 tx=0).stop 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 shutdown_connections 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe8c0668d0 0x7fbe8c068d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbeac155660 0x7fbeac0c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbeac1520f0 0x7fbeac14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 --2- 172.21.15.89:0/1190455614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeac06b650 0x7fbeac15e710 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 >> 172.21.15.89:0/1190455614 conn(0x7fbeac0ca070 msgr2=0x7fbeac0c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 shutdown_connections 2023-12-07T10:00:30.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.161+0000 7fbeb1955640 1 -- 172.21.15.89:0/1190455614 wait complete. 2023-12-07T10:00:30.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:30.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.317+0000 7f0a6fdf8640 1 Processor -- start 2023-12-07T10:00:30.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.317+0000 7f0a6fdf8640 1 -- start start 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6fdf8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0a68155360 0x7f0a6806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6fdf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a68158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6fdf8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6806e280 con 0x7f0a6806baf0 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6fdf8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680c2150 con 0x7f0a68155360 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6fdf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68157c60 con 0x7f0a681580b0 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6d393640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0a6806baf0 0x7f0a6806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51686/0 (socket says 172.21.15.89:51686) 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6d393640 1 -- 172.21.15.89:0/3577869930 learned_addr learned my addr 172.21.15.89:0/3577869930 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:30.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6e395640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a68158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6db94640 1 --2- 172.21.15.89:0/3577869930 >> v2:172.21.15.97:3300/0 conn(0x7f0a68155360 0x7f0a6806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6cb92640 1 -- 172.21.15.89:0/3577869930 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209155656 0 0) 0x7f0a6806e280 con 0x7f0a6806baf0 2023-12-07T10:00:30.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6cb92640 1 -- 172.21.15.89:0/3577869930 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a54003530 con 0x7f0a6806baf0 2023-12-07T10:00:30.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6db94640 1 -- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 msgr2=0x7f0a68158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:30.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6db94640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a68158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6db94640 1 -- 172.21.15.89:0/3577869930 >> v1:172.21.15.89:6789/0 conn(0x7f0a6806baf0 legacy=0x7f0a6806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6db94640 1 -- 172.21.15.89:0/3577869930 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680c1bd0 con 0x7f0a68155360 2023-12-07T10:00:30.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.321+0000 7f0a6e395640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a68158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:30.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6db94640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a68155360 0x7f0a6806b5b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a640097c0 tx=0x7f0a6401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fc60d88e862ef0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6cb92640 1 -- 172.21.15.89:0/3577869930 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640ab600 con 0x7f0a68155360 2023-12-07T10:00:30.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6cb92640 1 -- 172.21.15.89:0/3577869930 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a640a7050 con 0x7f0a68155360 2023-12-07T10:00:30.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6cb92640 1 -- 172.21.15.89:0/3577869930 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640ab980 con 0x7f0a68155360 2023-12-07T10:00:30.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a68155360 msgr2=0x7f0a6806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a68155360 0x7f0a6806b5b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a640097c0 tx=0x7f0a6401c480 comp rx=0 tx=0).stop 2023-12-07T10:00:30.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3577869930 shutdown_connections 2023-12-07T10:00:30.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a68158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3577869930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a68155360 0x7f0a6806b5b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3577869930 >> 172.21.15.89:0/3577869930 conn(0x7f0a680c3240 msgr2=0x7f0a680c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:30.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3577869930 shutdown_connections 2023-12-07T10:00:30.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3577869930 wait complete. 2023-12-07T10:00:30.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.325+0000 7f0a6fdf8640 1 Processor -- start 2023-12-07T10:00:30.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- start start 2023-12-07T10:00:30.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6806baf0 0x7f0a680aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 0x7f0a68071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a681ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6815d290 con 0x7f0a68155360 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6815d4a0 con 0x7f0a6806baf0 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6815d780 con 0x7f0a681580b0 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 0x7f0a68071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 0x7f0a68071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48078/0 (socket says 172.21.15.89:48078) 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 -- 172.21.15.89:0/3690150722 learned_addr learned my addr 172.21.15.89:0/3690150722 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6e395640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a681ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6db94640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6806baf0 0x7f0a680aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 -- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 msgr2=0x7f0a681ed2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a681ed2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 -- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6806baf0 msgr2=0x7f0a680aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6806baf0 0x7f0a680aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 -- 172.21.15.89:0/3690150722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60009a70 con 0x7f0a68155360 2023-12-07T10:00:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6d393640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 0x7f0a68071d20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800c420 tx=0x7f0a5800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58005cf0 con 0x7f0a68155360 2023-12-07T10:00:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58005e50 con 0x7f0a68155360 2023-12-07T10:00:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580072d0 con 0x7f0a68155360 2023-12-07T10:00:30.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a64009420 con 0x7f0a68155360 2023-12-07T10:00:30.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6815dd40 con 0x7f0a68155360 2023-12-07T10:00:30.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.329+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6804e890 con 0x7f0a68155360 2023-12-07T10:00:30.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.333+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a58007430 con 0x7f0a68155360 2023-12-07T10:00:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.333+0000 7f0a5e7fc640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a4c0668d0 0x7f0a4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.333+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0a58083cd0 con 0x7f0a68155360 2023-12-07T10:00:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.333+0000 7f0a6db94640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a4c0668d0 0x7f0a4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.333+0000 7f0a6db94640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a4c0668d0 0x7f0a4c068d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a640ad000 tx=0x7f0a640a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.337+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a58050bc0 con 0x7f0a68155360 2023-12-07T10:00:30.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.493+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a681546c0 con 0x7f0a68155360 2023-12-07T10:00:30.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.493+0000 7f0a5e7fc640 1 -- 172.21.15.89:0/3690150722 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f0a58017090 con 0x7f0a68155360 2023-12-07T10:00:30.499 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:30.500 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:30.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a4c0668d0 msgr2=0x7f0a4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a4c0668d0 0x7f0a4c068d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a640ad000 tx=0x7f0a640a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:30.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 msgr2=0x7f0a68071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 0x7f0a68071d20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800c420 tx=0x7f0a5800c820 comp rx=0 tx=0).stop 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 shutdown_connections 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a4c0668d0 0x7f0a4c068d90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0a681580b0 0x7f0a681ed2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a68155360 0x7f0a68071d20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 --2- 172.21.15.89:0/3690150722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6806baf0 0x7f0a680aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 >> 172.21.15.89:0/3690150722 conn(0x7f0a680c3240 msgr2=0x7f0a680bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 shutdown_connections 2023-12-07T10:00:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.497+0000 7f0a6fdf8640 1 -- 172.21.15.89:0/3690150722 wait complete. 2023-12-07T10:00:30.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T09:59:55.032694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T09:59:55.602397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:00:12.010823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:00:12.808546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:30.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:30.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.657+0000 7fae738c9640 1 Processor -- start 2023-12-07T10:00:30.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.657+0000 7fae738c9640 1 -- start start 2023-12-07T10:00:30.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.657+0000 7fae738c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae6c0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.657+0000 7fae738c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c071020 con 0x7fae6c158ff0 2023-12-07T10:00:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.657+0000 7fae738c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c071300 con 0x7fae6c070760 2023-12-07T10:00:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.657+0000 7fae738c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0715e0 con 0x7fae6c1561d0 2023-12-07T10:00:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71e66640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fae6c158ff0 0x7fae6c159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51702/0 (socket says 172.21.15.89:51702) 2023-12-07T10:00:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71e66640 1 -- 172.21.15.89:0/558217920 learned_addr learned my addr 172.21.15.89:0/558217920 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae6c0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976080077 0 0) 0x7fae6c071020 con 0x7fae6c158ff0 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae58003530 con 0x7fae6c158ff0 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326299412 0 0) 0x7fae6c071300 con 0x7fae6c070760 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c071020 con 0x7fae6c070760 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3193328757 0 0) 0x7fae58003530 con 0x7fae6c158ff0 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 msgr2=0x7fae6c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:30.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae6c0701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 >> v1:172.21.15.97:6789/0 conn(0x7fae6c070760 legacy=0x7fae6c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0718c0 con 0x7fae6c158ff0 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fae64001a00 con 0x7fae6c158ff0 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae6c0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 >> v1:172.21.15.89:6789/0 conn(0x7fae6c158ff0 legacy=0x7fae6c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae58003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae58004d10 0x7fae58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0715e0 con 0x7fae58003b40 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5800baa0 con 0x7fae58004d10 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5800bc60 con 0x7fae6c1561d0 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae58003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae70e64640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71e66640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae58004d10 0x7fae58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 -- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 msgr2=0x7fae580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:30.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c1561d0 0x7fae580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 -- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae58004d10 msgr2=0x7fae58005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:30.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae58004d10 0x7fae58005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71665640 1 -- 172.21.15.89:0/558217920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68009420 con 0x7fae58003b40 2023-12-07T10:00:30.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.661+0000 7fae71e66640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae58004d10 0x7fae58005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:30.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae71665640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae58003f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fae68009cb0 tx=0x7fae6801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce4c11828f122f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680a5690 con 0x7fae58003b40 2023-12-07T10:00:30.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae680a57f0 con 0x7fae58003b40 2023-12-07T10:00:30.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae63fff640 1 -- 172.21.15.89:0/558217920 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680a5ba0 con 0x7fae58003b40 2023-12-07T10:00:30.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 -- 172.21.15.89:0/558217920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 msgr2=0x7fae58003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 --2- 172.21.15.89:0/558217920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae58003f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fae68009cb0 tx=0x7fae6801cbf0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae71e66640 1 -- 172.21.15.89:0/558217920 reap_dead start 2023-12-07T10:00:30.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 -- 172.21.15.89:0/558217920 shutdown_connections 2023-12-07T10:00:30.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 -- 172.21.15.89:0/558217920 >> 172.21.15.89:0/558217920 conn(0x7fae6c0c2a60 msgr2=0x7fae6c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:30.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 -- 172.21.15.89:0/558217920 shutdown_connections 2023-12-07T10:00:30.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 -- 172.21.15.89:0/558217920 wait complete. 2023-12-07T10:00:30.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 Processor -- start 2023-12-07T10:00:30.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.665+0000 7fae738c9640 1 -- start start 2023-12-07T10:00:30.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae6c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c150480 0x7fae6c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c0a8d10 0x7fae6c145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0aba40 con 0x7fae58003b40 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c147280 con 0x7fae6c150480 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0c4560 con 0x7fae6c0a8d10 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae6c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae6c146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48090/0 (socket says 172.21.15.89:48090) 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 -- 172.21.15.89:0/3689735052 learned_addr learned my addr 172.21.15.89:0/3689735052 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 -- 172.21.15.89:0/3689735052 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c0a8d10 msgr2=0x7fae6c145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c0a8d10 0x7fae6c145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 -- 172.21.15.89:0/3689735052 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c150480 msgr2=0x7fae6c14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c150480 0x7fae6c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 -- 172.21.15.89:0/3689735052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c146a60 con 0x7fae58003b40 2023-12-07T10:00:30.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae71665640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae6c146d40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fae68009cb0 tx=0x7fae58005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68006e40 con 0x7fae58003b40 2023-12-07T10:00:30.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae680ad440 con 0x7fae58003b40 2023-12-07T10:00:30.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c0c58b0 con 0x7fae58003b40 2023-12-07T10:00:30.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680ad7d0 con 0x7fae58003b40 2023-12-07T10:00:30.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c14a5f0 con 0x7fae58003b40 2023-12-07T10:00:30.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c0c5d60 con 0x7fae58003b40 2023-12-07T10:00:30.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.669+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fae680b4040 con 0x7fae58003b40 2023-12-07T10:00:30.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.673+0000 7fae61ffb640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fae500668d0 0x7fae50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.673+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae6811ec70 con 0x7fae58003b40 2023-12-07T10:00:30.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.673+0000 7fae70e64640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fae500668d0 0x7fae50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.673+0000 7fae70e64640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fae500668d0 0x7fae50068d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae6c157110 tx=0x7fae5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.677+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae680ebbf0 con 0x7fae58003b40 2023-12-07T10:00:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.825+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae6c04e890 con 0x7fae58003b40 2023-12-07T10:00:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.825+0000 7fae61ffb640 1 -- 172.21.15.89:0/3689735052 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae680ef210 con 0x7fae58003b40 2023-12-07T10:00:30.831 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fae500668d0 msgr2=0x7fae50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fae500668d0 0x7fae50068d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae6c157110 tx=0x7fae5c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 msgr2=0x7fae6c146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae6c146d40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fae68009cb0 tx=0x7fae58005800 comp rx=0 tx=0).stop 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 shutdown_connections 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fae500668d0 0x7fae50068d90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fae6c0a8d10 0x7fae6c145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c150480 0x7fae6c14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 --2- 172.21.15.89:0/3689735052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae58003b40 0x7fae6c146d40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 >> 172.21.15.89:0/3689735052 conn(0x7fae6c0c2a60 msgr2=0x7fae6c159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 shutdown_connections 2023-12-07T10:00:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.829+0000 7fae738c9640 1 -- 172.21.15.89:0/3689735052 wait complete. 2023-12-07T10:00:30.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:00:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 Processor -- start 2023-12-07T10:00:30.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 -- start start 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5b4070760 0x7fd5b40701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5b4158ff0 0x7fd5b4159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b4071020 con 0x7fd5b41561d0 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b4071300 con 0x7fd5b4158ff0 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5bbf72640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40715e0 con 0x7fd5b4070760 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5b4158ff0 0x7fd5b4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5b4158ff0 0x7fd5b4159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48100/0 (socket says 172.21.15.89:48100) 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 -- 172.21.15.89:0/4211307857 learned_addr learned my addr 172.21.15.89:0/4211307857 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5b950d640 1 --2- 172.21.15.89:0/4211307857 >> v2:172.21.15.97:3300/0 conn(0x7fd5b4070760 0x7fd5b40701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 -- 172.21.15.89:0/4211307857 >> v2:172.21.15.97:3300/0 conn(0x7fd5b4070760 msgr2=0x7fd5b40701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 --2- 172.21.15.89:0/4211307857 >> v2:172.21.15.97:3300/0 conn(0x7fd5b4070760 0x7fd5b40701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 -- 172.21.15.89:0/4211307857 >> v1:172.21.15.97:6789/0 conn(0x7fd5b41561d0 legacy=0x7fd5b406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:30.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.989+0000 7fd5ba50f640 1 -- 172.21.15.89:0/4211307857 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b40718c0 con 0x7fd5b4158ff0 2023-12-07T10:00:30.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5ba50f640 1 --2- 172.21.15.89:0/4211307857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b4158ff0 0x7fd5b4159440 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40c7020 tx=0x7fd5ac01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e3def9fcfbc906 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:30.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5b8d0c640 1 -- 172.21.15.89:0/4211307857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0a56d0 con 0x7fd5b4158ff0 2023-12-07T10:00:30.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5b8d0c640 1 -- 172.21.15.89:0/4211307857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac0a5830 con 0x7fd5b4158ff0 2023-12-07T10:00:30.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5b8d0c640 1 -- 172.21.15.89:0/4211307857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0a5bc0 con 0x7fd5b4158ff0 2023-12-07T10:00:30.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 -- 172.21.15.89:0/4211307857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b4158ff0 msgr2=0x7fd5b4159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:30.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/4211307857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b4158ff0 0x7fd5b4159440 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40c7020 tx=0x7fd5ac01c900 comp rx=0 tx=0).stop 2023-12-07T10:00:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 -- 172.21.15.89:0/4211307857 shutdown_connections 2023-12-07T10:00:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/4211307857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b4158ff0 0x7fd5b4159440 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/4211307857 >> v2:172.21.15.97:3300/0 conn(0x7fd5b4070760 0x7fd5b40701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 -- 172.21.15.89:0/4211307857 >> 172.21.15.89:0/4211307857 conn(0x7fd5b40c2a60 msgr2=0x7fd5b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 -- 172.21.15.89:0/4211307857 shutdown_connections 2023-12-07T10:00:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.993+0000 7fd5bbf72640 1 -- 172.21.15.89:0/4211307857 wait complete. 2023-12-07T10:00:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 Processor -- start 2023-12-07T10:00:31.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- start start 2023-12-07T10:00:31.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b4070760 0x7fd5b4150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 0x7fd5b41f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b4158ff0 0x7fd5b415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40c53c0 con 0x7fd5b41561d0 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40c5610 con 0x7fd5b4158ff0 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40c58f0 con 0x7fd5b4070760 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 0x7fd5b41f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 0x7fd5b41f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48114/0 (socket says 172.21.15.89:48114) 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 -- 172.21.15.89:0/1802385978 learned_addr learned my addr 172.21.15.89:0/1802385978 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b9d0e640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b4070760 0x7fd5b4150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5ba50f640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b4158ff0 0x7fd5b415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 -- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b4070760 msgr2=0x7fd5b4150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b4070760 0x7fd5b4150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 -- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b4158ff0 msgr2=0x7fd5b415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b4158ff0 0x7fd5b415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 -- 172.21.15.89:0/1802385978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac009b30 con 0x7fd5b41561d0 2023-12-07T10:00:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5b950d640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 0x7fd5b41f5040 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400d5f0 tx=0x7fd5a400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40125f0 con 0x7fd5b41561d0 2023-12-07T10:00:31.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4012750 con 0x7fd5b41561d0 2023-12-07T10:00:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b40c5bd0 con 0x7fd5b41561d0 2023-12-07T10:00:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4012ae0 con 0x7fd5b41561d0 2023-12-07T10:00:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b41f4b20 con 0x7fd5b41561d0 2023-12-07T10:00:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:30.997+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b41f4ce0 con 0x7fd5b41561d0 2023-12-07T10:00:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.001+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd5a4012c40 con 0x7fd5b41561d0 2023-12-07T10:00:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.001+0000 7fd5aa7fc640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5980668d0 0x7fd598068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.001+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd5a4084b00 con 0x7fd5b41561d0 2023-12-07T10:00:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.001+0000 7fd5b9d0e640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5980668d0 0x7fd598068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.001+0000 7fd5b9d0e640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5980668d0 0x7fd598068d90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00098e0 tx=0x7fd5b0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.005+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5a4086e60 con 0x7fd5b41561d0 2023-12-07T10:00:31.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.153+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5b404e890 con 0x7fd5b41561d0 2023-12-07T10:00:31.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.153+0000 7fd5aa7fc640 1 -- 172.21.15.89:0/1802385978 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5a4051a80 con 0x7fd5b41561d0 2023-12-07T10:00:31.159 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:31.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5980668d0 msgr2=0x7fd598068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5980668d0 0x7fd598068d90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00098e0 tx=0x7fd5b0009060 comp rx=0 tx=0).stop 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 msgr2=0x7fd5b41f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 0x7fd5b41f5040 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400d5f0 tx=0x7fd5a400dab0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 shutdown_connections 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b4158ff0 0x7fd5b415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5b41561d0 0x7fd5b41f5040 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd5980668d0 0x7fd598068d90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 --2- 172.21.15.89:0/1802385978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5b4070760 0x7fd5b4150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 >> 172.21.15.89:0/1802385978 conn(0x7fd5b40c2a60 msgr2=0x7fd5b4157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:31.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 shutdown_connections 2023-12-07T10:00:31.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.157+0000 7fd5bbf72640 1 -- 172.21.15.89:0/1802385978 wait complete. 2023-12-07T10:00:31.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:00:31.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 Processor -- start 2023-12-07T10:00:31.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 -- start start 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5eec151f90 0x7f5eec06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5eec0c0370 0x7f5eec06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec06de00 con 0x7f5eec151f90 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec070390 con 0x7f5eec0c0370 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ef0fb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec06db90 con 0x7f5eec14eaf0 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5eec151f90 0x7f5eec06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5eec151f90 0x7f5eec06d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48124/0 (socket says 172.21.15.89:48124) 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 -- 172.21.15.89:0/2817878572 learned_addr learned my addr 172.21.15.89:0/2817878572 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5eea59c640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5eead9d640 1 --2- 172.21.15.89:0/2817878572 >> v2:172.21.15.97:3300/0 conn(0x7f5eec0c0370 0x7f5eec06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 -- 172.21.15.89:0/2817878572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 msgr2=0x7f5eec151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 -- 172.21.15.89:0/2817878572 >> v2:172.21.15.97:3300/0 conn(0x7f5eec0c0370 msgr2=0x7f5eec06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 --2- 172.21.15.89:0/2817878572 >> v2:172.21.15.97:3300/0 conn(0x7f5eec0c0370 0x7f5eec06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5ee9d9b640 1 -- 172.21.15.89:0/2817878572 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec14eed0 con 0x7f5eec151f90 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5eead9d640 1 --2- 172.21.15.89:0/2817878572 >> v2:172.21.15.97:3300/0 conn(0x7f5eec0c0370 0x7f5eec06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:31.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.317+0000 7f5eea59c640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:31.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ee9d9b640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec151f90 0x7f5eec06d110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0ac250 tx=0x7f5ee001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97c47dc36b566b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ee959a640 1 -- 172.21.15.89:0/2817878572 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00a7b40 con 0x7f5eec151f90 2023-12-07T10:00:31.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ee959a640 1 -- 172.21.15.89:0/2817878572 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee00a7ca0 con 0x7f5eec151f90 2023-12-07T10:00:31.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ee959a640 1 -- 172.21.15.89:0/2817878572 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00af660 con 0x7f5eec151f90 2023-12-07T10:00:31.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/2817878572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec151f90 msgr2=0x7f5eec06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec151f90 0x7f5eec06d110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0ac250 tx=0x7f5ee001eab0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/2817878572 shutdown_connections 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/2817878572 >> v2:172.21.15.97:3300/0 conn(0x7f5eec0c0370 0x7f5eec06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec151f90 0x7f5eec06d110 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/2817878572 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/2817878572 >> 172.21.15.89:0/2817878572 conn(0x7f5eec0c2a60 msgr2=0x7f5eec0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/2817878572 shutdown_connections 2023-12-07T10:00:31.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.321+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/2817878572 wait complete. 2023-12-07T10:00:31.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 Processor -- start 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- start start 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 0x7f5eec1ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eec0abd60 0x7f5eec142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec14bf60 con 0x7f5eec0c0370 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec1edd50 con 0x7f5eec0abd60 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec1524d0 con 0x7f5eec14eaf0 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 0x7f5eec1ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 0x7f5eec1ed070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48132/0 (socket says 172.21.15.89:48132) 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 -- 172.21.15.89:0/1603068450 learned_addr learned my addr 172.21.15.89:0/1603068450 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ee9d9b640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eead9d640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eec0abd60 0x7f5eec142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 -- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 msgr2=0x7f5eec141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 -- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eec0abd60 msgr2=0x7f5eec142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eec0abd60 0x7f5eec142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 -- 172.21.15.89:0/1603068450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee000b770 con 0x7f5eec0c0370 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5eea59c640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 0x7f5eec1ed070 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e810 tx=0x7f5edc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00c8d0 con 0x7f5eec0c0370 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc00ca30 con 0x7f5eec0c0370 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00cdc0 con 0x7f5eec0c0370 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec1527b0 con 0x7f5eec0c0370 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec148da0 con 0x7f5eec0c0370 2023-12-07T10:00:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.325+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec04e890 con 0x7f5eec0c0370 2023-12-07T10:00:31.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.329+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5edc013410 con 0x7f5eec0c0370 2023-12-07T10:00:31.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.329+0000 7f5edaffd640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ecc0668d0 0x7f5ecc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.329+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5edc084510 con 0x7f5eec0c0370 2023-12-07T10:00:31.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.329+0000 7f5ee9d9b640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ecc0668d0 0x7f5ecc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.329+0000 7f5ee9d9b640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ecc0668d0 0x7f5ecc068d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00b1000 tx=0x7f5ee0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.333+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5edc051480 con 0x7f5eec0c0370 2023-12-07T10:00:31.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.481+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5eec150940 con 0x7f5eec0c0370 2023-12-07T10:00:31.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5edaffd640 1 -- 172.21.15.89:0/1603068450 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5edc009480 con 0x7f5eec0c0370 2023-12-07T10:00:31.488 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:31.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ecc0668d0 msgr2=0x7f5ecc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ecc0668d0 0x7f5ecc068d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00b1000 tx=0x7f5ee0008040 comp rx=0 tx=0).stop 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 msgr2=0x7f5eec1ed070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 0x7f5eec1ed070 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e810 tx=0x7f5edc00ecd0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 shutdown_connections 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eec0abd60 0x7f5eec142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5ecc0668d0 0x7f5ecc068d90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5eec14eaf0 0x7f5eec141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 --2- 172.21.15.89:0/1603068450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eec0c0370 0x7f5eec1ed070 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 >> 172.21.15.89:0/1603068450 conn(0x7f5eec0c2a60 msgr2=0x7f5eec06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 shutdown_connections 2023-12-07T10:00:31.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.485+0000 7f5ef0fb8640 1 -- 172.21.15.89:0/1603068450 wait complete. 2023-12-07T10:00:31.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:00:31.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 Processor -- start 2023-12-07T10:00:31.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 -- start start 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57814eaf0 0x7fc578151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc578151f90 0x7fc57806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5780c0370 0x7fc57806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57806de00 con 0x7fc5780c0370 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc578070390 con 0x7fc578151f90 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57ebe6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57806db90 con 0x7fc57814eaf0 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5780c0370 0x7fc57806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5780c0370 0x7fc57806d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48142/0 (socket says 172.21.15.89:48142) 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 -- 172.21.15.89:0/3061044005 learned_addr learned my addr 172.21.15.89:0/3061044005 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57c982640 1 --2- 172.21.15.89:0/3061044005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57814eaf0 0x7fc578151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc577fff640 1 --2- 172.21.15.89:0/3061044005 >> v2:172.21.15.97:3300/0 conn(0x7fc578151f90 0x7fc57806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 -- 172.21.15.89:0/3061044005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57814eaf0 msgr2=0x7fc578151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 --2- 172.21.15.89:0/3061044005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57814eaf0 0x7fc578151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 -- 172.21.15.89:0/3061044005 >> v2:172.21.15.97:3300/0 conn(0x7fc578151f90 msgr2=0x7fc57806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:31.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 --2- 172.21.15.89:0/3061044005 >> v2:172.21.15.97:3300/0 conn(0x7fc578151f90 0x7fc57806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.645+0000 7fc57d183640 1 -- 172.21.15.89:0/3061044005 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57814eed0 con 0x7fc5780c0370 2023-12-07T10:00:31.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57d183640 1 --2- 172.21.15.89:0/3061044005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5780c0370 0x7fc57806d650 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5780c6f80 tx=0x7fc57001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824fa58decbf949c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc5777fe640 1 -- 172.21.15.89:0/3061044005 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700a5730 con 0x7fc5780c0370 2023-12-07T10:00:31.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc5777fe640 1 -- 172.21.15.89:0/3061044005 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5700a5890 con 0x7fc5780c0370 2023-12-07T10:00:31.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc5777fe640 1 -- 172.21.15.89:0/3061044005 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700a5c20 con 0x7fc5780c0370 2023-12-07T10:00:31.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3061044005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5780c0370 msgr2=0x7fc57806d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3061044005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5780c0370 0x7fc57806d650 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc5780c6f80 tx=0x7fc57001c8b0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3061044005 shutdown_connections 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3061044005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5780c0370 0x7fc57806d650 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3061044005 >> v2:172.21.15.97:3300/0 conn(0x7fc578151f90 0x7fc57806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3061044005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57814eaf0 0x7fc578151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3061044005 >> 172.21.15.89:0/3061044005 conn(0x7fc5780c2a60 msgr2=0x7fc5780c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3061044005 shutdown_connections 2023-12-07T10:00:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.649+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3061044005 wait complete. 2023-12-07T10:00:31.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 Processor -- start 2023-12-07T10:00:31.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 -- start start 2023-12-07T10:00:31.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5780c0370 0x7fc5781411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 0x7fc57813b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57813bbc0 0x7fc5781f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780c5970 con 0x7fc57814eaf0 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57814e310 con 0x7fc5780c0370 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57814e0a0 con 0x7fc57813bbc0 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 0x7fc57813b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 0x7fc57813b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48146/0 (socket says 172.21.15.89:48146) 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 -- 172.21.15.89:0/3401476735 learned_addr learned my addr 172.21.15.89:0/3401476735 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57c982640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5780c0370 0x7fc5781411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57d183640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57813bbc0 0x7fc5781f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 -- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57813bbc0 msgr2=0x7fc5781f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57813bbc0 0x7fc5781f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 -- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5780c0370 msgr2=0x7fc5781411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5780c0370 0x7fc5781411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 -- 172.21.15.89:0/3401476735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570009b30 con 0x7fc57814eaf0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc577fff640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 0x7fc57813b680 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc56400e8a0 tx=0x7fc56400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564009510 con 0x7fc57814eaf0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400c940 con 0x7fc57814eaf0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400ccb0 con 0x7fc57814eaf0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578154920 con 0x7fc57814eaf0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.653+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578141730 con 0x7fc57814eaf0 2023-12-07T10:00:31.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.657+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57804e890 con 0x7fc57814eaf0 2023-12-07T10:00:31.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.657+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc564013470 con 0x7fc57814eaf0 2023-12-07T10:00:31.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.657+0000 7fc5757fa640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc55c066900 0x7fc55c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.657+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc5640846d0 con 0x7fc57814eaf0 2023-12-07T10:00:31.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.657+0000 7fc57c982640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc55c066900 0x7fc55c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.657+0000 7fc57c982640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc55c066900 0x7fc55c068dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc57814c200 tx=0x7fc56c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.661+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5640516d0 con 0x7fc57814eaf0 2023-12-07T10:00:31.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.809+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5781e33c0 con 0x7fc57814eaf0 2023-12-07T10:00:31.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.809+0000 7fc5757fa640 1 -- 172.21.15.89:0/3401476735 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc56405b070 con 0x7fc57814eaf0 2023-12-07T10:00:31.815 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:31.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc55c066900 msgr2=0x7fc55c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc55c066900 0x7fc55c068dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc57814c200 tx=0x7fc56c009190 comp rx=0 tx=0).stop 2023-12-07T10:00:31.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 msgr2=0x7fc57813b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 0x7fc57813b680 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc56400e8a0 tx=0x7fc56400eca0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 shutdown_connections 2023-12-07T10:00:31.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc55c066900 0x7fc55c068dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc57813bbc0 0x7fc5781f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc57814eaf0 0x7fc57813b680 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 --2- 172.21.15.89:0/3401476735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5780c0370 0x7fc5781411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 >> 172.21.15.89:0/3401476735 conn(0x7fc5780c2a60 msgr2=0x7fc5781428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:31.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 shutdown_connections 2023-12-07T10:00:31.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.813+0000 7fc57ebe6640 1 -- 172.21.15.89:0/3401476735 wait complete. 2023-12-07T10:00:31.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:00:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.969+0000 7f8f12232640 1 Processor -- start 2023-12-07T10:00:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.969+0000 7f8f12232640 1 -- start start 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f12232640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f12232640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f0c0c8430 0x7f8f0c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f12232640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f0c0c7f20 0x7f8f0c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f12232640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c06cf70 con 0x7f8f0c0c8430 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f12232640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c152160 con 0x7f8f0c0c7f20 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f12232640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c6a30 con 0x7f8f0c151d80 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f0c0c8430 0x7f8f0c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f0c0c8430 0x7f8f0c06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48154/0 (socket says 172.21.15.89:48154) 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 -- 172.21.15.89:0/757210197 learned_addr learned my addr 172.21.15.89:0/757210197 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0bfff640 1 --2- 172.21.15.89:0/757210197 >> v2:172.21.15.97:3300/0 conn(0x7f8f0c0c7f20 0x7f8f0c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0b7fe640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 -- 172.21.15.89:0/757210197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 msgr2=0x7f8f0c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 -- 172.21.15.89:0/757210197 >> v2:172.21.15.97:3300/0 conn(0x7f8f0c0c7f20 msgr2=0x7f8f0c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 --2- 172.21.15.89:0/757210197 >> v2:172.21.15.97:3300/0 conn(0x7f8f0c0c7f20 0x7f8f0c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0affd640 1 -- 172.21.15.89:0/757210197 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c0c72d0 con 0x7f8f0c0c8430 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0b7fe640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:31.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.973+0000 7f8f0bfff640 1 --2- 172.21.15.89:0/757210197 >> v2:172.21.15.97:3300/0 conn(0x7f8f0c0c7f20 0x7f8f0c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:31.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f0affd640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c06b720 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0bdb20 tx=0x7f8f0001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2fcb5e78e309d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f0a7fc640 1 -- 172.21.15.89:0/757210197 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a5790 con 0x7f8f0c0c8430 2023-12-07T10:00:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f0a7fc640 1 -- 172.21.15.89:0/757210197 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000a58f0 con 0x7f8f0c0c8430 2023-12-07T10:00:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f0a7fc640 1 -- 172.21.15.89:0/757210197 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a5c80 con 0x7f8f0c0c8430 2023-12-07T10:00:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 -- 172.21.15.89:0/757210197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 msgr2=0x7f8f0c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c06b720 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0bdb20 tx=0x7f8f0001c910 comp rx=0 tx=0).stop 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 -- 172.21.15.89:0/757210197 shutdown_connections 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 --2- 172.21.15.89:0/757210197 >> v2:172.21.15.97:3300/0 conn(0x7f8f0c0c7f20 0x7f8f0c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c06b720 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 --2- 172.21.15.89:0/757210197 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 -- 172.21.15.89:0/757210197 >> 172.21.15.89:0/757210197 conn(0x7f8f0c0abd00 msgr2=0x7f8f0c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 -- 172.21.15.89:0/757210197 shutdown_connections 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 -- 172.21.15.89:0/757210197 wait complete. 2023-12-07T10:00:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 Processor -- start 2023-12-07T10:00:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.977+0000 7f8f12232640 1 -- start start 2023-12-07T10:00:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0c0c7f20 0x7f8f0c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c153500 con 0x7f8f0c0c8430 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c152a70 con 0x7f8f0c0c7f20 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1ed160 con 0x7f8f0c151d80 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48168/0 (socket says 172.21.15.89:48168) 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 -- 172.21.15.89:0/1206651827 learned_addr learned my addr 172.21.15.89:0/1206651827 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0b7fe640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0c0c7f20 0x7f8f0c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0bfff640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 -- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 msgr2=0x7f8f0c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 -- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0c0c7f20 msgr2=0x7f8f0c155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0c0c7f20 0x7f8f0c155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 -- 172.21.15.89:0/1206651827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009b30 con 0x7f8f0c0c8430 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f0affd640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c152530 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8f0001afc0 tx=0x7f8f000196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b8880 con 0x7f8f0c0c8430 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000b8a00 con 0x7f8f0c0c8430 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c154390 con 0x7f8f0c0c8430 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b8db0 con 0x7f8f0c0c8430 2023-12-07T10:00:31.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c1ed400 con 0x7f8f0c0c8430 2023-12-07T10:00:31.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c1ed5f0 con 0x7f8f0c0c8430 2023-12-07T10:00:31.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.981+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8f000b6440 con 0x7f8f0c0c8430 2023-12-07T10:00:31.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.985+0000 7f8ef3fff640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef8066900 0x7f8ef8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:31.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.985+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8f0011fd80 con 0x7f8f0c0c8430 2023-12-07T10:00:31.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.985+0000 7f8f0b7fe640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef8066900 0x7f8ef8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:31.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.985+0000 7f8f0b7fe640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef8066900 0x7f8ef8068dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0c97b0 tx=0x7f8efc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:31.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:31.989+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f000ecdd0 con 0x7f8f0c0c8430 2023-12-07T10:00:32.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8f0c04e890 con 0x7f8f0c0c8430 2023-12-07T10:00:32.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8ef3fff640 1 -- 172.21.15.89:0/1206651827 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f8f000bc020 con 0x7f8f0c0c8430 2023-12-07T10:00:32.141 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:32.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef8066900 msgr2=0x7f8ef8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef8066900 0x7f8ef8068dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0c97b0 tx=0x7f8efc008040 comp rx=0 tx=0).stop 2023-12-07T10:00:32.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 msgr2=0x7f8f0c152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c152530 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8f0001afc0 tx=0x7f8f000196b0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 shutdown_connections 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef8066900 0x7f8ef8068dc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0c151d80 0x7f8f0c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f0c0c8430 0x7f8f0c152530 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 --2- 172.21.15.89:0/1206651827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0c0c7f20 0x7f8f0c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 >> 172.21.15.89:0/1206651827 conn(0x7f8f0c0abd00 msgr2=0x7f8f0c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 shutdown_connections 2023-12-07T10:00:32.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.137+0000 7f8f12232640 1 -- 172.21.15.89:0/1206651827 wait complete. 2023-12-07T10:00:32.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f0932a640 1 Processor -- start 2023-12-07T10:00:32.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f0932a640 1 -- start start 2023-12-07T10:00:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f0932a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 0x7f8f040c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f0932a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f04155790 con 0x7f8f040bd720 2023-12-07T10:00:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f0932a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f040c4b00 con 0x7f8f0406cd90 2023-12-07T10:00:32.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f0932a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040c4de0 con 0x7f8f040ca610 2023-12-07T10:00:32.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f027fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8f040bd720 0x7f8f04158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51706/0 (socket says 172.21.15.89:51706) 2023-12-07T10:00:32.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f027fc640 1 -- 172.21.15.89:0/3361613989 learned_addr learned my addr 172.21.15.89:0/3361613989 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:32.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 0x7f8f040c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378125250 0 0) 0x7f8f04155790 con 0x7f8f040bd720 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eec003530 con 0x7f8f040bd720 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3727795650 0 0) 0x7f8eec003530 con 0x7f8f040bd720 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 msgr2=0x7f8f040c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 0x7f8f040c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 >> v1:172.21.15.97:6789/0 conn(0x7f8f0406cd90 legacy=0x7f8f040c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04157e30 con 0x7f8f040bd720 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f8ef8001680 con 0x7f8f040bd720 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 >> v1:172.21.15.89:6789/0 conn(0x7f8f040bd720 legacy=0x7f8f04158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8eec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 0x7f8eec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8eec004d10 0x7f8eec005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040c4de0 con 0x7f8eec0039b0 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec00bba0 con 0x7f8eec004d10 2023-12-07T10:00:32.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec00bd60 con 0x7f8f040ca610 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.297+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8eec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f027fc640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 0x7f8eec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f037fe640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8eec004d10 0x7f8eec005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 msgr2=0x7f8eec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040ca610 0x7f8eec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8eec004d10 msgr2=0x7f8eec005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8eec004d10 0x7f8eec005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f02ffd640 1 -- 172.21.15.89:0/3361613989 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec003530 con 0x7f8eec0039b0 2023-12-07T10:00:32.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f037fe640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8eec004d10 0x7f8eec005170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:32.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8eec003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009ae0 tx=0x7f8ef401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc8fff08313c3d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040c52d0 con 0x7f8eec0039b0 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef40a4b90 con 0x7f8eec0039b0 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f01ffb640 1 -- 172.21.15.89:0/3361613989 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40ac440 con 0x7f8eec0039b0 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f0932a640 1 -- 172.21.15.89:0/3361613989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 msgr2=0x7f8eec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f0932a640 1 --2- 172.21.15.89:0/3361613989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8eec003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009ae0 tx=0x7f8ef401c730 comp rx=0 tx=0).stop 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.301+0000 7f8f037fe640 1 -- 172.21.15.89:0/3361613989 reap_dead start 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- 172.21.15.89:0/3361613989 shutdown_connections 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- 172.21.15.89:0/3361613989 >> 172.21.15.89:0/3361613989 conn(0x7f8f04071ea0 msgr2=0x7f8f040722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- 172.21.15.89:0/3361613989 shutdown_connections 2023-12-07T10:00:32.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- 172.21.15.89:0/3361613989 wait complete. 2023-12-07T10:00:32.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 Processor -- start 2023-12-07T10:00:32.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- start start 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8f040ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f041530b0 0x7f8f040ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040aa3f0 0x7f8f04153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040aac20 con 0x7f8eec0039b0 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041523c0 con 0x7f8f041530b0 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f0932a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04152c20 con 0x7f8f040aa3f0 2023-12-07T10:00:32.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8f040ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8f040ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48184/0 (socket says 172.21.15.89:48184) 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 -- 172.21.15.89:0/1974817494 learned_addr learned my addr 172.21.15.89:0/1974817494 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 -- 172.21.15.89:0/1974817494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040aa3f0 msgr2=0x7f8f04153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040aa3f0 0x7f8f04153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 -- 172.21.15.89:0/1974817494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f041530b0 msgr2=0x7f8f040ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f041530b0 0x7f8f040ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 -- 172.21.15.89:0/1974817494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040aa940 con 0x7f8eec0039b0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8f02ffd640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8f040ac350 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009ae0 tx=0x7f8eec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.305+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40accc0 con 0x7f8eec0039b0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef40ace20 con 0x7f8eec0039b0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4004220 con 0x7f8eec0039b0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f041525d0 con 0x7f8eec0039b0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0414e590 con 0x7f8eec0039b0 2023-12-07T10:00:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0404e890 con 0x7f8eec0039b0 2023-12-07T10:00:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8ef40b3040 con 0x7f8eec0039b0 2023-12-07T10:00:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8eeb7fe640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef00668d0 0x7f8ef0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8f040cac00 con 0x7f8eec0039b0 2023-12-07T10:00:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8f027fc640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef00668d0 0x7f8ef0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.309+0000 7f8f027fc640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef00668d0 0x7f8ef0068d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f040c0e50 tx=0x7f8ef8001b30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.313+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ef40eb0a0 con 0x7f8eec0039b0 2023-12-07T10:00:32.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.493+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f04160f20 con 0x7f8eec0039b0 2023-12-07T10:00:32.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8eeb7fe640 1 -- 172.21.15.89:0/1974817494 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6124 (secure 0 0 0) 0x7f8ef40ee6c0 con 0x7f8eec0039b0 2023-12-07T10:00:32.500 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:32.501 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:32.501 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2023-12-07T10:00:32.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef00668d0 msgr2=0x7f8ef0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef00668d0 0x7f8ef0068d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f040c0e50 tx=0x7f8ef8001b30 comp rx=0 tx=0).stop 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 msgr2=0x7f8f040ac350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8f040ac350 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009ae0 tx=0x7f8eec005800 comp rx=0 tx=0).stop 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 shutdown_connections 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8ef00668d0 0x7f8ef0068d90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f040aa3f0 0x7f8f04153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f041530b0 0x7f8f040ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 --2- 172.21.15.89:0/1974817494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eec0039b0 0x7f8f040ac350 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 >> 172.21.15.89:0/1974817494 conn(0x7f8f04071ea0 msgr2=0x7f8f04157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 shutdown_connections 2023-12-07T10:00:32.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.497+0000 7f8f0932a640 1 -- 172.21.15.89:0/1974817494 wait complete. 2023-12-07T10:00:32.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:32.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.653+0000 7f44e7217640 1 Processor -- start 2023-12-07T10:00:32.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.653+0000 7f44e7217640 1 -- start start 2023-12-07T10:00:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e7217640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f44e006ec90 0x7f44e0071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e7217640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e0157d00 con 0x7f44e0151f40 2023-12-07T10:00:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e7217640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e006d1f0 con 0x7f44e00c0700 2023-12-07T10:00:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e7217640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00c0be0 con 0x7f44e006ec90 2023-12-07T10:00:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e4fb3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f44e0151f40 0x7f44e00c1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51716/0 (socket says 172.21.15.89:51716) 2023-12-07T10:00:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e4fb3640 1 -- 172.21.15.89:0/1507249948 learned_addr learned my addr 172.21.15.89:0/1507249948 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654116735 0 0) 0x7f44e0157d00 con 0x7f44e0151f40 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c8003530 con 0x7f44e0151f40 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 --2- 172.21.15.89:0/1507249948 >> v2:172.21.15.97:3300/0 conn(0x7f44e006ec90 0x7f44e0071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2842231652 0 0) 0x7f44c8003530 con 0x7f44e0151f40 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 >> v2:172.21.15.97:3300/0 conn(0x7f44e006ec90 msgr2=0x7f44e0071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 --2- 172.21.15.89:0/1507249948 >> v2:172.21.15.97:3300/0 conn(0x7f44e006ec90 0x7f44e0071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 >> v1:172.21.15.97:6789/0 conn(0x7f44e00c0700 legacy=0x7f44e0071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e006cf30 con 0x7f44e0151f40 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f44dc001680 con 0x7f44e0151f40 2023-12-07T10:00:32.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 >> v1:172.21.15.89:6789/0 conn(0x7f44e0151f40 legacy=0x7f44e00c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c8003980 0x7f44c8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44c80047d0 0x7f44c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c80051e0 0x7f44c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00c0be0 con 0x7f44c80051e0 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c800c110 con 0x7f44c80047d0 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c800c2d0 con 0x7f44c8003980 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c80051e0 0x7f44c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e4fb3640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c8003980 0x7f44c8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44d7fff640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44c80047d0 0x7f44c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 -- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c8003980 msgr2=0x7f44c8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c8003980 0x7f44c8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 -- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44c80047d0 msgr2=0x7f44c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44c80047d0 0x7f44c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.657+0000 7f44e57b4640 1 -- 172.21.15.89:0/1507249948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c8003530 con 0x7f44c80051e0 2023-12-07T10:00:32.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e57b4640 1 -- 172.21.15.89:0/1507249948 reap_dead start 2023-12-07T10:00:32.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e57b4640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c80051e0 0x7f44c800b990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009fc0 tx=0x7f44d801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cff6ecdd78b3a02 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d80a5cb0 con 0x7f44c80051e0 2023-12-07T10:00:32.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800f040 con 0x7f44c80051e0 2023-12-07T10:00:32.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44d77fe640 1 -- 172.21.15.89:0/1507249948 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8003be0 con 0x7f44c80051e0 2023-12-07T10:00:32.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 -- 172.21.15.89:0/1507249948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c80051e0 msgr2=0x7f44c800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c80051e0 0x7f44c800b990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009fc0 tx=0x7f44d801cca0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 -- 172.21.15.89:0/1507249948 shutdown_connections 2023-12-07T10:00:32.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 --2- 172.21.15.89:0/1507249948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c80051e0 0x7f44c800b990 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 -- 172.21.15.89:0/1507249948 >> 172.21.15.89:0/1507249948 conn(0x7f44e00c2ce0 msgr2=0x7f44e00c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:32.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 -- 172.21.15.89:0/1507249948 shutdown_connections 2023-12-07T10:00:32.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.661+0000 7f44e7217640 1 -- 172.21.15.89:0/1507249948 wait complete. 2023-12-07T10:00:32.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 Processor -- start 2023-12-07T10:00:32.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- start start 2023-12-07T10:00:32.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c80051e0 0x7f44e00a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 0x7f44e01536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44e0153c10 0x7f44e0145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0152fc0 con 0x7f44e00a9180 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01554e0 con 0x7f44e0153c10 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0153240 con 0x7f44c80051e0 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 0x7f44e01536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 0x7f44e01536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48202/0 (socket says 172.21.15.89:48202) 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 -- 172.21.15.89:0/2738747172 learned_addr learned my addr 172.21.15.89:0/2738747172 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e57b4640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44e0153c10 0x7f44e0145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e4fb3640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c80051e0 0x7f44e00a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 -- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c80051e0 msgr2=0x7f44e00a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c80051e0 0x7f44e00a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 -- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44e0153c10 msgr2=0x7f44e0145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44e0153c10 0x7f44e0145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 -- 172.21.15.89:0/2738747172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0154f40 con 0x7f44e00a9180 2023-12-07T10:00:32.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e4fb3640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c80051e0 0x7f44e00a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e57b4640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44e0153c10 0x7f44e0145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d7fff640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 0x7f44e01536d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f44d0011c10 tx=0x7f44d000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000fcb0 con 0x7f44e00a9180 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000fe30 con 0x7f44e00a9180 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0005310 con 0x7f44e00a9180 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e01464d0 con 0x7f44e00a9180 2023-12-07T10:00:32.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e0155200 con 0x7f44e00a9180 2023-12-07T10:00:32.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.665+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e01533b0 con 0x7f44e00a9180 2023-12-07T10:00:32.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.669+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f44d0003600 con 0x7f44e00a9180 2023-12-07T10:00:32.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.669+0000 7f44d57fa640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44cc0668d0 0x7f44cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.669+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f44d00880e0 con 0x7f44e00a9180 2023-12-07T10:00:32.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.669+0000 7f44e4fb3640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44cc0668d0 0x7f44cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.669+0000 7f44e4fb3640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44cc0668d0 0x7f44cc068d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44dc000c10 tx=0x7f44dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.673+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44d0054fb0 con 0x7f44e00a9180 2023-12-07T10:00:32.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.825+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44e004e890 con 0x7f44e00a9180 2023-12-07T10:00:32.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.825+0000 7f44d57fa640 1 -- 172.21.15.89:0/2738747172 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f44d00585d0 con 0x7f44e00a9180 2023-12-07T10:00:32.830 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:32.831 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.825+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44cc0668d0 msgr2=0x7f44cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.825+0000 7f44e7217640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44cc0668d0 0x7f44cc068d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44dc000c10 tx=0x7f44dc009040 comp rx=0 tx=0).stop 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.825+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 msgr2=0x7f44e01536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.825+0000 7f44e7217640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 0x7f44e01536d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f44d0011c10 tx=0x7f44d000f5a0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 shutdown_connections 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44e0153c10 0x7f44e0145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44e00a9180 0x7f44e01536d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44cc0668d0 0x7f44cc068d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 --2- 172.21.15.89:0/2738747172 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44c80051e0 0x7f44e00a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 >> 172.21.15.89:0/2738747172 conn(0x7f44e00c2ce0 msgr2=0x7f44e00c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:32.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 shutdown_connections 2023-12-07T10:00:32.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.829+0000 7f44e7217640 1 -- 172.21.15.89:0/2738747172 wait complete. 2023-12-07T10:00:32.851 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-07T10:00:32.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:32.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 Processor -- start 2023-12-07T10:00:32.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 -- start start 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1cd40ca610 0x7f1cd40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cd40bd720 0x7f1cd40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd4155790 con 0x7f1cd406cd90 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40c4b00 con 0x7f1cd40bd720 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd8d65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40c4de0 con 0x7f1cd40ca610 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cd40bd720 0x7f1cd40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cd40bd720 0x7f1cd40c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48216/0 (socket says 172.21.15.89:48216) 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 -- 172.21.15.89:0/3410283179 learned_addr learned my addr 172.21.15.89:0/3410283179 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cd259c640 1 --2- 172.21.15.89:0/3410283179 >> v2:172.21.15.97:3300/0 conn(0x7f1cd40ca610 0x7f1cd40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 -- 172.21.15.89:0/3410283179 >> v2:172.21.15.97:3300/0 conn(0x7f1cd40ca610 msgr2=0x7f1cd40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:32.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 --2- 172.21.15.89:0/3410283179 >> v2:172.21.15.97:3300/0 conn(0x7f1cd40ca610 0x7f1cd40c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 -- 172.21.15.89:0/3410283179 >> v1:172.21.15.97:6789/0 conn(0x7f1cd406cd90 legacy=0x7f1cd4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.985+0000 7f1cc9d9b640 1 -- 172.21.15.89:0/3410283179 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4157e30 con 0x7f1cd40bd720 2023-12-07T10:00:32.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cc9d9b640 1 --2- 172.21.15.89:0/3410283179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40bd720 0x7f1cd40c9a00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40acc80 tx=0x7f1cc401c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786176e9ac07e15e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:32.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd1d9b640 1 -- 172.21.15.89:0/3410283179 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40c52d0 con 0x7f1cd40bd720 2023-12-07T10:00:32.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd1d9b640 1 -- 172.21.15.89:0/3410283179 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40a4900 con 0x7f1cd40bd720 2023-12-07T10:00:32.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd1d9b640 1 -- 172.21.15.89:0/3410283179 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40a4c90 con 0x7f1cd40bd720 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 -- 172.21.15.89:0/3410283179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40bd720 msgr2=0x7f1cd40c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/3410283179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40bd720 0x7f1cd40c9a00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40acc80 tx=0x7f1cc401c0c0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 -- 172.21.15.89:0/3410283179 shutdown_connections 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/3410283179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40bd720 0x7f1cd40c9a00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/3410283179 >> v2:172.21.15.97:3300/0 conn(0x7f1cd40ca610 0x7f1cd40c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 -- 172.21.15.89:0/3410283179 >> 172.21.15.89:0/3410283179 conn(0x7f1cd4071ea0 msgr2=0x7f1cd40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:32.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 -- 172.21.15.89:0/3410283179 shutdown_connections 2023-12-07T10:00:32.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.989+0000 7f1cd8d65640 1 -- 172.21.15.89:0/3410283179 wait complete. 2023-12-07T10:00:32.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 Processor -- start 2023-12-07T10:00:32.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 -- start start 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cd406cd90 0x7f1cd40ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd40bd720 0x7f1cd41ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 0x7f1cd41f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40ab460 con 0x7f1cd40ca610 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40ab6a0 con 0x7f1cd40bd720 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40ab980 con 0x7f1cd406cd90 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 0x7f1cd41f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cc9d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd40bd720 0x7f1cd41ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cd406cd90 0x7f1cd40ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:32.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 0x7f1cd41f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48222/0 (socket says 172.21.15.89:48222) 2023-12-07T10:00:32.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 -- 172.21.15.89:0/477119078 learned_addr learned my addr 172.21.15.89:0/477119078 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 -- 172.21.15.89:0/477119078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cd406cd90 msgr2=0x7f1cd40ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cd406cd90 0x7f1cd40ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 -- 172.21.15.89:0/477119078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd40bd720 msgr2=0x7f1cd41ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd40bd720 0x7f1cd41ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 -- 172.21.15.89:0/477119078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40094d0 con 0x7f1cd40ca610 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd2d9d640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 0x7f1cd41f1560 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c770 tx=0x7f1ccc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc003b80 con 0x7f1cd40ca610 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc003ce0 con 0x7f1cd40ca610 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00aa90 con 0x7f1cd40ca610 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd40abc60 con 0x7f1cd40ca610 2023-12-07T10:00:33.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.993+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd41f1f60 con 0x7f1cd40ca610 2023-12-07T10:00:33.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.997+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd40ab7e0 con 0x7f1cd40ca610 2023-12-07T10:00:33.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.997+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1ccc00abf0 con 0x7f1cd40ca610 2023-12-07T10:00:33.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.997+0000 7f1ccb7fe640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1cb4066900 0x7f1cb4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.997+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1ccc084460 con 0x7f1cd40ca610 2023-12-07T10:00:33.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.997+0000 7f1cd259c640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1cb4066900 0x7f1cb4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:32.997+0000 7f1cd259c640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1cb4066900 0x7f1cb4068dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009ac0 tx=0x7f1cbc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.001+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cd40ab7e0 con 0x7f1cd40ca610 2023-12-07T10:00:33.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd40ab7e0 con 0x7f1cd40ca610 2023-12-07T10:00:33.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1ccb7fe640 1 -- 172.21.15.89:0/477119078 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6124 (secure 0 0 0) 0x7f1cd40ab7e0 con 0x7f1cd40ca610 2023-12-07T10:00:33.185 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:33.185 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2023-12-07T10:00:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1cb4066900 msgr2=0x7f1cb4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1cb4066900 0x7f1cb4068dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009ac0 tx=0x7f1cbc009190 comp rx=0 tx=0).stop 2023-12-07T10:00:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 msgr2=0x7f1cd41f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 0x7f1cd41f1560 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c770 tx=0x7f1ccc00cc30 comp rx=0 tx=0).stop 2023-12-07T10:00:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 shutdown_connections 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cd40ca610 0x7f1cd41f1560 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd40bd720 0x7f1cd41ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1cb4066900 0x7f1cb4068dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 --2- 172.21.15.89:0/477119078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cd406cd90 0x7f1cd40ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 >> 172.21.15.89:0/477119078 conn(0x7f1cd4071ea0 msgr2=0x7f1cd4156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 shutdown_connections 2023-12-07T10:00:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.181+0000 7f1cd8d65640 1 -- 172.21.15.89:0/477119078 wait complete. 2023-12-07T10:00:33.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:33.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 Processor -- start 2023-12-07T10:00:33.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 -- start start 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf00156500 0x7faf0006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf000c19e0 0x7faf000c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0006dec0 con 0x7faf0014fcc0 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf000aa340 con 0x7faf000c19e0 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf08094640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf00156980 con 0x7faf00156500 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf06631640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf000c19e0 0x7faf000c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf05e30640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7faf0014fcc0 0x7faf000aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51724/0 (socket says 172.21.15.89:51724) 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf06631640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf000c19e0 0x7faf000c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48234/0 (socket says 172.21.15.89:48234) 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf05e30640 1 -- 172.21.15.89:0/1263478547 learned_addr learned my addr 172.21.15.89:0/1263478547 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf0562f640 1 --2- 172.21.15.89:0/1263478547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf00156500 0x7faf0006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf06631640 1 -- 172.21.15.89:0/1263478547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf00156500 msgr2=0x7faf0006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf06631640 1 --2- 172.21.15.89:0/1263478547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf00156500 0x7faf0006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf06631640 1 -- 172.21.15.89:0/1263478547 >> v1:172.21.15.89:6789/0 conn(0x7faf0014fcc0 legacy=0x7faf000aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.341+0000 7faf06631640 1 -- 172.21.15.89:0/1263478547 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000ab580 con 0x7faf000c19e0 2023-12-07T10:00:33.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf06631640 1 --2- 172.21.15.89:0/1263478547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf000c1e70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faef8009d90 tx=0x7faef801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b75ec1fc7ec05aa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf04e2e640 1 -- 172.21.15.89:0/1263478547 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80a58f0 con 0x7faf000c19e0 2023-12-07T10:00:33.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf04e2e640 1 -- 172.21.15.89:0/1263478547 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef80a5a50 con 0x7faf000c19e0 2023-12-07T10:00:33.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf04e2e640 1 -- 172.21.15.89:0/1263478547 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80a5de0 con 0x7faf000c19e0 2023-12-07T10:00:33.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 -- 172.21.15.89:0/1263478547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 msgr2=0x7faf000c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 --2- 172.21.15.89:0/1263478547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf000c1e70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faef8009d90 tx=0x7faef801c920 comp rx=0 tx=0).stop 2023-12-07T10:00:33.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 -- 172.21.15.89:0/1263478547 shutdown_connections 2023-12-07T10:00:33.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 --2- 172.21.15.89:0/1263478547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf000c1e70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 --2- 172.21.15.89:0/1263478547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf00156500 0x7faf0006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 -- 172.21.15.89:0/1263478547 >> 172.21.15.89:0/1263478547 conn(0x7faf000c2ad0 msgr2=0x7faf000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:33.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 -- 172.21.15.89:0/1263478547 shutdown_connections 2023-12-07T10:00:33.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.345+0000 7faf08094640 1 -- 172.21.15.89:0/1263478547 wait complete. 2023-12-07T10:00:33.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 Processor -- start 2023-12-07T10:00:33.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- start start 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf0015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf00156500 0x7faf001407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000bbcd0 0x7faf00140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf000bea00 con 0x7faf000c19e0 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf001ecd30 con 0x7faf00156500 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf00141230 con 0x7faf000bbcd0 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf0015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf0015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48246/0 (socket says 172.21.15.89:48246) 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 -- 172.21.15.89:0/2750473205 learned_addr learned my addr 172.21.15.89:0/2750473205 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:33.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf0562f640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf00156500 0x7faf001407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf06631640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000bbcd0 0x7faf00140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 -- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000bbcd0 msgr2=0x7faf00140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000bbcd0 0x7faf00140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 -- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf00156500 msgr2=0x7faf001407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf00156500 0x7faf001407b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 -- 172.21.15.89:0/2750473205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8009a70 con 0x7faf000c19e0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf05e30640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf0015b3f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c500 tx=0x7faefc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc005cf0 con 0x7faf000c19e0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc005e50 con 0x7faf000c19e0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0072f0 con 0x7faf000c19e0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf00151310 con 0x7faf000c19e0 2023-12-07T10:00:33.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf00152660 con 0x7faf000c19e0 2023-12-07T10:00:33.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.349+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0004e890 con 0x7faf000c19e0 2023-12-07T10:00:33.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.353+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faefc007450 con 0x7faf000c19e0 2023-12-07T10:00:33.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.353+0000 7faef67fc640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faee40668d0 0x7faee4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.353+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faefc083ac0 con 0x7faf000c19e0 2023-12-07T10:00:33.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.353+0000 7faf0562f640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faee40668d0 0x7faee4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.353+0000 7faf0562f640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faee40668d0 0x7faee4068d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf00074b20 tx=0x7faef0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.357+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faefc050a40 con 0x7faf000c19e0 2023-12-07T10:00:33.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.537+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf00152660 con 0x7faf000c19e0 2023-12-07T10:00:33.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.537+0000 7faef67fc640 1 -- 172.21.15.89:0/2750473205 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6124 (secure 0 0 0) 0x7faf00152660 con 0x7faf000c19e0 2023-12-07T10:00:33.543 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:33.543 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T09:59:56.607949+0000","modified":"2023-12-07T09:59:59.632179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/2626061332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":2626061332},{"type":"v1","addr":"172.21.15.97:6835","nonce":2626061332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faee40668d0 msgr2=0x7faee4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faee40668d0 0x7faee4068d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf00074b20 tx=0x7faef0008040 comp rx=0 tx=0).stop 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 msgr2=0x7faf0015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf0015b3f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c500 tx=0x7faefc00c9c0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 shutdown_connections 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faee40668d0 0x7faee4068d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf000bbcd0 0x7faf00140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf00156500 0x7faf001407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 --2- 172.21.15.89:0/2750473205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf000c19e0 0x7faf0015b3f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 >> 172.21.15.89:0/2750473205 conn(0x7faf000c2ad0 msgr2=0x7faf00066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 shutdown_connections 2023-12-07T10:00:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.541+0000 7faf08094640 1 -- 172.21.15.89:0/2750473205 wait complete. 2023-12-07T10:00:33.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:33.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.693+0000 7f83884fe640 1 Processor -- start 2023-12-07T10:00:33.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.693+0000 7f83884fe640 1 -- start start 2023-12-07T10:00:33.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f83884fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8380156500 0x7f838006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f83884fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83800c19e0 0x7f83800c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f83884fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838006dec0 con 0x7f838014fcc0 2023-12-07T10:00:33.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f83884fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83800aa340 con 0x7f83800c19e0 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f83884fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8380156980 con 0x7f8380156500 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83800c19e0 0x7f83800c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83800c19e0 0x7f83800c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48256/0 (socket says 172.21.15.89:48256) 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 -- 172.21.15.89:0/1366292410 learned_addr learned my addr 172.21.15.89:0/1366292410 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8385a99640 1 --2- 172.21.15.89:0/1366292410 >> v2:172.21.15.97:3300/0 conn(0x7f8380156500 0x7f838006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 -- 172.21.15.89:0/1366292410 >> v2:172.21.15.97:3300/0 conn(0x7f8380156500 msgr2=0x7f838006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:33.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 --2- 172.21.15.89:0/1366292410 >> v2:172.21.15.97:3300/0 conn(0x7f8380156500 0x7f838006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 -- 172.21.15.89:0/1366292410 >> v1:172.21.15.97:6789/0 conn(0x7f838014fcc0 legacy=0x7f83800aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.697+0000 7f8386a9b640 1 -- 172.21.15.89:0/1366292410 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800ab580 con 0x7f83800c19e0 2023-12-07T10:00:33.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f8386a9b640 1 --2- 172.21.15.89:0/1366292410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83800c19e0 0x7f83800c1e50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f838006b4e0 tx=0x7f837801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452270f31bc24cc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f8385298640 1 -- 172.21.15.89:0/1366292410 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780a5770 con 0x7f83800c19e0 2023-12-07T10:00:33.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f8385298640 1 -- 172.21.15.89:0/1366292410 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780a58d0 con 0x7f83800c19e0 2023-12-07T10:00:33.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f8385298640 1 -- 172.21.15.89:0/1366292410 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780a5c60 con 0x7f83800c19e0 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 -- 172.21.15.89:0/1366292410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83800c19e0 msgr2=0x7f83800c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 --2- 172.21.15.89:0/1366292410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83800c19e0 0x7f83800c1e50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f838006b4e0 tx=0x7f837801c9a0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 -- 172.21.15.89:0/1366292410 shutdown_connections 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 --2- 172.21.15.89:0/1366292410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83800c19e0 0x7f83800c1e50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 --2- 172.21.15.89:0/1366292410 >> v2:172.21.15.97:3300/0 conn(0x7f8380156500 0x7f838006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 -- 172.21.15.89:0/1366292410 >> 172.21.15.89:0/1366292410 conn(0x7f83800c2ad0 msgr2=0x7f83800c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 -- 172.21.15.89:0/1366292410 shutdown_connections 2023-12-07T10:00:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 -- 172.21.15.89:0/1366292410 wait complete. 2023-12-07T10:00:33.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 Processor -- start 2023-12-07T10:00:33.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.701+0000 7f83884fe640 1 -- start start 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83800c19e0 0x7f838015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 0x7f838014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f838014a4a0 0x7f838014a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83800c48c0 con 0x7f8380156500 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838014ae70 con 0x7f838014a4a0 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800c4b10 con 0x7f83800c19e0 2023-12-07T10:00:33.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 0x7f838014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 0x7f838014c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48270/0 (socket says 172.21.15.89:48270) 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 -- 172.21.15.89:0/2441788782 learned_addr learned my addr 172.21.15.89:0/2441788782 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8386a9b640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f838014a4a0 0x7f838014a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f838629a640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83800c19e0 0x7f838015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 -- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83800c19e0 msgr2=0x7f838015b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83800c19e0 0x7f838015b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 -- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f838014a4a0 msgr2=0x7f838014a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f838014a4a0 0x7f838014a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 -- 172.21.15.89:0/2441788782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009b30 con 0x7f8380156500 2023-12-07T10:00:33.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8385a99640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 0x7f838014c8c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f837000e930 tx=0x7f837000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370009690 con 0x7f8380156500 2023-12-07T10:00:33.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000ca00 con 0x7f8380156500 2023-12-07T10:00:33.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800c4df0 con 0x7f8380156500 2023-12-07T10:00:33.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000cd70 con 0x7f8380156500 2023-12-07T10:00:33.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83800c53b0 con 0x7f8380156500 2023-12-07T10:00:33.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838004e890 con 0x7f8380156500 2023-12-07T10:00:33.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.705+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8370013470 con 0x7f8380156500 2023-12-07T10:00:33.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.709+0000 7f8376ffd640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8364066900 0x7f8364068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:33.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.709+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8370084940 con 0x7f8380156500 2023-12-07T10:00:33.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.709+0000 7f838629a640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8364066900 0x7f8364068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:33.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.709+0000 7f838629a640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8364066900 0x7f8364068dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f837c007fd0 tx=0x7f837c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:33.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.713+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8370051990 con 0x7f8380156500 2023-12-07T10:00:33.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.861+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f838006ce10 con 0x7f8380156500 2023-12-07T10:00:33.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.861+0000 7f8376ffd640 1 -- 172.21.15.89:0/2441788782 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f8370054fb0 con 0x7f8380156500 2023-12-07T10:00:33.868 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:33.868 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:15.453598+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-07T09:59:55.032694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-07T09:59:55.602397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8364066900 msgr2=0x7f8364068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8364066900 0x7f8364068dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f837c007fd0 tx=0x7f837c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 msgr2=0x7f838014c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 0x7f838014c8c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f837000e930 tx=0x7f837000edf0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 shutdown_connections 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f838014a4a0 0x7f838014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380156500 0x7f838014c8c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8364066900 0x7f8364068dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 --2- 172.21.15.89:0/2441788782 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83800c19e0 0x7f838015b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 >> 172.21.15.89:0/2441788782 conn(0x7f83800c2ad0 msgr2=0x7f8380151b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:33.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 shutdown_connections 2023-12-07T10:00:33.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:33.865+0000 7f83884fe640 1 -- 172.21.15.89:0/2441788782 wait complete. 2023-12-07T10:00:33.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-07T10:00:34.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.021+0000 7fa316d01640 1 Processor -- start 2023-12-07T10:00:34.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa316d01640 1 -- start start 2023-12-07T10:00:34.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa316d01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3100a8470 0x7fa310151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa316d01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31006d320 con 0x7fa31014e9d0 2023-12-07T10:00:34.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa316d01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100721b0 con 0x7fa310070b80 2023-12-07T10:00:34.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa316d01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3100c2830 con 0x7fa3100a8470 2023-12-07T10:00:34.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa314a9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa31014e9d0 0x7fa3100c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51732/0 (socket says 172.21.15.89:51732) 2023-12-07T10:00:34.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa314a9d640 1 -- 172.21.15.89:0/2380489932 learned_addr learned my addr 172.21.15.89:0/2380489932 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:34.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa31529e640 1 --2- 172.21.15.89:0/2380489932 >> v2:172.21.15.89:3300/0 conn(0x7fa3100a8470 0x7fa310151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa3077fe640 1 -- 172.21.15.89:0/2380489932 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477366532 0 0) 0x7fa31006d320 con 0x7fa31014e9d0 2023-12-07T10:00:34.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa3077fe640 1 -- 172.21.15.89:0/2380489932 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003530 con 0x7fa31014e9d0 2023-12-07T10:00:34.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa31529e640 1 -- 172.21.15.89:0/2380489932 >> v1:172.21.15.97:6789/0 conn(0x7fa310070b80 legacy=0x7fa31006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa31529e640 1 -- 172.21.15.89:0/2380489932 >> v1:172.21.15.89:6789/0 conn(0x7fa31014e9d0 legacy=0x7fa3100c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.025+0000 7fa31529e640 1 -- 172.21.15.89:0/2380489932 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310072450 con 0x7fa3100a8470 2023-12-07T10:00:34.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa31529e640 1 --2- 172.21.15.89:0/2380489932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3100a8470 0x7fa310151e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa308009d90 tx=0x7fa30801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb2a1b20864ec7e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:34.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa3077fe640 1 -- 172.21.15.89:0/2380489932 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080a5890 con 0x7fa3100a8470 2023-12-07T10:00:34.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa3077fe640 1 -- 172.21.15.89:0/2380489932 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3080a59f0 con 0x7fa3100a8470 2023-12-07T10:00:34.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa3077fe640 1 -- 172.21.15.89:0/2380489932 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080a5d80 con 0x7fa3100a8470 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 -- 172.21.15.89:0/2380489932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3100a8470 msgr2=0x7fa310151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 --2- 172.21.15.89:0/2380489932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3100a8470 0x7fa310151e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa308009d90 tx=0x7fa30801c8c0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 -- 172.21.15.89:0/2380489932 shutdown_connections 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 --2- 172.21.15.89:0/2380489932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3100a8470 0x7fa310151e60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 -- 172.21.15.89:0/2380489932 >> 172.21.15.89:0/2380489932 conn(0x7fa3100c2ad0 msgr2=0x7fa3100c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 -- 172.21.15.89:0/2380489932 shutdown_connections 2023-12-07T10:00:34.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 -- 172.21.15.89:0/2380489932 wait complete. 2023-12-07T10:00:34.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 Processor -- start 2023-12-07T10:00:34.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.029+0000 7fa316d01640 1 -- start start 2023-12-07T10:00:34.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa310070b80 0x7fa310150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3100a8470 0x7fa31014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 0x7fa310147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310150ae0 con 0x7fa31014e9d0 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310144a60 con 0x7fa3100a8470 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa310151010 con 0x7fa310070b80 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 0x7fa310147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 0x7fa310147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48276/0 (socket says 172.21.15.89:48276) 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 -- 172.21.15.89:0/1635642708 learned_addr learned my addr 172.21.15.89:0/1635642708 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa314a9d640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa310070b80 0x7fa310150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa307fff640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3100a8470 0x7fa31014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 -- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa310070b80 msgr2=0x7fa310150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa310070b80 0x7fa310150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 -- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3100a8470 msgr2=0x7fa31014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3100a8470 0x7fa31014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 -- 172.21.15.89:0/1635642708 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308009a70 con 0x7fa31014e9d0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa307fff640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3100a8470 0x7fa31014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa31529e640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 0x7fa310147ba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa308009d90 tx=0x7fa308019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080b9860 con 0x7fa31014e9d0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3080b99c0 con 0x7fa31014e9d0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080b9d70 con 0x7fa31014e9d0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3101eb500 con 0x7fa31014e9d0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa310150d30 con 0x7fa31014e9d0 2023-12-07T10:00:34.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310142640 con 0x7fa31014e9d0 2023-12-07T10:00:34.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.033+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3080ad440 con 0x7fa31014e9d0 2023-12-07T10:00:34.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.037+0000 7fa3057fa640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2fc0668d0 0x7fa2fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.037+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa30811f900 con 0x7fa31014e9d0 2023-12-07T10:00:34.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.037+0000 7fa314a9d640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2fc0668d0 0x7fa2fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.037+0000 7fa314a9d640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2fc0668d0 0x7fa2fc068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0011f0 tx=0x7fa30c007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:34.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.041+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa310142640 con 0x7fa31014e9d0 2023-12-07T10:00:34.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.221+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa310142640 con 0x7fa31014e9d0 2023-12-07T10:00:34.225 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T10:00:34.221+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T10:00:34.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa3057fa640 1 -- 172.21.15.89:0/1635642708 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa310142640 con 0x7fa31014e9d0 2023-12-07T10:00:34.228 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T10:00:34.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2fc0668d0 msgr2=0x7fa2fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2fc0668d0 0x7fa2fc068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0011f0 tx=0x7fa30c007d40 comp rx=0 tx=0).stop 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 msgr2=0x7fa310147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 0x7fa310147ba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa308009d90 tx=0x7fa308019660 comp rx=0 tx=0).stop 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 shutdown_connections 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31014e9d0 0x7fa310147ba0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3100a8470 0x7fa31014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2fc0668d0 0x7fa2fc068d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 --2- 172.21.15.89:0/1635642708 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa310070b80 0x7fa310150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 >> 172.21.15.89:0/1635642708 conn(0x7fa3100c2ad0 msgr2=0x7fa3100c06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 shutdown_connections 2023-12-07T10:00:34.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.225+0000 7fa316d01640 1 -- 172.21.15.89:0/1635642708 wait complete. 2023-12-07T10:00:34.239 INFO:tasks.ceph.mds.d.smithi097.stderr: -2760> 2023-12-07T10:00:01.968+0000 7fb410ef2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:00:34.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-07T10:00:34.288 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2023-12-07T10:00:34.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ceeff8640 1 Processor -- start 2023-12-07T10:00:34.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ceeff8640 1 -- start start 2023-12-07T10:00:34.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ceeff8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ce80c1140 0x7f0ce806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ceeff8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce80c1590 con 0x7f0ce806f0d0 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ceeff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce8073710 con 0x7f0ce806b810 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ceeff8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce81589f0 con 0x7f0ce80c1140 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ced595640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ce80c1140 0x7f0ce806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ced595640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ce80c1140 0x7f0ce806e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48282/0 (socket says 172.21.15.89:48282) 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ced595640 1 -- 172.21.15.89:0/422681710 learned_addr learned my addr 172.21.15.89:0/422681710 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0cdffff640 1 --1- 172.21.15.89:0/422681710 >> v1:172.21.15.89:6789/0 conn(0x7f0ce806f0d0 0x7f0ce80c2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51736/0 (socket says 172.21.15.89:51736) 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ced595640 1 -- 172.21.15.89:0/422681710 >> v1:172.21.15.97:6789/0 conn(0x7f0ce806b810 legacy=0x7f0ce80bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ced595640 1 -- 172.21.15.89:0/422681710 >> v1:172.21.15.89:6789/0 conn(0x7f0ce806f0d0 legacy=0x7f0ce80c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0ced595640 1 -- 172.21.15.89:0/422681710 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80a6010 con 0x7f0ce80c1140 2023-12-07T10:00:34.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.389+0000 7f0cdf7fe640 1 -- 172.21.15.89:0/422681710 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315193286 0 0) 0x7f0ce80c1590 con 0x7f0ce806f0d0 2023-12-07T10:00:34.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ced595640 1 --2- 172.21.15.89:0/422681710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce806e550 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009e50 tx=0x7f0ce001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cd70cfee1f7154 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:34.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0cdf7fe640 1 -- 172.21.15.89:0/422681710 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a5690 con 0x7f0ce80c1140 2023-12-07T10:00:34.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0cdf7fe640 1 -- 172.21.15.89:0/422681710 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00a57f0 con 0x7f0ce80c1140 2023-12-07T10:00:34.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0cdf7fe640 1 -- 172.21.15.89:0/422681710 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a5b80 con 0x7f0ce80c1140 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 -- 172.21.15.89:0/422681710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 msgr2=0x7f0ce806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/422681710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce806e550 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009e50 tx=0x7f0ce001c9d0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 -- 172.21.15.89:0/422681710 shutdown_connections 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/422681710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce806e550 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 -- 172.21.15.89:0/422681710 >> 172.21.15.89:0/422681710 conn(0x7f0ce80c3240 msgr2=0x7f0ce80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 -- 172.21.15.89:0/422681710 shutdown_connections 2023-12-07T10:00:34.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.393+0000 7f0ceeff8640 1 -- 172.21.15.89:0/422681710 wait complete. 2023-12-07T10:00:34.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 Processor -- start 2023-12-07T10:00:34.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- start start 2023-12-07T10:00:34.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ce806b810 0x7f0ce814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ce806f0d0 0x7f0ce8146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce81473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8156c50 con 0x7f0ce80c1140 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80ab960 con 0x7f0ce806f0d0 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81f0ee0 con 0x7f0ce806b810 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce81473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce81473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48292/0 (socket says 172.21.15.89:48292) 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 -- 172.21.15.89:0/2345101725 learned_addr learned my addr 172.21.15.89:0/2345101725 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cdffff640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ce806f0d0 0x7f0ce8146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cecd94640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ce806b810 0x7f0ce814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 -- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ce806b810 msgr2=0x7f0ce814c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ce806b810 0x7f0ce814c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 -- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ce806f0d0 msgr2=0x7f0ce8146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ce806f0d0 0x7f0ce8146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 -- 172.21.15.89:0/2345101725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009b30 con 0x7f0ce80c1140 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cdffff640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ce806f0d0 0x7f0ce8146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cecd94640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ce806b810 0x7f0ce814c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ced595640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce81473f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00af040 tx=0x7f0ce0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b8670 con 0x7f0ce80c1140 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00b87d0 con 0x7f0ce80c1140 2023-12-07T10:00:34.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b8b40 con 0x7f0ce80c1140 2023-12-07T10:00:34.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce81f11c0 con 0x7f0ce80c1140 2023-12-07T10:00:34.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce814cb00 con 0x7f0ce80c1140 2023-12-07T10:00:34.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.397+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce804e890 con 0x7f0ce80c1140 2023-12-07T10:00:34.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.401+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ce00b8ca0 con 0x7f0ce80c1140 2023-12-07T10:00:34.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.401+0000 7f0cdd7fa640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0cd40668d0 0x7f0cd4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:34.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.401+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f0ce011fe60 con 0x7f0ce80c1140 2023-12-07T10:00:34.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.401+0000 7f0cecd94640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0cd40668d0 0x7f0cd4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:34.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.401+0000 7f0cecd94640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0cd40668d0 0x7f0cd4068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400a850 tx=0x7f0ce4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:34.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.405+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ce00ece00 con 0x7f0ce80c1140 2023-12-07T10:00:34.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:34.585+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0ce8151330 con 0x7f0ce80c1140 2023-12-07T10:00:35.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.269+0000 7f0cdd7fa640 1 -- 172.21.15.89:0/2345101725 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ce00f0420 con 0x7f0ce80c1140 2023-12-07T10:00:35.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0cd40668d0 msgr2=0x7f0cd4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:35.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0cd40668d0 0x7f0cd4068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400a850 tx=0x7f0ce4008040 comp rx=0 tx=0).stop 2023-12-07T10:00:35.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 msgr2=0x7f0ce81473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce81473f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00af040 tx=0x7f0ce0019770 comp rx=0 tx=0).stop 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 shutdown_connections 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ce80c1140 0x7f0ce81473f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ce806f0d0 0x7f0ce8146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0cd40668d0 0x7f0cd4068d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 --2- 172.21.15.89:0/2345101725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ce806b810 0x7f0ce814c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 >> 172.21.15.89:0/2345101725 conn(0x7f0ce80c3240 msgr2=0x7f0ce80c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 shutdown_connections 2023-12-07T10:00:35.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.273+0000 7f0ceeff8640 1 -- 172.21.15.89:0/2345101725 wait complete. 2023-12-07T10:00:35.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-07T10:00:35.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 Processor -- start 2023-12-07T10:00:35.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 -- start start 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad240c4bd0 0x7fad240c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad2415f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad241557b0 con 0x7fad24151d80 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad24154ba0 con 0x7fad240c4bd0 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad298d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad24154e80 con 0x7fad240c8770 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad240c4bd0 0x7fad240c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad240c4bd0 0x7fad240c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48294/0 (socket says 172.21.15.89:48294) 2023-12-07T10:00:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 -- 172.21.15.89:0/1191847646 learned_addr learned my addr 172.21.15.89:0/1191847646 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad237fe640 1 --2- 172.21.15.89:0/1191847646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad2415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 -- 172.21.15.89:0/1191847646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 msgr2=0x7fad2415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 --2- 172.21.15.89:0/1191847646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad2415f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 -- 172.21.15.89:0/1191847646 >> v1:172.21.15.97:6789/0 conn(0x7fad24151d80 legacy=0x7fad240c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.433+0000 7fad1bfff640 1 -- 172.21.15.89:0/1191847646 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24155160 con 0x7fad240c4bd0 2023-12-07T10:00:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad1bfff640 1 --2- 172.21.15.89:0/1191847646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad240c8230 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009870 tx=0x7fad0c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d686a9176b7753d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:35.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad227fc640 1 -- 172.21.15.89:0/1191847646 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0ad640 con 0x7fad240c4bd0 2023-12-07T10:00:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad227fc640 1 -- 172.21.15.89:0/1191847646 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c0ad7a0 con 0x7fad240c4bd0 2023-12-07T10:00:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad227fc640 1 -- 172.21.15.89:0/1191847646 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0adb30 con 0x7fad240c4bd0 2023-12-07T10:00:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 -- 172.21.15.89:0/1191847646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 msgr2=0x7fad240c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:35.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 --2- 172.21.15.89:0/1191847646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad240c8230 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009870 tx=0x7fad0c01c480 comp rx=0 tx=0).stop 2023-12-07T10:00:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 -- 172.21.15.89:0/1191847646 shutdown_connections 2023-12-07T10:00:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 --2- 172.21.15.89:0/1191847646 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad2415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 --2- 172.21.15.89:0/1191847646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad240c8230 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 -- 172.21.15.89:0/1191847646 >> 172.21.15.89:0/1191847646 conn(0x7fad240abfa0 msgr2=0x7fad240ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 -- 172.21.15.89:0/1191847646 shutdown_connections 2023-12-07T10:00:35.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.437+0000 7fad298d6640 1 -- 172.21.15.89:0/1191847646 wait complete. 2023-12-07T10:00:35.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 Processor -- start 2023-12-07T10:00:35.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 -- start start 2023-12-07T10:00:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad2414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad241484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad24151d80 0x7fad24144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad241496e0 con 0x7fad240c4bd0 2023-12-07T10:00:35.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad241edff0 con 0x7fad24151d80 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad24143d90 con 0x7fad240c8770 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad2414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad2414a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48298/0 (socket says 172.21.15.89:48298) 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 -- 172.21.15.89:0/2259176985 learned_addr learned my addr 172.21.15.89:0/2259176985 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad1bfff640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad241484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad237fe640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad24151d80 0x7fad24144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 -- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 msgr2=0x7fad241484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad241484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 -- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad24151d80 msgr2=0x7fad24144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad24151d80 0x7fad24144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 -- 172.21.15.89:0/2259176985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0094d0 con 0x7fad240c4bd0 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad22ffd640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad2414a4e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c3f0 tx=0x7fad1400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad140052d0 con 0x7fad240c4bd0 2023-12-07T10:00:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14005430 con 0x7fad240c4bd0 2023-12-07T10:00:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24144da0 con 0x7fad240c4bd0 2023-12-07T10:00:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14003840 con 0x7fad240c4bd0 2023-12-07T10:00:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.441+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24143a20 con 0x7fad240c4bd0 2023-12-07T10:00:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.445+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad24143be0 con 0x7fad240c4bd0 2023-12-07T10:00:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.445+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad140039a0 con 0x7fad240c4bd0 2023-12-07T10:00:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.445+0000 7fad20ff9640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad040668d0 0x7fad04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.445+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fad14083d50 con 0x7fad240c4bd0 2023-12-07T10:00:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.445+0000 7fad1bfff640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad040668d0 0x7fad04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.445+0000 7fad1bfff640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad040668d0 0x7fad04068d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0af000 tx=0x7fad0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:35.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.449+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad14050bf0 con 0x7fad240c4bd0 2023-12-07T10:00:35.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:35.597+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad2404e890 con 0x7fad240c4bd0 2023-12-07T10:00:36.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.277+0000 7fad20ff9640 1 -- 172.21.15.89:0/2259176985 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad14054210 con 0x7fad240c4bd0 2023-12-07T10:00:36.281 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2023-12-07T10:00:36.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.277+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad040668d0 msgr2=0x7fad04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.277+0000 7fad298d6640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad040668d0 0x7fad04068d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0af000 tx=0x7fad0c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:36.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.277+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 msgr2=0x7fad2414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.277+0000 7fad298d6640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad2414a4e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad1400c3f0 tx=0x7fad1400c8b0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 shutdown_connections 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad24151d80 0x7fad24144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad040668d0 0x7fad04068d90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad240c8770 0x7fad241484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 --2- 172.21.15.89:0/2259176985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240c4bd0 0x7fad2414a4e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 >> 172.21.15.89:0/2259176985 conn(0x7fad240abfa0 msgr2=0x7fad240c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 shutdown_connections 2023-12-07T10:00:36.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.281+0000 7fad298d6640 1 -- 172.21.15.89:0/2259176985 wait complete. 2023-12-07T10:00:36.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-07T10:00:36.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.445+0000 7f4c19b80640 1 Processor -- start 2023-12-07T10:00:36.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.445+0000 7f4c19b80640 1 -- start start 2023-12-07T10:00:36.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c19b80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c1406b0c0 0x7f4c14155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c19b80640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c141559d0 con 0x7f4c14154ea0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c19b80640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1406d910 con 0x7f4c14070260 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c19b80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c141557c0 con 0x7f4c1406b0c0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4c14154ea0 0x7f4c1414e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51744/0 (socket says 172.21.15.89:51744) 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 -- 172.21.15.89:0/3417198357 learned_addr learned my addr 172.21.15.89:0/3417198357 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c12ffd640 1 --2- 172.21.15.89:0/3417198357 >> v2:172.21.15.97:3300/0 conn(0x7f4c1406b0c0 0x7f4c14155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968987500 0 0) 0x7f4c141559d0 con 0x7f4c14154ea0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bfc003530 con 0x7f4c14154ea0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299626282 0 0) 0x7f4bfc003530 con 0x7f4c14154ea0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 >> v2:172.21.15.97:3300/0 conn(0x7f4c1406b0c0 msgr2=0x7f4c14155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 --2- 172.21.15.89:0/3417198357 >> v2:172.21.15.97:3300/0 conn(0x7f4c1406b0c0 0x7f4c14155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 >> v1:172.21.15.97:6789/0 conn(0x7f4c14070260 legacy=0x7f4c140706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140c1230 con 0x7f4c14154ea0 2023-12-07T10:00:36.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f4c04001680 con 0x7f4c14154ea0 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 >> v1:172.21.15.89:6789/0 conn(0x7f4c14154ea0 legacy=0x7f4c1414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc003980 0x7f4bfc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc0047d0 0x7f4bfc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bfc005190 0x7f4bfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141557c0 con 0x7f4bfc003980 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc00c130 con 0x7f4bfc005190 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc00c2f0 con 0x7f4bfc0047d0 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc003980 0x7f4bfc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c12ffd640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc0047d0 0x7f4bfc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c13fff640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bfc005190 0x7f4bfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 -- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc0047d0 msgr2=0x7f4bfc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc0047d0 0x7f4bfc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 -- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bfc005190 msgr2=0x7f4bfc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bfc005190 0x7f4bfc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c137fe640 1 -- 172.21.15.89:0/3417198357 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc003530 con 0x7f4bfc003980 2023-12-07T10:00:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c13fff640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bfc005190 0x7f4bfc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.449+0000 7f4c13fff640 1 -- 172.21.15.89:0/3417198357 reap_dead start 2023-12-07T10:00:36.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc003980 0x7f4bfc003da0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c240 tx=0x7f4c0401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bafb2184901597 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04005ae0 con 0x7f4bfc003980 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04005c40 con 0x7f4bfc003980 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c127fc640 1 -- 172.21.15.89:0/3417198357 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040a59b0 con 0x7f4bfc003980 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 -- 172.21.15.89:0/3417198357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc003980 msgr2=0x7f4bfc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc003980 0x7f4bfc003da0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c240 tx=0x7f4c0401cc10 comp rx=0 tx=0).stop 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 -- 172.21.15.89:0/3417198357 shutdown_connections 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3417198357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc003980 0x7f4bfc003da0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 -- 172.21.15.89:0/3417198357 >> 172.21.15.89:0/3417198357 conn(0x7f4c1406a5a0 msgr2=0x7f4c1406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 -- 172.21.15.89:0/3417198357 shutdown_connections 2023-12-07T10:00:36.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 -- 172.21.15.89:0/3417198357 wait complete. 2023-12-07T10:00:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.453+0000 7f4c19b80640 1 Processor -- start 2023-12-07T10:00:36.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- start start 2023-12-07T10:00:36.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc003980 0x7f4c140ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c1414b080 0x7f4c14148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 0x7f4c141f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14149f60 con 0x7f4c141492d0 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141e4610 con 0x7f4c1414b080 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141e4e10 con 0x7f4bfc003980 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 0x7f4c141f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 0x7f4c141f06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48312/0 (socket says 172.21.15.89:48312) 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 -- 172.21.15.89:0/3758078957 learned_addr learned my addr 172.21.15.89:0/3758078957 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc003980 0x7f4c140ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c12ffd640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c1414b080 0x7f4c14148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 -- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc003980 msgr2=0x7f4c140ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc003980 0x7f4c140ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 -- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c1414b080 msgr2=0x7f4c14148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c1414b080 0x7f4c14148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 -- 172.21.15.89:0/3758078957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14144f20 con 0x7f4c141492d0 2023-12-07T10:00:36.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c13fff640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 0x7f4c141f06e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4c1406bfb0 tx=0x7f4c0c00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c003b90 con 0x7f4c141492d0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c003cf0 con 0x7f4c141492d0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1414a170 con 0x7f4c141492d0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0052f0 con 0x7f4c141492d0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c140ab820 con 0x7f4c141492d0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.457+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c141e4b30 con 0x7f4c141492d0 2023-12-07T10:00:36.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.461+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c0c005450 con 0x7f4c141492d0 2023-12-07T10:00:36.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.461+0000 7f4bfbfff640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4c000668d0 0x7f4c00068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:36.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.461+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f4c0c083da0 con 0x7f4c141492d0 2023-12-07T10:00:36.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.461+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4c000668d0 0x7f4c00068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:36.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.461+0000 7f4c137fe640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4c000668d0 0x7f4c00068d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c040ab000 tx=0x7f4c040b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:36.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.465+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c141e4b30 con 0x7f4c141492d0 2023-12-07T10:00:36.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:36.625+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c14144960 con 0x7f4c141492d0 2023-12-07T10:00:37.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.285+0000 7f4bfbfff640 1 -- 172.21.15.89:0/3758078957 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4c14144960 con 0x7f4c141492d0 2023-12-07T10:00:37.289 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2023-12-07T10:00:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.285+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4c000668d0 msgr2=0x7f4c00068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.285+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4c000668d0 0x7f4c00068d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c040ab000 tx=0x7f4c040b1040 comp rx=0 tx=0).stop 2023-12-07T10:00:37.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.285+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 msgr2=0x7f4c141f06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.285+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 0x7f4c141f06e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4c1406bfb0 tx=0x7f4c0c00ead0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 shutdown_connections 2023-12-07T10:00:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c141492d0 0x7f4c141f06e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c1414b080 0x7f4c14148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4c000668d0 0x7f4c00068d90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 --2- 172.21.15.89:0/3758078957 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bfc003980 0x7f4c140ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 >> 172.21.15.89:0/3758078957 conn(0x7f4c1406a5a0 msgr2=0x7f4c1414c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:37.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 shutdown_connections 2023-12-07T10:00:37.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.289+0000 7f4c19b80640 1 -- 172.21.15.89:0/3758078957 wait complete. 2023-12-07T10:00:37.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:37.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 Processor -- start 2023-12-07T10:00:37.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 -- start start 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680ca620 0x7f18680caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f18680bd5a0 0x7f18680c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186806b7d0 con 0x7f18680c4890 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1868155160 con 0x7f18680bd5a0 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186e6bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186806b180 con 0x7f18680ca620 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186ceb8640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f18680c4890 0x7f18680c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51748/0 (socket says 172.21.15.89:51748) 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186ceb8640 1 -- 172.21.15.89:0/157188354 learned_addr learned my addr 172.21.15.89:0/157188354 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186d6b9640 1 --2- 172.21.15.89:0/157188354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680ca620 0x7f18680caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186deba640 1 --2- 172.21.15.89:0/157188354 >> v2:172.21.15.97:3300/0 conn(0x7f18680bd5a0 0x7f18680c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186d6b9640 1 -- 172.21.15.89:0/157188354 >> v2:172.21.15.97:3300/0 conn(0x7f18680bd5a0 msgr2=0x7f18680c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:37.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186d6b9640 1 --2- 172.21.15.89:0/157188354 >> v2:172.21.15.97:3300/0 conn(0x7f18680bd5a0 0x7f18680c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f185ffff640 1 -- 172.21.15.89:0/157188354 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781997366 0 0) 0x7f186806b7d0 con 0x7f18680c4890 2023-12-07T10:00:37.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186d6b9640 1 -- 172.21.15.89:0/157188354 >> v1:172.21.15.89:6789/0 conn(0x7f18680c4890 legacy=0x7f18680c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.453+0000 7f186d6b9640 1 -- 172.21.15.89:0/157188354 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186806b460 con 0x7f18680ca620 2023-12-07T10:00:37.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186d6b9640 1 --2- 172.21.15.89:0/157188354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680ca620 0x7f18680caa00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18640097c0 tx=0x7f186401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dee857fb545848b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:37.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f185ffff640 1 -- 172.21.15.89:0/157188354 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640ab600 con 0x7f18680ca620 2023-12-07T10:00:37.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f185ffff640 1 -- 172.21.15.89:0/157188354 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18640a7050 con 0x7f18680ca620 2023-12-07T10:00:37.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f185ffff640 1 -- 172.21.15.89:0/157188354 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640ab980 con 0x7f18680ca620 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 -- 172.21.15.89:0/157188354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680ca620 msgr2=0x7f18680caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 --2- 172.21.15.89:0/157188354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680ca620 0x7f18680caa00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18640097c0 tx=0x7f186401c3f0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 -- 172.21.15.89:0/157188354 shutdown_connections 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 --2- 172.21.15.89:0/157188354 >> v2:172.21.15.97:3300/0 conn(0x7f18680bd5a0 0x7f18680c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 --2- 172.21.15.89:0/157188354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680ca620 0x7f18680caa00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 -- 172.21.15.89:0/157188354 >> 172.21.15.89:0/157188354 conn(0x7f18680ac0a0 msgr2=0x7f18680c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 -- 172.21.15.89:0/157188354 shutdown_connections 2023-12-07T10:00:37.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.457+0000 7f186e6bb640 1 -- 172.21.15.89:0/157188354 wait complete. 2023-12-07T10:00:37.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 Processor -- start 2023-12-07T10:00:37.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 -- start start 2023-12-07T10:00:37.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 0x7f18681515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680c4890 0x7f18680be160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18680ca620 0x7f18680acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c04a0 con 0x7f18680bd5a0 2023-12-07T10:00:37.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680ae900 con 0x7f18680ca620 2023-12-07T10:00:37.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680aebe0 con 0x7f18680c4890 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 0x7f18681515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 0x7f18681515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48320/0 (socket says 172.21.15.89:48320) 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 -- 172.21.15.89:0/2916854666 learned_addr learned my addr 172.21.15.89:0/2916854666 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186ceb8640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680c4890 0x7f18680be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186deba640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18680ca620 0x7f18680acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 -- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680c4890 msgr2=0x7f18680be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680c4890 0x7f18680be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 -- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18680ca620 msgr2=0x7f18680acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18680ca620 0x7f18680acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 -- 172.21.15.89:0/2916854666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009420 con 0x7f18680bd5a0 2023-12-07T10:00:37.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186d6b9640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 0x7f18681515b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f186401cc90 tx=0x7f1864019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640b4400 con 0x7f18680bd5a0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18640b45a0 con 0x7f18680bd5a0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640b4950 con 0x7f18680bd5a0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18681f0b80 con 0x7f18680bd5a0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.461+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18681f1140 con 0x7f18680bd5a0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.465+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18681f1330 con 0x7f18680bd5a0 2023-12-07T10:00:37.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.465+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f18640b2040 con 0x7f18680bd5a0 2023-12-07T10:00:37.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.465+0000 7f185dffb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f184c0668d0 0x7f184c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.465+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f186411e480 con 0x7f18680bd5a0 2023-12-07T10:00:37.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.465+0000 7f186ceb8640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f184c0668d0 0x7f184c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.465+0000 7f186ceb8640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f184c0668d0 0x7f184c068d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f18681539b0 tx=0x7f1858007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:37.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.469+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18640eb650 con 0x7f18680bd5a0 2023-12-07T10:00:37.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.621+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f186804e890 con 0x7f18680bd5a0 2023-12-07T10:00:37.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.621+0000 7f185dffb640 1 -- 172.21.15.89:0/2916854666 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f18640eec70 con 0x7f18680bd5a0 2023-12-07T10:00:37.627 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:37.627 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:37.279589+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/2626061332":"2023-12-08T10:00:34.223257+0000","172.21.15.97:6833/2626061332":"2023-12-08T10:00:34.223257+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f184c0668d0 msgr2=0x7f184c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f184c0668d0 0x7f184c068d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f18681539b0 tx=0x7f1858007df0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 msgr2=0x7f18681515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 0x7f18681515b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f186401cc90 tx=0x7f1864019190 comp rx=0 tx=0).stop 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 shutdown_connections 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18680ca620 0x7f18680acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f184c0668d0 0x7f184c068d90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18680c4890 0x7f18680be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 --2- 172.21.15.89:0/2916854666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18680bd5a0 0x7f18681515b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 >> 172.21.15.89:0/2916854666 conn(0x7f18680ac0a0 msgr2=0x7f1868154570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 shutdown_connections 2023-12-07T10:00:37.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.625+0000 7f186e6bb640 1 -- 172.21.15.89:0/2916854666 wait complete. 2023-12-07T10:00:37.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:00:12.010823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:00:12.808546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:37.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:37.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 Processor -- start 2023-12-07T10:00:37.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 -- start start 2023-12-07T10:00:37.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f89e414eaf0 0x7f89e4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89e4151f90 0x7f89e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e406de00 con 0x7f89e40c0370 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e4070390 con 0x7f89e4151f90 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89eaefe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e414eed0 con 0x7f89e414eaf0 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89e4151f90 0x7f89e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89e4151f90 0x7f89e406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48334/0 (socket says 172.21.15.89:48334) 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 -- 172.21.15.89:0/2715962052 learned_addr learned my addr 172.21.15.89:0/2715962052 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e8c9a640 1 --2- 172.21.15.89:0/2715962052 >> v2:172.21.15.97:3300/0 conn(0x7f89e414eaf0 0x7f89e4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 -- 172.21.15.89:0/2715962052 >> v2:172.21.15.97:3300/0 conn(0x7f89e414eaf0 msgr2=0x7f89e4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:37.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 --2- 172.21.15.89:0/2715962052 >> v2:172.21.15.97:3300/0 conn(0x7f89e414eaf0 0x7f89e4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 -- 172.21.15.89:0/2715962052 >> v1:172.21.15.97:6789/0 conn(0x7f89e40c0370 legacy=0x7f89e406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.797+0000 7f89e3fff640 1 -- 172.21.15.89:0/2715962052 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4151270 con 0x7f89e4151f90 2023-12-07T10:00:37.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89e3fff640 1 --2- 172.21.15.89:0/2715962052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4151f90 0x7f89e406d110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c3b00 tx=0x7f89d001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2fc485815fd0bd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:37.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89e37fe640 1 -- 172.21.15.89:0/2715962052 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00a7a50 con 0x7f89e4151f90 2023-12-07T10:00:37.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89e37fe640 1 -- 172.21.15.89:0/2715962052 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d00a7bb0 con 0x7f89e4151f90 2023-12-07T10:00:37.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89e37fe640 1 -- 172.21.15.89:0/2715962052 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00af440 con 0x7f89e4151f90 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 -- 172.21.15.89:0/2715962052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4151f90 msgr2=0x7f89e406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2715962052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4151f90 0x7f89e406d110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c3b00 tx=0x7f89d001ea80 comp rx=0 tx=0).stop 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 -- 172.21.15.89:0/2715962052 shutdown_connections 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2715962052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4151f90 0x7f89e406d110 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2715962052 >> v2:172.21.15.97:3300/0 conn(0x7f89e414eaf0 0x7f89e4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 -- 172.21.15.89:0/2715962052 >> 172.21.15.89:0/2715962052 conn(0x7f89e40c2a60 msgr2=0x7f89e40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 -- 172.21.15.89:0/2715962052 shutdown_connections 2023-12-07T10:00:37.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 -- 172.21.15.89:0/2715962052 wait complete. 2023-12-07T10:00:37.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 Processor -- start 2023-12-07T10:00:37.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.801+0000 7f89eaefe640 1 -- start start 2023-12-07T10:00:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89e40c0370 0x7f89e41452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89e414eaf0 0x7f89e4142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 0x7f89e41f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e41f07a0 con 0x7f89e4142850 2023-12-07T10:00:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40c51a0 con 0x7f89e414eaf0 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40c5480 con 0x7f89e40c0370 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 0x7f89e41f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 0x7f89e41f0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48340/0 (socket says 172.21.15.89:48340) 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 -- 172.21.15.89:0/2371096014 learned_addr learned my addr 172.21.15.89:0/2371096014 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e8c9a640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89e40c0370 0x7f89e41452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e3fff640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89e414eaf0 0x7f89e4142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 -- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89e40c0370 msgr2=0x7f89e41452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89e40c0370 0x7f89e41452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 -- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89e414eaf0 msgr2=0x7f89e4142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89e414eaf0 0x7f89e4142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 -- 172.21.15.89:0/2371096014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d000b770 con 0x7f89e4142850 2023-12-07T10:00:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e949b640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 0x7f89e41f0c30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c770 tx=0x7f89dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc003b80 con 0x7f89e4142850 2023-12-07T10:00:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc003ce0 con 0x7f89e4142850 2023-12-07T10:00:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e40c5760 con 0x7f89e4142850 2023-12-07T10:00:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00aa90 con 0x7f89e4142850 2023-12-07T10:00:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e40c5d20 con 0x7f89e4142850 2023-12-07T10:00:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.805+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e41f0910 con 0x7f89e4142850 2023-12-07T10:00:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.809+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89dc00abf0 con 0x7f89e4142850 2023-12-07T10:00:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.809+0000 7f89e17fa640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89c8066900 0x7f89c8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.809+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f89dc084140 con 0x7f89e4142850 2023-12-07T10:00:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.809+0000 7f89e8c9a640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89c8066900 0x7f89c8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.809+0000 7f89e8c9a640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89c8066900 0x7f89c8068dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009b60 tx=0x7f89d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:37.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.813+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89dc051460 con 0x7f89e4142850 2023-12-07T10:00:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.961+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89e404e890 con 0x7f89e4142850 2023-12-07T10:00:37.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.961+0000 7f89e17fa640 1 -- 172.21.15.89:0/2371096014 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89dc054a80 con 0x7f89e4142850 2023-12-07T10:00:37.968 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89c8066900 msgr2=0x7f89c8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89c8066900 0x7f89c8068dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009b60 tx=0x7f89d8009190 comp rx=0 tx=0).stop 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 msgr2=0x7f89e41f0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 0x7f89e41f0c30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c770 tx=0x7f89dc00cc30 comp rx=0 tx=0).stop 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 shutdown_connections 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4142850 0x7f89e41f0c30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89e414eaf0 0x7f89e4142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89c8066900 0x7f89c8068dc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 --2- 172.21.15.89:0/2371096014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89e40c0370 0x7f89e41452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 >> 172.21.15.89:0/2371096014 conn(0x7f89e40c2a60 msgr2=0x7f89e40bf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 shutdown_connections 2023-12-07T10:00:37.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:37.965+0000 7f89eaefe640 1 -- 172.21.15.89:0/2371096014 wait complete. 2023-12-07T10:00:37.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:00:38.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 Processor -- start 2023-12-07T10:00:38.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 -- start start 2023-12-07T10:00:38.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f342014eaf0 0x7f3420151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3420151f90 0x7f342006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34200c0370 0x7f342006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342006de00 con 0x7f342014eaf0 2023-12-07T10:00:38.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3420070390 con 0x7f3420151f90 2023-12-07T10:00:38.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3424b2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342006db90 con 0x7f34200c0370 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f341e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f342014eaf0 0x7f3420151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f341e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f342014eaf0 0x7f3420151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48348/0 (socket says 172.21.15.89:48348) 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f341e59c640 1 -- 172.21.15.89:0/1485272594 learned_addr learned my addr 172.21.15.89:0/1485272594 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f3415d9b640 1 --2- 172.21.15.89:0/1485272594 >> v2:172.21.15.97:3300/0 conn(0x7f3420151f90 0x7f342006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f341ed9d640 1 --2- 172.21.15.89:0/1485272594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34200c0370 0x7f342006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f341e59c640 1 -- 172.21.15.89:0/1485272594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34200c0370 msgr2=0x7f342006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.124+0000 7f341e59c640 1 --2- 172.21.15.89:0/1485272594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34200c0370 0x7f342006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341e59c640 1 -- 172.21.15.89:0/1485272594 >> v2:172.21.15.97:3300/0 conn(0x7f3420151f90 msgr2=0x7f342006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341e59c640 1 --2- 172.21.15.89:0/1485272594 >> v2:172.21.15.97:3300/0 conn(0x7f3420151f90 0x7f342006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341e59c640 1 -- 172.21.15.89:0/1485272594 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342014eed0 con 0x7f342014eaf0 2023-12-07T10:00:38.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341e59c640 1 --2- 172.21.15.89:0/1485272594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f342014eaf0 0x7f3420151a50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f342006e2d0 tx=0x7f341001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3be9184599057e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341dd9b640 1 -- 172.21.15.89:0/1485272594 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100ac600 con 0x7f342014eaf0 2023-12-07T10:00:38.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341dd9b640 1 -- 172.21.15.89:0/1485272594 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34100a8050 con 0x7f342014eaf0 2023-12-07T10:00:38.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f341dd9b640 1 -- 172.21.15.89:0/1485272594 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100ac980 con 0x7f342014eaf0 2023-12-07T10:00:38.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f3424b2a640 1 -- 172.21.15.89:0/1485272594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f342014eaf0 msgr2=0x7f3420151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.128+0000 7f3424b2a640 1 --2- 172.21.15.89:0/1485272594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f342014eaf0 0x7f3420151a50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f342006e2d0 tx=0x7f341001c3e0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- 172.21.15.89:0/1485272594 shutdown_connections 2023-12-07T10:00:38.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 --2- 172.21.15.89:0/1485272594 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34200c0370 0x7f342006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 --2- 172.21.15.89:0/1485272594 >> v2:172.21.15.97:3300/0 conn(0x7f3420151f90 0x7f342006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 --2- 172.21.15.89:0/1485272594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f342014eaf0 0x7f3420151a50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- 172.21.15.89:0/1485272594 >> 172.21.15.89:0/1485272594 conn(0x7f34200c2a60 msgr2=0x7f34200c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:38.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- 172.21.15.89:0/1485272594 shutdown_connections 2023-12-07T10:00:38.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- 172.21.15.89:0/1485272594 wait complete. 2023-12-07T10:00:38.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 Processor -- start 2023-12-07T10:00:38.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- start start 2023-12-07T10:00:38.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 0x7f3420152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f342014eaf0 0x7f34200ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f342014b8f0 0x7f34200ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420142db0 con 0x7f34200c0370 2023-12-07T10:00:38.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34200abe60 con 0x7f342014eaf0 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3424b2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34201ec650 con 0x7f342014b8f0 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 0x7f3420152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 0x7f3420152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48364/0 (socket says 172.21.15.89:48364) 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 -- 172.21.15.89:0/3586312323 learned_addr learned my addr 172.21.15.89:0/3586312323 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f3415d9b640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f342014eaf0 0x7f34200ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341ed9d640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f342014b8f0 0x7f34200ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 -- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f342014b8f0 msgr2=0x7f34200ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f342014b8f0 0x7f34200ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 -- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f342014eaf0 msgr2=0x7f34200ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f342014eaf0 0x7f34200ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 -- 172.21.15.89:0/3586312323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34100094d0 con 0x7f34200c0370 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.132+0000 7f341e59c640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 0x7f3420152f90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f341001aa90 tx=0x7f341001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100b7620 con 0x7f34200c0370 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34100b7780 con 0x7f34200c0370 2023-12-07T10:00:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100b7af0 con 0x7f34200c0370 2023-12-07T10:00:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34201ec8f0 con 0x7f34200c0370 2023-12-07T10:00:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34201eceb0 con 0x7f34200c0370 2023-12-07T10:00:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342004e890 con 0x7f34200c0370 2023-12-07T10:00:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f34100b3040 con 0x7f34200c0370 2023-12-07T10:00:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f34177fe640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f340006ace0 0x7f340006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f341011e9b0 con 0x7f34200c0370 2023-12-07T10:00:38.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f3415d9b640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f340006ace0 0x7f340006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.136+0000 7f3415d9b640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f340006ace0 0x7f340006d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f34201e6d80 tx=0x7f340800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.140+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34100ebc30 con 0x7f34200c0370 2023-12-07T10:00:38.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3420070850 con 0x7f34200c0370 2023-12-07T10:00:38.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f34177fe640 1 -- 172.21.15.89:0/3586312323 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f34100ef250 con 0x7f34200c0370 2023-12-07T10:00:38.364 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f340006ace0 msgr2=0x7f340006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f340006ace0 0x7f340006d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f34201e6d80 tx=0x7f340800b040 comp rx=0 tx=0).stop 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 msgr2=0x7f3420152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 0x7f3420152f90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f341001aa90 tx=0x7f341001ac20 comp rx=0 tx=0).stop 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 shutdown_connections 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f340006ace0 0x7f340006d1a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f342014b8f0 0x7f34200ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f342014eaf0 0x7f34200ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 --2- 172.21.15.89:0/3586312323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34200c0370 0x7f3420152f90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 >> 172.21.15.89:0/3586312323 conn(0x7f34200c2a60 msgr2=0x7f342014f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 shutdown_connections 2023-12-07T10:00:38.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.292+0000 7f3424b2a640 1 -- 172.21.15.89:0/3586312323 wait complete. 2023-12-07T10:00:38.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:00:38.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.504+0000 7ff7deb2a640 1 Processor -- start 2023-12-07T10:00:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.504+0000 7ff7deb2a640 1 -- start start 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.504+0000 7ff7deb2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7d80c8430 0x7ff7d806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.504+0000 7ff7deb2a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d806cf70 con 0x7ff7d80c7f20 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7deb2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d8152160 con 0x7ff7d8151d80 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7deb2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80c6a30 con 0x7ff7d80c8430 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7dd0c7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff7d80c7f20 0x7ff7d806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51760/0 (socket says 172.21.15.89:51760) 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7dd0c7640 1 -- 172.21.15.89:0/1584807480 learned_addr learned my addr 172.21.15.89:0/1584807480 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cffff640 1 --2- 172.21.15.89:0/1584807480 >> v2:172.21.15.97:3300/0 conn(0x7ff7d80c8430 0x7ff7d806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cf7fe640 1 -- 172.21.15.89:0/1584807480 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865950974 0 0) 0x7ff7d806cf70 con 0x7ff7d80c7f20 2023-12-07T10:00:38.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cf7fe640 1 -- 172.21.15.89:0/1584807480 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c0003530 con 0x7ff7d80c7f20 2023-12-07T10:00:38.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cffff640 1 -- 172.21.15.89:0/1584807480 >> v1:172.21.15.97:6789/0 conn(0x7ff7d8151d80 legacy=0x7ff7d80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cffff640 1 -- 172.21.15.89:0/1584807480 >> v1:172.21.15.89:6789/0 conn(0x7ff7d80c7f20 legacy=0x7ff7d806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cffff640 1 -- 172.21.15.89:0/1584807480 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80c72d0 con 0x7ff7d80c8430 2023-12-07T10:00:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cffff640 1 --2- 172.21.15.89:0/1584807480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d806b720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80097c0 tx=0x7ff7c801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a155cbe78a271a19 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cf7fe640 1 -- 172.21.15.89:0/1584807480 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c80ac620 con 0x7ff7d80c8430 2023-12-07T10:00:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cf7fe640 1 -- 172.21.15.89:0/1584807480 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c80ac780 con 0x7ff7d80c8430 2023-12-07T10:00:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.508+0000 7ff7cf7fe640 1 -- 172.21.15.89:0/1584807480 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c80acb10 con 0x7ff7d80c8430 2023-12-07T10:00:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- 172.21.15.89:0/1584807480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 msgr2=0x7ff7d806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/1584807480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d806b720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80097c0 tx=0x7ff7c801c3c0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- 172.21.15.89:0/1584807480 shutdown_connections 2023-12-07T10:00:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/1584807480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d806b720 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- 172.21.15.89:0/1584807480 >> 172.21.15.89:0/1584807480 conn(0x7ff7d80abd00 msgr2=0x7ff7d80ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- 172.21.15.89:0/1584807480 shutdown_connections 2023-12-07T10:00:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- 172.21.15.89:0/1584807480 wait complete. 2023-12-07T10:00:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 Processor -- start 2023-12-07T10:00:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- start start 2023-12-07T10:00:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 0x7ff7d814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7d8151d80 0x7ff7d814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81ec850 con 0x7ff7d80c7f20 2023-12-07T10:00:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81ecb30 con 0x7ff7d80c8430 2023-12-07T10:00:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7deb2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81ece10 con 0x7ff7d8151d80 2023-12-07T10:00:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 0x7ff7d814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 0x7ff7d814cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48370/0 (socket says 172.21.15.89:48370) 2023-12-07T10:00:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 -- 172.21.15.89:0/2739507767 learned_addr learned my addr 172.21.15.89:0/2739507767 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7cffff640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dd0c7640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7d8151d80 0x7ff7d814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 -- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7d8151d80 msgr2=0x7ff7d814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7d8151d80 0x7ff7d814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 -- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 msgr2=0x7ff7d814b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d814b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dc8c6640 1 -- 172.21.15.89:0/2739507767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8009420 con 0x7ff7d80c7f20 2023-12-07T10:00:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7cffff640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d814b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.512+0000 7ff7dd0c7640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7d8151d80 0x7ff7d814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7dc8c6640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 0x7ff7d814cb60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c500 tx=0x7ff7d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4005220 con 0x7ff7d80c7f20 2023-12-07T10:00:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d4005380 con 0x7ff7d80c7f20 2023-12-07T10:00:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4007270 con 0x7ff7d80c7f20 2023-12-07T10:00:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d81ed0f0 con 0x7ff7d80c7f20 2023-12-07T10:00:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d81493a0 con 0x7ff7d80c7f20 2023-12-07T10:00:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d81ed610 con 0x7ff7d80c7f20 2023-12-07T10:00:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff7d40073d0 con 0x7ff7d80c7f20 2023-12-07T10:00:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cd7fa640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c40668d0 0x7ff7c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff7d4083ce0 con 0x7ff7d80c7f20 2023-12-07T10:00:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.516+0000 7ff7cffff640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c40668d0 0x7ff7c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.520+0000 7ff7cffff640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c40668d0 0x7ff7c4068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80ae000 tx=0x7ff7c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.520+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7d81ed610 con 0x7ff7d80c7f20 2023-12-07T10:00:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff7d8152160 con 0x7ff7d80c7f20 2023-12-07T10:00:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7cd7fa640 1 -- 172.21.15.89:0/2739507767 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff7d8152160 con 0x7ff7d80c7f20 2023-12-07T10:00:38.678 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:00:38.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c40668d0 msgr2=0x7ff7c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c40668d0 0x7ff7c4068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80ae000 tx=0x7ff7c8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 msgr2=0x7ff7d814cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 0x7ff7d814cb60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c500 tx=0x7ff7d400c9c0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 shutdown_connections 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c40668d0 0x7ff7c4068d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7d8151d80 0x7ff7d814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c8430 0x7ff7d814b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 --2- 172.21.15.89:0/2739507767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d80c7f20 0x7ff7d814cb60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 >> 172.21.15.89:0/2739507767 conn(0x7ff7d80abd00 msgr2=0x7ff7d80c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 shutdown_connections 2023-12-07T10:00:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.672+0000 7ff7deb2a640 1 -- 172.21.15.89:0/2739507767 wait complete. 2023-12-07T10:00:38.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:38.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 Processor -- start 2023-12-07T10:00:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 -- start start 2023-12-07T10:00:38.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53480c77c0 0x7f5348151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f53480c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480c5b40 con 0x7f534806c0a0 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534806cb90 con 0x7f53480c77c0 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f534d965640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348158880 con 0x7f5348152060 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53480c77c0 0x7f5348151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53480c77c0 0x7f5348151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48386/0 (socket says 172.21.15.89:48386) 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 -- 172.21.15.89:0/1782128633 learned_addr learned my addr 172.21.15.89:0/1782128633 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f53477fe640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f53480c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 -- 172.21.15.89:0/1782128633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 msgr2=0x7f53480c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f53480c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 -- 172.21.15.89:0/1782128633 >> v1:172.21.15.97:6789/0 conn(0x7f534806c0a0 legacy=0x7f534806c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f533e7fc640 1 -- 172.21.15.89:0/1782128633 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c5de0 con 0x7f53480c77c0 2023-12-07T10:00:38.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.832+0000 7f53477fe640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f53480c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f533e7fc640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f5348151b20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5330009e50 tx=0x7f533001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a89b2c2e24834b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f53467fc640 1 -- 172.21.15.89:0/1782128633 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480c7330 con 0x7f53480c77c0 2023-12-07T10:00:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f53467fc640 1 -- 172.21.15.89:0/1782128633 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300a5640 con 0x7f53480c77c0 2023-12-07T10:00:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f53467fc640 1 -- 172.21.15.89:0/1782128633 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300a59d0 con 0x7f53480c77c0 2023-12-07T10:00:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 -- 172.21.15.89:0/1782128633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 msgr2=0x7f5348151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f5348151b20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5330009e50 tx=0x7f533001c980 comp rx=0 tx=0).stop 2023-12-07T10:00:38.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 -- 172.21.15.89:0/1782128633 shutdown_connections 2023-12-07T10:00:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f53480c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 --2- 172.21.15.89:0/1782128633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f5348151b20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 -- 172.21.15.89:0/1782128633 >> 172.21.15.89:0/1782128633 conn(0x7f53480abcb0 msgr2=0x7f53480ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 -- 172.21.15.89:0/1782128633 shutdown_connections 2023-12-07T10:00:38.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.836+0000 7f534d965640 1 -- 172.21.15.89:0/1782128633 wait complete. 2023-12-07T10:00:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 Processor -- start 2023-12-07T10:00:38.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 -- start start 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534806c0a0 0x7f534814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f53481ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f5348150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534814fb20 con 0x7f53480c77c0 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53481ed9b0 con 0x7f534806c0a0 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534814eea0 con 0x7f5348152060 2023-12-07T10:00:38.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f53481ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f5346ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534806c0a0 0x7f534814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f53477fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f5348150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f53481ec990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48388/0 (socket says 172.21.15.89:48388) 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 -- 172.21.15.89:0/1281788520 learned_addr learned my addr 172.21.15.89:0/1281788520 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 -- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 msgr2=0x7f5348150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f5348150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 -- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534806c0a0 msgr2=0x7f534814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534806c0a0 0x7f534814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 -- 172.21.15.89:0/1281788520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330009b30 con 0x7f53480c77c0 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f5346ffd640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534806c0a0 0x7f534814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f53477fe640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f5348150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f533e7fc640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f53481ec990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f53300af040 tx=0x7f5330019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300b8670 con 0x7f53480c77c0 2023-12-07T10:00:38.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300b87f0 con 0x7f53480c77c0 2023-12-07T10:00:38.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534814f180 con 0x7f53480c77c0 2023-12-07T10:00:38.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300b8ba0 con 0x7f53480c77c0 2023-12-07T10:00:38.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.840+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534814f740 con 0x7f53480c77c0 2023-12-07T10:00:38.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.844+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534814fc60 con 0x7f53480c77c0 2023-12-07T10:00:38.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.844+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53300b8d00 con 0x7f53480c77c0 2023-12-07T10:00:38.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.844+0000 7f5344ff9640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53280668d0 0x7f5328068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:38.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.844+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f533011f7d0 con 0x7f53480c77c0 2023-12-07T10:00:38.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.844+0000 7f5346ffd640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53280668d0 0x7f5328068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:38.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.844+0000 7f5346ffd640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53280668d0 0x7f5328068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5338007fd0 tx=0x7f5338009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:38.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:38.848+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f534814fc60 con 0x7f53480c77c0 2023-12-07T10:00:39.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.028+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f534814fc60 con 0x7f53480c77c0 2023-12-07T10:00:39.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.028+0000 7f5344ff9640 1 -- 172.21.15.89:0/1281788520 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f534814fc60 con 0x7f53480c77c0 2023-12-07T10:00:39.035 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:39.035 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3802417913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3802417913},{"type":"v1","addr":"172.21.15.97:6835","nonce":3802417913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:39.035 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 24 2023-12-07T10:00:39.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53280668d0 msgr2=0x7f5328068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53280668d0 0x7f5328068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5338007fd0 tx=0x7f5338009040 comp rx=0 tx=0).stop 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 msgr2=0x7f53481ec990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f53481ec990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f53300af040 tx=0x7f5330019720 comp rx=0 tx=0).stop 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 shutdown_connections 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53280668d0 0x7f5328068d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5348152060 0x7f5348150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53480c77c0 0x7f53481ec990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 --2- 172.21.15.89:0/1281788520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534806c0a0 0x7f534814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 >> 172.21.15.89:0/1281788520 conn(0x7f53480abcb0 msgr2=0x7f53480ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 shutdown_connections 2023-12-07T10:00:39.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.032+0000 7f534d965640 1 -- 172.21.15.89:0/1281788520 wait complete. 2023-12-07T10:00:39.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:39.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 Processor -- start 2023-12-07T10:00:39.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 -- start start 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f174814ea60 0x7f1748155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f174806bd00 0x7f17480700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174806c440 con 0x7f17480bf400 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748154790 con 0x7f174814ea60 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174e3aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174806c6e0 con 0x7f174806bd00 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f1747fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f174814ea60 0x7f1748155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174c947640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f17480bf400 0x7f17480c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51770/0 (socket says 172.21.15.89:51770) 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f174c947640 1 -- 172.21.15.89:0/3253324384 learned_addr learned my addr 172.21.15.89:0/3253324384 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:39.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f17477fe640 1 --2- 172.21.15.89:0/3253324384 >> v2:172.21.15.97:3300/0 conn(0x7f174806bd00 0x7f17480700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f1747fff640 1 -- 172.21.15.89:0/3253324384 >> v2:172.21.15.97:3300/0 conn(0x7f174806bd00 msgr2=0x7f17480700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:39.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f1747fff640 1 --2- 172.21.15.89:0/3253324384 >> v2:172.21.15.97:3300/0 conn(0x7f174806bd00 0x7f17480700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f1747fff640 1 -- 172.21.15.89:0/3253324384 >> v1:172.21.15.89:6789/0 conn(0x7f17480bf400 legacy=0x7f17480c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f1747fff640 1 -- 172.21.15.89:0/3253324384 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748154a50 con 0x7f174814ea60 2023-12-07T10:00:39.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.188+0000 7f1746ffd640 1 -- 172.21.15.89:0/3253324384 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101565402 0 0) 0x7f174806c440 con 0x7f17480bf400 2023-12-07T10:00:39.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f1747fff640 1 --2- 172.21.15.89:0/3253324384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174814ea60 0x7f1748155250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f174806b370 tx=0x7f173801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef807329f62f83a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f1746ffd640 1 -- 172.21.15.89:0/3253324384 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380ab600 con 0x7f174814ea60 2023-12-07T10:00:39.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f1746ffd640 1 -- 172.21.15.89:0/3253324384 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380a7050 con 0x7f174814ea60 2023-12-07T10:00:39.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f1746ffd640 1 -- 172.21.15.89:0/3253324384 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380ab980 con 0x7f174814ea60 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 -- 172.21.15.89:0/3253324384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174814ea60 msgr2=0x7f1748155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 --2- 172.21.15.89:0/3253324384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174814ea60 0x7f1748155250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f174806b370 tx=0x7f173801c310 comp rx=0 tx=0).stop 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 -- 172.21.15.89:0/3253324384 shutdown_connections 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 --2- 172.21.15.89:0/3253324384 >> v2:172.21.15.97:3300/0 conn(0x7f174806bd00 0x7f17480700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 --2- 172.21.15.89:0/3253324384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174814ea60 0x7f1748155250 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 -- 172.21.15.89:0/3253324384 >> 172.21.15.89:0/3253324384 conn(0x7f17480c2ad0 msgr2=0x7f17480c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 -- 172.21.15.89:0/3253324384 shutdown_connections 2023-12-07T10:00:39.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.192+0000 7f174e3aa640 1 -- 172.21.15.89:0/3253324384 wait complete. 2023-12-07T10:00:39.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 Processor -- start 2023-12-07T10:00:39.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- start start 2023-12-07T10:00:39.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f174806bd00 0x7f17481523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 0x7f1748143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174814ea60 0x7f1748156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748148c50 con 0x7f17480bf400 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174814a410 con 0x7f174814ea60 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1748157090 con 0x7f174806bd00 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 0x7f1748143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 0x7f1748143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48398/0 (socket says 172.21.15.89:48398) 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 -- 172.21.15.89:0/22732975 learned_addr learned my addr 172.21.15.89:0/22732975 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174c947640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174814ea60 0x7f1748156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f1747fff640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f174806bd00 0x7f17481523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 -- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f174806bd00 msgr2=0x7f17481523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f174806bd00 0x7f17481523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 -- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174814ea60 msgr2=0x7f1748156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174814ea60 0x7f1748156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 -- 172.21.15.89:0/22732975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738009420 con 0x7f17480bf400 2023-12-07T10:00:39.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f17477fe640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 0x7f1748143ec0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f173c00e960 tx=0x7f173c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c009690 con 0x7f17480bf400 2023-12-07T10:00:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c00ca00 con 0x7f17480bf400 2023-12-07T10:00:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1748158860 con 0x7f17480bf400 2023-12-07T10:00:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c00cd70 con 0x7f17480bf400 2023-12-07T10:00:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17481ed7a0 con 0x7f17480bf400 2023-12-07T10:00:39.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.196+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174814a5a0 con 0x7f17480bf400 2023-12-07T10:00:39.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.200+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f173c013470 con 0x7f17480bf400 2023-12-07T10:00:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.200+0000 7f1744ff9640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f17340668d0 0x7f1734068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.200+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f173c084ac0 con 0x7f17480bf400 2023-12-07T10:00:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.200+0000 7f1747fff640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f17340668d0 0x7f1734068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.200+0000 7f1747fff640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f17340668d0 0x7f1734068d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f17380ad000 tx=0x7f17380a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.204+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f173c051c90 con 0x7f17480bf400 2023-12-07T10:00:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.356+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f174804e890 con 0x7f17480bf400 2023-12-07T10:00:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f1744ff9640 1 -- 172.21.15.89:0/22732975 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f173c017090 con 0x7f17480bf400 2023-12-07T10:00:39.364 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:39.364 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:37.279589+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/2626061332":"2023-12-08T10:00:34.223257+0000","172.21.15.97:6833/2626061332":"2023-12-08T10:00:34.223257+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f17340668d0 msgr2=0x7f1734068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f17340668d0 0x7f1734068d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f17380ad000 tx=0x7f17380a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 msgr2=0x7f1748143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 0x7f1748143ec0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f173c00e960 tx=0x7f173c00ee20 comp rx=0 tx=0).stop 2023-12-07T10:00:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 shutdown_connections 2023-12-07T10:00:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174814ea60 0x7f1748156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17480bf400 0x7f1748143ec0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f17340668d0 0x7f1734068d90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 --2- 172.21.15.89:0/22732975 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f174806bd00 0x7f17481523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 >> 172.21.15.89:0/22732975 conn(0x7f17480c2ad0 msgr2=0x7f1748152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 shutdown_connections 2023-12-07T10:00:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.360+0000 7f174e3aa640 1 -- 172.21.15.89:0/22732975 wait complete. 2023-12-07T10:00:39.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-07T10:00:39.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:39.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.516+0000 7f9bfa879640 1 Processor -- start 2023-12-07T10:00:39.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.516+0000 7f9bfa879640 1 -- start start 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bfa879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9bf4155360 0x7f9bf406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bfa879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf406baf0 0x7f9bf406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bfa879640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9bf406ed00 0x7f9bf41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bfa879640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40c2150 con 0x7f9bf406ed00 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bfa879640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf4157c60 con 0x7f9bf4155360 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bfa879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf406e280 con 0x7f9bf406baf0 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9bf406ed00 0x7f9bf41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9bf406ed00 0x7f9bf41580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46494/0 (socket says 172.21.15.89:46494) 2023-12-07T10:00:39.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 -- 172.21.15.89:0/1293618549 learned_addr learned my addr 172.21.15.89:0/1293618549 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:39.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf37fe640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf406baf0 0x7f9bf406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf3fff640 1 --2- 172.21.15.89:0/1293618549 >> v2:172.21.15.97:3300/0 conn(0x7f9bf4155360 0x7f9bf406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 -- 172.21.15.89:0/1293618549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf406baf0 msgr2=0x7f9bf406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:39.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf406baf0 0x7f9bf406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 -- 172.21.15.89:0/1293618549 >> v2:172.21.15.97:3300/0 conn(0x7f9bf4155360 msgr2=0x7f9bf406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:39.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 --2- 172.21.15.89:0/1293618549 >> v2:172.21.15.97:3300/0 conn(0x7f9bf4155360 0x7f9bf406b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 -- 172.21.15.89:0/1293618549 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40c1bd0 con 0x7f9bf406ed00 2023-12-07T10:00:39.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf37fe640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf406baf0 0x7f9bf406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:39.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf3fff640 1 --2- 172.21.15.89:0/1293618549 >> v2:172.21.15.97:3300/0 conn(0x7f9bf4155360 0x7f9bf406b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:39.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf8e16640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406ed00 0x7f9bf41580b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40c0c10 tx=0x7f9bec01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f49aa54dd9caba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.520+0000 7f9bf2ffd640 1 -- 172.21.15.89:0/1293618549 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0a56d0 con 0x7f9bf406ed00 2023-12-07T10:00:39.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bf2ffd640 1 -- 172.21.15.89:0/1293618549 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0a5830 con 0x7f9bf406ed00 2023-12-07T10:00:39.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bf2ffd640 1 -- 172.21.15.89:0/1293618549 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0a5bc0 con 0x7f9bf406ed00 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- 172.21.15.89:0/1293618549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406ed00 msgr2=0x7f9bf41580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406ed00 0x7f9bf41580b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40c0c10 tx=0x7f9bec01c940 comp rx=0 tx=0).stop 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- 172.21.15.89:0/1293618549 shutdown_connections 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406ed00 0x7f9bf41580b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- 172.21.15.89:0/1293618549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf406baf0 0x7f9bf406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- 172.21.15.89:0/1293618549 >> v2:172.21.15.97:3300/0 conn(0x7f9bf4155360 0x7f9bf406b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- 172.21.15.89:0/1293618549 >> 172.21.15.89:0/1293618549 conn(0x7f9bf40c3240 msgr2=0x7f9bf40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- 172.21.15.89:0/1293618549 shutdown_connections 2023-12-07T10:00:39.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- 172.21.15.89:0/1293618549 wait complete. 2023-12-07T10:00:39.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 Processor -- start 2023-12-07T10:00:39.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- start start 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 0x7f9bf40abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bf406ed00 0x7f9bf41ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf4155360 0x7f9bf41ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf414f6c0 con 0x7f9bf406baf0 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4159b70 con 0x7f9bf406ed00 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bfa879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4158f60 con 0x7f9bf4155360 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bf3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 0x7f9bf40abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.524+0000 7f9bf3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 0x7f9bf40abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46498/0 (socket says 172.21.15.89:46498) 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf37fe640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bf406ed00 0x7f9bf41ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 -- 172.21.15.89:0/2535182941 learned_addr learned my addr 172.21.15.89:0/2535182941 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf8e16640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf4155360 0x7f9bf41ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 -- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf4155360 msgr2=0x7f9bf41ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf4155360 0x7f9bf41ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 -- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bf406ed00 msgr2=0x7f9bf41ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bf406ed00 0x7f9bf41ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 -- 172.21.15.89:0/2535182941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec009b30 con 0x7f9bf406baf0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf37fe640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bf406ed00 0x7f9bf41ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf3fff640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 0x7f9bf40abf50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9be400c7f0 tx=0x7f9be400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4007820 con 0x7f9bf406baf0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4007980 con 0x7f9bf406baf0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf4159240 con 0x7f9bf406baf0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4007d30 con 0x7f9bf406baf0 2023-12-07T10:00:39.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf4159800 con 0x7f9bf406baf0 2023-12-07T10:00:39.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf404e890 con 0x7f9bf406baf0 2023-12-07T10:00:39.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.528+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9be40113f0 con 0x7f9bf406baf0 2023-12-07T10:00:39.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.532+0000 7f9bf0ff9640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9be00668d0 0x7f9be0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.532+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9be40846e0 con 0x7f9bf406baf0 2023-12-07T10:00:39.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.532+0000 7f9bf37fe640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9be00668d0 0x7f9be0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.532+0000 7f9bf37fe640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9be00668d0 0x7f9be0068d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006b20 tx=0x7f9be8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.536+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9be4051970 con 0x7f9bf406baf0 2023-12-07T10:00:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.712+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bf41ecd20 con 0x7f9bf406baf0 2023-12-07T10:00:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bf0ff9640 1 -- 172.21.15.89:0/2535182941 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f9be4054f90 con 0x7f9bf406baf0 2023-12-07T10:00:39.721 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:39.721 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3802417913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3802417913},{"type":"v1","addr":"172.21.15.97:6835","nonce":3802417913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:39.721 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 24 2023-12-07T10:00:39.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9be00668d0 msgr2=0x7f9be0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9be00668d0 0x7f9be0068d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006b20 tx=0x7f9be8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:39.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 msgr2=0x7f9bf40abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 0x7f9bf40abf50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9be400c7f0 tx=0x7f9be400ccb0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 shutdown_connections 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9be00668d0 0x7f9be0068d90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9bf4155360 0x7f9bf41ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bf406ed00 0x7f9bf41ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 --2- 172.21.15.89:0/2535182941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bf406baf0 0x7f9bf40abf50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 >> 172.21.15.89:0/2535182941 conn(0x7f9bf40c3240 msgr2=0x7f9bf4153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 shutdown_connections 2023-12-07T10:00:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.716+0000 7f9bfa879640 1 -- 172.21.15.89:0/2535182941 wait complete. 2023-12-07T10:00:39.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:39.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f705a879640 1 Processor -- start 2023-12-07T10:00:39.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f705a879640 1 -- start start 2023-12-07T10:00:39.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f705a879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f705414e9d0 0x7f7054151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f705a879640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705406d320 con 0x7f70540a8470 2023-12-07T10:00:39.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f705a879640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540721b0 con 0x7f7054070b80 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f705a879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c2830 con 0x7f705414e9d0 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f7058e16640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f70540a8470 0x7f705406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33820/0 (socket says 172.21.15.89:33820) 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f7058e16640 1 -- 172.21.15.89:0/2025490013 learned_addr learned my addr 172.21.15.89:0/2025490013 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.872+0000 7f7053fff640 1 --2- 172.21.15.89:0/2025490013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f705414e9d0 0x7f7054151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7052ffd640 1 -- 172.21.15.89:0/2025490013 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284545053 0 0) 0x7f705406d320 con 0x7f70540a8470 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7052ffd640 1 -- 172.21.15.89:0/2025490013 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f703c003530 con 0x7f70540a8470 2023-12-07T10:00:39.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7053fff640 1 -- 172.21.15.89:0/2025490013 >> v1:172.21.15.97:6789/0 conn(0x7f7054070b80 legacy=0x7f70540c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7052ffd640 1 -- 172.21.15.89:0/2025490013 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135756552 0 0) 0x7f70540721b0 con 0x7f7054070b80 2023-12-07T10:00:39.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7053fff640 1 -- 172.21.15.89:0/2025490013 >> v1:172.21.15.89:6789/0 conn(0x7f70540a8470 legacy=0x7f705406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7053fff640 1 -- 172.21.15.89:0/2025490013 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054072450 con 0x7f705414e9d0 2023-12-07T10:00:39.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7053fff640 1 --2- 172.21.15.89:0/2025490013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f705414e9d0 0x7f7054151e60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70440097f0 tx=0x7f704401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e31d3f0d9dc4959 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7052ffd640 1 -- 172.21.15.89:0/2025490013 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440ab600 con 0x7f705414e9d0 2023-12-07T10:00:39.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7052ffd640 1 -- 172.21.15.89:0/2025490013 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70440a7050 con 0x7f705414e9d0 2023-12-07T10:00:39.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.876+0000 7f7052ffd640 1 -- 172.21.15.89:0/2025490013 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440ab960 con 0x7f705414e9d0 2023-12-07T10:00:39.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- 172.21.15.89:0/2025490013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f705414e9d0 msgr2=0x7f7054151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 --2- 172.21.15.89:0/2025490013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f705414e9d0 0x7f7054151e60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70440097f0 tx=0x7f704401c430 comp rx=0 tx=0).stop 2023-12-07T10:00:39.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- 172.21.15.89:0/2025490013 shutdown_connections 2023-12-07T10:00:39.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 --2- 172.21.15.89:0/2025490013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f705414e9d0 0x7f7054151e60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- 172.21.15.89:0/2025490013 >> 172.21.15.89:0/2025490013 conn(0x7f70540c2ad0 msgr2=0x7f70540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:39.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- 172.21.15.89:0/2025490013 shutdown_connections 2023-12-07T10:00:39.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- 172.21.15.89:0/2025490013 wait complete. 2023-12-07T10:00:39.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 Processor -- start 2023-12-07T10:00:39.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- start start 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7054070b80 0x7f70540c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70540a8470 0x7f70541ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 0x7f70540bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054148390 con 0x7f705414e9d0 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c52b0 con 0x7f7054070b80 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f705a879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70541ed6d0 con 0x7f70540a8470 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f7058e16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 0x7f70540bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f7058e16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 0x7f70540bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46510/0 (socket says 172.21.15.89:46510) 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f7058e16640 1 -- 172.21.15.89:0/1307540679 learned_addr learned my addr 172.21.15.89:0/1307540679 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:39.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f7053fff640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7054070b80 0x7f70540c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.880+0000 7f70537fe640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70540a8470 0x7f70541ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7058e16640 1 -- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70540a8470 msgr2=0x7f70541ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7058e16640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70540a8470 0x7f70541ed190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7058e16640 1 -- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7054070b80 msgr2=0x7f70540c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7058e16640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7054070b80 0x7f70540c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7058e16640 1 -- 172.21.15.89:0/1307540679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044009420 con 0x7f705414e9d0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7058e16640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 0x7f70540bf660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f704c00cbb0 tx=0x7f704c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00ace0 con 0x7f705414e9d0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00ae40 con 0x7f705414e9d0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c012600 con 0x7f705414e9d0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70540aa030 con 0x7f705414e9d0 2023-12-07T10:00:39.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70540aa280 con 0x7f705414e9d0 2023-12-07T10:00:39.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7054067a40 con 0x7f705414e9d0 2023-12-07T10:00:39.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f704c012820 con 0x7f705414e9d0 2023-12-07T10:00:39.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7050ff9640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70400668d0 0x7f7040068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:39.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f704c0842b0 con 0x7f705414e9d0 2023-12-07T10:00:39.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.884+0000 7f7053fff640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70400668d0 0x7f7040068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:39.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.888+0000 7f7053fff640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70400668d0 0x7f7040068d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f70540704f0 tx=0x7f70440a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:39.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:39.888+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f704c0515d0 con 0x7f705414e9d0 2023-12-07T10:00:40.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.068+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70541efd10 con 0x7f705414e9d0 2023-12-07T10:00:40.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.068+0000 7f7050ff9640 1 -- 172.21.15.89:0/1307540679 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f70541efd10 con 0x7f705414e9d0 2023-12-07T10:00:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:40.075 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3802417913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3802417913},{"type":"v1","addr":"172.21.15.97:6835","nonce":3802417913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:13.810346+0000","modified":"2023-12-07T10:00:16.856163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6835/3032135309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3032135309},{"type":"v1","addr":"172.21.15.89:6835","nonce":3032135309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-07T10:00:40.075 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 24 2023-12-07T10:00:40.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70400668d0 msgr2=0x7f7040068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70400668d0 0x7f7040068d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f70540704f0 tx=0x7f70440a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:40.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 msgr2=0x7f70540bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 0x7f70540bf660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f704c00cbb0 tx=0x7f704c00a430 comp rx=0 tx=0).stop 2023-12-07T10:00:40.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 shutdown_connections 2023-12-07T10:00:40.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705414e9d0 0x7f70540bf660 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70400668d0 0x7f7040068d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70540a8470 0x7f70541ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 --2- 172.21.15.89:0/1307540679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7054070b80 0x7f70540c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 >> 172.21.15.89:0/1307540679 conn(0x7f70540c2ad0 msgr2=0x7f705415c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 shutdown_connections 2023-12-07T10:00:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.072+0000 7f705a879640 1 -- 172.21.15.89:0/1307540679 wait complete. 2023-12-07T10:00:40.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:40.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadeb1d640 1 Processor -- start 2023-12-07T10:00:40.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadeb1d640 1 -- start start 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadeb1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcad80ca610 0x7fcad80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadeb1d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8155790 con 0x7fcad806cd90 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadeb1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80c4b00 con 0x7fcad80bd720 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadeb1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad80c4de0 con 0x7fcad80ca610 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadd0ba640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcad806cd90 0x7fcad80c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33826/0 (socket says 172.21.15.89:33826) 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadd0ba640 1 -- 172.21.15.89:0/2595015058 learned_addr learned my addr 172.21.15.89:0/2595015058 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadc8b9640 1 --2- 172.21.15.89:0/2595015058 >> v2:172.21.15.97:3300/0 conn(0x7fcad80ca610 0x7fcad80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcacf7fe640 1 -- 172.21.15.89:0/2595015058 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156081104 0 0) 0x7fcad8155790 con 0x7fcad806cd90 2023-12-07T10:00:40.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcacf7fe640 1 -- 172.21.15.89:0/2595015058 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac0003530 con 0x7fcad806cd90 2023-12-07T10:00:40.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcacf7fe640 1 -- 172.21.15.89:0/2595015058 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716913222 0 0) 0x7fcac0003530 con 0x7fcad806cd90 2023-12-07T10:00:40.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadc8b9640 1 -- 172.21.15.89:0/2595015058 >> v1:172.21.15.97:6789/0 conn(0x7fcad80bd720 legacy=0x7fcad8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadc8b9640 1 -- 172.21.15.89:0/2595015058 >> v1:172.21.15.89:6789/0 conn(0x7fcad806cd90 legacy=0x7fcad80c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.228+0000 7fcadc8b9640 1 -- 172.21.15.89:0/2595015058 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8157e30 con 0x7fcad80ca610 2023-12-07T10:00:40.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcadc8b9640 1 --2- 172.21.15.89:0/2595015058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad80ca610 0x7fcad80c94c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097c0 tx=0x7fcad401bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e684fc39af8613b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcacf7fe640 1 -- 172.21.15.89:0/2595015058 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80c52d0 con 0x7fcad80ca610 2023-12-07T10:00:40.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcacf7fe640 1 -- 172.21.15.89:0/2595015058 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad40a5420 con 0x7fcad80ca610 2023-12-07T10:00:40.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcacf7fe640 1 -- 172.21.15.89:0/2595015058 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0001a00 con 0x7fcad80ca610 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcadeb1d640 1 -- 172.21.15.89:0/2595015058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad80ca610 msgr2=0x7fcad80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/2595015058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad80ca610 0x7fcad80c94c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097c0 tx=0x7fcad401bf60 comp rx=0 tx=0).stop 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcadeb1d640 1 -- 172.21.15.89:0/2595015058 shutdown_connections 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/2595015058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad80ca610 0x7fcad80c94c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.232+0000 7fcadeb1d640 1 -- 172.21.15.89:0/2595015058 >> 172.21.15.89:0/2595015058 conn(0x7fcad8071ea0 msgr2=0x7fcad80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 -- 172.21.15.89:0/2595015058 shutdown_connections 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 -- 172.21.15.89:0/2595015058 wait complete. 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 Processor -- start 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 -- start start 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad806cd90 0x7fcad8148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcad80bd720 0x7fcad8148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 0x7fcad81f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8152100 con 0x7fcad80ca610 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad81523e0 con 0x7fcad806cd90 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadeb1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8149fe0 con 0x7fcad80bd720 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 0x7fcad81f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 0x7fcad81f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46524/0 (socket says 172.21.15.89:46524) 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 -- 172.21.15.89:0/1957147208 learned_addr learned my addr 172.21.15.89:0/1957147208 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadc8b9640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad806cd90 0x7fcad8148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcacffff640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcad80bd720 0x7fcad8148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 -- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcad80bd720 msgr2=0x7fcad8148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcad80bd720 0x7fcad8148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 -- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad806cd90 msgr2=0x7fcad8148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad806cd90 0x7fcad8148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 -- 172.21.15.89:0/1957147208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4009420 con 0x7fcad80ca610 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadc8b9640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad806cd90 0x7fcad8148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:40.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.236+0000 7fcadd0ba640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 0x7fcad81f1200 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcad0001f80 tx=0x7fcad000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0012400 con 0x7fcad80ca610 2023-12-07T10:00:40.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0012560 con 0x7fcad80ca610 2023-12-07T10:00:40.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0012910 con 0x7fcad80ca610 2023-12-07T10:00:40.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad814a2c0 con 0x7fcad80ca610 2023-12-07T10:00:40.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad814c0f0 con 0x7fcad80ca610 2023-12-07T10:00:40.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad814a4e0 con 0x7fcad80ca610 2023-12-07T10:00:40.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcad0012a70 con 0x7fcad80ca610 2023-12-07T10:00:40.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcacd7fa640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcac40668d0 0x7fcac4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcad0084a80 con 0x7fcad80ca610 2023-12-07T10:00:40.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.240+0000 7fcadc8b9640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcac40668d0 0x7fcac4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.244+0000 7fcadc8b9640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcac40668d0 0x7fcac4068d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcad40ae000 tx=0x7fcad40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.244+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcad0051da0 con 0x7fcad80ca610 2023-12-07T10:00:40.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.400+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcad804e890 con 0x7fcad80ca610 2023-12-07T10:00:40.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.400+0000 7fcacd7fa640 1 -- 172.21.15.89:0/1957147208 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16586 (secure 0 0 0) 0x7fcad00553c0 con 0x7fcad80ca610 2023-12-07T10:00:40.408 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:40.408 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:37.279589+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:00:12.010823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:00:12.808546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/2626061332":"2023-12-08T10:00:34.223257+0000","172.21.15.97:6833/2626061332":"2023-12-08T10:00:34.223257+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcac40668d0 msgr2=0x7fcac4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcac40668d0 0x7fcac4068d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcad40ae000 tx=0x7fcad40a6000 comp rx=0 tx=0).stop 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 msgr2=0x7fcad81f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 0x7fcad81f1200 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcad0001f80 tx=0x7fcad000a430 comp rx=0 tx=0).stop 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 shutdown_connections 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad80ca610 0x7fcad81f1200 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcac40668d0 0x7fcac4068d90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcad80bd720 0x7fcad8148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 --2- 172.21.15.89:0/1957147208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcad806cd90 0x7fcad8148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 >> 172.21.15.89:0/1957147208 conn(0x7fcad8071ea0 msgr2=0x7fcad8158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 shutdown_connections 2023-12-07T10:00:40.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.404+0000 7fcadeb1d640 1 -- 172.21.15.89:0/1957147208 wait complete. 2023-12-07T10:00:40.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-07T10:00:40.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.560+0000 7fc1e965f640 1 Processor -- start 2023-12-07T10:00:40.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e965f640 1 -- start start 2023-12-07T10:00:40.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e965f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e414e9d0 0x7fc1e4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e965f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1e4070b80 0x7fc1e40c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e965f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e406d320 con 0x7fc1e40c1f20 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e965f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40721b0 con 0x7fc1e4070b80 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e965f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c2830 con 0x7fc1e414e9d0 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1dbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1e4070b80 0x7fc1e40c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e37fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc1e40c1f20 0x7fc1e406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33836/0 (socket says 172.21.15.89:33836) 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1dbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1e4070b80 0x7fc1e40c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46530/0 (socket says 172.21.15.89:46530) 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e37fe640 1 -- 172.21.15.89:0/3418853227 learned_addr learned my addr 172.21.15.89:0/3418853227 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:40.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1e2ffd640 1 --2- 172.21.15.89:0/3418853227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e414e9d0 0x7fc1e4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1dbfff640 1 -- 172.21.15.89:0/3418853227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e414e9d0 msgr2=0x7fc1e4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:40.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1dbfff640 1 --2- 172.21.15.89:0/3418853227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e414e9d0 0x7fc1e4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1dbfff640 1 -- 172.21.15.89:0/3418853227 >> v1:172.21.15.89:6789/0 conn(0x7fc1e40c1f20 legacy=0x7fc1e406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.564+0000 7fc1dbfff640 1 -- 172.21.15.89:0/3418853227 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4072450 con 0x7fc1e4070b80 2023-12-07T10:00:40.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1dbfff640 1 --2- 172.21.15.89:0/3418853227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e4070b80 0x7fc1e40c19e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0097c0 tx=0x7fc1cc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898987c4a23d24ec server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e27fc640 1 -- 172.21.15.89:0/3418853227 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0ab600 con 0x7fc1e4070b80 2023-12-07T10:00:40.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e27fc640 1 -- 172.21.15.89:0/3418853227 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0a7050 con 0x7fc1e4070b80 2023-12-07T10:00:40.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e27fc640 1 -- 172.21.15.89:0/3418853227 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0ab980 con 0x7fc1e4070b80 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 -- 172.21.15.89:0/3418853227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e4070b80 msgr2=0x7fc1e40c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 --2- 172.21.15.89:0/3418853227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e4070b80 0x7fc1e40c19e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0097c0 tx=0x7fc1cc01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 -- 172.21.15.89:0/3418853227 shutdown_connections 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 --2- 172.21.15.89:0/3418853227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e4070b80 0x7fc1e40c19e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 --2- 172.21.15.89:0/3418853227 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e414e9d0 0x7fc1e4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 -- 172.21.15.89:0/3418853227 >> 172.21.15.89:0/3418853227 conn(0x7fc1e40c2ad0 msgr2=0x7fc1e40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 -- 172.21.15.89:0/3418853227 shutdown_connections 2023-12-07T10:00:40.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 -- 172.21.15.89:0/3418853227 wait complete. 2023-12-07T10:00:40.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 Processor -- start 2023-12-07T10:00:40.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.568+0000 7fc1e965f640 1 -- start start 2023-12-07T10:00:40.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e4070b80 0x7fc1e4155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1e40c1f20 0x7fc1e41406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 0x7fc1e4140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4154260 con 0x7fc1e414e9d0 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e41517c0 con 0x7fc1e40c1f20 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e41eb840 con 0x7fc1e4070b80 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 0x7fc1e4140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 0x7fc1e4140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46538/0 (socket says 172.21.15.89:46538) 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 -- 172.21.15.89:0/2160433541 learned_addr learned my addr 172.21.15.89:0/2160433541 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1dbfff640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1e40c1f20 0x7fc1e41406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e2ffd640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e4070b80 0x7fc1e4155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 -- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e4070b80 msgr2=0x7fc1e4155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e4070b80 0x7fc1e4155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 -- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1e40c1f20 msgr2=0x7fc1e41406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1e40c1f20 0x7fc1e41406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 -- 172.21.15.89:0/2160433541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc009420 con 0x7fc1e414e9d0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1dbfff640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1e40c1f20 0x7fc1e41406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e37fe640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 0x7fc1e4140bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00cbc0 tx=0x7fc1dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00ad40 con 0x7fc1e414e9d0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc012400 con 0x7fc1e414e9d0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00aea0 con 0x7fc1e414e9d0 2023-12-07T10:00:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e41ebd30 con 0x7fc1e414e9d0 2023-12-07T10:00:40.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e41513e0 con 0x7fc1e414e9d0 2023-12-07T10:00:40.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4151900 con 0x7fc1e414e9d0 2023-12-07T10:00:40.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.572+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc1dc007070 con 0x7fc1e414e9d0 2023-12-07T10:00:40.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.576+0000 7fc1db7fe640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c4066900 0x7fc1c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.576+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc1dc0842c0 con 0x7fc1e414e9d0 2023-12-07T10:00:40.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.576+0000 7fc1e2ffd640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c4066900 0x7fc1c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.576+0000 7fc1e2ffd640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c4066900 0x7fc1c4068dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40079c0 tx=0x7fc1d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.580+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1e4151900 con 0x7fc1e414e9d0 2023-12-07T10:00:40.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.760+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fc1e4151900 con 0x7fc1e414e9d0 2023-12-07T10:00:40.768 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T10:00:40.764+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T10:00:40.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.764+0000 7fc1db7fe640 1 -- 172.21.15.89:0/2160433541 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc1e4151900 con 0x7fc1e414e9d0 2023-12-07T10:00:40.771 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c4066900 msgr2=0x7fc1c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c4066900 0x7fc1c4068dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40079c0 tx=0x7fc1d4008040 comp rx=0 tx=0).stop 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 msgr2=0x7fc1e4140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 0x7fc1e4140bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00cbc0 tx=0x7fc1dc00a430 comp rx=0 tx=0).stop 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 shutdown_connections 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e414e9d0 0x7fc1e4140bf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1e40c1f20 0x7fc1e41406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1c4066900 0x7fc1c4068dc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 --2- 172.21.15.89:0/2160433541 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1e4070b80 0x7fc1e4155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 >> 172.21.15.89:0/2160433541 conn(0x7fc1e40c2ad0 msgr2=0x7fc1e414d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:40.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 shutdown_connections 2023-12-07T10:00:40.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.768+0000 7fc1e965f640 1 -- 172.21.15.89:0/2160433541 wait complete. 2023-12-07T10:00:40.779 INFO:tasks.ceph.mds.a.smithi089.stderr: -2077> 2023-12-07T10:00:15.961+0000 7f1e8ccf4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:00:40.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-07T10:00:40.825 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T10:00:40.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:40.907 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:40.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.932+0000 7fcedb30f640 1 Processor -- start 2023-12-07T10:00:40.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.932+0000 7fcedb30f640 1 -- start start 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.932+0000 7fcedb30f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 0x7fced41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.932+0000 7fcedb30f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4157d20 con 0x7fced40c1bd0 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.932+0000 7fcedb30f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced406deb0 con 0x7fced40c24a0 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.932+0000 7fcedb30f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced406e100 con 0x7fced406c5c0 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced90ab640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fced40c1bd0 0x7fced4151c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33860/0 (socket says 172.21.15.89:33860) 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced90ab640 1 -- 172.21.15.89:0/1485487368 learned_addr learned my addr 172.21.15.89:0/1485487368 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:40.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 0x7fced41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899786407 0 0) 0x7fced4157d20 con 0x7fced40c1bd0 2023-12-07T10:00:40.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec0003530 con 0x7fced40c1bd0 2023-12-07T10:00:40.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265841908 0 0) 0x7fced406deb0 con 0x7fced40c24a0 2023-12-07T10:00:40.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced4157d20 con 0x7fced40c24a0 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2635193342 0 0) 0x7fcec0003530 con 0x7fced40c1bd0 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 msgr2=0x7fced41581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 0x7fced41581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 >> v1:172.21.15.97:6789/0 conn(0x7fced40c24a0 legacy=0x7fced41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40700f0 con 0x7fced40c1bd0 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fced0001680 con 0x7fced40c1bd0 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 >> v1:172.21.15.89:6789/0 conn(0x7fced40c1bd0 legacy=0x7fced4151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcec0003b40 0x7fcec0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcec00047d0 0x7fcec0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 0x7fcec0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced406e100 con 0x7fcec00047d0 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec000bb50 con 0x7fcec0003b40 2023-12-07T10:00:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec000bd10 con 0x7fced406c5c0 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcec00047d0 0x7fcec0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced90ab640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcec0003b40 0x7fcec0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced98ac640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 0x7fcec0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 -- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 msgr2=0x7fcec0005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fced406c5c0 0x7fcec0005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 -- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcec0003b40 msgr2=0x7fcec0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcec0003b40 0x7fcec0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.936+0000 7fced88aa640 1 -- 172.21.15.89:0/1485487368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0003530 con 0x7fcec00047d0 2023-12-07T10:00:40.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fced88aa640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcec00047d0 0x7fcec0004c50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009ab0 tx=0x7fcec401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b8d7026b74c107 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40a5510 con 0x7fcec00047d0 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec40a5670 con 0x7fcec00047d0 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcecbfff640 1 -- 172.21.15.89:0/1485487368 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40a5a20 con 0x7fcec00047d0 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 -- 172.21.15.89:0/1485487368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcec00047d0 msgr2=0x7fcec0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1485487368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcec00047d0 0x7fcec0004c50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009ab0 tx=0x7fcec401ca30 comp rx=0 tx=0).stop 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fced98ac640 1 -- 172.21.15.89:0/1485487368 reap_dead start 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 -- 172.21.15.89:0/1485487368 shutdown_connections 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 -- 172.21.15.89:0/1485487368 >> 172.21.15.89:0/1485487368 conn(0x7fced40c2a60 msgr2=0x7fced40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 -- 172.21.15.89:0/1485487368 shutdown_connections 2023-12-07T10:00:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 -- 172.21.15.89:0/1485487368 wait complete. 2023-12-07T10:00:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 Processor -- start 2023-12-07T10:00:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.940+0000 7fcedb30f640 1 -- start start 2023-12-07T10:00:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcec00047d0 0x7fced415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced414cf40 0x7fced415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 0x7fced40c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced415ae80 con 0x7fced41ed2d0 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41edfb0 con 0x7fced414cf40 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced415f350 con 0x7fcec00047d0 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 0x7fced40c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced90ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcec00047d0 0x7fced415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced90ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcec00047d0 0x7fced415ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:56316/0 (socket says 172.21.15.89:56316) 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 0x7fced40c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46566/0 (socket says 172.21.15.89:46566) 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced90ab640 1 -- 172.21.15.89:0/1580155803 learned_addr learned my addr 172.21.15.89:0/1580155803 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced88aa640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced414cf40 0x7fced415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 -- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcec00047d0 msgr2=0x7fced415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcec00047d0 0x7fced415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 -- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced414cf40 msgr2=0x7fced415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced414cf40 0x7fced415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 -- 172.21.15.89:0/1580155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced41edcd0 con 0x7fced41ed2d0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fced98ac640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 0x7fced40c4dc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fced4070f00 tx=0x7fcecc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc003980 con 0x7fced41ed2d0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc003b00 con 0x7fced41ed2d0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced415a7c0 con 0x7fced41ed2d0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0050d0 con 0x7fced41ed2d0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced415df90 con 0x7fced41ed2d0 2023-12-07T10:00:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced415a600 con 0x7fced41ed2d0 2023-12-07T10:00:40.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.944+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcecc005230 con 0x7fced41ed2d0 2023-12-07T10:00:40.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.948+0000 7fcec9ffb640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fceb80668d0 0x7fceb8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:40.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.948+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fcecc0840b0 con 0x7fced41ed2d0 2023-12-07T10:00:40.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.948+0000 7fced90ab640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fceb80668d0 0x7fceb8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:40.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.948+0000 7fced90ab640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fceb80668d0 0x7fceb8068d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fced0000c10 tx=0x7fced0001e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:40.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:40.952+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcecc051380 con 0x7fced41ed2d0 2023-12-07T10:00:41.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.136+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fced404e890 con 0x7fced41ed2d0 2023-12-07T10:00:41.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.768+0000 7fcec9ffb640 1 -- 172.21.15.89:0/1580155803 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7fcecc0549a0 con 0x7fced41ed2d0 2023-12-07T10:00:41.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fceb80668d0 msgr2=0x7fceb8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fceb80668d0 0x7fceb8068d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fced0000c10 tx=0x7fced0001e30 comp rx=0 tx=0).stop 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 msgr2=0x7fced40c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 0x7fced40c4dc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fced4070f00 tx=0x7fcecc00eb90 comp rx=0 tx=0).stop 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 shutdown_connections 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced41ed2d0 0x7fced40c4dc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fced414cf40 0x7fced415da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fceb80668d0 0x7fceb8068d90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 --2- 172.21.15.89:0/1580155803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcec00047d0 0x7fced415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 >> 172.21.15.89:0/1580155803 conn(0x7fced40c2a60 msgr2=0x7fced4071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 shutdown_connections 2023-12-07T10:00:41.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.772+0000 7fcedb30f640 1 -- 172.21.15.89:0/1580155803 wait complete. 2023-12-07T10:00:41.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-07T10:00:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 Processor -- start 2023-12-07T10:00:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 -- start start 2023-12-07T10:00:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc0abde0 0x7f70dc0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70dc1545a0 0x7f70dc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc14e770 con 0x7f70dc14e390 2023-12-07T10:00:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc06b2e0 con 0x7f70dc1545a0 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70e1afe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1518d0 con 0x7f70dc0abde0 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70dc1545a0 0x7f70dc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70dc1545a0 0x7f70dc154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46570/0 (socket says 172.21.15.89:46570) 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 -- 172.21.15.89:0/1490170733 learned_addr learned my addr 172.21.15.89:0/1490170733 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70d3fff640 1 --2- 172.21.15.89:0/1490170733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc0abde0 0x7f70dc0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 -- 172.21.15.89:0/1490170733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc0abde0 msgr2=0x7f70dc0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 --2- 172.21.15.89:0/1490170733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc0abde0 0x7f70dc0c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 -- 172.21.15.89:0/1490170733 >> v1:172.21.15.97:6789/0 conn(0x7f70dc14e390 legacy=0x7f70dc0c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:41.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.976+0000 7f70dbfff640 1 -- 172.21.15.89:0/1490170733 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc151bb0 con 0x7f70dc1545a0 2023-12-07T10:00:41.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70dbfff640 1 --2- 172.21.15.89:0/1490170733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc1545a0 0x7f70dc154a10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009e50 tx=0x7f70d401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dae75721abbd89 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:41.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70daffd640 1 -- 172.21.15.89:0/1490170733 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40a5840 con 0x7f70dc1545a0 2023-12-07T10:00:41.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70daffd640 1 -- 172.21.15.89:0/1490170733 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d40a59a0 con 0x7f70dc1545a0 2023-12-07T10:00:41.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70daffd640 1 -- 172.21.15.89:0/1490170733 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40a5d30 con 0x7f70dc1545a0 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 -- 172.21.15.89:0/1490170733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc1545a0 msgr2=0x7f70dc154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 --2- 172.21.15.89:0/1490170733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc1545a0 0x7f70dc154a10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009e50 tx=0x7f70d401c980 comp rx=0 tx=0).stop 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 -- 172.21.15.89:0/1490170733 shutdown_connections 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 --2- 172.21.15.89:0/1490170733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc1545a0 0x7f70dc154a10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 --2- 172.21.15.89:0/1490170733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc0abde0 0x7f70dc0c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 -- 172.21.15.89:0/1490170733 >> 172.21.15.89:0/1490170733 conn(0x7f70dc06a5a0 msgr2=0x7f70dc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 -- 172.21.15.89:0/1490170733 shutdown_connections 2023-12-07T10:00:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.980+0000 7f70e1afe640 1 -- 172.21.15.89:0/1490170733 wait complete. 2023-12-07T10:00:41.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 Processor -- start 2023-12-07T10:00:41.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- start start 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70dc0abde0 0x7f70dc1f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 0x7f70dc1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc1545a0 0x7f70dc1ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1f19a0 con 0x7f70dc14e390 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc14f7f0 con 0x7f70dc0abde0 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1ed4e0 con 0x7f70dc1545a0 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 0x7f70dc1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:41.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 0x7f70dc1493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46586/0 (socket says 172.21.15.89:46586) 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 -- 172.21.15.89:0/2840827079 learned_addr learned my addr 172.21.15.89:0/2840827079 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70db7fe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70dc0abde0 0x7f70dc1f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70dbfff640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc1545a0 0x7f70dc1ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 -- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc1545a0 msgr2=0x7f70dc1ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc1545a0 0x7f70dc1ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 -- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70dc0abde0 msgr2=0x7f70dc1f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70dc0abde0 0x7f70dc1f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 -- 172.21.15.89:0/2840827079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4009b30 con 0x7f70dc14e390 2023-12-07T10:00:41.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d3fff640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 0x7f70dc1493c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f70c400e960 tx=0x7f70c400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4009690 con 0x7f70dc14e390 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c400ca00 con 0x7f70dc14e390 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400cd70 con 0x7f70dc14e390 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc14bbc0 con 0x7f70dc14e390 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc14d440 con 0x7f70dc14e390 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.984+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc1ed6a0 con 0x7f70dc14e390 2023-12-07T10:00:41.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.988+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f70c4013470 con 0x7f70dc14e390 2023-12-07T10:00:41.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.988+0000 7f70d8ff9640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70bc0668d0 0x7f70bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:41.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.988+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f70c4084700 con 0x7f70dc14e390 2023-12-07T10:00:41.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.988+0000 7f70db7fe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70bc0668d0 0x7f70bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:41.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.988+0000 7f70db7fe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70bc0668d0 0x7f70bc068d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f70cc000f70 tx=0x7f70cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:41.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:41.992+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70c4051920 con 0x7f70dc14e390 2023-12-07T10:00:42.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.140+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70dc04e890 con 0x7f70dc14e390 2023-12-07T10:00:42.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.772+0000 7f70d8ff9640 1 -- 172.21.15.89:0/2840827079 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f70c4054f40 con 0x7f70dc14e390 2023-12-07T10:00:42.777 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_metadata' removed 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.772+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70bc0668d0 msgr2=0x7f70bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.772+0000 7f70e1afe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70bc0668d0 0x7f70bc068d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f70cc000f70 tx=0x7f70cc009040 comp rx=0 tx=0).stop 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.772+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 msgr2=0x7f70dc1493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.772+0000 7f70e1afe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 0x7f70dc1493c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f70c400e960 tx=0x7f70c400ee20 comp rx=0 tx=0).stop 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 shutdown_connections 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70bc0668d0 0x7f70bc068d90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70dc1545a0 0x7f70dc1ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70dc14e390 0x7f70dc1493c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 --2- 172.21.15.89:0/2840827079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70dc0abde0 0x7f70dc1f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 >> 172.21.15.89:0/2840827079 conn(0x7f70dc06a5a0 msgr2=0x7f70dc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 shutdown_connections 2023-12-07T10:00:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.776+0000 7f70e1afe640 1 -- 172.21.15.89:0/2840827079 wait complete. 2023-12-07T10:00:42.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-07T10:00:42.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.944+0000 7fa1b6557640 1 Processor -- start 2023-12-07T10:00:42.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.944+0000 7fa1b6557640 1 -- start start 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b6557640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1b0151e10 0x7fa1b00c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b6557640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1b00c4f50 0x7fa1b006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b6557640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b006bd20 con 0x7fa1b00bd720 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b6557640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b01521f0 con 0x7fa1b0151e10 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b6557640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b0155330 con 0x7fa1b00c4f50 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1b0151e10 0x7fa1b00c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1b0151e10 0x7fa1b00c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46598/0 (socket says 172.21.15.89:46598) 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 -- 172.21.15.89:0/2434402825 learned_addr learned my addr 172.21.15.89:0/2434402825 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b4af4640 1 --2- 172.21.15.89:0/2434402825 >> v2:172.21.15.97:3300/0 conn(0x7fa1b00c4f50 0x7fa1b006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 -- 172.21.15.89:0/2434402825 >> v2:172.21.15.97:3300/0 conn(0x7fa1b00c4f50 msgr2=0x7fa1b006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:42.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 --2- 172.21.15.89:0/2434402825 >> v2:172.21.15.97:3300/0 conn(0x7fa1b00c4f50 0x7fa1b006c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 -- 172.21.15.89:0/2434402825 >> v1:172.21.15.97:6789/0 conn(0x7fa1b00bd720 legacy=0x7fa1b006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:42.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 -- 172.21.15.89:0/2434402825 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0155610 con 0x7fa1b0151e10 2023-12-07T10:00:42.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1b4af4640 1 --2- 172.21.15.89:0/2434402825 >> v2:172.21.15.97:3300/0 conn(0x7fa1b00c4f50 0x7fa1b006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:42.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.948+0000 7fa1affff640 1 --2- 172.21.15.89:0/2434402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b0151e10 0x7fa1b00c4a10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00b01e0 tx=0x7fa1a001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e7a8518a1ab1fb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:42.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1aeffd640 1 -- 172.21.15.89:0/2434402825 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00ab600 con 0x7fa1b0151e10 2023-12-07T10:00:42.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1aeffd640 1 -- 172.21.15.89:0/2434402825 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00a7050 con 0x7fa1b0151e10 2023-12-07T10:00:42.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1aeffd640 1 -- 172.21.15.89:0/2434402825 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00ab980 con 0x7fa1b0151e10 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- 172.21.15.89:0/2434402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b0151e10 msgr2=0x7fa1b00c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2434402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b0151e10 0x7fa1b00c4a10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00b01e0 tx=0x7fa1a001c430 comp rx=0 tx=0).stop 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- 172.21.15.89:0/2434402825 shutdown_connections 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2434402825 >> v2:172.21.15.97:3300/0 conn(0x7fa1b00c4f50 0x7fa1b006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2434402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b0151e10 0x7fa1b00c4a10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- 172.21.15.89:0/2434402825 >> 172.21.15.89:0/2434402825 conn(0x7fa1b00ca090 msgr2=0x7fa1b00ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- 172.21.15.89:0/2434402825 shutdown_connections 2023-12-07T10:00:42.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- 172.21.15.89:0/2434402825 wait complete. 2023-12-07T10:00:42.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 Processor -- start 2023-12-07T10:00:42.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- start start 2023-12-07T10:00:42.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1b00bd720 0x7fa1b01ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:42.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 0x7fa1b01efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:42.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1b0151e10 0x7fa1b0157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:42.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0146eb0 con 0x7fa1b00c4f50 2023-12-07T10:00:42.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01f0360 con 0x7fa1b00bd720 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1b6557640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01f1000 con 0x7fa1b0151e10 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.952+0000 7fa1af7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 0x7fa1b01efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 0x7fa1b01efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46606/0 (socket says 172.21.15.89:46606) 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 -- 172.21.15.89:0/2349904982 learned_addr learned my addr 172.21.15.89:0/2349904982 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1affff640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1b00bd720 0x7fa1b01ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1b4af4640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1b0151e10 0x7fa1b0157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 -- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1b0151e10 msgr2=0x7fa1b0157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1b0151e10 0x7fa1b0157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 -- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1b00bd720 msgr2=0x7fa1b01ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1b00bd720 0x7fa1b01ef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 -- 172.21.15.89:0/2349904982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00094d0 con 0x7fa1b00c4f50 2023-12-07T10:00:42.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1af7fe640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 0x7fa1b01efe20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400c440 tx=0x7fa1a400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:42.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4012830 con 0x7fa1b00c4f50 2023-12-07T10:00:42.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4012990 con 0x7fa1b00c4f50 2023-12-07T10:00:42.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b01ecfe0 con 0x7fa1b00c4f50 2023-12-07T10:00:42.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4012d40 con 0x7fa1b00c4f50 2023-12-07T10:00:42.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b01f12a0 con 0x7fa1b00c4f50 2023-12-07T10:00:42.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b01ed200 con 0x7fa1b00c4f50 2023-12-07T10:00:42.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa1a401b400 con 0x7fa1b00c4f50 2023-12-07T10:00:42.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1acff9640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa19c0668d0 0x7fa19c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:42.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.956+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5445+0+0 (secure 0 0 0) 0x7fa1a4084150 con 0x7fa1b00c4f50 2023-12-07T10:00:42.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.960+0000 7fa1affff640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa19c0668d0 0x7fa19c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:42.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.960+0000 7fa1affff640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa19c0668d0 0x7fa19c068d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa1b006d810 tx=0x7fa1a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:42.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:42.964+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa1b01ed200 con 0x7fa1b00c4f50 2023-12-07T10:00:43.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.116+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1b01ed1d0 con 0x7fa1b00c4f50 2023-12-07T10:00:43.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.772+0000 7fa1acff9640 1 -- 172.21.15.89:0/2349904982 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v41) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa1a40160d0 con 0x7fa1b00c4f50 2023-12-07T10:00:43.779 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_data' removed 2023-12-07T10:00:43.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa19c0668d0 msgr2=0x7fa19c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:43.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa19c0668d0 0x7fa19c068d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa1b006d810 tx=0x7fa1a0009040 comp rx=0 tx=0).stop 2023-12-07T10:00:43.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 msgr2=0x7fa1b01efe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:43.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 0x7fa1b01efe20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400c440 tx=0x7fa1a400c900 comp rx=0 tx=0).stop 2023-12-07T10:00:43.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 shutdown_connections 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa19c0668d0 0x7fa19c068d90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1b0151e10 0x7fa1b0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1b00c4f50 0x7fa1b01efe20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 --2- 172.21.15.89:0/2349904982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1b00bd720 0x7fa1b01ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 >> 172.21.15.89:0/2349904982 conn(0x7fa1b00ca090 msgr2=0x7fa1b015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 shutdown_connections 2023-12-07T10:00:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.776+0000 7fa1b6557640 1 -- 172.21.15.89:0/2349904982 wait complete. 2023-12-07T10:00:43.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-07T10:00:43.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 Processor -- start 2023-12-07T10:00:43.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 -- start start 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fee380a86d0 0x7fee380a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee3814fd00 0x7fee380aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee38152d90 con 0x7fee38156600 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee38152480 con 0x7fee3814fd00 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee3d59d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee380a9760 con 0x7fee380a86d0 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee2e7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fee38156600 0x7fee3814f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33874/0 (socket says 172.21.15.89:33874) 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee2e7fc640 1 -- 172.21.15.89:0/1365314443 learned_addr learned my addr 172.21.15.89:0/1365314443 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee377fe640 1 --2- 172.21.15.89:0/1365314443 >> v2:172.21.15.89:3300/0 conn(0x7fee3814fd00 0x7fee380aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:43.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee36ffd640 1 --2- 172.21.15.89:0/1365314443 >> v2:172.21.15.97:3300/0 conn(0x7fee380a86d0 0x7fee380a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:43.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee367fc640 1 -- 172.21.15.89:0/1365314443 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532873949 0 0) 0x7fee38152d90 con 0x7fee38156600 2023-12-07T10:00:43.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee367fc640 1 -- 172.21.15.89:0/1365314443 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee24003530 con 0x7fee38156600 2023-12-07T10:00:43.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee377fe640 1 -- 172.21.15.89:0/1365314443 >> v2:172.21.15.97:3300/0 conn(0x7fee380a86d0 msgr2=0x7fee380a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:43.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee377fe640 1 --2- 172.21.15.89:0/1365314443 >> v2:172.21.15.97:3300/0 conn(0x7fee380a86d0 0x7fee380a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee377fe640 1 -- 172.21.15.89:0/1365314443 >> v1:172.21.15.89:6789/0 conn(0x7fee38156600 legacy=0x7fee3814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:43.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.940+0000 7fee377fe640 1 -- 172.21.15.89:0/1365314443 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38152740 con 0x7fee3814fd00 2023-12-07T10:00:43.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee377fe640 1 --2- 172.21.15.89:0/1365314443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3814fd00 0x7fee380aae40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fee30009d90 tx=0x7fee3001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a9673790cd0dbe server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:43.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee367fc640 1 -- 172.21.15.89:0/1365314443 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300a58c0 con 0x7fee3814fd00 2023-12-07T10:00:43.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee367fc640 1 -- 172.21.15.89:0/1365314443 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee300a5a20 con 0x7fee3814fd00 2023-12-07T10:00:43.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee367fc640 1 -- 172.21.15.89:0/1365314443 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300a5db0 con 0x7fee3814fd00 2023-12-07T10:00:43.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 -- 172.21.15.89:0/1365314443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3814fd00 msgr2=0x7fee380aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:43.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 --2- 172.21.15.89:0/1365314443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3814fd00 0x7fee380aae40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fee30009d90 tx=0x7fee3001c910 comp rx=0 tx=0).stop 2023-12-07T10:00:43.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 -- 172.21.15.89:0/1365314443 shutdown_connections 2023-12-07T10:00:43.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 --2- 172.21.15.89:0/1365314443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3814fd00 0x7fee380aae40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 --2- 172.21.15.89:0/1365314443 >> v2:172.21.15.97:3300/0 conn(0x7fee380a86d0 0x7fee380a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 -- 172.21.15.89:0/1365314443 >> 172.21.15.89:0/1365314443 conn(0x7fee380c2a60 msgr2=0x7fee380c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:43.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 -- 172.21.15.89:0/1365314443 shutdown_connections 2023-12-07T10:00:43.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.944+0000 7fee3d59d640 1 -- 172.21.15.89:0/1365314443 wait complete. 2023-12-07T10:00:43.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 Processor -- start 2023-12-07T10:00:43.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 -- start start 2023-12-07T10:00:43.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee380a86d0 0x7fee381ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:43.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3814fd00 0x7fee3814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:43.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 0x7fee38145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee38070ef0 con 0x7fee38156600 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee381f1370 con 0x7fee380a86d0 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee381f07f0 con 0x7fee3814fd00 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 0x7fee38145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 0x7fee38145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46624/0 (socket says 172.21.15.89:46624) 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 -- 172.21.15.89:0/2339332725 learned_addr learned my addr 172.21.15.89:0/2339332725 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee36ffd640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee380a86d0 0x7fee381ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee2e7fc640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3814fd00 0x7fee3814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:43.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 -- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3814fd00 msgr2=0x7fee3814a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3814fd00 0x7fee3814a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 -- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee380a86d0 msgr2=0x7fee381ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee380a86d0 0x7fee381ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 -- 172.21.15.89:0/2339332725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009a70 con 0x7fee38156600 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee2e7fc640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3814fd00 0x7fee3814a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee377fe640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 0x7fee38145820 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fee3001a540 tx=0x7fee300196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300b9650 con 0x7fee38156600 2023-12-07T10:00:43.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee300b97b0 con 0x7fee38156600 2023-12-07T10:00:43.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee381f0ad0 con 0x7fee38156600 2023-12-07T10:00:43.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300b9b40 con 0x7fee38156600 2023-12-07T10:00:43.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.948+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee381f1090 con 0x7fee38156600 2023-12-07T10:00:43.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.952+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3804e890 con 0x7fee38156600 2023-12-07T10:00:43.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.952+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee300b9ca0 con 0x7fee38156600 2023-12-07T10:00:43.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.952+0000 7fee2ffff640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee180668d0 0x7fee18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:43.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.952+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fee3011f370 con 0x7fee38156600 2023-12-07T10:00:43.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.952+0000 7fee36ffd640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee180668d0 0x7fee18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:43.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.952+0000 7fee36ffd640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee180668d0 0x7fee18068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fee28009ac0 tx=0x7fee28009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:43.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:43.956+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee300ec850 con 0x7fee38156600 2023-12-07T10:00:44.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.104+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fee380c21e0 con 0x7fee38156600 2023-12-07T10:00:44.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.108+0000 7fee2ffff640 1 -- 172.21.15.89:0/2339332725 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee300efe70 con 0x7fee38156600 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee180668d0 msgr2=0x7fee18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee180668d0 0x7fee18068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fee28009ac0 tx=0x7fee28009190 comp rx=0 tx=0).stop 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 msgr2=0x7fee38145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 0x7fee38145820 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fee3001a540 tx=0x7fee300196b0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 shutdown_connections 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38156600 0x7fee38145820 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee180668d0 0x7fee18068d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3814fd00 0x7fee3814a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 --2- 172.21.15.89:0/2339332725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee380a86d0 0x7fee381ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 >> 172.21.15.89:0/2339332725 conn(0x7fee380c2a60 msgr2=0x7fee38151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:44.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 shutdown_connections 2023-12-07T10:00:44.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.112+0000 7fee3d59d640 1 -- 172.21.15.89:0/2339332725 wait complete. 2023-12-07T10:00:44.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-07T10:00:44.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 Processor -- start 2023-12-07T10:00:44.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 -- start start 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8f80ca610 0x7fe8f80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8f80bd720 0x7fe8f80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f806cd90 0x7fe8f8158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f8155790 con 0x7fe8f80ca610 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f80c4b00 con 0x7fe8f80bd720 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fe86b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80c4de0 con 0x7fe8f806cd90 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8f80ca610 0x7fe8f80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8f80ca610 0x7fe8f80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46632/0 (socket says 172.21.15.89:46632) 2023-12-07T10:00:44.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 -- 172.21.15.89:0/132054767 learned_addr learned my addr 172.21.15.89:0/132054767 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fce08640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f806cd90 0x7fe8f8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8effff640 1 --2- 172.21.15.89:0/132054767 >> v2:172.21.15.97:3300/0 conn(0x7fe8f80bd720 0x7fe8f80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 -- 172.21.15.89:0/132054767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f806cd90 msgr2=0x7fe8f8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f806cd90 0x7fe8f8158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 -- 172.21.15.89:0/132054767 >> v2:172.21.15.97:3300/0 conn(0x7fe8f80bd720 msgr2=0x7fe8f80c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/132054767 >> v2:172.21.15.97:3300/0 conn(0x7fe8f80bd720 0x7fe8f80c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8f7fff640 1 -- 172.21.15.89:0/132054767 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8157e30 con 0x7fe8f80ca610 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8fce08640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f806cd90 0x7fe8f8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:44.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.280+0000 7fe8effff640 1 --2- 172.21.15.89:0/132054767 >> v2:172.21.15.97:3300/0 conn(0x7fe8f80bd720 0x7fe8f80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:44.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f80c94c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80ca380 tx=0x7fe8e801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f663a6f83b12bb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:44.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8f77fe640 1 -- 172.21.15.89:0/132054767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80c52d0 con 0x7fe8f80ca610 2023-12-07T10:00:44.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8f77fe640 1 -- 172.21.15.89:0/132054767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e80a4880 con 0x7fe8f80ca610 2023-12-07T10:00:44.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8f77fe640 1 -- 172.21.15.89:0/132054767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80a4c10 con 0x7fe8f80ca610 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 -- 172.21.15.89:0/132054767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 msgr2=0x7fe8f80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f80c94c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80ca380 tx=0x7fe8e801c0c0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 -- 172.21.15.89:0/132054767 shutdown_connections 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f806cd90 0x7fe8f8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/132054767 >> v2:172.21.15.97:3300/0 conn(0x7fe8f80bd720 0x7fe8f80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/132054767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f80c94c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 -- 172.21.15.89:0/132054767 >> 172.21.15.89:0/132054767 conn(0x7fe8f8071ea0 msgr2=0x7fe8f80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 -- 172.21.15.89:0/132054767 shutdown_connections 2023-12-07T10:00:44.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.284+0000 7fe8fe86b640 1 -- 172.21.15.89:0/132054767 wait complete. 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 Processor -- start 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 -- start start 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f806cd90 0x7fe8f8144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f80bd720 0x7fe8f8145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f8146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80aa6d0 con 0x7fe8f80ca610 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80a9a70 con 0x7fe8f806cd90 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80a9d10 con 0x7fe8f80bd720 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f8146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f8146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46646/0 (socket says 172.21.15.89:46646) 2023-12-07T10:00:44.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 -- 172.21.15.89:0/4221903766 learned_addr learned my addr 172.21.15.89:0/4221903766 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f806cd90 0x7fe8f8144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8effff640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f80bd720 0x7fe8f8145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 -- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f80bd720 msgr2=0x7fe8f8145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f80bd720 0x7fe8f8145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 -- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f806cd90 msgr2=0x7fe8f8144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f806cd90 0x7fe8f8144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 -- 172.21.15.89:0/4221903766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80094d0 con 0x7fe8f80ca610 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f806cd90 0x7fe8f8144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fce08640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f8146390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0007e10 tx=0x7fe8f000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0003ba0 con 0x7fe8f80ca610 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f000f040 con 0x7fe8f80ca610 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000de80 con 0x7fe8f80ca610 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f81459b0 con 0x7fe8f80ca610 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.288+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f81eecc0 con 0x7fe8f80ca610 2023-12-07T10:00:44.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.292+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f804e890 con 0x7fe8f80ca610 2023-12-07T10:00:44.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.292+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8f0004030 con 0x7fe8f80ca610 2023-12-07T10:00:44.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.292+0000 7fe8f57fa640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8d80668d0 0x7fe8d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.292+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe8f0084490 con 0x7fe8f80ca610 2023-12-07T10:00:44.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.292+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8d80668d0 0x7fe8d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.292+0000 7fe8f7fff640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8d80668d0 0x7fe8d8068d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80ae000 tx=0x7fe8e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:44.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.296+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8f0051960 con 0x7fe8f80ca610 2023-12-07T10:00:44.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.496+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fe8f80a9e50 con 0x7fe8f80ca610 2023-12-07T10:00:44.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8f57fa640 1 -- 172.21.15.89:0/4221903766 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v113) v1 ==== 159+0+0 (secure 0 0 0) 0x7fe8f0054f80 con 0x7fe8f80ca610 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8d80668d0 msgr2=0x7fe8d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8d80668d0 0x7fe8d8068d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80ae000 tx=0x7fe8e8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 msgr2=0x7fe8f8146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f8146390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0007e10 tx=0x7fe8f000d4a0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 shutdown_connections 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8f80ca610 0x7fe8f8146390 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8d80668d0 0x7fe8d8068d90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8f80bd720 0x7fe8f8145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 --2- 172.21.15.89:0/4221903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8f806cd90 0x7fe8f8144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 >> 172.21.15.89:0/4221903766 conn(0x7fe8f8071ea0 msgr2=0x7fe8f8072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 shutdown_connections 2023-12-07T10:00:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.776+0000 7fe8fe86b640 1 -- 172.21.15.89:0/4221903766 wait complete. 2023-12-07T10:00:44.803 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-07T10:00:44.803 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-07T10:00:44.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:44.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 Processor -- start 2023-12-07T10:00:44.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 -- start start 2023-12-07T10:00:44.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f840ca610 0x7f3f840c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f840bd720 0x7f3f840c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3f8406cd90 0x7f3f84158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f84155790 con 0x7f3f840bd720 2023-12-07T10:00:44.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f840c4b00 con 0x7f3f8406cd90 2023-12-07T10:00:44.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f8a879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840c4de0 con 0x7f3f840ca610 2023-12-07T10:00:44.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f840bd720 0x7f3f840c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f840bd720 0x7f3f840c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46662/0 (socket says 172.21.15.89:46662) 2023-12-07T10:00:44.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 -- 172.21.15.89:0/2878912741 learned_addr learned my addr 172.21.15.89:0/2878912741 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:44.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f83fff640 1 --2- 172.21.15.89:0/2878912741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f840ca610 0x7f3f840c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f88e16640 1 --2- 172.21.15.89:0/2878912741 >> v2:172.21.15.97:3300/0 conn(0x7f3f8406cd90 0x7f3f84158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 -- 172.21.15.89:0/2878912741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f840ca610 msgr2=0x7f3f840c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:44.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 --2- 172.21.15.89:0/2878912741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f840ca610 0x7f3f840c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 -- 172.21.15.89:0/2878912741 >> v2:172.21.15.97:3300/0 conn(0x7f3f8406cd90 msgr2=0x7f3f84158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:44.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 --2- 172.21.15.89:0/2878912741 >> v2:172.21.15.97:3300/0 conn(0x7f3f8406cd90 0x7f3f84158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.936+0000 7f3f837fe640 1 -- 172.21.15.89:0/2878912741 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84157e30 con 0x7f3f840bd720 2023-12-07T10:00:44.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f837fe640 1 --2- 172.21.15.89:0/2878912741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840c9a00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3f84152370 tx=0x7f3f7801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25535da67305ef37 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:44.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f82ffd640 1 -- 172.21.15.89:0/2878912741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840c52d0 con 0x7f3f840bd720 2023-12-07T10:00:44.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f82ffd640 1 -- 172.21.15.89:0/2878912741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f780a4880 con 0x7f3f840bd720 2023-12-07T10:00:44.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f82ffd640 1 -- 172.21.15.89:0/2878912741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780a4c10 con 0x7f3f840bd720 2023-12-07T10:00:44.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 -- 172.21.15.89:0/2878912741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 msgr2=0x7f3f840c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 --2- 172.21.15.89:0/2878912741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840c9a00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3f84152370 tx=0x7f3f7801c0c0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 -- 172.21.15.89:0/2878912741 shutdown_connections 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 --2- 172.21.15.89:0/2878912741 >> v2:172.21.15.97:3300/0 conn(0x7f3f8406cd90 0x7f3f84158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 --2- 172.21.15.89:0/2878912741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840c9a00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 --2- 172.21.15.89:0/2878912741 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f840ca610 0x7f3f840c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 -- 172.21.15.89:0/2878912741 >> 172.21.15.89:0/2878912741 conn(0x7f3f84071ea0 msgr2=0x7f3f840722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 -- 172.21.15.89:0/2878912741 shutdown_connections 2023-12-07T10:00:44.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.940+0000 7f3f8a879640 1 -- 172.21.15.89:0/2878912741 wait complete. 2023-12-07T10:00:44.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 Processor -- start 2023-12-07T10:00:44.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 -- start start 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f8406cd90 0x7f3f84147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f840ca610 0x7f3f840a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84149900 con 0x7f3f840bd720 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84157bb0 con 0x7f3f840ca610 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84148550 con 0x7f3f8406cd90 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46678/0 (socket says 172.21.15.89:46678) 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 -- 172.21.15.89:0/4177830631 learned_addr learned my addr 172.21.15.89:0/4177830631 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f83fff640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f8406cd90 0x7f3f84147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f88e16640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f840ca610 0x7f3f840a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 -- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f8406cd90 msgr2=0x7f3f84147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f8406cd90 0x7f3f84147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 -- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f840ca610 msgr2=0x7f3f840a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f840ca610 0x7f3f840a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 -- 172.21.15.89:0/4177830631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780094d0 con 0x7f3f840bd720 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f83fff640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f8406cd90 0x7f3f84147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f837fe640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840ac240 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3f7801a770 tx=0x7f3f78019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780ac740 con 0x7f3f840bd720 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f780ac8a0 con 0x7f3f840bd720 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f840aae00 con 0x7f3f840bd720 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780acc30 con 0x7f3f840bd720 2023-12-07T10:00:44.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.944+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f840aab20 con 0x7f3f840bd720 2023-12-07T10:00:44.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.948+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8404e890 con 0x7f3f840bd720 2023-12-07T10:00:44.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.948+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3f780b43f0 con 0x7f3f840bd720 2023-12-07T10:00:44.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.948+0000 7f3f80ff9640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3f70066900 0x7f3f70068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:44.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.948+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3f840cac00 con 0x7f3f840bd720 2023-12-07T10:00:44.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.948+0000 7f3f83fff640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3f70066900 0x7f3f70068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:44.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.948+0000 7f3f83fff640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3f70066900 0x7f3f70068dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400b9f0 tx=0x7f3f74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:44.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:44.952+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f780eac50 con 0x7f3f840bd720 2023-12-07T10:00:45.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f840c9ea0 con 0x7f3f840bd720 2023-12-07T10:00:45.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f80ff9640 1 -- 172.21.15.89:0/4177830631 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13056 (secure 0 0 0) 0x7f3f780ee270 con 0x7f3f840bd720 2023-12-07T10:00:45.109 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:45.110 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:43.774050+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6835/3032135309":"2023-12-08T10:00:40.765564+0000","172.21.15.89:6834/3032135309":"2023-12-08T10:00:40.765564+0000","172.21.15.97:6835/2626061332":"2023-12-08T10:00:34.223257+0000","172.21.15.97:6833/2626061332":"2023-12-08T10:00:34.223257+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3f70066900 msgr2=0x7f3f70068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3f70066900 0x7f3f70068dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400b9f0 tx=0x7f3f74008040 comp rx=0 tx=0).stop 2023-12-07T10:00:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 msgr2=0x7f3f840ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840ac240 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3f7801a770 tx=0x7f3f78019180 comp rx=0 tx=0).stop 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 shutdown_connections 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f840ca610 0x7f3f840a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840bd720 0x7f3f840ac240 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3f70066900 0x7f3f70068dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 --2- 172.21.15.89:0/4177830631 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3f8406cd90 0x7f3f84147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 >> 172.21.15.89:0/4177830631 conn(0x7f3f84071ea0 msgr2=0x7f3f840c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 shutdown_connections 2023-12-07T10:00:45.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.104+0000 7f3f8a879640 1 -- 172.21.15.89:0/4177830631 wait complete. 2023-12-07T10:00:45.132 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:45.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:45.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 Processor -- start 2023-12-07T10:00:45.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 -- start start 2023-12-07T10:00:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc980a86d0 0x7fcc980a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc98156600 0x7fcc9814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc98152d90 con 0x7fcc9814fb30 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9814ffa0 con 0x7fcc98156600 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc9dbb8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc98152480 con 0x7fcc980a86d0 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.272+0000 7fcc96ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc98156600 0x7fcc9814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc98156600 0x7fcc9814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46682/0 (socket says 172.21.15.89:46682) 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 -- 172.21.15.89:0/2606317801 learned_addr learned my addr 172.21.15.89:0/2606317801 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc977fe640 1 --2- 172.21.15.89:0/2606317801 >> v2:172.21.15.97:3300/0 conn(0x7fcc980a86d0 0x7fcc980a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 -- 172.21.15.89:0/2606317801 >> v2:172.21.15.97:3300/0 conn(0x7fcc980a86d0 msgr2=0x7fcc980a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 --2- 172.21.15.89:0/2606317801 >> v2:172.21.15.97:3300/0 conn(0x7fcc980a86d0 0x7fcc980a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 -- 172.21.15.89:0/2606317801 >> v1:172.21.15.97:6789/0 conn(0x7fcc9814fb30 legacy=0x7fcc980aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 -- 172.21.15.89:0/2606317801 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980a9760 con 0x7fcc98156600 2023-12-07T10:00:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc977fe640 1 --2- 172.21.15.89:0/2606317801 >> v2:172.21.15.97:3300/0 conn(0x7fcc980a86d0 0x7fcc980a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc96ffd640 1 --2- 172.21.15.89:0/2606317801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc9814f5f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009870 tx=0x7fcc8c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8152ffaedb00928 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc967fc640 1 -- 172.21.15.89:0/2606317801 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c0ac410 con 0x7fcc98156600 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc967fc640 1 -- 172.21.15.89:0/2606317801 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c0ac570 con 0x7fcc98156600 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.276+0000 7fcc967fc640 1 -- 172.21.15.89:0/2606317801 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c0ac900 con 0x7fcc98156600 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/2606317801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 msgr2=0x7fcc9814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/2606317801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc9814f5f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009870 tx=0x7fcc8c01c4c0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/2606317801 shutdown_connections 2023-12-07T10:00:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/2606317801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc9814f5f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/2606317801 >> v2:172.21.15.97:3300/0 conn(0x7fcc980a86d0 0x7fcc980a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/2606317801 >> 172.21.15.89:0/2606317801 conn(0x7fcc980c2a60 msgr2=0x7fcc980c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/2606317801 shutdown_connections 2023-12-07T10:00:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/2606317801 wait complete. 2023-12-07T10:00:45.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 Processor -- start 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- start start 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc980a86d0 0x7fcc980bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9814fb30 0x7fcc98154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc98154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981eda00 con 0x7fcc98156600 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981414b0 con 0x7fcc9814fb30 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc9dbb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981ecb90 con 0x7fcc980a86d0 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc98154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc98154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46696/0 (socket says 172.21.15.89:46696) 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 -- 172.21.15.89:0/3125870649 learned_addr learned my addr 172.21.15.89:0/3125870649 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc96ffd640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9814fb30 0x7fcc98154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc977fe640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc980a86d0 0x7fcc980bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 -- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc980a86d0 msgr2=0x7fcc980bb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc980a86d0 0x7fcc980bb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 -- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9814fb30 msgr2=0x7fcc98154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9814fb30 0x7fcc98154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.280+0000 7fcc97fff640 1 -- 172.21.15.89:0/3125870649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0094d0 con 0x7fcc98156600 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc97fff640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc98154ff0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c780 tx=0x7fcc9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90004b70 con 0x7fcc98156600 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9000ce90 con 0x7fcc98156600 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000a850 con 0x7fcc98156600 2023-12-07T10:00:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc981ecd80 con 0x7fcc98156600 2023-12-07T10:00:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc981ed620 con 0x7fcc98156600 2023-12-07T10:00:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9804e890 con 0x7fcc98156600 2023-12-07T10:00:45.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc9000a9b0 con 0x7fcc98156600 2023-12-07T10:00:45.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc7ffff640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc840668d0 0x7fcc84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcc900841f0 con 0x7fcc98156600 2023-12-07T10:00:45.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.284+0000 7fcc977fe640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc840668d0 0x7fcc84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.288+0000 7fcc977fe640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc840668d0 0x7fcc84068d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:45.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.288+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc90051770 con 0x7fcc98156600 2023-12-07T10:00:45.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.440+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc98067650 con 0x7fcc98156600 2023-12-07T10:00:45.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.440+0000 7fcc7ffff640 1 -- 172.21.15.89:0/3125870649 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc90054d90 con 0x7fcc98156600 2023-12-07T10:00:45.448 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc840668d0 msgr2=0x7fcc84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc840668d0 0x7fcc84068d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88008040 comp rx=0 tx=0).stop 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 msgr2=0x7fcc98154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc98154ff0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c780 tx=0x7fcc9000cc40 comp rx=0 tx=0).stop 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 shutdown_connections 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc98156600 0x7fcc98154ff0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9814fb30 0x7fcc98154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc840668d0 0x7fcc84068d90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 --2- 172.21.15.89:0/3125870649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc980a86d0 0x7fcc980bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 >> 172.21.15.89:0/3125870649 conn(0x7fcc980c2a60 msgr2=0x7fcc980c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 shutdown_connections 2023-12-07T10:00:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.444+0000 7fcc9dbb8640 1 -- 172.21.15.89:0/3125870649 wait complete. 2023-12-07T10:00:45.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-07T10:00:45.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.600+0000 7fedfabdf640 1 Processor -- start 2023-12-07T10:00:45.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.600+0000 7fedfabdf640 1 -- start start 2023-12-07T10:00:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.600+0000 7fedfabdf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedf41587c0 0x7fedf406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.600+0000 7fedfabdf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf406e280 con 0x7fedf4155360 2023-12-07T10:00:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.600+0000 7fedfabdf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf40c1bd0 con 0x7fedf406e7c0 2023-12-07T10:00:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.600+0000 7fedfabdf640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf40c2150 con 0x7fedf41587c0 2023-12-07T10:00:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf897b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fedf4155360 0x7fedf406b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33886/0 (socket says 172.21.15.89:33886) 2023-12-07T10:00:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf897b640 1 -- 172.21.15.89:0/3104661253 learned_addr learned my addr 172.21.15.89:0/3104661253 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf917c640 1 --2- 172.21.15.89:0/3104661253 >> v2:172.21.15.97:3300/0 conn(0x7fedf41587c0 0x7fedf406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423955500 0 0) 0x7fedf406e280 con 0x7fedf4155360 2023-12-07T10:00:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede4003530 con 0x7fedf4155360 2023-12-07T10:00:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442003656 0 0) 0x7fede4003530 con 0x7fedf4155360 2023-12-07T10:00:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 >> v2:172.21.15.97:3300/0 conn(0x7fedf41587c0 msgr2=0x7fedf406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 --2- 172.21.15.89:0/3104661253 >> v2:172.21.15.97:3300/0 conn(0x7fedf41587c0 0x7fedf406ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 >> v1:172.21.15.97:6789/0 conn(0x7fedf406e7c0 legacy=0x7fedf41580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40c4c40 con 0x7fedf4155360 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fede8001680 con 0x7fedf4155360 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 >> v1:172.21.15.89:6789/0 conn(0x7fedf4155360 legacy=0x7fedf406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede4003980 0x7fede4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fede4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4005190 0x7fede400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40c2150 con 0x7fede40047d0 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede400c130 con 0x7fede4005190 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede400c2f0 con 0x7fede4003980 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf3fff640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fede4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf917c640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4005190 0x7fede400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf897b640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede4003980 0x7fede4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf3fff640 1 -- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede4003980 msgr2=0x7fede4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:45.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf3fff640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fede4003980 0x7fede4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf3fff640 1 -- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4005190 msgr2=0x7fede400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:45.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf3fff640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4005190 0x7fede400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf3fff640 1 -- 172.21.15.89:0/3104661253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4003530 con 0x7fede40047d0 2023-12-07T10:00:45.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf917c640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede4005190 0x7fede400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:45.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.604+0000 7fedf917c640 1 -- 172.21.15.89:0/3104661253 reap_dead start 2023-12-07T10:00:45.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedf3fff640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fede4004c50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fede0001780 tx=0x7fede001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb02a96aeb7a4bf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:45.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede00a4ea0 con 0x7fede40047d0 2023-12-07T10:00:45.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00a7050 con 0x7fede40047d0 2023-12-07T10:00:45.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedf37fe640 1 -- 172.21.15.89:0/3104661253 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0003600 con 0x7fede40047d0 2023-12-07T10:00:45.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 -- 172.21.15.89:0/3104661253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 msgr2=0x7fede4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fede4004c50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fede0001780 tx=0x7fede001c3e0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 -- 172.21.15.89:0/3104661253 shutdown_connections 2023-12-07T10:00:45.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 --2- 172.21.15.89:0/3104661253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fede4004c50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 -- 172.21.15.89:0/3104661253 >> 172.21.15.89:0/3104661253 conn(0x7fedf40c3240 msgr2=0x7fedf40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:45.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 -- 172.21.15.89:0/3104661253 shutdown_connections 2023-12-07T10:00:45.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 -- 172.21.15.89:0/3104661253 wait complete. 2023-12-07T10:00:45.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 Processor -- start 2023-12-07T10:00:45.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.608+0000 7fedfabdf640 1 -- start start 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fedf40aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedf40a9b20 0x7fedf4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedf4071740 0x7fedf41f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4151f80 con 0x7fede40047d0 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4070a90 con 0x7fedf4071740 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4070d70 con 0x7fedf40a9b20 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fedf40aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fedf40aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46708/0 (socket says 172.21.15.89:46708) 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 -- 172.21.15.89:0/1286935135 learned_addr learned my addr 172.21.15.89:0/1286935135 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf3fff640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedf40a9b20 0x7fedf4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 -- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedf40a9b20 msgr2=0x7fedf4071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedf40a9b20 0x7fedf4071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 -- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedf4071740 msgr2=0x7fedf41f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:45.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedf4071740 0x7fedf41f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:45.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 -- 172.21.15.89:0/1286935135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40ab3c0 con 0x7fede40047d0 2023-12-07T10:00:45.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf897b640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fedf40aae80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fede800e7b0 tx=0x7fede800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800ee60 con 0x7fede40047d0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede800c850 con 0x7fede40047d0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf40727c0 con 0x7fede40047d0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800cc00 con 0x7fede40047d0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4072a60 con 0x7fede40047d0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf404e890 con 0x7fede40047d0 2023-12-07T10:00:45.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.612+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fede801d460 con 0x7fede40047d0 2023-12-07T10:00:45.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.616+0000 7fedf17fa640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fedd8066900 0x7fedd8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:45.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.616+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fede8083ff0 con 0x7fede40047d0 2023-12-07T10:00:45.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.616+0000 7fedf3fff640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fedd8066900 0x7fedd8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:45.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.616+0000 7fedf3fff640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fedd8066900 0x7fedd8068dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fede0001750 tx=0x7fede00011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:45.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.620+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fede8051520 con 0x7fede40047d0 2023-12-07T10:00:45.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:45.820+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fedf40c4780 con 0x7fede40047d0 2023-12-07T10:00:46.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.784+0000 7fedf17fa640 1 -- 172.21.15.89:0/1286935135 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v115) v1 ==== 187+0+0 (secure 0 0 0) 0x7fede8054b40 con 0x7fede40047d0 2023-12-07T10:00:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fedd8066900 msgr2=0x7fedd8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fedd8066900 0x7fedd8068dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fede0001750 tx=0x7fede00011a0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 msgr2=0x7fedf40aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fedf40aae80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fede800e7b0 tx=0x7fede800ec70 comp rx=0 tx=0).stop 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 shutdown_connections 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedf4071740 0x7fedf41f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fedd8066900 0x7fedd8068dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedf40a9b20 0x7fedf4071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 --2- 172.21.15.89:0/1286935135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fede40047d0 0x7fedf40aae80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 >> 172.21.15.89:0/1286935135 conn(0x7fedf40c3240 msgr2=0x7fedf40bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 shutdown_connections 2023-12-07T10:00:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.788+0000 7fedfabdf640 1 -- 172.21.15.89:0/1286935135 wait complete. 2023-12-07T10:00:46.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-07T10:00:46.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 Processor -- start 2023-12-07T10:00:46.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 -- start start 2023-12-07T10:00:46.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 0x7f4a841543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4a840700f0 0x7f4a84070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a84154920 con 0x7f4a8406df30 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a840a8710 con 0x7f4a840700f0 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a8a2bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84071be0 con 0x7f4a84154000 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a88858640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4a8406df30 0x7f4a840714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33892/0 (socket says 172.21.15.89:33892) 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a88858640 1 -- 172.21.15.89:0/1448614106 learned_addr learned my addr 172.21.15.89:0/1448614106 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a837fe640 1 --2- 172.21.15.89:0/1448614106 >> v2:172.21.15.97:3300/0 conn(0x7f4a840700f0 0x7f4a84070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a83fff640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 0x7f4a841543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798111448 0 0) 0x7f4a84154920 con 0x7f4a8406df30 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c004640 con 0x7f4a8406df30 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3531116452 0 0) 0x7f4a6c004640 con 0x7f4a8406df30 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 msgr2=0x7f4a841543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 0x7f4a841543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 >> v2:172.21.15.97:3300/0 conn(0x7f4a840700f0 msgr2=0x7f4a84070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 --2- 172.21.15.89:0/1448614106 >> v2:172.21.15.97:3300/0 conn(0x7f4a840700f0 0x7f4a84070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a84154b90 con 0x7f4a8406df30 2023-12-07T10:00:46.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f4a7c001a00 con 0x7f4a8406df30 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 >> v1:172.21.15.89:6789/0 conn(0x7f4a8406df30 legacy=0x7f4a840714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a6c004a90 0x7f4a6c004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 0x7f4a6c0058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c005e20 0x7f4a6c0062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84071be0 con 0x7f4a6c005e20 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00caf0 con 0x7f4a6c004a90 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00ccb0 con 0x7f4a84154000 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.956+0000 7f4a88858640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c005e20 0x7f4a6c0062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a83fff640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a6c004a90 0x7f4a6c004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a837fe640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 0x7f4a6c0058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a88858640 1 -- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 msgr2=0x7f4a6c0058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a88858640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a84154000 0x7f4a6c0058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a88858640 1 -- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a6c004a90 msgr2=0x7f4a6c004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:46.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a88858640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a6c004a90 0x7f4a6c004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a88858640 1 -- 172.21.15.89:0/1448614106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c004640 con 0x7f4a6c005e20 2023-12-07T10:00:46.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a88858640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c005e20 0x7f4a6c0062a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00a780 tx=0x7f4a7c01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe38ca5e8c05ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:46.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0ad630 con 0x7f4a6c005e20 2023-12-07T10:00:46.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c0a8070 con 0x7f4a6c005e20 2023-12-07T10:00:46.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.960+0000 7f4a82ffd640 1 -- 172.21.15.89:0/1448614106 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0ad9d0 con 0x7f4a6c005e20 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/1448614106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c005e20 msgr2=0x7f4a6c0062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/1448614106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a6c005e20 0x7f4a6c0062a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00a780 tx=0x7f4a7c01d280 comp rx=0 tx=0).stop 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 -- 172.21.15.89:0/1448614106 reap_dead start 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/1448614106 shutdown_connections 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/1448614106 >> 172.21.15.89:0/1448614106 conn(0x7f4a840c2a60 msgr2=0x7f4a840c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/1448614106 shutdown_connections 2023-12-07T10:00:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/1448614106 wait complete. 2023-12-07T10:00:46.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 Processor -- start 2023-12-07T10:00:46.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- start start 2023-12-07T10:00:46.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a6c005e20 0x7f4a84159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a84147a90 0x7f4a841ebc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 0x7f4a84148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841ec630 con 0x7f4a841ec1b0 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840c50d0 con 0x7f4a84147a90 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a8a2bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840c4910 con 0x7f4a6c005e20 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 0x7f4a84148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 0x7f4a84148be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46732/0 (socket says 172.21.15.89:46732) 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 -- 172.21.15.89:0/286293598 learned_addr learned my addr 172.21.15.89:0/286293598 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a837fe640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a84147a90 0x7f4a841ebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a83fff640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a6c005e20 0x7f4a84159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 -- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a6c005e20 msgr2=0x7f4a84159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:46.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a6c005e20 0x7f4a84159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 -- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a84147a90 msgr2=0x7f4a841ebc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a84147a90 0x7f4a841ebc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a88858640 1 -- 172.21.15.89:0/286293598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a841ec820 con 0x7f4a841ec1b0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.964+0000 7f4a83fff640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a6c005e20 0x7f4a84159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a88858640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 0x7f4a84148be0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c01d0b0 tx=0x7f4a6c006910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c001940 con 0x7f4a841ec1b0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c001f40 con 0x7f4a841ec1b0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a840c4bb0 con 0x7f4a841ec1b0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c004d70 con 0x7f4a841ec1b0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a84151730 con 0x7f4a841ec1b0 2023-12-07T10:00:46.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8404e890 con 0x7f4a841ec1b0 2023-12-07T10:00:46.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4a7c0aa030 con 0x7f4a841ec1b0 2023-12-07T10:00:46.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a80ff9640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4a70066900 0x7f4a70068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:46.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4a7c11de80 con 0x7f4a841ec1b0 2023-12-07T10:00:46.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.968+0000 7f4a83fff640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4a70066900 0x7f4a70068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:46.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.972+0000 7f4a83fff640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4a70066900 0x7f4a70068dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009be0 tx=0x7f4a74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:46.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:46.972+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a7c0eb350 con 0x7f4a841ec1b0 2023-12-07T10:00:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.124+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4a840c25f0 con 0x7f4a841ec1b0 2023-12-07T10:00:47.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.128+0000 7f4a80ff9640 1 -- 172.21.15.89:0/286293598 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a7c0ee970 con 0x7f4a841ec1b0 2023-12-07T10:00:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4a70066900 msgr2=0x7f4a70068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4a70066900 0x7f4a70068dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009be0 tx=0x7f4a74008040 comp rx=0 tx=0).stop 2023-12-07T10:00:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 msgr2=0x7f4a84148be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 0x7f4a84148be0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c01d0b0 tx=0x7f4a6c006910 comp rx=0 tx=0).stop 2023-12-07T10:00:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 shutdown_connections 2023-12-07T10:00:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a841ec1b0 0x7f4a84148be0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a84147a90 0x7f4a841ebc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4a70066900 0x7f4a70068dc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 --2- 172.21.15.89:0/286293598 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4a6c005e20 0x7f4a84159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 >> 172.21.15.89:0/286293598 conn(0x7f4a840c2a60 msgr2=0x7f4a8414d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 shutdown_connections 2023-12-07T10:00:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.132+0000 7f4a8a2bb640 1 -- 172.21.15.89:0/286293598 wait complete. 2023-12-07T10:00:47.156 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T10:00:47.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:00:47.235 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:00:47.315 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T10:00:47.316 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:00:47.316 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:47.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:00:47.325 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:00:47.325 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:00:47.334 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:00:47.334 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-07T10:00:47.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:47.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.500+0000 7feece6d6640 1 Processor -- start 2023-12-07T10:00:47.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feece6d6640 1 -- start start 2023-12-07T10:00:47.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feece6d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec80bd720 0x7feec8158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feece6d6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec8155790 con 0x7feec806cd90 2023-12-07T10:00:47.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feece6d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec80c4b00 con 0x7feec80ca610 2023-12-07T10:00:47.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feece6d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80c4de0 con 0x7feec80bd720 2023-12-07T10:00:47.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feec77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec80bd720 0x7feec8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feeccc73640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7feec806cd90 0x7feec80c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33908/0 (socket says 172.21.15.89:33908) 2023-12-07T10:00:47.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feeccc73640 1 -- 172.21.15.89:0/3713671308 learned_addr learned my addr 172.21.15.89:0/3713671308 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:47.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feec77fe640 1 -- 172.21.15.89:0/3713671308 >> v1:172.21.15.97:6789/0 conn(0x7feec80ca610 legacy=0x7feec80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feec77fe640 1 -- 172.21.15.89:0/3713671308 >> v1:172.21.15.89:6789/0 conn(0x7feec806cd90 legacy=0x7feec80c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feec77fe640 1 -- 172.21.15.89:0/3713671308 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8157e30 con 0x7feec80bd720 2023-12-07T10:00:47.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.504+0000 7feec6ffd640 1 -- 172.21.15.89:0/3713671308 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844244245 0 0) 0x7feec8155790 con 0x7feec806cd90 2023-12-07T10:00:47.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feec77fe640 1 --2- 172.21.15.89:0/3713671308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec80bd720 0x7feec8158350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feebc0097c0 tx=0x7feebc01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f17d889f0ee302 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:47.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feec6ffd640 1 -- 172.21.15.89:0/3713671308 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80c52d0 con 0x7feec80bd720 2023-12-07T10:00:47.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feec6ffd640 1 -- 172.21.15.89:0/3713671308 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc0a4840 con 0x7feec80bd720 2023-12-07T10:00:47.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feec6ffd640 1 -- 172.21.15.89:0/3713671308 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc0a4bd0 con 0x7feec80bd720 2023-12-07T10:00:47.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 -- 172.21.15.89:0/3713671308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec80bd720 msgr2=0x7feec8158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 --2- 172.21.15.89:0/3713671308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec80bd720 0x7feec8158350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feebc0097c0 tx=0x7feebc01c040 comp rx=0 tx=0).stop 2023-12-07T10:00:47.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 -- 172.21.15.89:0/3713671308 shutdown_connections 2023-12-07T10:00:47.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 --2- 172.21.15.89:0/3713671308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec80bd720 0x7feec8158350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 -- 172.21.15.89:0/3713671308 >> 172.21.15.89:0/3713671308 conn(0x7feec8071ea0 msgr2=0x7feec80722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:47.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 -- 172.21.15.89:0/3713671308 shutdown_connections 2023-12-07T10:00:47.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 -- 172.21.15.89:0/3713671308 wait complete. 2023-12-07T10:00:47.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 Processor -- start 2023-12-07T10:00:47.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.508+0000 7feece6d6640 1 -- start start 2023-12-07T10:00:47.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 0x7feec814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feec80bd720 0x7feec80aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feec80ca610 0x7feec81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec814ace0 con 0x7feec806cd90 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8150970 con 0x7feec80bd720 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec80aaec0 con 0x7feec80ca610 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 0x7feec814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 0x7feec814a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46736/0 (socket says 172.21.15.89:46736) 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 -- 172.21.15.89:0/2767951923 learned_addr learned my addr 172.21.15.89:0/2767951923 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feeccc73640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feec80ca610 0x7feec81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec77fe640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feec80bd720 0x7feec80aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 -- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feec80ca610 msgr2=0x7feec81538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feec80ca610 0x7feec81538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 -- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feec80bd720 msgr2=0x7feec80aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feec80bd720 0x7feec80aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 -- 172.21.15.89:0/2767951923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc009420 con 0x7feec806cd90 2023-12-07T10:00:47.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec77fe640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feec80bd720 0x7feec80aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec7fff640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 0x7feec814a7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c3c0 tx=0x7feeb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80052d0 con 0x7feec806cd90 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8005430 con 0x7feec806cd90 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec81511d0 con 0x7feec806cd90 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8003840 con 0x7feec806cd90 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec8150b80 con 0x7feec806cd90 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec8151e00 con 0x7feec806cd90 2023-12-07T10:00:47.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.512+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feeb80039a0 con 0x7feec806cd90 2023-12-07T10:00:47.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.516+0000 7feec4ff9640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feeb40668d0 0x7feeb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.516+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7feeb8083760 con 0x7feec806cd90 2023-12-07T10:00:47.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.516+0000 7feec77fe640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feeb40668d0 0x7feeb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.516+0000 7feec77fe640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feeb40668d0 0x7feeb4068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feebc0ae000 tx=0x7feebc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:47.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.520+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feeb8050ba0 con 0x7feec806cd90 2023-12-07T10:00:47.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feec804e890 con 0x7feec806cd90 2023-12-07T10:00:47.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feec4ff9640 1 -- 172.21.15.89:0/2767951923 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3693 (secure 0 0 0) 0x7feeb8017e80 con 0x7feec806cd90 2023-12-07T10:00:47.706 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:47.706 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/95101790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":95101790},{"type":"v1","addr":"172.21.15.97:6834","nonce":95101790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2163560750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2163560750},{"type":"v1","addr":"172.21.15.89:6837","nonce":2163560750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3802417913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3802417913},{"type":"v1","addr":"172.21.15.97:6835","nonce":3802417913}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3728074856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3728074856},{"type":"v1","addr":"172.21.15.89:6835","nonce":3728074856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-12-07T10:00:47.706 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 26 2023-12-07T10:00:47.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feeb40668d0 msgr2=0x7feeb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feeb40668d0 0x7feeb4068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feebc0ae000 tx=0x7feebc008040 comp rx=0 tx=0).stop 2023-12-07T10:00:47.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 msgr2=0x7feec814a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 0x7feec814a7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c3c0 tx=0x7feeb800c880 comp rx=0 tx=0).stop 2023-12-07T10:00:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 shutdown_connections 2023-12-07T10:00:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7feeb40668d0 0x7feeb4068d90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feec80ca610 0x7feec81538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feec80bd720 0x7feec80aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 --2- 172.21.15.89:0/2767951923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec806cd90 0x7feec814a7a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 >> 172.21.15.89:0/2767951923 conn(0x7feec8071ea0 msgr2=0x7feec80c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:47.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 shutdown_connections 2023-12-07T10:00:47.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.700+0000 7feece6d6640 1 -- 172.21.15.89:0/2767951923 wait complete. 2023-12-07T10:00:47.726 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-07T10:00:47.727 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-07T10:00:47.727 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-07T10:00:47.727 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:00:47.728 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-07T10:00:47.728 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-07T10:00:47.728 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-07T10:00:47.728 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:00:47.728 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-07T10:00:47.729 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-07T10:00:47.729 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-07T10:00:47.729 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:00:47.729 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-07T10:00:47.730 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-07T10:00:47.730 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-07T10:00:47.730 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:00:47.740 INFO:tasks.ceph.mds.a:Stopped 2023-12-07T10:00:47.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-07T10:00:47.741 INFO:tasks.ceph.mds.c:Stopped 2023-12-07T10:00:47.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-07T10:00:47.745 INFO:tasks.ceph.mds.b:Stopped 2023-12-07T10:00:47.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-07T10:00:47.746 INFO:tasks.ceph.mds.d:Stopped 2023-12-07T10:00:47.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-07T10:00:47.791 INFO:tasks.ceph.mds.a:Started 2023-12-07T10:00:47.791 DEBUG:teuthology.parallel:result is None 2023-12-07T10:00:47.793 INFO:tasks.ceph.mds.c:Started 2023-12-07T10:00:47.793 DEBUG:teuthology.parallel:result is None 2023-12-07T10:00:47.797 INFO:tasks.ceph.mds.b:Started 2023-12-07T10:00:47.797 DEBUG:teuthology.parallel:result is None 2023-12-07T10:00:47.800 INFO:tasks.ceph.mds.d:Started 2023-12-07T10:00:47.800 DEBUG:teuthology.parallel:result is None 2023-12-07T10:00:47.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-07T10:00:47.880 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T10:00:47.882 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-12-07T10:00:47.891 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2023-12-07T10:00:47.892 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2023-12-07T10:00:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc5481c3640 1 Processor -- start 2023-12-07T10:00:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc5481c3640 1 -- start start 2023-12-07T10:00:47.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc5481c3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc540151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc5481c3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54006d320 con 0x7fc540070b80 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc5481c3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400721b0 con 0x7fc54014e9d0 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc5481c3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400c2830 con 0x7fc5400a8470 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc54575e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc540070b80 0x7fc54006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33926/0 (socket says 172.21.15.89:33926) 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc54575e640 1 -- 172.21.15.89:0/1715010390 learned_addr learned my addr 172.21.15.89:0/1715010390 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc546760640 1 --2- 172.21.15.89:0/1715010390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc540151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705268428 0 0) 0x7fc54006d320 con 0x7fc540070b80 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc52c005740 con 0x7fc540070b80 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077887303 0 0) 0x7fc5400721b0 con 0x7fc54014e9d0 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54006d320 con 0x7fc54014e9d0 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc546760640 1 -- 172.21.15.89:0/1715010390 >> v1:172.21.15.97:6789/0 conn(0x7fc54014e9d0 legacy=0x7fc5400c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc546760640 1 -- 172.21.15.89:0/1715010390 >> v1:172.21.15.89:6789/0 conn(0x7fc540070b80 legacy=0x7fc54006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.944+0000 7fc546760640 1 -- 172.21.15.89:0/1715010390 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc540072450 con 0x7fc5400a8470 2023-12-07T10:00:47.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc546760640 1 --2- 172.21.15.89:0/1715010390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc540151e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc538009dc0 tx=0x7fc53801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7717ce9e9b9e97b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:47.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380a57b0 con 0x7fc5400a8470 2023-12-07T10:00:47.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5380a5910 con 0x7fc5400a8470 2023-12-07T10:00:47.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc544f5d640 1 -- 172.21.15.89:0/1715010390 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380a5ca0 con 0x7fc5400a8470 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 -- 172.21.15.89:0/1715010390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 msgr2=0x7fc540151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1715010390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc540151e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc538009dc0 tx=0x7fc53801c8e0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 -- 172.21.15.89:0/1715010390 shutdown_connections 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1715010390 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc540151e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 -- 172.21.15.89:0/1715010390 >> 172.21.15.89:0/1715010390 conn(0x7fc5400c2ad0 msgr2=0x7fc5400c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 -- 172.21.15.89:0/1715010390 shutdown_connections 2023-12-07T10:00:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.948+0000 7fc5481c3640 1 -- 172.21.15.89:0/1715010390 wait complete. 2023-12-07T10:00:47.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 Processor -- start 2023-12-07T10:00:47.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- start start 2023-12-07T10:00:47.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 0x7fc540151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc5401ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc54014e9d0 0x7fc5400a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540142160 con 0x7fc540070b80 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54014f8b0 con 0x7fc54014e9d0 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5401edbb0 con 0x7fc5400a8470 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 0x7fc540151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 0x7fc540151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46780/0 (socket says 172.21.15.89:46780) 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 -- 172.21.15.89:0/1032747230 learned_addr learned my addr 172.21.15.89:0/1032747230 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc54575e640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc5401ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc546760640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc54014e9d0 0x7fc5400a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 -- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 msgr2=0x7fc5401ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc5401ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 -- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc54014e9d0 msgr2=0x7fc5400a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:47.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc54014e9d0 0x7fc5400a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:47.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 -- 172.21.15.89:0/1032747230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538009a70 con 0x7fc540070b80 2023-12-07T10:00:47.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc545f5f640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 0x7fc540151090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00c490 tx=0x7fc53c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0052d0 con 0x7fc540070b80 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c005450 con 0x7fc540070b80 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5400ab760 con 0x7fc540070b80 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c003840 con 0x7fc540070b80 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54014f5d0 con 0x7fc540070b80 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.952+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc540067a40 con 0x7fc540070b80 2023-12-07T10:00:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.956+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc53c0039a0 con 0x7fc540070b80 2023-12-07T10:00:47.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.956+0000 7fc5367fc640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc5240668d0 0x7fc524068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:47.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.956+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc53c083760 con 0x7fc540070b80 2023-12-07T10:00:47.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.956+0000 7fc54575e640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc5240668d0 0x7fc524068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:47.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.956+0000 7fc54575e640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc5240668d0 0x7fc524068d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5400c06f0 tx=0x7fc530009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:47.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:47.960+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc53c050c30 con 0x7fc540070b80 2023-12-07T10:00:48.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.120+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc540150db0 con 0x7fc540070b80 2023-12-07T10:00:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.804+0000 7fc5367fc640 1 -- 172.21.15.89:0/1032747230 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc540150db0 con 0x7fc540070b80 2023-12-07T10:00:48.810 INFO:teuthology.orchestra.run.smithi089.stderr: removed all blocklist entries 2023-12-07T10:00:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc5240668d0 msgr2=0x7fc524068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc5240668d0 0x7fc524068d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5400c06f0 tx=0x7fc530009040 comp rx=0 tx=0).stop 2023-12-07T10:00:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 msgr2=0x7fc540151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 0x7fc540151090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00c490 tx=0x7fc53c00c950 comp rx=0 tx=0).stop 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 shutdown_connections 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc54014e9d0 0x7fc5400a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc5240668d0 0x7fc524068d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5400a8470 0x7fc5401ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 --2- 172.21.15.89:0/1032747230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540070b80 0x7fc540151090 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 >> 172.21.15.89:0/1032747230 conn(0x7fc5400c2ad0 msgr2=0x7fc54014cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 shutdown_connections 2023-12-07T10:00:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.808+0000 7fc5481c3640 1 -- 172.21.15.89:0/1032747230 wait complete. 2023-12-07T10:00:48.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-07T10:00:48.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 Processor -- start 2023-12-07T10:00:48.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 -- start start 2023-12-07T10:00:48.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 0x7f18d806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f18d81580b0 0x7f18d8158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d806e280 con 0x7f18d806baf0 2023-12-07T10:00:48.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80c2150 con 0x7f18d81580b0 2023-12-07T10:00:48.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18de279640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8157c60 con 0x7f18d8155360 2023-12-07T10:00:48.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d77fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f18d806baf0 0x7f18d806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33934/0 (socket says 172.21.15.89:33934) 2023-12-07T10:00:48.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d77fe640 1 -- 172.21.15.89:0/1838527689 learned_addr learned my addr 172.21.15.89:0/1838527689 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:48.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487325041 0 0) 0x7f18d806e280 con 0x7f18d806baf0 2023-12-07T10:00:48.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c0003530 con 0x7f18d806baf0 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d7fff640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 0x7f18d806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18dc816640 1 --2- 172.21.15.89:0/1838527689 >> v2:172.21.15.97:3300/0 conn(0x7f18d81580b0 0x7f18d8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967332325 0 0) 0x7f18c0003530 con 0x7f18d806baf0 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 msgr2=0x7f18d806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 0x7f18d806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 >> v2:172.21.15.97:3300/0 conn(0x7f18d81580b0 msgr2=0x7f18d8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 --2- 172.21.15.89:0/1838527689 >> v2:172.21.15.97:3300/0 conn(0x7f18d81580b0 0x7f18d8158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80c1bd0 con 0x7f18d806baf0 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f18cc001680 con 0x7f18d806baf0 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 >> v1:172.21.15.89:6789/0 conn(0x7f18d806baf0 legacy=0x7f18d806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 0x7f18c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18c0004d10 0x7f18c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c2150 con 0x7f18c0003f50 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8157c60 con 0x7f18c0004d10 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.972+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c000b990 con 0x7f18d8155360 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d7fff640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 0x7f18c0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18dc816640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18c0004d10 0x7f18c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 -- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 msgr2=0x7f18c0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:48.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8155360 0x7f18c0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 -- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18c0004d10 msgr2=0x7f18c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:48.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18c0004d10 0x7f18c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 -- 172.21.15.89:0/1838527689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0003530 con 0x7f18c0003f50 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d77fe640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18c00047d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00c190 tx=0x7f18cc01f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158d429f83ed385d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0a8d00 con 0x7f18c0003f50 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc0a8e60 con 0x7f18c0003f50 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18d6ffd640 1 -- 172.21.15.89:0/1838527689 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc005b00 con 0x7f18c0003f50 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18de279640 1 -- 172.21.15.89:0/1838527689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 msgr2=0x7f18c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18de279640 1 --2- 172.21.15.89:0/1838527689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18c00047d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00c190 tx=0x7f18cc01f2d0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.976+0000 7f18dc816640 1 -- 172.21.15.89:0/1838527689 reap_dead start 2023-12-07T10:00:48.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- 172.21.15.89:0/1838527689 shutdown_connections 2023-12-07T10:00:48.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- 172.21.15.89:0/1838527689 >> 172.21.15.89:0/1838527689 conn(0x7f18d80c3240 msgr2=0x7f18d80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:48.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- 172.21.15.89:0/1838527689 shutdown_connections 2023-12-07T10:00:48.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- 172.21.15.89:0/1838527689 wait complete. 2023-12-07T10:00:48.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 Processor -- start 2023-12-07T10:00:48.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- start start 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18d8155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8071f00 0x7f18d80a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d81ed940 0x7f18d8070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80a9830 con 0x7f18c0003f50 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81ea500 con 0x7f18d81ed940 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18de279640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81ed4b0 con 0x7f18d8071f00 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18d8155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18d8155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46794/0 (socket says 172.21.15.89:46794) 2023-12-07T10:00:48.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 -- 172.21.15.89:0/2647547424 learned_addr learned my addr 172.21.15.89:0/2647547424 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:48.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18dc816640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d81ed940 0x7f18d8070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d77fe640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8071f00 0x7f18d80a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 -- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8071f00 msgr2=0x7f18d80a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8071f00 0x7f18d80a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 -- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d81ed940 msgr2=0x7f18d8070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d81ed940 0x7f18d8070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 -- 172.21.15.89:0/2647547424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d81eaa30 con 0x7f18c0003f50 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.980+0000 7f18d7fff640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18d8155b70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f18c8011990 tx=0x7f18c8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800fad0 con 0x7f18c0003f50 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800fc30 con 0x7f18c0003f50 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8014440 con 0x7f18c0003f50 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d81ed180 con 0x7f18c0003f50 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d8155740 con 0x7f18c0003f50 2023-12-07T10:00:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8067a40 con 0x7f18c0003f50 2023-12-07T10:00:48.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f18c80145a0 con 0x7f18c0003f50 2023-12-07T10:00:48.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d4ff9640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f18c4066900 0x7f18c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:48.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f18c8084700 con 0x7f18c0003f50 2023-12-07T10:00:48.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d77fe640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f18c4066900 0x7f18c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:48.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.984+0000 7f18d77fe640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f18c4066900 0x7f18c4068dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00c160 tx=0x7f18cc001940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:48.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:48.988+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18c8051d30 con 0x7f18c0003f50 2023-12-07T10:00:49.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.188+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f18d80c4c10 con 0x7f18c0003f50 2023-12-07T10:00:49.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.188+0000 7f18d4ff9640 1 -- 172.21.15.89:0/2647547424 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f18c8022090 con 0x7f18c0003f50 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_dump": [ 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.a", 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3Flf1wcOhAACzyi07iCb6OeVrox4hSSoQ==", 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.b", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlNmS9ChAAKeb6oUGcE358orATMWlpig==", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.c", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3Fl8di0BRAA6GZD2xbIkzOykVG6rHfqew==", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:00:49.196 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.d", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3Fl/RH+ERAAAUPU8qglPPkntimRXcvGwg==", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.0", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA4l3Fl/Z3VIBAASvuI7XuDpc3FH9/P7lhsww==", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.1", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA7l3FlC/M1KBAAjwhtKGKQ/HZ6yhpOCXV0kw==", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.198 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.2", 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA+l3Fl/y6sLxAAm8pKF8kx9qUmFNUmMbFBMw==", 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.3", 2023-12-07T10:00:49.199 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBBl3Fl+0hCNxAAIVwKiVgagVbLZsm7QcynUQ==", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.4", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBIl3FlwbtwDBAAk6YFzxYayyMbAudT72sxGA==", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.5", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBLl3Flwt1OFBAAoLwAtcuFIt/FW7gisMaV/w==", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.6", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBOl3FlXhU/GhAA/4dl8x5v2OapJqCTPbYFwA==", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.201 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.7", 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBRl3FlTTKFIBAAUuR+A3irHtSU67nIRnoFug==", 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.0", 2023-12-07T10:00:49.202 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg==", 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow r", 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.1", 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA==", 2023-12-07T10:00:49.203 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow r", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.admin", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3Fl9gGkHRAABCgzAlOwroY6GO3tuPbihQ==", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.testuser", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQC3l3Fl6/iADxAA8LuRMu2019crYDu6LFmRsw==", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow rw fsname=cephfs", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow r fsname=cephfs", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.x", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3FlefecNRAAaSFdy4bxWI1FH6tFc84Hqg==", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T10:00:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.y", 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3FluC/UMRAA6hAJrSbSRn3I/3XeHlIBCQ==", 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2023-12-07T10:00:49.206 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:00:49.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f18c4066900 msgr2=0x7f18c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f18c4066900 0x7f18c4068dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00c160 tx=0x7f18cc001940 comp rx=0 tx=0).stop 2023-12-07T10:00:49.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 msgr2=0x7f18d8155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18d8155b70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f18c8011990 tx=0x7f18c8011e50 comp rx=0 tx=0).stop 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 shutdown_connections 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18d81ed940 0x7f18d8070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f18c4066900 0x7f18c4068dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18d8071f00 0x7f18d80a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 --2- 172.21.15.89:0/2647547424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18c0003f50 0x7f18d8155b70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 >> 172.21.15.89:0/2647547424 conn(0x7f18d80c3240 msgr2=0x7f18d806eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 shutdown_connections 2023-12-07T10:00:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.192+0000 7f18de279640 1 -- 172.21.15.89:0/2647547424 wait complete. 2023-12-07T10:00:49.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-07T10:00:49.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 Processor -- start 2023-12-07T10:00:49.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 -- start start 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec1c0ca610 0x7fec1c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec1c0bd720 0x7fec1c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c06cd90 0x7fec1c158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c155790 con 0x7fec1c0ca610 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0c4b00 con 0x7fec1c0bd720 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec2331d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c4de0 con 0x7fec1c06cd90 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec1c0ca610 0x7fec1c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec1c0ca610 0x7fec1c0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46808/0 (socket says 172.21.15.89:46808) 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 -- 172.21.15.89:0/1612924543 learned_addr learned my addr 172.21.15.89:0/1612924543 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec218ba640 1 --2- 172.21.15.89:0/1612924543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c06cd90 0x7fec1c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec208b8640 1 --2- 172.21.15.89:0/1612924543 >> v2:172.21.15.97:3300/0 conn(0x7fec1c0bd720 0x7fec1c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 -- 172.21.15.89:0/1612924543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c06cd90 msgr2=0x7fec1c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:49.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 --2- 172.21.15.89:0/1612924543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c06cd90 0x7fec1c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 -- 172.21.15.89:0/1612924543 >> v2:172.21.15.97:3300/0 conn(0x7fec1c0bd720 msgr2=0x7fec1c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:49.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 --2- 172.21.15.89:0/1612924543 >> v2:172.21.15.97:3300/0 conn(0x7fec1c0bd720 0x7fec1c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec210b9640 1 -- 172.21.15.89:0/1612924543 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c157e30 con 0x7fec1c0ca610 2023-12-07T10:00:49.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.348+0000 7fec208b8640 1 --2- 172.21.15.89:0/1612924543 >> v2:172.21.15.97:3300/0 conn(0x7fec1c0bd720 0x7fec1c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:49.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec210b9640 1 --2- 172.21.15.89:0/1612924543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c0ca610 0x7fec1c0c94c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0ca380 tx=0x7fec1801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1152394c1516c763 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:49.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec13fff640 1 -- 172.21.15.89:0/1612924543 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0c52d0 con 0x7fec1c0ca610 2023-12-07T10:00:49.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec13fff640 1 -- 172.21.15.89:0/1612924543 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec180a4880 con 0x7fec1c0ca610 2023-12-07T10:00:49.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec13fff640 1 -- 172.21.15.89:0/1612924543 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180a4c10 con 0x7fec1c0ca610 2023-12-07T10:00:49.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 -- 172.21.15.89:0/1612924543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c0ca610 msgr2=0x7fec1c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 --2- 172.21.15.89:0/1612924543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c0ca610 0x7fec1c0c94c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0ca380 tx=0x7fec1801c0c0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 -- 172.21.15.89:0/1612924543 shutdown_connections 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 --2- 172.21.15.89:0/1612924543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c06cd90 0x7fec1c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 --2- 172.21.15.89:0/1612924543 >> v2:172.21.15.97:3300/0 conn(0x7fec1c0bd720 0x7fec1c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 --2- 172.21.15.89:0/1612924543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c0ca610 0x7fec1c0c94c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 -- 172.21.15.89:0/1612924543 >> 172.21.15.89:0/1612924543 conn(0x7fec1c071ea0 msgr2=0x7fec1c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 -- 172.21.15.89:0/1612924543 shutdown_connections 2023-12-07T10:00:49.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.352+0000 7fec2331d640 1 -- 172.21.15.89:0/1612924543 wait complete. 2023-12-07T10:00:49.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 Processor -- start 2023-12-07T10:00:49.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 -- start start 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 0x7fec1c14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c0bd720 0x7fec1c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec1c0ca610 0x7fec1c1f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c14e0 con 0x7fec1c06cd90 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c151380 con 0x7fec1c0ca610 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c14daf0 con 0x7fec1c0bd720 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 0x7fec1c14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 0x7fec1c14d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46816/0 (socket says 172.21.15.89:46816) 2023-12-07T10:00:49.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 -- 172.21.15.89:0/3175228694 learned_addr learned my addr 172.21.15.89:0/3175228694 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 -- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c0bd720 msgr2=0x7fec1c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec208b8640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c0bd720 0x7fec1c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec218ba640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec1c0ca610 0x7fec1c1f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c0bd720 0x7fec1c14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 -- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec1c0ca610 msgr2=0x7fec1c1f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec1c0ca610 0x7fec1c1f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 -- 172.21.15.89:0/3175228694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180094d0 con 0x7fec1c06cd90 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec218ba640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec1c0ca610 0x7fec1c1f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec208b8640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c0bd720 0x7fec1c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec210b9640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 0x7fec1c14d070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fec180af040 tx=0x7fec18019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180b7670 con 0x7fec1c06cd90 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec180b77f0 con 0x7fec1c06cd90 2023-12-07T10:00:49.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180b7ba0 con 0x7fec1c06cd90 2023-12-07T10:00:49.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c151620 con 0x7fec1c06cd90 2023-12-07T10:00:49.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.356+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0c16f0 con 0x7fec1c06cd90 2023-12-07T10:00:49.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.360+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c151ad0 con 0x7fec1c06cd90 2023-12-07T10:00:49.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.360+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fec180b3070 con 0x7fec1c06cd90 2023-12-07T10:00:49.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.360+0000 7fec11ffb640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fec00066900 0x7fec00068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.360+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec1c0cac00 con 0x7fec1c06cd90 2023-12-07T10:00:49.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.360+0000 7fec208b8640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fec00066900 0x7fec00068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.360+0000 7fec208b8640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fec00066900 0x7fec00068dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fec1c157d80 tx=0x7fec0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:49.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.364+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec180eb230 con 0x7fec1c06cd90 2023-12-07T10:00:49.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.568+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fec1c0c18e0 con 0x7fec1c06cd90 2023-12-07T10:00:49.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.568+0000 7fec11ffb640 1 -- 172.21.15.89:0/3175228694 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7fec180b1090 con 0x7fec1c06cd90 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fec00066900 msgr2=0x7fec00068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fec00066900 0x7fec00068dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fec1c157d80 tx=0x7fec0c008040 comp rx=0 tx=0).stop 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 msgr2=0x7fec1c14d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 0x7fec1c14d070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fec180af040 tx=0x7fec18019180 comp rx=0 tx=0).stop 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 shutdown_connections 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec1c0ca610 0x7fec1c1f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fec00066900 0x7fec00068dc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec1c0bd720 0x7fec1c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 --2- 172.21.15.89:0/3175228694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1c06cd90 0x7fec1c14d070 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 >> 172.21.15.89:0/3175228694 conn(0x7fec1c071ea0 msgr2=0x7fec1c0c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 shutdown_connections 2023-12-07T10:00:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.572+0000 7fec2331d640 1 -- 172.21.15.89:0/3175228694 wait complete. 2023-12-07T10:00:49.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:49.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba8c32640 1 Processor -- start 2023-12-07T10:00:49.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba8c32640 1 -- start start 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba8c32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcba40c0c20 0x7fcba40c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba8c32640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba41551d0 con 0x7fcba406a5a0 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba8c32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba4072840 con 0x7fcba40c1ae0 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba8c32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba406e9c0 con 0x7fcba40c0c20 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcba406a5a0 0x7fcba40c0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47062/0 (socket says 172.21.15.89:47062) 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba259c640 1 -- 172.21.15.89:0/879715250 learned_addr learned my addr 172.21.15.89:0/879715250 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba2d9d640 1 --2- 172.21.15.89:0/879715250 >> v2:172.21.15.97:3300/0 conn(0x7fcba40c0c20 0x7fcba40c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538129828 0 0) 0x7fcba41551d0 con 0x7fcba406a5a0 2023-12-07T10:00:49.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb8c003530 con 0x7fcba406a5a0 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265319979 0 0) 0x7fcb8c003530 con 0x7fcba406a5a0 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 >> v2:172.21.15.97:3300/0 conn(0x7fcba40c0c20 msgr2=0x7fcba40c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 --2- 172.21.15.89:0/879715250 >> v2:172.21.15.97:3300/0 conn(0x7fcba40c0c20 0x7fcba40c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 >> v1:172.21.15.97:6789/0 conn(0x7fcba40c1ae0 legacy=0x7fcba415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4072560 con 0x7fcba406a5a0 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fcb94001a00 con 0x7fcba406a5a0 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 >> v1:172.21.15.89:6789/0 conn(0x7fcba406a5a0 legacy=0x7fcba40c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb8c003980 0x7fcb8c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcb8c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8c005050 0x7fcb8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba406e9c0 con 0x7fcb8c004380 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c00bfb0 con 0x7fcb8c003980 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c00c170 con 0x7fcb8c005050 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcb8c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.728+0000 7fcba259c640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb8c003980 0x7fcb8c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba2d9d640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8c005050 0x7fcb8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba1d9b640 1 -- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8c005050 msgr2=0x7fcb8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8c005050 0x7fcb8c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba1d9b640 1 -- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb8c003980 msgr2=0x7fcb8c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb8c003980 0x7fcb8c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba1d9b640 1 -- 172.21.15.89:0/879715250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c003530 con 0x7fcb8c004380 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba2d9d640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8c005050 0x7fcb8c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:49.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba2d9d640 1 -- 172.21.15.89:0/879715250 reap_dead start 2023-12-07T10:00:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcb8c004850 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcb98001910 tx=0x7fcb9801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c99b4e44c0151ab server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb980a88b0 con 0x7fcb8c004380 2023-12-07T10:00:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb980a8a30 con 0x7fcb8c004380 2023-12-07T10:00:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba159a640 1 -- 172.21.15.89:0/879715250 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb980a8de0 con 0x7fcb8c004380 2023-12-07T10:00:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba8c32640 1 -- 172.21.15.89:0/879715250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 msgr2=0x7fcb8c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.732+0000 7fcba8c32640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcb8c004850 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcb98001910 tx=0x7fcb9801ec90 comp rx=0 tx=0).stop 2023-12-07T10:00:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- 172.21.15.89:0/879715250 shutdown_connections 2023-12-07T10:00:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 --2- 172.21.15.89:0/879715250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcb8c004850 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- 172.21.15.89:0/879715250 >> 172.21.15.89:0/879715250 conn(0x7fcba40c3be0 msgr2=0x7fcba40c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- 172.21.15.89:0/879715250 shutdown_connections 2023-12-07T10:00:49.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- 172.21.15.89:0/879715250 wait complete. 2023-12-07T10:00:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 Processor -- start 2023-12-07T10:00:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- start start 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcba41560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcba4158810 0x7fcba41ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcba40c5780 0x7fcba414bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4157320 con 0x7fcb8c004380 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4155b50 con 0x7fcba4158810 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba8c32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41ee3a0 con 0x7fcba40c5780 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcba41560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcba41560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57630/0 (socket says 172.21.15.89:57630) 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 -- 172.21.15.89:0/2347768753 learned_addr learned my addr 172.21.15.89:0/2347768753 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcba4158810 0x7fcba41ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba2d9d640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcba40c5780 0x7fcba414bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 -- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcba40c5780 msgr2=0x7fcba414bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcba40c5780 0x7fcba414bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 -- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcba4158810 msgr2=0x7fcba41ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcba4158810 0x7fcba41ede60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 -- 172.21.15.89:0/2347768753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4155df0 con 0x7fcb8c004380 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba2d9d640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcba40c5780 0x7fcba414bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.736+0000 7fcba259c640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcba41560d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcb940079a0 tx=0x7fcb9400a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007a90 con 0x7fcb8c004380 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb940133f0 con 0x7fcb8c004380 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba41ed660 con 0x7fcb8c004380 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb940137a0 con 0x7fcb8c004380 2023-12-07T10:00:49.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba414c2c0 con 0x7fcb8c004380 2023-12-07T10:00:49.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba4067a40 con 0x7fcb8c004380 2023-12-07T10:00:49.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb94013900 con 0x7fcb8c004380 2023-12-07T10:00:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcb92ffd640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb840668d0 0x7fcb84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb94084d20 con 0x7fcb8c004380 2023-12-07T10:00:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.740+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb840668d0 0x7fcb84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.744+0000 7fcba1d9b640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb840668d0 0x7fcb84068d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcb980b2000 tx=0x7fcb98001330 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:49.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.744+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb94052180 con 0x7fcb8c004380 2023-12-07T10:00:49.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.896+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcba41ed4c0 con 0x7fcb8c004380 2023-12-07T10:00:49.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcb92ffd640 1 -- 172.21.15.89:0/2347768753 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fcba41ed4c0 con 0x7fcb8c004380 2023-12-07T10:00:49.905 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:49.905 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":45,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:48.818953+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb840668d0 msgr2=0x7fcb84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb840668d0 0x7fcb84068d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcb980b2000 tx=0x7fcb98001330 comp rx=0 tx=0).stop 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 msgr2=0x7fcba41560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcba41560d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcb940079a0 tx=0x7fcb9400a6a0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 shutdown_connections 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb840668d0 0x7fcb84068d90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcba40c5780 0x7fcba414bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcba4158810 0x7fcba41ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 --2- 172.21.15.89:0/2347768753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb8c004380 0x7fcba41560d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 >> 172.21.15.89:0/2347768753 conn(0x7fcba40c3be0 msgr2=0x7fcba406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:49.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 shutdown_connections 2023-12-07T10:00:49.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:49.900+0000 7fcba8c32640 1 -- 172.21.15.89:0/2347768753 wait complete. 2023-12-07T10:00:49.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:00:49.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:00:50.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 Processor -- start 2023-12-07T10:00:50.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 -- start start 2023-12-07T10:00:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b40c0370 0x7fe8b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8b40a8470 0x7fe8b406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b406de00 con 0x7fe8b414eaf0 2023-12-07T10:00:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b4070390 con 0x7fe8b40a8470 2023-12-07T10:00:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8ba51d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b406db90 con 0x7fe8b40c0370 2023-12-07T10:00:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8b8aba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8b40a8470 0x7fe8b406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8b8aba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8b40a8470 0x7fe8b406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57634/0 (socket says 172.21.15.89:57634) 2023-12-07T10:00:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8b8aba640 1 -- 172.21.15.89:0/2167101978 learned_addr learned my addr 172.21.15.89:0/2167101978 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.060+0000 7fe8b37fe640 1 --2- 172.21.15.89:0/2167101978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b40c0370 0x7fe8b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b8aba640 1 -- 172.21.15.89:0/2167101978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b40c0370 msgr2=0x7fe8b406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:50.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b8aba640 1 --2- 172.21.15.89:0/2167101978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b40c0370 0x7fe8b406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b8aba640 1 -- 172.21.15.89:0/2167101978 >> v1:172.21.15.97:6789/0 conn(0x7fe8b414eaf0 legacy=0x7fe8b4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b8aba640 1 -- 172.21.15.89:0/2167101978 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b414eed0 con 0x7fe8b40a8470 2023-12-07T10:00:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b8aba640 1 --2- 172.21.15.89:0/2167101978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40a8470 0x7fe8b406d650 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009e50 tx=0x7fe8ac01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcc4e187d07ee82 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b2ffd640 1 -- 172.21.15.89:0/2167101978 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0a57d0 con 0x7fe8b40a8470 2023-12-07T10:00:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b2ffd640 1 -- 172.21.15.89:0/2167101978 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac0a5930 con 0x7fe8b40a8470 2023-12-07T10:00:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8b2ffd640 1 -- 172.21.15.89:0/2167101978 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0a5cc0 con 0x7fe8b40a8470 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2167101978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40a8470 msgr2=0x7fe8b406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2167101978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40a8470 0x7fe8b406d650 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009e50 tx=0x7fe8ac01c8f0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2167101978 shutdown_connections 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2167101978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40a8470 0x7fe8b406d650 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2167101978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b40c0370 0x7fe8b406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.064+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2167101978 >> 172.21.15.89:0/2167101978 conn(0x7fe8b40c2a60 msgr2=0x7fe8b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2167101978 shutdown_connections 2023-12-07T10:00:50.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2167101978 wait complete. 2023-12-07T10:00:50.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 Processor -- start 2023-12-07T10:00:50.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 -- start start 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8b40a8470 0x7fe8b41f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 0x7fe8b40bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b414eaf0 0x7fe8b4139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4148f10 con 0x7fe8b40c0370 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41ecf50 con 0x7fe8b40a8470 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8ba51d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4142f30 con 0x7fe8b414eaf0 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 0x7fe8b40bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 0x7fe8b40bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57648/0 (socket says 172.21.15.89:57648) 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 -- 172.21.15.89:0/2253500290 learned_addr learned my addr 172.21.15.89:0/2253500290 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:50.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b3fff640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8b40a8470 0x7fe8b41f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b8aba640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b414eaf0 0x7fe8b4139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 -- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b414eaf0 msgr2=0x7fe8b4139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b414eaf0 0x7fe8b4139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 -- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8b40a8470 msgr2=0x7fe8b41f0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8b40a8470 0x7fe8b41f0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 -- 172.21.15.89:0/2253500290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac009b30 con 0x7fe8b40c0370 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.068+0000 7fe8b37fe640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 0x7fe8b40bf5f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8006e90 tx=0x7fe8a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800b6c0 con 0x7fe8b40c0370 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800b840 con 0x7fe8b40c0370 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800bbf0 con 0x7fe8b40c0370 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41f13c0 con 0x7fe8b40c0370 2023-12-07T10:00:50.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b413a940 con 0x7fe8b40c0370 2023-12-07T10:00:50.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b413feb0 con 0x7fe8b40c0370 2023-12-07T10:00:50.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8a800bd50 con 0x7fe8b40c0370 2023-12-07T10:00:50.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b0ff9640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8a00668d0 0x7fe8a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe8a8084410 con 0x7fe8b40c0370 2023-12-07T10:00:50.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.072+0000 7fe8b3fff640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8a00668d0 0x7fe8a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.076+0000 7fe8b3fff640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8a00668d0 0x7fe8a0068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4001770 tx=0x7fe8a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.076+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8a8051ae0 con 0x7fe8b40c0370 2023-12-07T10:00:50.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.228+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8b404e890 con 0x7fe8b40c0370 2023-12-07T10:00:50.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.228+0000 7fe8b0ff9640 1 -- 172.21.15.89:0/2253500290 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8a8055100 con 0x7fe8b40c0370 2023-12-07T10:00:50.234 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.228+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8a00668d0 msgr2=0x7fe8a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.228+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8a00668d0 0x7fe8a0068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4001770 tx=0x7fe8a4009040 comp rx=0 tx=0).stop 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.228+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 msgr2=0x7fe8b40bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.228+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 0x7fe8b40bf5f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8006e90 tx=0x7fe8a800dc60 comp rx=0 tx=0).stop 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 shutdown_connections 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8a00668d0 0x7fe8a0068d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8b414eaf0 0x7fe8b4139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b40c0370 0x7fe8b40bf5f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 --2- 172.21.15.89:0/2253500290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8b40a8470 0x7fe8b41f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 >> 172.21.15.89:0/2253500290 conn(0x7fe8b40c2a60 msgr2=0x7fe8b4070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:50.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 shutdown_connections 2023-12-07T10:00:50.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.232+0000 7fe8ba51d640 1 -- 172.21.15.89:0/2253500290 wait complete. 2023-12-07T10:00:50.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T10:00:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 Processor -- start 2023-12-07T10:00:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 -- start start 2023-12-07T10:00:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc0bd720 0x7fdacc158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdacc06cd90 0x7fdacc158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc155790 con 0x7fdacc0ca610 2023-12-07T10:00:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0c4b00 con 0x7fdacc06cd90 2023-12-07T10:00:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdad1b57640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0c4de0 con 0x7fdacc0bd720 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdac3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc0bd720 0x7fdacc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdacb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdacc0ca610 0x7fdacc0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:58696/0 (socket says 172.21.15.89:58696) 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdacb7fe640 1 -- 172.21.15.89:0/2959016266 learned_addr learned my addr 172.21.15.89:0/2959016266 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdacbfff640 1 --2- 172.21.15.89:0/2959016266 >> v2:172.21.15.97:3300/0 conn(0x7fdacc06cd90 0x7fdacc158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdacaffd640 1 -- 172.21.15.89:0/2959016266 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918195676 0 0) 0x7fdacc155790 con 0x7fdacc0ca610 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdac3fff640 1 -- 172.21.15.89:0/2959016266 >> v2:172.21.15.97:3300/0 conn(0x7fdacc06cd90 msgr2=0x7fdacc158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdac3fff640 1 --2- 172.21.15.89:0/2959016266 >> v2:172.21.15.97:3300/0 conn(0x7fdacc06cd90 0x7fdacc158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdac3fff640 1 -- 172.21.15.89:0/2959016266 >> v1:172.21.15.97:6789/0 conn(0x7fdacc0ca610 legacy=0x7fdacc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.388+0000 7fdac3fff640 1 -- 172.21.15.89:0/2959016266 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc157e30 con 0x7fdacc0bd720 2023-12-07T10:00:50.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdac3fff640 1 --2- 172.21.15.89:0/2959016266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc0bd720 0x7fdacc158350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdab40097c0 tx=0x7fdab401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f676683c5594e5ef server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdacaffd640 1 -- 172.21.15.89:0/2959016266 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0c52d0 con 0x7fdacc0bd720 2023-12-07T10:00:50.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdacaffd640 1 -- 172.21.15.89:0/2959016266 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab40a7050 con 0x7fdacc0bd720 2023-12-07T10:00:50.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdacaffd640 1 -- 172.21.15.89:0/2959016266 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40ab820 con 0x7fdacc0bd720 2023-12-07T10:00:50.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 -- 172.21.15.89:0/2959016266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc0bd720 msgr2=0x7fdacc158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2959016266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc0bd720 0x7fdacc158350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdab40097c0 tx=0x7fdab401c360 comp rx=0 tx=0).stop 2023-12-07T10:00:50.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 -- 172.21.15.89:0/2959016266 shutdown_connections 2023-12-07T10:00:50.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2959016266 >> v2:172.21.15.97:3300/0 conn(0x7fdacc06cd90 0x7fdacc158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2959016266 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc0bd720 0x7fdacc158350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 -- 172.21.15.89:0/2959016266 >> 172.21.15.89:0/2959016266 conn(0x7fdacc071ea0 msgr2=0x7fdacc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:50.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 -- 172.21.15.89:0/2959016266 shutdown_connections 2023-12-07T10:00:50.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.392+0000 7fdad1b57640 1 -- 172.21.15.89:0/2959016266 wait complete. 2023-12-07T10:00:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 Processor -- start 2023-12-07T10:00:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 -- start start 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc06cd90 0x7fdacc14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 0x7fdacc144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdacc0ca610 0x7fdacc144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc14f310 con 0x7fdacc0bd720 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0addf0 con 0x7fdacc0ca610 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc14f030 con 0x7fdacc06cd90 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 0x7fdacc144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 0x7fdacc144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57652/0 (socket says 172.21.15.89:57652) 2023-12-07T10:00:50.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 -- 172.21.15.89:0/2548591426 learned_addr learned my addr 172.21.15.89:0/2548591426 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:50.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdacb7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc06cd90 0x7fdacc14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdacbfff640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdacc0ca610 0x7fdacc144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 -- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc06cd90 msgr2=0x7fdacc14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc06cd90 0x7fdacc14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 -- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdacc0ca610 msgr2=0x7fdacc144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdacc0ca610 0x7fdacc144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 -- 172.21.15.89:0/2548591426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009420 con 0x7fdacc0bd720 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac3fff640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 0x7fdacc144300 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdab401aa10 tx=0x7fdab4019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4006e20 con 0x7fdacc0bd720 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4004020 con 0x7fdacc0bd720 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc1edd50 con 0x7fdacc0bd720 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4004390 con 0x7fdacc0bd720 2023-12-07T10:00:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.396+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc1502f0 con 0x7fdacc0bd720 2023-12-07T10:00:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.400+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc1edbb0 con 0x7fdacc0bd720 2023-12-07T10:00:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.400+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdab40b2040 con 0x7fdacc0bd720 2023-12-07T10:00:50.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.400+0000 7fdac8ff9640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdaac0668d0 0x7fdaac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.400+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdab411df30 con 0x7fdacc0bd720 2023-12-07T10:00:50.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.400+0000 7fdacb7fe640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdaac0668d0 0x7fdaac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.400+0000 7fdacb7fe640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdaac0668d0 0x7fdaac068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007fd0 tx=0x7fdabc007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.404+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdacc1edbb0 con 0x7fdacc0bd720 2023-12-07T10:00:50.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdacc1edbb0 con 0x7fdacc0bd720 2023-12-07T10:00:50.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdac8ff9640 1 -- 172.21.15.89:0/2548591426 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdacc1edbb0 con 0x7fdacc0bd720 2023-12-07T10:00:50.561 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T10:00:50.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:00:50.562 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T10:00:50.562 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T10:00:50.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:00:50.562 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T10:00:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdaac0668d0 msgr2=0x7fdaac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdaac0668d0 0x7fdaac068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007fd0 tx=0x7fdabc007d60 comp rx=0 tx=0).stop 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 msgr2=0x7fdacc144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 0x7fdacc144300 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdab401aa10 tx=0x7fdab4019100 comp rx=0 tx=0).stop 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 shutdown_connections 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdacc0ca610 0x7fdacc144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdacc0bd720 0x7fdacc144300 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdaac0668d0 0x7fdaac068d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 --2- 172.21.15.89:0/2548591426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdacc06cd90 0x7fdacc14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 >> 172.21.15.89:0/2548591426 conn(0x7fdacc071ea0 msgr2=0x7fdacc1525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 shutdown_connections 2023-12-07T10:00:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.556+0000 7fdad1b57640 1 -- 172.21.15.89:0/2548591426 wait complete. 2023-12-07T10:00:50.582 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-07T10:00:50.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-07T10:00:50.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.716+0000 7fc5b19b8640 1 Processor -- start 2023-12-07T10:00:50.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.716+0000 7fc5b19b8640 1 -- start start 2023-12-07T10:00:50.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5b19b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5ac0c1cf0 0x7fc5ac072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5b19b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc5ac0c25a0 0x7fc5ac0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5b19b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac1558e0 con 0x7fc5ac152300 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5b19b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac06c8d0 con 0x7fc5ac0c1cf0 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5b19b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac154cd0 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5ac0c1cf0 0x7fc5ac072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5ac0c1cf0 0x7fc5ac072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57654/0 (socket says 172.21.15.89:57654) 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 -- 172.21.15.89:0/1340639410 learned_addr learned my addr 172.21.15.89:0/1340639410 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5ab7fe640 1 --2- 172.21.15.89:0/1340639410 >> v2:172.21.15.97:3300/0 conn(0x7fc5ac0c25a0 0x7fc5ac0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 -- 172.21.15.89:0/1340639410 >> v2:172.21.15.97:3300/0 conn(0x7fc5ac0c25a0 msgr2=0x7fc5ac0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:50.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 --2- 172.21.15.89:0/1340639410 >> v2:172.21.15.97:3300/0 conn(0x7fc5ac0c25a0 0x7fc5ac0c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 -- 172.21.15.89:0/1340639410 >> v1:172.21.15.97:6789/0 conn(0x7fc5ac152300 legacy=0x7fc5ac0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.720+0000 7fc5a27fc640 1 -- 172.21.15.89:0/1340639410 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac154fb0 con 0x7fc5ac0c1cf0 2023-12-07T10:00:50.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5a27fc640 1 --2- 172.21.15.89:0/1340639410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac072070 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac155bc0 tx=0x7fc59401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319640a73884db6f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5aa7fc640 1 -- 172.21.15.89:0/1340639410 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940ab600 con 0x7fc5ac0c1cf0 2023-12-07T10:00:50.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5aa7fc640 1 -- 172.21.15.89:0/1340639410 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5940a7050 con 0x7fc5ac0c1cf0 2023-12-07T10:00:50.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5aa7fc640 1 -- 172.21.15.89:0/1340639410 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940ab980 con 0x7fc5ac0c1cf0 2023-12-07T10:00:50.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 -- 172.21.15.89:0/1340639410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c1cf0 msgr2=0x7fc5ac072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/1340639410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac072070 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac155bc0 tx=0x7fc59401c3b0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 -- 172.21.15.89:0/1340639410 shutdown_connections 2023-12-07T10:00:50.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/1340639410 >> v2:172.21.15.97:3300/0 conn(0x7fc5ac0c25a0 0x7fc5ac0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/1340639410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac072070 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 -- 172.21.15.89:0/1340639410 >> 172.21.15.89:0/1340639410 conn(0x7fc5ac0c5b70 msgr2=0x7fc5ac0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:50.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 -- 172.21.15.89:0/1340639410 shutdown_connections 2023-12-07T10:00:50.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 -- 172.21.15.89:0/1340639410 wait complete. 2023-12-07T10:00:50.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 Processor -- start 2023-12-07T10:00:50.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.724+0000 7fc5b19b8640 1 -- start start 2023-12-07T10:00:50.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 0x7fc5ac1ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac152300 0x7fc5ac0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac14bf10 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0a9250 con 0x7fc5ac0c1cf0 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac1f1740 con 0x7fc5ac152300 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 0x7fc5ac1ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 0x7fc5ac1ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57670/0 (socket says 172.21.15.89:57670) 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 -- 172.21.15.89:0/13592331 learned_addr learned my addr 172.21.15.89:0/13592331 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5ab7fe640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac152300 0x7fc5ac0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5aaffd640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 -- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac152300 msgr2=0x7fc5ac0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac152300 0x7fc5ac0711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 -- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac0c1cf0 msgr2=0x7fc5ac149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:50.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 -- 172.21.15.89:0/13592331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5940094d0 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5aaffd640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a27fc640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 0x7fc5ac1ed620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc594018fc0 tx=0x7fc594019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940b4420 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5940b4580 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940b4930 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac0a94f0 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac071720 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac04e890 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.728+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc5940b2070 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.732+0000 7fc5a8ff9640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc58c0668d0 0x7fc58c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:50.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.732+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc59411daa0 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.732+0000 7fc5aaffd640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc58c0668d0 0x7fc58c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:50.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.732+0000 7fc5aaffd640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc58c0668d0 0x7fc58c068d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0a9a30 tx=0x7fc59c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:50.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.736+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5940eb020 con 0x7fc5ac0c25a0 2023-12-07T10:00:50.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:50.888+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc5ac15bc40 con 0x7fc5ac0c25a0 2023-12-07T10:00:51.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.820+0000 7fc5a8ff9640 1 -- 172.21.15.89:0/13592331 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc5940ee640 con 0x7fc5ac0c25a0 2023-12-07T10:00:51.828 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2023-12-07T10:00:51.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc58c0668d0 msgr2=0x7fc58c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:51.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc58c0668d0 0x7fc58c068d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0a9a30 tx=0x7fc59c009040 comp rx=0 tx=0).stop 2023-12-07T10:00:51.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 msgr2=0x7fc5ac1ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 0x7fc5ac1ed620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc594018fc0 tx=0x7fc594019150 comp rx=0 tx=0).stop 2023-12-07T10:00:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 shutdown_connections 2023-12-07T10:00:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc58c0668d0 0x7fc58c068d90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5ac152300 0x7fc5ac0711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5ac0c25a0 0x7fc5ac1ed620 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 --2- 172.21.15.89:0/13592331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5ac0c1cf0 0x7fc5ac149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 >> 172.21.15.89:0/13592331 conn(0x7fc5ac0c5b70 msgr2=0x7fc5ac0c0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 shutdown_connections 2023-12-07T10:00:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:51.824+0000 7fc5b19b8640 1 -- 172.21.15.89:0/13592331 wait complete. 2023-12-07T10:00:51.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T10:00:52.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 Processor -- start 2023-12-07T10:00:52.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 -- start start 2023-12-07T10:00:52.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83ac156600 0x7f83ac14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:52.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83ac14fb30 0x7f83ac0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:52.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ac152d90 con 0x7f83ac0a86d0 2023-12-07T10:00:52.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac14ffa0 con 0x7f83ac14fb30 2023-12-07T10:00:52.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83b085f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac152480 con 0x7f83ac156600 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83aa59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f83ac0a86d0 0x7f83ac0a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47076/0 (socket says 172.21.15.89:47076) 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83aa59c640 1 -- 172.21.15.89:0/3982642362 learned_addr learned my addr 172.21.15.89:0/3982642362 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83aad9d640 1 --2- 172.21.15.89:0/3982642362 >> v2:172.21.15.89:3300/0 conn(0x7f83ac14fb30 0x7f83ac0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.000+0000 7f83a3fff640 1 --2- 172.21.15.89:0/3982642362 >> v2:172.21.15.97:3300/0 conn(0x7f83ac156600 0x7f83ac14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83aad9d640 1 -- 172.21.15.89:0/3982642362 >> v2:172.21.15.97:3300/0 conn(0x7f83ac156600 msgr2=0x7f83ac14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83aad9d640 1 --2- 172.21.15.89:0/3982642362 >> v2:172.21.15.97:3300/0 conn(0x7f83ac156600 0x7f83ac14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83aad9d640 1 -- 172.21.15.89:0/3982642362 >> v1:172.21.15.89:6789/0 conn(0x7f83ac0a86d0 legacy=0x7f83ac0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:52.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83aad9d640 1 -- 172.21.15.89:0/3982642362 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0a9760 con 0x7f83ac14fb30 2023-12-07T10:00:52.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83a9d9b640 1 -- 172.21.15.89:0/3982642362 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906983542 0 0) 0x7f83ac152d90 con 0x7f83ac0a86d0 2023-12-07T10:00:52.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83aad9d640 1 --2- 172.21.15.89:0/3982642362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac0aae40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009d90 tx=0x7f83a401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11b749f1ea0cc00 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:52.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83a9d9b640 1 -- 172.21.15.89:0/3982642362 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40a58c0 con 0x7f83ac14fb30 2023-12-07T10:00:52.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83a9d9b640 1 -- 172.21.15.89:0/3982642362 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a40a5a20 con 0x7f83ac14fb30 2023-12-07T10:00:52.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83a9d9b640 1 -- 172.21.15.89:0/3982642362 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40a5db0 con 0x7f83ac14fb30 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 -- 172.21.15.89:0/3982642362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 msgr2=0x7f83ac0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 --2- 172.21.15.89:0/3982642362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac0aae40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009d90 tx=0x7f83a401c910 comp rx=0 tx=0).stop 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 -- 172.21.15.89:0/3982642362 shutdown_connections 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 --2- 172.21.15.89:0/3982642362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac0aae40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 --2- 172.21.15.89:0/3982642362 >> v2:172.21.15.97:3300/0 conn(0x7f83ac156600 0x7f83ac14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 -- 172.21.15.89:0/3982642362 >> 172.21.15.89:0/3982642362 conn(0x7f83ac0c2a60 msgr2=0x7f83ac0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.004+0000 7f83b085f640 1 -- 172.21.15.89:0/3982642362 shutdown_connections 2023-12-07T10:00:52.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 -- 172.21.15.89:0/3982642362 wait complete. 2023-12-07T10:00:52.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 Processor -- start 2023-12-07T10:00:52.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 -- start start 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83ac0a86d0 0x7f83ac0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac1ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac156600 0x7f83ac1ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac1ecd70 con 0x7f83ac14fb30 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac14a280 con 0x7f83ac156600 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83b085f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac1f0d00 con 0x7f83ac0a86d0 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac1ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac1ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57684/0 (socket says 172.21.15.89:57684) 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 -- 172.21.15.89:0/223718125 learned_addr learned my addr 172.21.15.89:0/223718125 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83aa59c640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83ac0a86d0 0x7f83ac0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83aad9d640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac156600 0x7f83ac1ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 -- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83ac0a86d0 msgr2=0x7f83ac0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83ac0a86d0 0x7f83ac0c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 -- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac156600 msgr2=0x7f83ac1ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac156600 0x7f83ac1ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 -- 172.21.15.89:0/223718125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4009a70 con 0x7f83ac14fb30 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a3fff640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac1ed200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f839400e900 tx=0x7f839400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.008+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394009690 con 0x7f83ac14fb30 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839400ca00 con 0x7f83ac14fb30 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400cd90 con 0x7f83ac14fb30 2023-12-07T10:00:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac1533a0 con 0x7f83ac14fb30 2023-12-07T10:00:52.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ac14a560 con 0x7f83ac14fb30 2023-12-07T10:00:52.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac153200 con 0x7f83ac14fb30 2023-12-07T10:00:52.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8394013470 con 0x7f83ac14fb30 2023-12-07T10:00:52.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83a2ffd640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f838c0668d0 0x7f838c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:52.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f83940849c0 con 0x7f83ac14fb30 2023-12-07T10:00:52.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83aa59c640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f838c0668d0 0x7f838c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:52.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.012+0000 7f83aa59c640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f838c0668d0 0x7f838c068d90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f839c000f70 tx=0x7f839c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.016+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8394051f80 con 0x7f83ac14fb30 2023-12-07T10:00:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.164+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83ac153200 con 0x7f83ac14fb30 2023-12-07T10:00:52.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.828+0000 7f83a2ffd640 1 -- 172.21.15.89:0/223718125 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7f83ac153200 con 0x7f83ac14fb30 2023-12-07T10:00:52.836 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2023-12-07T10:00:52.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f838c0668d0 msgr2=0x7f838c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:52.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f838c0668d0 0x7f838c068d90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f839c000f70 tx=0x7f839c007df0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 msgr2=0x7f83ac1ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:52.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac1ed200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f839400e900 tx=0x7f839400edc0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 shutdown_connections 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac156600 0x7f83ac1ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83ac14fb30 0x7f83ac1ed200 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f838c0668d0 0x7f838c068d90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 --2- 172.21.15.89:0/223718125 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83ac0a86d0 0x7f83ac0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 >> 172.21.15.89:0/223718125 conn(0x7f83ac0c2a60 msgr2=0x7f83ac148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:52.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 shutdown_connections 2023-12-07T10:00:52.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:52.832+0000 7f83b085f640 1 -- 172.21.15.89:0/223718125 wait complete. 2023-12-07T10:00:52.876 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-07T10:00:53.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.008+0000 7fbcffc79640 1 Processor -- start 2023-12-07T10:00:53.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.008+0000 7fbcffc79640 1 -- start start 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcffc79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcf80700f0 0x7fbcf80c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcffc79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcf806df30 0x7fbcf8154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcffc79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf8154b90 con 0x7fbcf8154540 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcffc79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80a8710 con 0x7fbcf806df30 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcffc79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80abd70 con 0x7fbcf80700f0 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfd214640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcf806df30 0x7fbcf8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfe216640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbcf8154540 0x7fbcf8070f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47086/0 (socket says 172.21.15.89:47086) 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfe216640 1 -- 172.21.15.89:0/541958579 learned_addr learned my addr 172.21.15.89:0/541958579 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfda15640 1 --2- 172.21.15.89:0/541958579 >> v2:172.21.15.97:3300/0 conn(0x7fbcf80700f0 0x7fbcf80c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfd214640 1 -- 172.21.15.89:0/541958579 >> v2:172.21.15.97:3300/0 conn(0x7fbcf80700f0 msgr2=0x7fbcf80c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfd214640 1 --2- 172.21.15.89:0/541958579 >> v2:172.21.15.97:3300/0 conn(0x7fbcf80700f0 0x7fbcf80c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfd214640 1 -- 172.21.15.89:0/541958579 >> v1:172.21.15.89:6789/0 conn(0x7fbcf8154540 legacy=0x7fbcf8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfd214640 1 -- 172.21.15.89:0/541958579 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80ab820 con 0x7fbcf806df30 2023-12-07T10:00:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.012+0000 7fbcfca13640 1 -- 172.21.15.89:0/541958579 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455693816 0 0) 0x7fbcf8154b90 con 0x7fbcf8154540 2023-12-07T10:00:53.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcfd214640 1 --2- 172.21.15.89:0/541958579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf806df30 0x7fbcf8154000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80c3a30 tx=0x7fbce801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a53ffe4584c99 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:53.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcfca13640 1 -- 172.21.15.89:0/541958579 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80ab600 con 0x7fbcf806df30 2023-12-07T10:00:53.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcfca13640 1 -- 172.21.15.89:0/541958579 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce80a7050 con 0x7fbcf806df30 2023-12-07T10:00:53.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcfca13640 1 -- 172.21.15.89:0/541958579 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80ab980 con 0x7fbcf806df30 2023-12-07T10:00:53.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 -- 172.21.15.89:0/541958579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf806df30 msgr2=0x7fbcf8154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 --2- 172.21.15.89:0/541958579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf806df30 0x7fbcf8154000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80c3a30 tx=0x7fbce801c340 comp rx=0 tx=0).stop 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 -- 172.21.15.89:0/541958579 shutdown_connections 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 --2- 172.21.15.89:0/541958579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf806df30 0x7fbcf8154000 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 --2- 172.21.15.89:0/541958579 >> v2:172.21.15.97:3300/0 conn(0x7fbcf80700f0 0x7fbcf80c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 -- 172.21.15.89:0/541958579 >> 172.21.15.89:0/541958579 conn(0x7fbcf80c2a60 msgr2=0x7fbcf80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 -- 172.21.15.89:0/541958579 shutdown_connections 2023-12-07T10:00:53.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 -- 172.21.15.89:0/541958579 wait complete. 2023-12-07T10:00:53.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 Processor -- start 2023-12-07T10:00:53.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.016+0000 7fbcffc79640 1 -- start start 2023-12-07T10:00:53.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcf806df30 0x7fbcf80bf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:53.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcf80700f0 0x7fbcf8137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:53.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 0x7fbcf8137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:53.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8150900 con 0x7fbcf8154540 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf81f1050 con 0x7fbcf80700f0 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf81380a0 con 0x7fbcf806df30 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 0x7fbcf8137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 0x7fbcf8137b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57712/0 (socket says 172.21.15.89:57712) 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfd214640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcf80700f0 0x7fbcf8137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 -- 172.21.15.89:0/2031631310 learned_addr learned my addr 172.21.15.89:0/2031631310 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfda15640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcf806df30 0x7fbcf80bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 -- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcf806df30 msgr2=0x7fbcf80bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcf806df30 0x7fbcf80bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 -- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcf80700f0 msgr2=0x7fbcf8137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcf80700f0 0x7fbcf8137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 -- 172.21.15.89:0/2031631310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8009420 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcfe216640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 0x7fbcf8137b60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c7b0 tx=0x7fbcf000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000a640 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000a7c0 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000ab70 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf80c4e20 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf80c50e0 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf804e890 con 0x7fbcf8154540 2023-12-07T10:00:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.020+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbcf000acd0 con 0x7fbcf8154540 2023-12-07T10:00:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.024+0000 7fbcee7fc640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbcdc0668d0 0x7fbcdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.024+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbcf00836d0 con 0x7fbcf8154540 2023-12-07T10:00:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.024+0000 7fbcfda15640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbcdc0668d0 0x7fbcdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.024+0000 7fbcfda15640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbcdc0668d0 0x7fbcdc068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009ac0 tx=0x7fbcf4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:53.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.028+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcf0050ab0 con 0x7fbcf8154540 2023-12-07T10:00:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.208+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbcf80c25f0 con 0x7fbcf8154540 2023-12-07T10:00:53.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.832+0000 7fbcee7fc640 1 -- 172.21.15.89:0/2031631310 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbcf00180c0 con 0x7fbcf8154540 2023-12-07T10:00:53.838 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 8 and data pool 9 2023-12-07T10:00:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbcdc0668d0 msgr2=0x7fbcdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbcdc0668d0 0x7fbcdc068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009ac0 tx=0x7fbcf4009190 comp rx=0 tx=0).stop 2023-12-07T10:00:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 msgr2=0x7fbcf8137b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 0x7fbcf8137b60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c7b0 tx=0x7fbcf000cc70 comp rx=0 tx=0).stop 2023-12-07T10:00:53.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 shutdown_connections 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcf8154540 0x7fbcf8137b60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcf80700f0 0x7fbcf8137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbcdc0668d0 0x7fbcdc068d90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 --2- 172.21.15.89:0/2031631310 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcf806df30 0x7fbcf80bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 >> 172.21.15.89:0/2031631310 conn(0x7fbcf80c2a60 msgr2=0x7fbcf80c16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 shutdown_connections 2023-12-07T10:00:53.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:53.836+0000 7fbcffc79640 1 -- 172.21.15.89:0/2031631310 wait complete. 2023-12-07T10:00:53.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:54.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.000+0000 7f1febb65640 1 Processor -- start 2023-12-07T10:00:54.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.000+0000 7f1febb65640 1 -- start start 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1febb65640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1fe40a8470 0x7f1fe4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1febb65640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe406d320 con 0x7f1fe4070b80 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1febb65640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40721b0 con 0x7f1fe414e9d0 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1febb65640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40c2830 con 0x7f1fe40a8470 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fe9100640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1fe4070b80 0x7f1fe406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47102/0 (socket says 172.21.15.89:47102) 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fe9100640 1 -- 172.21.15.89:0/3298664117 learned_addr learned my addr 172.21.15.89:0/3298664117 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:54.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fea102640 1 --2- 172.21.15.89:0/3298664117 >> v2:172.21.15.89:3300/0 conn(0x7f1fe40a8470 0x7f1fe4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fe88ff640 1 -- 172.21.15.89:0/3298664117 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996342640 0 0) 0x7f1fe406d320 con 0x7f1fe4070b80 2023-12-07T10:00:54.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fe88ff640 1 -- 172.21.15.89:0/3298664117 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd0003530 con 0x7f1fe4070b80 2023-12-07T10:00:54.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fea102640 1 -- 172.21.15.89:0/3298664117 >> v1:172.21.15.97:6789/0 conn(0x7f1fe414e9d0 legacy=0x7f1fe40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fea102640 1 -- 172.21.15.89:0/3298664117 >> v1:172.21.15.89:6789/0 conn(0x7f1fe4070b80 legacy=0x7f1fe406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.004+0000 7f1fea102640 1 -- 172.21.15.89:0/3298664117 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4072450 con 0x7f1fe40a8470 2023-12-07T10:00:54.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1fea102640 1 --2- 172.21.15.89:0/3298664117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe40a8470 0x7f1fe4151e60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009d90 tx=0x7f1fdc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e14cc6356a39b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1fe88ff640 1 -- 172.21.15.89:0/3298664117 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0a5890 con 0x7f1fe40a8470 2023-12-07T10:00:54.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1fe88ff640 1 -- 172.21.15.89:0/3298664117 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc0a59f0 con 0x7f1fe40a8470 2023-12-07T10:00:54.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1fe88ff640 1 -- 172.21.15.89:0/3298664117 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0a5d80 con 0x7f1fe40a8470 2023-12-07T10:00:54.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 -- 172.21.15.89:0/3298664117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe40a8470 msgr2=0x7f1fe4151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 --2- 172.21.15.89:0/3298664117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe40a8470 0x7f1fe4151e60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009d90 tx=0x7f1fdc01c8c0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 -- 172.21.15.89:0/3298664117 shutdown_connections 2023-12-07T10:00:54.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 --2- 172.21.15.89:0/3298664117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe40a8470 0x7f1fe4151e60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 -- 172.21.15.89:0/3298664117 >> 172.21.15.89:0/3298664117 conn(0x7f1fe40c2ad0 msgr2=0x7f1fe40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:54.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 -- 172.21.15.89:0/3298664117 shutdown_connections 2023-12-07T10:00:54.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 -- 172.21.15.89:0/3298664117 wait complete. 2023-12-07T10:00:54.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 Processor -- start 2023-12-07T10:00:54.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.008+0000 7f1febb65640 1 -- start start 2023-12-07T10:00:54.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fe40a8470 0x7f1fe414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fe414e9d0 0x7f1fe41419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40ab880 con 0x7f1fe4070b80 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40aa930 con 0x7f1fe40a8470 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4152c30 con 0x7f1fe414e9d0 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57732/0 (socket says 172.21.15.89:57732) 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 -- 172.21.15.89:0/1400262208 learned_addr learned my addr 172.21.15.89:0/1400262208 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9100640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fe40a8470 0x7f1fe414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fea102640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fe414e9d0 0x7f1fe41419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 -- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fe414e9d0 msgr2=0x7f1fe41419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fe414e9d0 0x7f1fe41419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 -- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fe40a8470 msgr2=0x7f1fe414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fe40a8470 0x7f1fe414fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 -- 172.21.15.89:0/1400262208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009a70 con 0x7f1fe4070b80 2023-12-07T10:00:54.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fea102640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fe414e9d0 0x7f1fe41419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9100640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fe40a8470 0x7f1fe414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fe9901640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4e20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c3f0 tx=0x7f1fe000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00052d0 con 0x7f1fe4070b80 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0005430 con 0x7f1fe4070b80 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe41426b0 con 0x7f1fe4070b80 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0003840 con 0x7f1fe4070b80 2023-12-07T10:00:54.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40abdb0 con 0x7f1fe4070b80 2023-12-07T10:00:54.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe4067a40 con 0x7f1fe4070b80 2023-12-07T10:00:54.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.012+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1fe00039a0 con 0x7f1fe4070b80 2023-12-07T10:00:54.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.016+0000 7f1fda7fc640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fc80668d0 0x7f1fc8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.016+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fe0083920 con 0x7f1fe4070b80 2023-12-07T10:00:54.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.016+0000 7f1fe9100640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fc80668d0 0x7f1fc8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.016+0000 7f1fe9100640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fc80668d0 0x7f1fc8068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4150d70 tx=0x7f1fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.020+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fe0050bf0 con 0x7f1fe4070b80 2023-12-07T10:00:54.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.168+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fe40c0520 con 0x7f1fe4070b80 2023-12-07T10:00:54.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.168+0000 7f1fda7fc640 1 -- 172.21.15.89:0/1400262208 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f1fe0054210 con 0x7f1fe4070b80 2023-12-07T10:00:54.174 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:54.174 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":48,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:53.212507+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fc80668d0 msgr2=0x7f1fc8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fc80668d0 0x7f1fc8068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4150d70 tx=0x7f1fd4009040 comp rx=0 tx=0).stop 2023-12-07T10:00:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 msgr2=0x7f1fe40c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4e20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c3f0 tx=0x7f1fe000c8b0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 shutdown_connections 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fc80668d0 0x7f1fc8068d90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fe414e9d0 0x7f1fe41419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fe40a8470 0x7f1fe414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 --2- 172.21.15.89:0/1400262208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4e20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 >> 172.21.15.89:0/1400262208 conn(0x7f1fe40c2ad0 msgr2=0x7f1fe4071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 shutdown_connections 2023-12-07T10:00:54.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.172+0000 7f1febb65640 1 -- 172.21.15.89:0/1400262208 wait complete. 2023-12-07T10:00:54.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:54.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736f92a640 1 Processor -- start 2023-12-07T10:00:54.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736f92a640 1 -- start start 2023-12-07T10:00:54.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736f92a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f736814fcc0 0x7f7368156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736f92a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73680ab580 con 0x7f73680c19e0 2023-12-07T10:00:54.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736f92a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7368152fe0 con 0x7f736806d980 2023-12-07T10:00:54.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736f92a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73680aa340 con 0x7f736814fcc0 2023-12-07T10:00:54.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736dec7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f73680c19e0 0x7f73680c1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47108/0 (socket says 172.21.15.89:47108) 2023-12-07T10:00:54.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736dec7640 1 -- 172.21.15.89:0/4013112353 learned_addr learned my addr 172.21.15.89:0/4013112353 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736d6c6640 1 --2- 172.21.15.89:0/4013112353 >> v2:172.21.15.97:3300/0 conn(0x7f736814fcc0 0x7f7368156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838956297 0 0) 0x7f73680ab580 con 0x7f73680c19e0 2023-12-07T10:00:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7354003530 con 0x7f73680c19e0 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201862608 0 0) 0x7f7354003530 con 0x7f73680c19e0 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 >> v2:172.21.15.97:3300/0 conn(0x7f736814fcc0 msgr2=0x7f7368156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 --2- 172.21.15.89:0/4013112353 >> v2:172.21.15.97:3300/0 conn(0x7f736814fcc0 0x7f7368156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 >> v1:172.21.15.97:6789/0 conn(0x7f736806d980 legacy=0x7f73680aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73681532c0 con 0x7f73680c19e0 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f7360001a00 con 0x7f73680c19e0 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 >> v1:172.21.15.89:6789/0 conn(0x7f73680c19e0 legacy=0x7f73680c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354003980 0x7f7354003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7354004380 0x7f7354004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354005050 0x7f735400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735400bf80 con 0x7f7354005050 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735400c0f0 con 0x7f7354003980 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735400c2b0 con 0x7f7354004380 2023-12-07T10:00:54.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.328+0000 7f736dec7640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354005050 0x7f735400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736d6c6640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354003980 0x7f7354003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736cec5640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7354004380 0x7f7354004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 -- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7354004380 msgr2=0x7f7354004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7354004380 0x7f7354004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 -- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354003980 msgr2=0x7f7354003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354003980 0x7f7354003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 -- 172.21.15.89:0/4013112353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354003530 con 0x7f7354005050 2023-12-07T10:00:54.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 -- 172.21.15.89:0/4013112353 reap_dead start 2023-12-07T10:00:54.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736dec7640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354005050 0x7f735400b990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f736000a830 tx=0x7f736001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbef5b3b4ee29faa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600af070 con 0x7f7354005050 2023-12-07T10:00:54.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73600aa4d0 con 0x7f7354005050 2023-12-07T10:00:54.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f735ffff640 1 -- 172.21.15.89:0/4013112353 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600aa8a0 con 0x7f7354005050 2023-12-07T10:00:54.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736f92a640 1 -- 172.21.15.89:0/4013112353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354005050 msgr2=0x7f735400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736f92a640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354005050 0x7f735400b990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f736000a830 tx=0x7f736001faa0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736f92a640 1 -- 172.21.15.89:0/4013112353 shutdown_connections 2023-12-07T10:00:54.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736f92a640 1 --2- 172.21.15.89:0/4013112353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7354005050 0x7f735400b990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.332+0000 7f736f92a640 1 -- 172.21.15.89:0/4013112353 >> 172.21.15.89:0/4013112353 conn(0x7f73680c2ad0 msgr2=0x7f73680c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:54.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 -- 172.21.15.89:0/4013112353 shutdown_connections 2023-12-07T10:00:54.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 -- 172.21.15.89:0/4013112353 wait complete. 2023-12-07T10:00:54.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 Processor -- start 2023-12-07T10:00:54.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 -- start start 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354005050 0x7f7368070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7368148f50 0x7f73681e9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 0x7f736806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7368070440 con 0x7f73681e9c50 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73681496a0 con 0x7f7354005050 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736f92a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7368151150 con 0x7f7368148f50 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 0x7f736806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 0x7f736806bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57754/0 (socket says 172.21.15.89:57754) 2023-12-07T10:00:54.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 -- 172.21.15.89:0/288102845 learned_addr learned my addr 172.21.15.89:0/288102845 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736d6c6640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354005050 0x7f7368070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736cec5640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7368148f50 0x7f73681e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 -- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7368148f50 msgr2=0x7f73681e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7368148f50 0x7f73681e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 -- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354005050 msgr2=0x7f7368070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354005050 0x7f7368070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 -- 172.21.15.89:0/288102845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680700a0 con 0x7f73681e9c50 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736cec5640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7368148f50 0x7f73681e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736d6c6640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354005050 0x7f7368070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.336+0000 7f736dec7640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 0x7f736806bd00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7360002240 tx=0x7f7354005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600af040 con 0x7f73681e9c50 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73600019c0 con 0x7f73681e9c50 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600aade0 con 0x7f73681e9c50 2023-12-07T10:00:54.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73681504d0 con 0x7f73681e9c50 2023-12-07T10:00:54.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7368150790 con 0x7f73681e9c50 2023-12-07T10:00:54.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736804e890 con 0x7f73681e9c50 2023-12-07T10:00:54.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7360004b70 con 0x7f73681e9c50 2023-12-07T10:00:54.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f735dffb640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f734c0668d0 0x7f734c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7360121310 con 0x7f73681e9c50 2023-12-07T10:00:54.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f736d6c6640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f734c0668d0 0x7f734c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.340+0000 7f736d6c6640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f734c0668d0 0x7f734c068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7364009b60 tx=0x7f7364008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.344+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73600ee540 con 0x7f73681e9c50 2023-12-07T10:00:54.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.500+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f736806ce10 con 0x7f73681e9c50 2023-12-07T10:00:54.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f735dffb640 1 -- 172.21.15.89:0/288102845 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f73600f1b60 con 0x7f73681e9c50 2023-12-07T10:00:54.509 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:54.509 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":49,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:54.224366+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f734c0668d0 msgr2=0x7f734c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f734c0668d0 0x7f734c068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7364009b60 tx=0x7f7364008040 comp rx=0 tx=0).stop 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 msgr2=0x7f736806bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 0x7f736806bd00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7360002240 tx=0x7f7354005800 comp rx=0 tx=0).stop 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 shutdown_connections 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73681e9c50 0x7f736806bd00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f734c0668d0 0x7f734c068d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7368148f50 0x7f73681e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 --2- 172.21.15.89:0/288102845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7354005050 0x7f7368070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 >> 172.21.15.89:0/288102845 conn(0x7f73680c2ad0 msgr2=0x7f73680a8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:54.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 shutdown_connections 2023-12-07T10:00:54.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.504+0000 7f736f92a640 1 -- 172.21.15.89:0/288102845 wait complete. 2023-12-07T10:00:54.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-07T10:00:54.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.664+0000 7fe11e584640 1 Processor -- start 2023-12-07T10:00:54.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.664+0000 7fe11e584640 1 -- start start 2023-12-07T10:00:54.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11e584640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe118154dc0 0x7fe118160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11e584640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118157ca0 con 0x7fe1180c7de0 2023-12-07T10:00:54.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11e584640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118157ef0 con 0x7fe118151df0 2023-12-07T10:00:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11e584640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181521d0 con 0x7fe118154dc0 2023-12-07T10:00:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11cd81640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe1180c7de0 0x7fe1181546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47110/0 (socket says 172.21.15.89:47110) 2023-12-07T10:00:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11cd81640 1 -- 172.21.15.89:0/3081314717 learned_addr learned my addr 172.21.15.89:0/3081314717 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11dd83640 1 --2- 172.21.15.89:0/3081314717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe118154dc0 0x7fe118160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506751247 0 0) 0x7fe118157ca0 con 0x7fe1180c7de0 2023-12-07T10:00:54.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe104003530 con 0x7fe1180c7de0 2023-12-07T10:00:54.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526268770 0 0) 0x7fe118157ef0 con 0x7fe118151df0 2023-12-07T10:00:54.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe118157ca0 con 0x7fe118151df0 2023-12-07T10:00:54.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11dd83640 1 -- 172.21.15.89:0/3081314717 >> v1:172.21.15.97:6789/0 conn(0x7fe118151df0 legacy=0x7fe1180c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11dd83640 1 -- 172.21.15.89:0/3081314717 >> v1:172.21.15.89:6789/0 conn(0x7fe1180c7de0 legacy=0x7fe1181546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.668+0000 7fe11dd83640 1 -- 172.21.15.89:0/3081314717 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1181581d0 con 0x7fe118154dc0 2023-12-07T10:00:54.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11dd83640 1 --2- 172.21.15.89:0/3081314717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe118154dc0 0x7fe118160040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe110009dc0 tx=0x7fe11001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652acea3a61f15c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a57a0 con 0x7fe118154dc0 2023-12-07T10:00:54.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100a5900 con 0x7fe118154dc0 2023-12-07T10:00:54.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe10ffff640 1 -- 172.21.15.89:0/3081314717 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a5c90 con 0x7fe118154dc0 2023-12-07T10:00:54.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 -- 172.21.15.89:0/3081314717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe118154dc0 msgr2=0x7fe118160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 --2- 172.21.15.89:0/3081314717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe118154dc0 0x7fe118160040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe110009dc0 tx=0x7fe11001c8e0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 -- 172.21.15.89:0/3081314717 shutdown_connections 2023-12-07T10:00:54.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 --2- 172.21.15.89:0/3081314717 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe118154dc0 0x7fe118160040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 -- 172.21.15.89:0/3081314717 >> 172.21.15.89:0/3081314717 conn(0x7fe1180abab0 msgr2=0x7fe1180abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:54.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 -- 172.21.15.89:0/3081314717 shutdown_connections 2023-12-07T10:00:54.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 -- 172.21.15.89:0/3081314717 wait complete. 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 Processor -- start 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.672+0000 7fe11e584640 1 -- start start 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1180c7de0 0x7fe118144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe118151df0 0x7fe118144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 0x7fe118156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c55f0 con 0x7fe118154dc0 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181540b0 con 0x7fe118151df0 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe118154390 con 0x7fe1180c7de0 2023-12-07T10:00:54.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 0x7fe118156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 0x7fe118156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57768/0 (socket says 172.21.15.89:57768) 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 -- 172.21.15.89:0/502179126 learned_addr learned my addr 172.21.15.89:0/502179126 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11d582640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1180c7de0 0x7fe118144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11cd81640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe118151df0 0x7fe118144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 -- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1180c7de0 msgr2=0x7fe118144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1180c7de0 0x7fe118144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 -- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe118151df0 msgr2=0x7fe118144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe118151df0 0x7fe118144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 -- 172.21.15.89:0/502179126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009a70 con 0x7fe118154dc0 2023-12-07T10:00:54.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11dd83640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 0x7fe118156060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe11001a510 tx=0x7fe110019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100ad640 con 0x7fe118154dc0 2023-12-07T10:00:54.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100ad7a0 con 0x7fe118154dc0 2023-12-07T10:00:54.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe118155b40 con 0x7fe118154dc0 2023-12-07T10:00:54.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100adb50 con 0x7fe118154dc0 2023-12-07T10:00:54.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe118145460 con 0x7fe118154dc0 2023-12-07T10:00:54.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe118067a40 con 0x7fe118154dc0 2023-12-07T10:00:54.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.676+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe1100b4050 con 0x7fe118154dc0 2023-12-07T10:00:54.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.680+0000 7fe10dffb640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe0fc0668d0 0x7fe0fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:54.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.680+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe11011f1b0 con 0x7fe118154dc0 2023-12-07T10:00:54.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.680+0000 7fe11d582640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe0fc0668d0 0x7fe0fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:54.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.680+0000 7fe11d582640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe0fc0668d0 0x7fe0fc068d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1140011f0 tx=0x7fe114009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:54.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.684+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1100ec500 con 0x7fe118154dc0 2023-12-07T10:00:54.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:54.868+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe118074970 con 0x7fe118154dc0 2023-12-07T10:00:55.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe10dffb640 1 -- 172.21.15.89:0/502179126 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe1100efb20 con 0x7fe118154dc0 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe0fc0668d0 msgr2=0x7fe0fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe0fc0668d0 0x7fe0fc068d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1140011f0 tx=0x7fe114009040 comp rx=0 tx=0).stop 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 msgr2=0x7fe118156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 0x7fe118156060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe11001a510 tx=0x7fe110019680 comp rx=0 tx=0).stop 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 shutdown_connections 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe118154dc0 0x7fe118156060 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe118151df0 0x7fe118144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe0fc0668d0 0x7fe0fc068d90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 --2- 172.21.15.89:0/502179126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1180c7de0 0x7fe118144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 >> 172.21.15.89:0/502179126 conn(0x7fe1180abab0 msgr2=0x7fe1180c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 shutdown_connections 2023-12-07T10:00:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:55.852+0000 7fe11e584640 1 -- 172.21.15.89:0/502179126 wait complete. 2023-12-07T10:00:55.883 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T10:00:55.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-07T10:00:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.020+0000 7f18915e6640 1 Processor -- start 2023-12-07T10:00:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f18915e6640 1 -- start start 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f18915e6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f188c151d60 0x7f188c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f18915e6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c157db0 con 0x7f188c0c4980 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f18915e6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c158090 con 0x7f188c155240 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f18915e6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c152140 con 0x7f188c151d60 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f188affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f188c151d60 0x7f188c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f188b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f188c0c4980 0x7f188c15f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47114/0 (socket says 172.21.15.89:47114) 2023-12-07T10:00:56.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f188b7fe640 1 -- 172.21.15.89:0/363614354 learned_addr learned my addr 172.21.15.89:0/363614354 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:56.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f188affd640 1 -- 172.21.15.89:0/363614354 >> v1:172.21.15.97:6789/0 conn(0x7f188c155240 legacy=0x7f188c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f188affd640 1 -- 172.21.15.89:0/363614354 >> v1:172.21.15.89:6789/0 conn(0x7f188c0c4980 legacy=0x7f188c15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.024+0000 7f188affd640 1 -- 172.21.15.89:0/363614354 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0ca500 con 0x7f188c151d60 2023-12-07T10:00:56.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f188affd640 1 --2- 172.21.15.89:0/363614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c151d60 0x7f188c0c8050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f187c0097c0 tx=0x7f187c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357c7eda2ae734d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:56.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f188a7fc640 1 -- 172.21.15.89:0/363614354 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0ab600 con 0x7f188c151d60 2023-12-07T10:00:56.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f188a7fc640 1 -- 172.21.15.89:0/363614354 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0a7050 con 0x7f188c151d60 2023-12-07T10:00:56.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f188a7fc640 1 -- 172.21.15.89:0/363614354 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0ab980 con 0x7f188c151d60 2023-12-07T10:00:56.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 -- 172.21.15.89:0/363614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c151d60 msgr2=0x7f188c0c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 --2- 172.21.15.89:0/363614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c151d60 0x7f188c0c8050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f187c0097c0 tx=0x7f187c01c3c0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 -- 172.21.15.89:0/363614354 shutdown_connections 2023-12-07T10:00:56.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 --2- 172.21.15.89:0/363614354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c151d60 0x7f188c0c8050 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 -- 172.21.15.89:0/363614354 >> 172.21.15.89:0/363614354 conn(0x7f188c071ea0 msgr2=0x7f188c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:56.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 -- 172.21.15.89:0/363614354 shutdown_connections 2023-12-07T10:00:56.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 -- 172.21.15.89:0/363614354 wait complete. 2023-12-07T10:00:56.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 Processor -- start 2023-12-07T10:00:56.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.028+0000 7f18915e6640 1 -- start start 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 0x7f188c148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188c151d60 0x7f188c14b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188c155240 0x7f188c14b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1546e0 con 0x7f188c0c4980 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c14f620 con 0x7f188c155240 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c14be00 con 0x7f188c151d60 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 0x7f188c148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:56.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 0x7f188c148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57788/0 (socket says 172.21.15.89:57788) 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 -- 172.21.15.89:0/710564240 learned_addr learned my addr 172.21.15.89:0/710564240 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188b7fe640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188c155240 0x7f188c14b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f1883fff640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188c151d60 0x7f188c14b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 -- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188c151d60 msgr2=0x7f188c14b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188c151d60 0x7f188c14b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 -- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188c155240 msgr2=0x7f188c14b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188c155240 0x7f188c14b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 -- 172.21.15.89:0/710564240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c009420 con 0x7f188c0c4980 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188b7fe640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188c155240 0x7f188c14b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:56.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f188affd640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 0x7f188c148560 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f187c009710 tx=0x7f187c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:56.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0b7650 con 0x7f188c0c4980 2023-12-07T10:00:56.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0b77b0 con 0x7f188c0c4980 2023-12-07T10:00:56.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0b7b60 con 0x7f188c0c4980 2023-12-07T10:00:56.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c153e40 con 0x7f188c0c4980 2023-12-07T10:00:56.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c154400 con 0x7f188c0c4980 2023-12-07T10:00:56.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c074970 con 0x7f188c0c4980 2023-12-07T10:00:56.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.032+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f187c0b7cc0 con 0x7f188c0c4980 2023-12-07T10:00:56.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.036+0000 7f18837fe640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f186c066900 0x7f186c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:56.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.036+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f187c11ed90 con 0x7f188c0c4980 2023-12-07T10:00:56.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.036+0000 7f1883fff640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f186c066900 0x7f186c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:56.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.036+0000 7f1883fff640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f186c066900 0x7f186c068dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1874000f70 tx=0x7f1874009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:56.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.040+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f187c0ebfc0 con 0x7f188c0c4980 2023-12-07T10:00:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.220+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f188c14f3f0 con 0x7f188c0c4980 2023-12-07T10:00:56.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.864+0000 7f18837fe640 1 -- 172.21.15.89:0/710564240 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f187c0ef5e0 con 0x7f188c0c4980 2023-12-07T10:00:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f186c066900 msgr2=0x7f186c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f186c066900 0x7f186c068dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1874000f70 tx=0x7f1874009040 comp rx=0 tx=0).stop 2023-12-07T10:00:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 msgr2=0x7f188c148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 0x7f188c148560 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f187c009710 tx=0x7f187c01ac00 comp rx=0 tx=0).stop 2023-12-07T10:00:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 shutdown_connections 2023-12-07T10:00:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f188c155240 0x7f188c14b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f186c066900 0x7f186c068dc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f188c151d60 0x7f188c14b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 --2- 172.21.15.89:0/710564240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f188c0c4980 0x7f188c148560 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:56.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 >> 172.21.15.89:0/710564240 conn(0x7f188c071ea0 msgr2=0x7f188c0c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:56.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 shutdown_connections 2023-12-07T10:00:56.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:56.868+0000 7f18915e6640 1 -- 172.21.15.89:0/710564240 wait complete. 2023-12-07T10:00:56.895 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-07T10:00:56.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:57.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.028+0000 7fb30aa9c640 1 Processor -- start 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb30aa9c640 1 -- start start 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb30aa9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb3040ca610 0x7fb3040c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb30aa9c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb30406cd90 0x7fb3040c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb30aa9c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb304155790 con 0x7fb3040bd720 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb30aa9c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3040c4b00 con 0x7fb30406cd90 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb30aa9c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3040c4de0 con 0x7fb3040ca610 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb309039640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb30406cd90 0x7fb3040c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb303fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb3040bd720 0x7fb304158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47122/0 (socket says 172.21.15.89:47122) 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb303fff640 1 -- 172.21.15.89:0/2996202424 learned_addr learned my addr 172.21.15.89:0/2996202424 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb308838640 1 --2- 172.21.15.89:0/2996202424 >> v2:172.21.15.97:3300/0 conn(0x7fb3040ca610 0x7fb3040c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb3037fe640 1 -- 172.21.15.89:0/2996202424 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955718992 0 0) 0x7fb304155790 con 0x7fb3040bd720 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb3037fe640 1 -- 172.21.15.89:0/2996202424 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f4003530 con 0x7fb3040bd720 2023-12-07T10:00:57.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb309039640 1 -- 172.21.15.89:0/2996202424 >> v2:172.21.15.97:3300/0 conn(0x7fb3040ca610 msgr2=0x7fb3040c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:57.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb309039640 1 --2- 172.21.15.89:0/2996202424 >> v2:172.21.15.97:3300/0 conn(0x7fb3040ca610 0x7fb3040c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb309039640 1 -- 172.21.15.89:0/2996202424 >> v1:172.21.15.89:6789/0 conn(0x7fb3040bd720 legacy=0x7fb304158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.032+0000 7fb309039640 1 -- 172.21.15.89:0/2996202424 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304157e30 con 0x7fb30406cd90 2023-12-07T10:00:57.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb309039640 1 --2- 172.21.15.89:0/2996202424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb30406cd90 0x7fb3040c9a00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb3040acc80 tx=0x7fb2fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd031f76dc04602e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb3037fe640 1 -- 172.21.15.89:0/2996202424 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040c52d0 con 0x7fb30406cd90 2023-12-07T10:00:57.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb3037fe640 1 -- 172.21.15.89:0/2996202424 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0a4e20 con 0x7fb30406cd90 2023-12-07T10:00:57.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb3037fe640 1 -- 172.21.15.89:0/2996202424 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0ac660 con 0x7fb30406cd90 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 -- 172.21.15.89:0/2996202424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb30406cd90 msgr2=0x7fb3040c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/2996202424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb30406cd90 0x7fb3040c9a00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb3040acc80 tx=0x7fb2fc01c4d0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 -- 172.21.15.89:0/2996202424 shutdown_connections 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/2996202424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb30406cd90 0x7fb3040c9a00 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/2996202424 >> v2:172.21.15.97:3300/0 conn(0x7fb3040ca610 0x7fb3040c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 -- 172.21.15.89:0/2996202424 >> 172.21.15.89:0/2996202424 conn(0x7fb304071ea0 msgr2=0x7fb3040722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 -- 172.21.15.89:0/2996202424 shutdown_connections 2023-12-07T10:00:57.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 -- 172.21.15.89:0/2996202424 wait complete. 2023-12-07T10:00:57.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 Processor -- start 2023-12-07T10:00:57.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.036+0000 7fb30aa9c640 1 -- start start 2023-12-07T10:00:57.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb30406cd90 0x7fb3040ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3040bd720 0x7fb304153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 0x7fb3041edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040ac070 con 0x7fb3040ca610 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040ac9d0 con 0x7fb3040bd720 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb304157ac0 con 0x7fb30406cd90 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 0x7fb3041edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 0x7fb3041edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57798/0 (socket says 172.21.15.89:57798) 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 -- 172.21.15.89:0/3610443126 learned_addr learned my addr 172.21.15.89:0/3610443126 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb303fff640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3040bd720 0x7fb304153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb308838640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb30406cd90 0x7fb3040ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 -- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb30406cd90 msgr2=0x7fb3040ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb30406cd90 0x7fb3040ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 -- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3040bd720 msgr2=0x7fb304153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3040bd720 0x7fb304153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 -- 172.21.15.89:0/3610443126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009a70 con 0x7fb3040ca610 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb308838640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb30406cd90 0x7fb3040ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:57.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb303fff640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3040bd720 0x7fb304153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:57.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb309039640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 0x7fb3041edd90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01a310 tx=0x7fb2fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc009450 con 0x7fb3040ca610 2023-12-07T10:00:57.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0accd0 con 0x7fb3040ca610 2023-12-07T10:00:57.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb304157500 con 0x7fb3040ca610 2023-12-07T10:00:57.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0b8690 con 0x7fb3040ca610 2023-12-07T10:00:57.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3040abc90 con 0x7fb3040ca610 2023-12-07T10:00:57.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.040+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3040abad0 con 0x7fb3040ca610 2023-12-07T10:00:57.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.044+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2fc0b87f0 con 0x7fb3040ca610 2023-12-07T10:00:57.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.044+0000 7fb3017fa640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2e8066900 0x7fb2e8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.044+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3040cac00 con 0x7fb3040ca610 2023-12-07T10:00:57.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.044+0000 7fb308838640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2e8066900 0x7fb2e8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.044+0000 7fb308838640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2e8066900 0x7fb2e8068dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009b10 tx=0x7fb2f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.048+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2fc0ebe80 con 0x7fb3040ca610 2023-12-07T10:00:57.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.228+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb30404e890 con 0x7fb3040ca610 2023-12-07T10:00:57.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.228+0000 7fb3017fa640 1 -- 172.21.15.89:0/3610443126 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4907 (secure 0 0 0) 0x7fb2fc0bc090 con 0x7fb3040ca610 2023-12-07T10:00:57.235 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:57.235 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-07T10:00:57.235 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 33 2023-12-07T10:00:57.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2e8066900 msgr2=0x7fb2e8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2e8066900 0x7fb2e8068dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009b10 tx=0x7fb2f8008040 comp rx=0 tx=0).stop 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 msgr2=0x7fb3041edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 0x7fb3041edd90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01a310 tx=0x7fb2fc01ad10 comp rx=0 tx=0).stop 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 shutdown_connections 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3040ca610 0x7fb3041edd90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3040bd720 0x7fb304153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2e8066900 0x7fb2e8068dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 --2- 172.21.15.89:0/3610443126 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb30406cd90 0x7fb3040ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 >> 172.21.15.89:0/3610443126 conn(0x7fb304071ea0 msgr2=0x7fb304072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 shutdown_connections 2023-12-07T10:00:57.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.232+0000 7fb30aa9c640 1 -- 172.21.15.89:0/3610443126 wait complete. 2023-12-07T10:00:57.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:00:57.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 Processor -- start 2023-12-07T10:00:57.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 -- start start 2023-12-07T10:00:57.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4dfc0ca610 0x7f4dfc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4dfc0bd720 0x7f4dfc0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc155790 con 0x7f4dfc06cd90 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c4b00 con 0x7f4dfc0ca610 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e0465f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c4de0 con 0x7f4dfc0bd720 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e023fb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4dfc0ca610 0x7f4dfc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e02bfc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4dfc06cd90 0x7f4dfc158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47136/0 (socket says 172.21.15.89:47136) 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e02bfc640 1 -- 172.21.15.89:0/900038090 learned_addr learned my addr 172.21.15.89:0/900038090 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e01bfa640 1 --2- 172.21.15.89:0/900038090 >> v2:172.21.15.97:3300/0 conn(0x7f4dfc0bd720 0x7f4dfc0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e023fb640 1 -- 172.21.15.89:0/900038090 >> v2:172.21.15.97:3300/0 conn(0x7f4dfc0bd720 msgr2=0x7f4dfc0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:57.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e023fb640 1 --2- 172.21.15.89:0/900038090 >> v2:172.21.15.97:3300/0 conn(0x7f4dfc0bd720 0x7f4dfc0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e023fb640 1 -- 172.21.15.89:0/900038090 >> v1:172.21.15.89:6789/0 conn(0x7f4dfc06cd90 legacy=0x7f4dfc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e013f9640 1 -- 172.21.15.89:0/900038090 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494743764 0 0) 0x7f4dfc155790 con 0x7f4dfc06cd90 2023-12-07T10:00:57.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.388+0000 7f4e023fb640 1 -- 172.21.15.89:0/900038090 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc157e30 con 0x7f4dfc0ca610 2023-12-07T10:00:57.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e023fb640 1 --2- 172.21.15.89:0/900038090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc0ca610 0x7f4dfc0c94c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0ca380 tx=0x7f4df801c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72040d9d084c3fd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e013f9640 1 -- 172.21.15.89:0/900038090 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0c52d0 con 0x7f4dfc0ca610 2023-12-07T10:00:57.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e013f9640 1 -- 172.21.15.89:0/900038090 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df80a4860 con 0x7f4dfc0ca610 2023-12-07T10:00:57.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e013f9640 1 -- 172.21.15.89:0/900038090 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80a4bf0 con 0x7f4dfc0ca610 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 -- 172.21.15.89:0/900038090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc0ca610 msgr2=0x7f4dfc0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 --2- 172.21.15.89:0/900038090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc0ca610 0x7f4dfc0c94c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0ca380 tx=0x7f4df801c020 comp rx=0 tx=0).stop 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 -- 172.21.15.89:0/900038090 shutdown_connections 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 --2- 172.21.15.89:0/900038090 >> v2:172.21.15.97:3300/0 conn(0x7f4dfc0bd720 0x7f4dfc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 --2- 172.21.15.89:0/900038090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc0ca610 0x7f4dfc0c94c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 -- 172.21.15.89:0/900038090 >> 172.21.15.89:0/900038090 conn(0x7f4dfc071ea0 msgr2=0x7f4dfc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 -- 172.21.15.89:0/900038090 shutdown_connections 2023-12-07T10:00:57.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.392+0000 7f4e0465f640 1 -- 172.21.15.89:0/900038090 wait complete. 2023-12-07T10:00:57.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 Processor -- start 2023-12-07T10:00:57.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 -- start start 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 0x7f4dfc0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dfc0bd720 0x7f4dfc0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4dfc0ca610 0x7f4dfc1f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0aaa70 con 0x7f4dfc06cd90 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0ad150 con 0x7f4dfc0bd720 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc151c20 con 0x7f4dfc0ca610 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 0x7f4dfc0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 0x7f4dfc0ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57822/0 (socket says 172.21.15.89:57822) 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 -- 172.21.15.89:0/3062739241 learned_addr learned my addr 172.21.15.89:0/3062739241 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e02bfc640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4dfc0ca610 0x7f4dfc1f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e01bfa640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dfc0bd720 0x7f4dfc0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 -- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4dfc0ca610 msgr2=0x7f4dfc1f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4dfc0ca610 0x7f4dfc1f13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 -- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dfc0bd720 msgr2=0x7f4dfc0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dfc0bd720 0x7f4dfc0ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 -- 172.21.15.89:0/3062739241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009420 con 0x7f4dfc06cd90 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e023fb640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 0x7f4dfc0ac600 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4df801c500 tx=0x7f4df80190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8004230 con 0x7f4dfc06cd90 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8004390 con 0x7f4dfc06cd90 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc0ac170 con 0x7f4dfc06cd90 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80ac850 con 0x7f4dfc06cd90 2023-12-07T10:00:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.396+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc151e70 con 0x7f4dfc06cd90 2023-12-07T10:00:57.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.400+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc04e890 con 0x7f4dfc06cd90 2023-12-07T10:00:57.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.400+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4df80b3040 con 0x7f4dfc06cd90 2023-12-07T10:00:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.400+0000 7f4df2ffd640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4de00668d0 0x7f4de0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.400+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dfc0cac00 con 0x7f4dfc06cd90 2023-12-07T10:00:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.400+0000 7f4e01bfa640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4de00668d0 0x7f4de0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.400+0000 7f4e01bfa640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4de00668d0 0x7f4de0068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0af510 tx=0x7f4dec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.404+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4df80eaf20 con 0x7f4dfc06cd90 2023-12-07T10:00:57.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.556+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dfc06cb70 con 0x7f4dfc06cd90 2023-12-07T10:00:57.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.556+0000 7f4df2ffd640 1 -- 172.21.15.89:0/3062739241 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f4df80c3020 con 0x7f4dfc06cd90 2023-12-07T10:00:57.563 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:57.563 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":49,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:54.224366+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:00:57.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4de00668d0 msgr2=0x7f4de0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4de00668d0 0x7f4de0068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0af510 tx=0x7f4dec008040 comp rx=0 tx=0).stop 2023-12-07T10:00:57.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 msgr2=0x7f4dfc0ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 0x7f4dfc0ac600 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4df801c500 tx=0x7f4df80190e0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 shutdown_connections 2023-12-07T10:00:57.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4de00668d0 0x7f4de0068d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4dfc0ca610 0x7f4dfc1f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dfc0bd720 0x7f4dfc0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 --2- 172.21.15.89:0/3062739241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dfc06cd90 0x7f4dfc0ac600 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 >> 172.21.15.89:0/3062739241 conn(0x7f4dfc071ea0 msgr2=0x7f4dfc15f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:57.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 shutdown_connections 2023-12-07T10:00:57.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.560+0000 7f4e0465f640 1 -- 172.21.15.89:0/3062739241 wait complete. 2023-12-07T10:00:57.584 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T10:00:57.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:57.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 Processor -- start 2023-12-07T10:00:57.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 -- start start 2023-12-07T10:00:57.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34a0152ce0 0x7f34a006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34a006db80 0x7f34a00700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a00c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a0159b10 con 0x7f34a006db80 2023-12-07T10:00:57.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a006bea0 con 0x7f34a0152ce0 2023-12-07T10:00:57.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a72c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0159550 con 0x7f34a00705e0 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a4864640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34a006db80 0x7f34a00700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a4864640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34a006db80 0x7f34a00700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57838/0 (socket says 172.21.15.89:57838) 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.716+0000 7f34a4864640 1 -- 172.21.15.89:0/3666717871 learned_addr learned my addr 172.21.15.89:0/3666717871 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a5866640 1 --2- 172.21.15.89:0/3666717871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a00c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a5065640 1 --2- 172.21.15.89:0/3666717871 >> v2:172.21.15.97:3300/0 conn(0x7f34a0152ce0 0x7f34a006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a4864640 1 -- 172.21.15.89:0/3666717871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 msgr2=0x7f34a00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a4864640 1 --2- 172.21.15.89:0/3666717871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a00c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a4864640 1 -- 172.21.15.89:0/3666717871 >> v2:172.21.15.97:3300/0 conn(0x7f34a0152ce0 msgr2=0x7f34a006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a4864640 1 --2- 172.21.15.89:0/3666717871 >> v2:172.21.15.97:3300/0 conn(0x7f34a0152ce0 0x7f34a006c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a4864640 1 -- 172.21.15.89:0/3666717871 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0159830 con 0x7f34a006db80 2023-12-07T10:00:57.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a4864640 1 --2- 172.21.15.89:0/3666717871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a00700a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f34a00c2800 tx=0x7f349001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac22db779897e03 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f3497fff640 1 -- 172.21.15.89:0/3666717871 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900a7070 con 0x7f34a006db80 2023-12-07T10:00:57.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f3497fff640 1 -- 172.21.15.89:0/3666717871 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900ab430 con 0x7f34a006db80 2023-12-07T10:00:57.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f3497fff640 1 -- 172.21.15.89:0/3666717871 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900ab7c0 con 0x7f34a006db80 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a72c9640 1 -- 172.21.15.89:0/3666717871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 msgr2=0x7f34a00700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.720+0000 7f34a72c9640 1 --2- 172.21.15.89:0/3666717871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a00700a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f34a00c2800 tx=0x7f349001c470 comp rx=0 tx=0).stop 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- 172.21.15.89:0/3666717871 shutdown_connections 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 --2- 172.21.15.89:0/3666717871 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a00c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 --2- 172.21.15.89:0/3666717871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a00700a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 --2- 172.21.15.89:0/3666717871 >> v2:172.21.15.97:3300/0 conn(0x7f34a0152ce0 0x7f34a006c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- 172.21.15.89:0/3666717871 >> 172.21.15.89:0/3666717871 conn(0x7f34a00c2ad0 msgr2=0x7f34a00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- 172.21.15.89:0/3666717871 shutdown_connections 2023-12-07T10:00:57.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- 172.21.15.89:0/3666717871 wait complete. 2023-12-07T10:00:57.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 Processor -- start 2023-12-07T10:00:57.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- start start 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a01f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a0152ce0 0x7f34a01570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0156940 con 0x7f34a006db80 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0153260 con 0x7f34a0152ce0 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a72c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0153540 con 0x7f34a00705e0 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a01f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a01f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57842/0 (socket says 172.21.15.89:57842) 2023-12-07T10:00:57.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 -- 172.21.15.89:0/1678493308 learned_addr learned my addr 172.21.15.89:0/1678493308 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5866640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a0152ce0 0x7f34a01570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a4864640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 -- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 msgr2=0x7f34a015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a015b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 -- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a0152ce0 msgr2=0x7f34a01570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a0152ce0 0x7f34a01570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 -- 172.21.15.89:0/1678493308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900094d0 con 0x7f34a006db80 2023-12-07T10:00:57.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5866640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a0152ce0 0x7f34a01570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:57.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f34a5065640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a01f23b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d5f0 tx=0x7f349c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.724+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0125f0 con 0x7f34a006db80 2023-12-07T10:00:57.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c012750 con 0x7f34a006db80 2023-12-07T10:00:57.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c012ae0 con 0x7f34a006db80 2023-12-07T10:00:57.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0156b90 con 0x7f34a006db80 2023-12-07T10:00:57.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a0158840 con 0x7f34a006db80 2023-12-07T10:00:57.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a004e890 con 0x7f34a006db80 2023-12-07T10:00:57.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f349c012c40 con 0x7f34a006db80 2023-12-07T10:00:57.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f3495ffb640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34840668d0 0x7f3484068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:57.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f349c084890 con 0x7f34a006db80 2023-12-07T10:00:57.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f34a4864640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34840668d0 0x7f3484068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:57.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.728+0000 7f34a4864640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34840668d0 0x7f3484068d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34900af000 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:57.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.732+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f349c051ac0 con 0x7f34a006db80 2023-12-07T10:00:57.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.880+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34a014ac20 con 0x7f34840668d0 2023-12-07T10:00:57.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.888+0000 7f3495ffb640 1 -- 172.21.15.89:0/1678493308 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288744 (secure 0 0 0) 0x7f34a014ac20 con 0x7f34840668d0 2023-12-07T10:00:57.898 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:57.899 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34840668d0 msgr2=0x7f3484068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34840668d0 0x7f3484068d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34900af000 tx=0x7f3490008040 comp rx=0 tx=0).stop 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 msgr2=0x7f34a01f23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a01f23b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d5f0 tx=0x7f349c00dab0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 shutdown_connections 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34a0152ce0 0x7f34a01570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34840668d0 0x7f3484068d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f34a00705e0 0x7f34a015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 --2- 172.21.15.89:0/1678493308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a006db80 0x7f34a01f23b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:57.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 >> 172.21.15.89:0/1678493308 conn(0x7f34a00c2ad0 msgr2=0x7f34a00712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:57.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 shutdown_connections 2023-12-07T10:00:57.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:57.892+0000 7f34a72c9640 1 -- 172.21.15.89:0/1678493308 wait complete. 2023-12-07T10:00:57.918 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-12-07T10:00:56.361452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226148,"kb_used_data":5776,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748572,"statfs":{"total":773094113280,"available":772862537728,"internally_reserved":0,"allocated":5914624,"data_stored":3145100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534184"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745243+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:00:54.745243+0000","last_peered":"2023-12-07T10:00:54.745243+0000","last_clean":"2023-12-07T10:00:54.745243+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:00:54.745243+0000","last_undegraded":"2023-12-07T10:00:54.745243+0000","last_fullsized":"2023-12-07T10:00:54.745243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433606+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:00:54.433606+0000","last_peered":"2023-12-07T10:00:54.433606+0000","last_clean":"2023-12-07T10:00:54.433606+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:00:54.433606+0000","last_undegraded":"2023-12-07T10:00:54.433606+0000","last_fullsized":"2023-12-07T10:00:54.433606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234874+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:00:54.234874+0000","last_peered":"2023-12-07T10:00:54.234874+0000","last_clean":"2023-12-07T10:00:54.234874+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:00:54.234874+0000","last_undegraded":"2023-12-07T10:00:54.234874+0000","last_fullsized":"2023-12-07T10:00:54.234874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233005+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:00:54.233005+0000","last_peered":"2023-12-07T10:00:54.233005+0000","last_clean":"2023-12-07T10:00:54.233005+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:00:54.233005+0000","last_undegraded":"2023-12-07T10:00:54.233005+0000","last_fullsized":"2023-12-07T10:00:54.233005+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745166+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:00:54.745166+0000","last_peered":"2023-12-07T10:00:54.745166+0000","last_clean":"2023-12-07T10:00:54.745166+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:00:54.745166+0000","last_undegraded":"2023-12-07T10:00:54.745166+0000","last_fullsized":"2023-12-07T10:00:54.745166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933302+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:00:54.933302+0000","last_peered":"2023-12-07T10:00:54.933302+0000","last_clean":"2023-12-07T10:00:54.933302+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:00:54.933302+0000","last_undegraded":"2023-12-07T10:00:54.933302+0000","last_fullsized":"2023-12-07T10:00:54.933302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235314+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:00:54.235314+0000","last_peered":"2023-12-07T10:00:54.235314+0000","last_clean":"2023-12-07T10:00:54.235314+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:00:54.235314+0000","last_undegraded":"2023-12-07T10:00:54.235314+0000","last_fullsized":"2023-12-07T10:00:54.235314+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433367+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:00:54.433367+0000","last_peered":"2023-12-07T10:00:54.433367+0000","last_clean":"2023-12-07T10:00:54.433367+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:00:54.433367+0000","last_undegraded":"2023-12-07T10:00:54.433367+0000","last_fullsized":"2023-12-07T10:00:54.433367+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234621+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:00:54.234621+0000","last_peered":"2023-12-07T10:00:54.234621+0000","last_clean":"2023-12-07T10:00:54.234621+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:00:54.234621+0000","last_undegraded":"2023-12-07T10:00:54.234621+0000","last_fullsized":"2023-12-07T10:00:54.234621+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731818+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:00:54.731818+0000","last_peered":"2023-12-07T10:00:54.731818+0000","last_clean":"2023-12-07T10:00:54.731818+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:00:54.731818+0000","last_undegraded":"2023-12-07T10:00:54.731818+0000","last_fullsized":"2023-12-07T10:00:54.731818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731747+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:00:54.731747+0000","last_peered":"2023-12-07T10:00:54.731747+0000","last_clean":"2023-12-07T10:00:54.731747+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:00:54.731747+0000","last_undegraded":"2023-12-07T10:00:54.731747+0000","last_fullsized":"2023-12-07T10:00:54.731747+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233083+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:00:54.233083+0000","last_peered":"2023-12-07T10:00:54.233083+0000","last_clean":"2023-12-07T10:00:54.233083+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:00:54.233083+0000","last_undegraded":"2023-12-07T10:00:54.233083+0000","last_fullsized":"2023-12-07T10:00:54.233083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934683+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:00:54.934683+0000","last_peered":"2023-12-07T10:00:54.934683+0000","last_clean":"2023-12-07T10:00:54.934683+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:00:54.934683+0000","last_undegraded":"2023-12-07T10:00:54.934683+0000","last_fullsized":"2023-12-07T10:00:54.934683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235139+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:00:54.235139+0000","last_peered":"2023-12-07T10:00:54.235139+0000","last_clean":"2023-12-07T10:00:54.235139+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:00:54.235139+0000","last_undegraded":"2023-12-07T10:00:54.235139+0000","last_fullsized":"2023-12-07T10:00:54.235139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234858+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:00:54.234858+0000","last_peered":"2023-12-07T10:00:54.234858+0000","last_clean":"2023-12-07T10:00:54.234858+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:00:54.234858+0000","last_undegraded":"2023-12-07T10:00:54.234858+0000","last_fullsized":"2023-12-07T10:00:54.234858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933303+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:00:54.933303+0000","last_peered":"2023-12-07T10:00:54.933303+0000","last_clean":"2023-12-07T10:00:54.933303+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:00:54.933303+0000","last_undegraded":"2023-12-07T10:00:54.933303+0000","last_fullsized":"2023-12-07T10:00:54.933303+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433779+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:00:54.433779+0000","last_peered":"2023-12-07T10:00:54.433779+0000","last_clean":"2023-12-07T10:00:54.433779+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:00:54.433779+0000","last_undegraded":"2023-12-07T10:00:54.433779+0000","last_fullsized":"2023-12-07T10:00:54.433779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235139+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:00:54.235139+0000","last_peered":"2023-12-07T10:00:54.235139+0000","last_clean":"2023-12-07T10:00:54.235139+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:00:54.235139+0000","last_undegraded":"2023-12-07T10:00:54.235139+0000","last_fullsized":"2023-12-07T10:00:54.235139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745082+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:00:54.745082+0000","last_peered":"2023-12-07T10:00:54.745082+0000","last_clean":"2023-12-07T10:00:54.745082+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:00:54.745082+0000","last_undegraded":"2023-12-07T10:00:54.745082+0000","last_fullsized":"2023-12-07T10:00:54.745082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433302+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:54.433302+0000","last_peered":"2023-12-07T10:00:54.433302+0000","last_clean":"2023-12-07T10:00:54.433302+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:00:54.433302+0000","last_undegraded":"2023-12-07T10:00:54.433302+0000","last_fullsized":"2023-12-07T10:00:54.433302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234441+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:00:54.234441+0000","last_peered":"2023-12-07T10:00:54.234441+0000","last_clean":"2023-12-07T10:00:54.234441+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:00:54.234441+0000","last_undegraded":"2023-12-07T10:00:54.234441+0000","last_fullsized":"2023-12-07T10:00:54.234441+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433428+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:00:54.433428+0000","last_peered":"2023-12-07T10:00:54.433428+0000","last_clean":"2023-12-07T10:00:54.433428+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:00:54.433428+0000","last_undegraded":"2023-12-07T10:00:54.433428+0000","last_fullsized":"2023-12-07T10:00:54.433428+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234614+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:00:54.234614+0000","last_peered":"2023-12-07T10:00:54.234614+0000","last_clean":"2023-12-07T10:00:54.234614+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:00:54.234614+0000","last_undegraded":"2023-12-07T10:00:54.234614+0000","last_fullsized":"2023-12-07T10:00:54.234614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934498+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:00:54.934498+0000","last_peered":"2023-12-07T10:00:54.934498+0000","last_clean":"2023-12-07T10:00:54.934498+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:00:54.934498+0000","last_undegraded":"2023-12-07T10:00:54.934498+0000","last_fullsized":"2023-12-07T10:00:54.934498+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745242+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:00:54.745242+0000","last_peered":"2023-12-07T10:00:54.745242+0000","last_clean":"2023-12-07T10:00:54.745242+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:00:54.745242+0000","last_undegraded":"2023-12-07T10:00:54.745242+0000","last_fullsized":"2023-12-07T10:00:54.745242+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233354+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:00:54.233354+0000","last_peered":"2023-12-07T10:00:54.233354+0000","last_clean":"2023-12-07T10:00:54.233354+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:00:54.233354+0000","last_undegraded":"2023-12-07T10:00:54.233354+0000","last_fullsized":"2023-12-07T10:00:54.233354+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933584+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:00:54.933584+0000","last_peered":"2023-12-07T10:00:54.933584+0000","last_clean":"2023-12-07T10:00:54.933584+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:00:54.933584+0000","last_undegraded":"2023-12-07T10:00:54.933584+0000","last_fullsized":"2023-12-07T10:00:54.933584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745090+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:00:54.745090+0000","last_peered":"2023-12-07T10:00:54.745090+0000","last_clean":"2023-12-07T10:00:54.745090+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:00:54.745090+0000","last_undegraded":"2023-12-07T10:00:54.745090+0000","last_fullsized":"2023-12-07T10:00:54.745090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433562+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:00:54.433562+0000","last_peered":"2023-12-07T10:00:54.433562+0000","last_clean":"2023-12-07T10:00:54.433562+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:00:54.433562+0000","last_undegraded":"2023-12-07T10:00:54.433562+0000","last_fullsized":"2023-12-07T10:00:54.433562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234429+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:00:54.234429+0000","last_peered":"2023-12-07T10:00:54.234429+0000","last_clean":"2023-12-07T10:00:54.234429+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:00:54.234429+0000","last_undegraded":"2023-12-07T10:00:54.234429+0000","last_fullsized":"2023-12-07T10:00:54.234429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.744921+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:00:54.744921+0000","last_peered":"2023-12-07T10:00:54.744921+0000","last_clean":"2023-12-07T10:00:54.744921+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:00:54.744921+0000","last_undegraded":"2023-12-07T10:00:54.744921+0000","last_fullsized":"2023-12-07T10:00:54.744921+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933458+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:00:54.933458+0000","last_peered":"2023-12-07T10:00:54.933458+0000","last_clean":"2023-12-07T10:00:54.933458+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:00:54.933458+0000","last_undegraded":"2023-12-07T10:00:54.933458+0000","last_fullsized":"2023-12-07T10:00:54.933458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933656+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:00:54.933656+0000","last_peered":"2023-12-07T10:00:54.933656+0000","last_clean":"2023-12-07T10:00:54.933656+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:00:54.933656+0000","last_undegraded":"2023-12-07T10:00:54.933656+0000","last_fullsized":"2023-12-07T10:00:54.933656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933752+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:00:54.933752+0000","last_peered":"2023-12-07T10:00:54.933752+0000","last_clean":"2023-12-07T10:00:54.933752+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:00:54.933752+0000","last_undegraded":"2023-12-07T10:00:54.933752+0000","last_fullsized":"2023-12-07T10:00:54.933752+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731921+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:00:54.731921+0000","last_peered":"2023-12-07T10:00:54.731921+0000","last_clean":"2023-12-07T10:00:54.731921+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:00:54.731921+0000","last_undegraded":"2023-12-07T10:00:54.731921+0000","last_fullsized":"2023-12-07T10:00:54.731921+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433593+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:00:54.433593+0000","last_peered":"2023-12-07T10:00:54.433593+0000","last_clean":"2023-12-07T10:00:54.433593+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:00:54.433593+0000","last_undegraded":"2023-12-07T10:00:54.433593+0000","last_fullsized":"2023-12-07T10:00:54.433593+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933582+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:00:54.933582+0000","last_peered":"2023-12-07T10:00:54.933582+0000","last_clean":"2023-12-07T10:00:54.933582+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:00:54.933582+0000","last_undegraded":"2023-12-07T10:00:54.933582+0000","last_fullsized":"2023-12-07T10:00:54.933582+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933700+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:00:54.933700+0000","last_peered":"2023-12-07T10:00:54.933700+0000","last_clean":"2023-12-07T10:00:54.933700+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:00:54.933700+0000","last_undegraded":"2023-12-07T10:00:54.933700+0000","last_fullsized":"2023-12-07T10:00:54.933700+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933602+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:00:54.933602+0000","last_peered":"2023-12-07T10:00:54.933602+0000","last_clean":"2023-12-07T10:00:54.933602+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:00:54.933602+0000","last_undegraded":"2023-12-07T10:00:54.933602+0000","last_fullsized":"2023-12-07T10:00:54.933602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233188+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:00:54.233188+0000","last_peered":"2023-12-07T10:00:54.233188+0000","last_clean":"2023-12-07T10:00:54.233188+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:00:54.233188+0000","last_undegraded":"2023-12-07T10:00:54.233188+0000","last_fullsized":"2023-12-07T10:00:54.233188+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433268+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:00:54.433268+0000","last_peered":"2023-12-07T10:00:54.433268+0000","last_clean":"2023-12-07T10:00:54.433268+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:00:54.433268+0000","last_undegraded":"2023-12-07T10:00:54.433268+0000","last_fullsized":"2023-12-07T10:00:54.433268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234594+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:00:54.234594+0000","last_peered":"2023-12-07T10:00:54.234594+0000","last_clean":"2023-12-07T10:00:54.234594+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:00:54.234594+0000","last_undegraded":"2023-12-07T10:00:54.234594+0000","last_fullsized":"2023-12-07T10:00:54.234594+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433340+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:54.433340+0000","last_peered":"2023-12-07T10:00:54.433340+0000","last_clean":"2023-12-07T10:00:54.433340+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:00:54.433340+0000","last_undegraded":"2023-12-07T10:00:54.433340+0000","last_fullsized":"2023-12-07T10:00:54.433340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933339+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:00:54.933339+0000","last_peered":"2023-12-07T10:00:54.933339+0000","last_clean":"2023-12-07T10:00:54.933339+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:00:54.933339+0000","last_undegraded":"2023-12-07T10:00:54.933339+0000","last_fullsized":"2023-12-07T10:00:54.933339+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934707+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:00:54.934707+0000","last_peered":"2023-12-07T10:00:54.934707+0000","last_clean":"2023-12-07T10:00:54.934707+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:00:54.934707+0000","last_undegraded":"2023-12-07T10:00:54.934707+0000","last_fullsized":"2023-12-07T10:00:54.934707+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232693+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:00:54.232693+0000","last_peered":"2023-12-07T10:00:54.232693+0000","last_clean":"2023-12-07T10:00:54.232693+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:00:54.232693+0000","last_undegraded":"2023-12-07T10:00:54.232693+0000","last_fullsized":"2023-12-07T10:00:54.232693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433227+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:00:54.433227+0000","last_peered":"2023-12-07T10:00:54.433227+0000","last_clean":"2023-12-07T10:00:54.433227+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:00:54.433227+0000","last_undegraded":"2023-12-07T10:00:54.433227+0000","last_fullsized":"2023-12-07T10:00:54.433227+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234205+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:00:54.234205+0000","last_peered":"2023-12-07T10:00:54.234205+0000","last_clean":"2023-12-07T10:00:54.234205+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:00:54.234205+0000","last_undegraded":"2023-12-07T10:00:54.234205+0000","last_fullsized":"2023-12-07T10:00:54.234205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234655+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:00:54.234655+0000","last_peered":"2023-12-07T10:00:54.234655+0000","last_clean":"2023-12-07T10:00:54.234655+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:00:54.234655+0000","last_undegraded":"2023-12-07T10:00:54.234655+0000","last_fullsized":"2023-12-07T10:00:54.234655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235305+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:00:54.235305+0000","last_peered":"2023-12-07T10:00:54.235305+0000","last_clean":"2023-12-07T10:00:54.235305+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:00:54.235305+0000","last_undegraded":"2023-12-07T10:00:54.235305+0000","last_fullsized":"2023-12-07T10:00:54.235305+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235194+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:00:54.235194+0000","last_peered":"2023-12-07T10:00:54.235194+0000","last_clean":"2023-12-07T10:00:54.235194+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:00:54.235194+0000","last_undegraded":"2023-12-07T10:00:54.235194+0000","last_fullsized":"2023-12-07T10:00:54.235194+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433697+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:00:54.433697+0000","last_peered":"2023-12-07T10:00:54.433697+0000","last_clean":"2023-12-07T10:00:54.433697+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:00:54.433697+0000","last_undegraded":"2023-12-07T10:00:54.433697+0000","last_fullsized":"2023-12-07T10:00:54.433697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731561+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:00:54.731561+0000","last_peered":"2023-12-07T10:00:54.731561+0000","last_clean":"2023-12-07T10:00:54.731561+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:00:54.731561+0000","last_undegraded":"2023-12-07T10:00:54.731561+0000","last_fullsized":"2023-12-07T10:00:54.731561+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235209+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:00:54.235209+0000","last_peered":"2023-12-07T10:00:54.235209+0000","last_clean":"2023-12-07T10:00:54.235209+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:00:54.235209+0000","last_undegraded":"2023-12-07T10:00:54.235209+0000","last_fullsized":"2023-12-07T10:00:54.235209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235009+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:00:54.235009+0000","last_peered":"2023-12-07T10:00:54.235009+0000","last_clean":"2023-12-07T10:00:54.235009+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:00:54.235009+0000","last_undegraded":"2023-12-07T10:00:54.235009+0000","last_fullsized":"2023-12-07T10:00:54.235009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"48'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234887+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:00:54.234887+0000","last_peered":"2023-12-07T10:00:54.234887+0000","last_clean":"2023-12-07T10:00:54.234887+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:00:54.234887+0000","last_undegraded":"2023-12-07T10:00:54.234887+0000","last_fullsized":"2023-12-07T10:00:54.234887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232907+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:00:54.232907+0000","last_peered":"2023-12-07T10:00:54.232907+0000","last_clean":"2023-12-07T10:00:54.232907+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:00:54.232907+0000","last_undegraded":"2023-12-07T10:00:54.232907+0000","last_fullsized":"2023-12-07T10:00:54.232907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433341+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:00:54.433341+0000","last_peered":"2023-12-07T10:00:54.433341+0000","last_clean":"2023-12-07T10:00:54.433341+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:00:54.433341+0000","last_undegraded":"2023-12-07T10:00:54.433341+0000","last_fullsized":"2023-12-07T10:00:54.433341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234614+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:00:54.234614+0000","last_peered":"2023-12-07T10:00:54.234614+0000","last_clean":"2023-12-07T10:00:54.234614+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:00:54.234614+0000","last_undegraded":"2023-12-07T10:00:54.234614+0000","last_fullsized":"2023-12-07T10:00:54.234614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934600+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:00:54.934600+0000","last_peered":"2023-12-07T10:00:54.934600+0000","last_clean":"2023-12-07T10:00:54.934600+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:00:54.934600+0000","last_undegraded":"2023-12-07T10:00:54.934600+0000","last_fullsized":"2023-12-07T10:00:54.934600+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234215+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:00:54.234215+0000","last_peered":"2023-12-07T10:00:54.234215+0000","last_clean":"2023-12-07T10:00:54.234215+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:00:54.234215+0000","last_undegraded":"2023-12-07T10:00:54.234215+0000","last_fullsized":"2023-12-07T10:00:54.234215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232802+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:00:54.232802+0000","last_peered":"2023-12-07T10:00:54.232802+0000","last_clean":"2023-12-07T10:00:54.232802+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:00:54.232802+0000","last_undegraded":"2023-12-07T10:00:54.232802+0000","last_fullsized":"2023-12-07T10:00:54.232802+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234655+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:00:54.234655+0000","last_peered":"2023-12-07T10:00:54.234655+0000","last_clean":"2023-12-07T10:00:54.234655+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:00:54.234655+0000","last_undegraded":"2023-12-07T10:00:54.234655+0000","last_fullsized":"2023-12-07T10:00:54.234655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234741+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:00:54.234741+0000","last_peered":"2023-12-07T10:00:54.234741+0000","last_clean":"2023-12-07T10:00:54.234741+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:00:54.234741+0000","last_undegraded":"2023-12-07T10:00:54.234741+0000","last_fullsized":"2023-12-07T10:00:54.234741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235159+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:00:54.235159+0000","last_peered":"2023-12-07T10:00:54.235159+0000","last_clean":"2023-12-07T10:00:54.235159+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:00:54.235159+0000","last_undegraded":"2023-12-07T10:00:54.235159+0000","last_fullsized":"2023-12-07T10:00:54.235159+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433785+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:00:54.433785+0000","last_peered":"2023-12-07T10:00:54.433785+0000","last_clean":"2023-12-07T10:00:54.433785+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:00:54.433785+0000","last_undegraded":"2023-12-07T10:00:54.433785+0000","last_fullsized":"2023-12-07T10:00:54.433785+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233503+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:00:54.233503+0000","last_peered":"2023-12-07T10:00:54.233503+0000","last_clean":"2023-12-07T10:00:54.233503+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:00:54.233503+0000","last_undegraded":"2023-12-07T10:00:54.233503+0000","last_fullsized":"2023-12-07T10:00:54.233503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933640+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:00:54.933640+0000","last_peered":"2023-12-07T10:00:54.933640+0000","last_clean":"2023-12-07T10:00:54.933640+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:00:54.933640+0000","last_undegraded":"2023-12-07T10:00:54.933640+0000","last_fullsized":"2023-12-07T10:00:54.933640+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433390+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:00:54.433390+0000","last_peered":"2023-12-07T10:00:54.433390+0000","last_clean":"2023-12-07T10:00:54.433390+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:00:54.433390+0000","last_undegraded":"2023-12-07T10:00:54.433390+0000","last_fullsized":"2023-12-07T10:00:54.433390+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233314+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:00:54.233314+0000","last_peered":"2023-12-07T10:00:54.233314+0000","last_clean":"2023-12-07T10:00:54.233314+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:00:54.233314+0000","last_undegraded":"2023-12-07T10:00:54.233314+0000","last_fullsized":"2023-12-07T10:00:54.233314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235144+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:00:54.235144+0000","last_peered":"2023-12-07T10:00:54.235144+0000","last_clean":"2023-12-07T10:00:54.235144+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:00:54.235144+0000","last_undegraded":"2023-12-07T10:00:54.235144+0000","last_fullsized":"2023-12-07T10:00:54.235144+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933498+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:00:54.933498+0000","last_peered":"2023-12-07T10:00:54.933498+0000","last_clean":"2023-12-07T10:00:54.933498+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:00:54.933498+0000","last_undegraded":"2023-12-07T10:00:54.933498+0000","last_fullsized":"2023-12-07T10:00:54.933498+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232955+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:00:54.232955+0000","last_peered":"2023-12-07T10:00:54.232955+0000","last_clean":"2023-12-07T10:00:54.232955+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:00:54.232955+0000","last_undegraded":"2023-12-07T10:00:54.232955+0000","last_fullsized":"2023-12-07T10:00:54.232955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433453+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:00:54.433453+0000","last_peered":"2023-12-07T10:00:54.433453+0000","last_clean":"2023-12-07T10:00:54.433453+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:00:54.433453+0000","last_undegraded":"2023-12-07T10:00:54.433453+0000","last_fullsized":"2023-12-07T10:00:54.433453+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933426+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:00:54.933426+0000","last_peered":"2023-12-07T10:00:54.933426+0000","last_clean":"2023-12-07T10:00:54.933426+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:00:54.933426+0000","last_undegraded":"2023-12-07T10:00:54.933426+0000","last_fullsized":"2023-12-07T10:00:54.933426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731504+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:00:54.731504+0000","last_peered":"2023-12-07T10:00:54.731504+0000","last_clean":"2023-12-07T10:00:54.731504+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:00:54.731504+0000","last_undegraded":"2023-12-07T10:00:54.731504+0000","last_fullsized":"2023-12-07T10:00:54.731504+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933293+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:00:54.933293+0000","last_peered":"2023-12-07T10:00:54.933293+0000","last_clean":"2023-12-07T10:00:54.933293+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:00:54.933293+0000","last_undegraded":"2023-12-07T10:00:54.933293+0000","last_fullsized":"2023-12-07T10:00:54.933293+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232694+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:00:54.232694+0000","last_peered":"2023-12-07T10:00:54.232694+0000","last_clean":"2023-12-07T10:00:54.232694+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:00:54.232694+0000","last_undegraded":"2023-12-07T10:00:54.232694+0000","last_fullsized":"2023-12-07T10:00:54.232694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233492+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:00:54.233492+0000","last_peered":"2023-12-07T10:00:54.233492+0000","last_clean":"2023-12-07T10:00:54.233492+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:00:54.233492+0000","last_undegraded":"2023-12-07T10:00:54.233492+0000","last_fullsized":"2023-12-07T10:00:54.233492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731916+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:00:54.731916+0000","last_peered":"2023-12-07T10:00:54.731916+0000","last_clean":"2023-12-07T10:00:54.731916+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:00:54.731916+0000","last_undegraded":"2023-12-07T10:00:54.731916+0000","last_fullsized":"2023-12-07T10:00:54.731916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233588+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:00:54.233588+0000","last_peered":"2023-12-07T10:00:54.233588+0000","last_clean":"2023-12-07T10:00:54.233588+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:00:54.233588+0000","last_undegraded":"2023-12-07T10:00:54.233588+0000","last_fullsized":"2023-12-07T10:00:54.233588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933736+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:00:54.933736+0000","last_peered":"2023-12-07T10:00:54.933736+0000","last_clean":"2023-12-07T10:00:54.933736+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:00:54.933736+0000","last_undegraded":"2023-12-07T10:00:54.933736+0000","last_fullsized":"2023-12-07T10:00:54.933736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731572+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:00:54.731572+0000","last_peered":"2023-12-07T10:00:54.731572+0000","last_clean":"2023-12-07T10:00:54.731572+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:00:54.731572+0000","last_undegraded":"2023-12-07T10:00:54.731572+0000","last_fullsized":"2023-12-07T10:00:54.731572+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934596+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:00:54.934596+0000","last_peered":"2023-12-07T10:00:54.934596+0000","last_clean":"2023-12-07T10:00:54.934596+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:00:54.934596+0000","last_undegraded":"2023-12-07T10:00:54.934596+0000","last_fullsized":"2023-12-07T10:00:54.934596+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933721+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:00:54.933721+0000","last_peered":"2023-12-07T10:00:54.933721+0000","last_clean":"2023-12-07T10:00:54.933721+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:00:54.933721+0000","last_undegraded":"2023-12-07T10:00:54.933721+0000","last_fullsized":"2023-12-07T10:00:54.933721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233316+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:00:54.233316+0000","last_peered":"2023-12-07T10:00:54.233316+0000","last_clean":"2023-12-07T10:00:54.233316+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:00:54.233316+0000","last_undegraded":"2023-12-07T10:00:54.233316+0000","last_fullsized":"2023-12-07T10:00:54.233316+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433441+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:00:54.433441+0000","last_peered":"2023-12-07T10:00:54.433441+0000","last_clean":"2023-12-07T10:00:54.433441+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:00:54.433441+0000","last_undegraded":"2023-12-07T10:00:54.433441+0000","last_fullsized":"2023-12-07T10:00:54.433441+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731421+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:00:54.731421+0000","last_peered":"2023-12-07T10:00:54.731421+0000","last_clean":"2023-12-07T10:00:54.731421+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:00:54.731421+0000","last_undegraded":"2023-12-07T10:00:54.731421+0000","last_fullsized":"2023-12-07T10:00:54.731421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234767+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:00:54.234767+0000","last_peered":"2023-12-07T10:00:54.234767+0000","last_clean":"2023-12-07T10:00:54.234767+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:00:54.234767+0000","last_undegraded":"2023-12-07T10:00:54.234767+0000","last_fullsized":"2023-12-07T10:00:54.234767+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235239+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:00:54.235239+0000","last_peered":"2023-12-07T10:00:54.235239+0000","last_clean":"2023-12-07T10:00:54.235239+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:00:54.235239+0000","last_undegraded":"2023-12-07T10:00:54.235239+0000","last_fullsized":"2023-12-07T10:00:54.235239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731309+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:00:54.731309+0000","last_peered":"2023-12-07T10:00:54.731309+0000","last_clean":"2023-12-07T10:00:54.731309+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:00:54.731309+0000","last_undegraded":"2023-12-07T10:00:54.731309+0000","last_fullsized":"2023-12-07T10:00:54.731309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731369+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:00:54.731369+0000","last_peered":"2023-12-07T10:00:54.731369+0000","last_clean":"2023-12-07T10:00:54.731369+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:00:54.731369+0000","last_undegraded":"2023-12-07T10:00:54.731369+0000","last_fullsized":"2023-12-07T10:00:54.731369+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433364+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:00:54.433364+0000","last_peered":"2023-12-07T10:00:54.433364+0000","last_clean":"2023-12-07T10:00:54.433364+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:00:54.433364+0000","last_undegraded":"2023-12-07T10:00:54.433364+0000","last_fullsized":"2023-12-07T10:00:54.433364+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433567+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:00:54.433567+0000","last_peered":"2023-12-07T10:00:54.433567+0000","last_clean":"2023-12-07T10:00:54.433567+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:00:54.433567+0000","last_undegraded":"2023-12-07T10:00:54.433567+0000","last_fullsized":"2023-12-07T10:00:54.433567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433443+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:00:54.433443+0000","last_peered":"2023-12-07T10:00:54.433443+0000","last_clean":"2023-12-07T10:00:54.433443+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:00:54.433443+0000","last_undegraded":"2023-12-07T10:00:54.433443+0000","last_fullsized":"2023-12-07T10:00:54.433443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934554+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:00:54.934554+0000","last_peered":"2023-12-07T10:00:54.934554+0000","last_clean":"2023-12-07T10:00:54.934554+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:00:54.934554+0000","last_undegraded":"2023-12-07T10:00:54.934554+0000","last_fullsized":"2023-12-07T10:00:54.934554+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-07T10:00:53.232362+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:00:53.232362+0000","last_peered":"2023-12-07T10:00:53.232362+0000","last_clean":"2023-12-07T10:00:53.232362+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:00:53.232362+0000","last_undegraded":"2023-12-07T10:00:53.232362+0000","last_fullsized":"2023-12-07T10:00:53.232362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":837046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.624},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.49399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":240218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.501}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":247170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.441}]},{"osd":6,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.502},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":598016,"data_stored":248130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.516,"5min":5.516,"15min":5.516},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.5030000000000001,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.468,"5min":3.468,"15min":3.468},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":13.016,"5min":13.016,"15min":13.016},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":13.166,"5min":13.166,"15min":13.166},"last":0.373}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.1690000000000005,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.0809999999999995,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.502}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.7680000000000007,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":1.0089999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":5.75,"5min":5.75,"15min":5.75},"last":0.872}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7050000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":1.028}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":240308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.006}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.94199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":839080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.495},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.879},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:57.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:00:58.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.088+0000 7fe3b99df640 1 Processor -- start 2023-12-07T10:00:58.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b99df640 1 -- start start 2023-12-07T10:00:58.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b99df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3b40a6e50 0x7fe3b40c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b99df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b406c510 con 0x7fe3b4155570 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b99df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b4158cb0 con 0x7fe3b41587f0 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b99df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b40c76d0 con 0x7fe3b40a6e50 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe3b4155570 0x7fe3b40c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47142/0 (socket says 172.21.15.89:47142) 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b2ffd640 1 -- 172.21.15.89:0/591415169 learned_addr learned my addr 172.21.15.89:0/591415169 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3aa7fc640 1 --2- 172.21.15.89:0/591415169 >> v2:172.21.15.89:3300/0 conn(0x7fe3b40a6e50 0x7fe3b40c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b27fc640 1 -- 172.21.15.89:0/591415169 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232035514 0 0) 0x7fe3b406c510 con 0x7fe3b4155570 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3b27fc640 1 -- 172.21.15.89:0/591415169 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a0003530 con 0x7fe3b4155570 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/591415169 >> v1:172.21.15.97:6789/0 conn(0x7fe3b41587f0 legacy=0x7fe3b406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/591415169 >> v1:172.21.15.89:6789/0 conn(0x7fe3b4155570 legacy=0x7fe3b40c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.092+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/591415169 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40c79b0 con 0x7fe3b40a6e50 2023-12-07T10:00:58.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3aa7fc640 1 --2- 172.21.15.89:0/591415169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b40a6e50 0x7fe3b40c6760 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009d90 tx=0x7fe39c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254b70f2e29b6726 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b27fc640 1 -- 172.21.15.89:0/591415169 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0a5880 con 0x7fe3b40a6e50 2023-12-07T10:00:58.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b27fc640 1 -- 172.21.15.89:0/591415169 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c0a59e0 con 0x7fe3b40a6e50 2023-12-07T10:00:58.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b27fc640 1 -- 172.21.15.89:0/591415169 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0a5d70 con 0x7fe3b40a6e50 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 -- 172.21.15.89:0/591415169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b40a6e50 msgr2=0x7fe3b40c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 --2- 172.21.15.89:0/591415169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b40a6e50 0x7fe3b40c6760 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009d90 tx=0x7fe39c01c890 comp rx=0 tx=0).stop 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 -- 172.21.15.89:0/591415169 shutdown_connections 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 --2- 172.21.15.89:0/591415169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b40a6e50 0x7fe3b40c6760 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 -- 172.21.15.89:0/591415169 >> 172.21.15.89:0/591415169 conn(0x7fe3b40c7e60 msgr2=0x7fe3b40c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 -- 172.21.15.89:0/591415169 shutdown_connections 2023-12-07T10:00:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 -- 172.21.15.89:0/591415169 wait complete. 2023-12-07T10:00:58.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 Processor -- start 2023-12-07T10:00:58.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.096+0000 7fe3b99df640 1 -- start start 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b40a6e50 0x7fe3b41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 0x7fe3b41ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b41587f0 0x7fe3b4146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b414c7b0 con 0x7fe3b4155570 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41eca20 con 0x7fe3b41587f0 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b414c0b0 con 0x7fe3b40a6e50 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 0x7fe3b41ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 0x7fe3b41ed170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57870/0 (socket says 172.21.15.89:57870) 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/1170912072 learned_addr learned my addr 172.21.15.89:0/1170912072 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b2ffd640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b40a6e50 0x7fe3b41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b37fe640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b41587f0 0x7fe3b4146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b40a6e50 msgr2=0x7fe3b41502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b40a6e50 0x7fe3b41502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b41587f0 msgr2=0x7fe3b4146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b41587f0 0x7fe3b4146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 -- 172.21.15.89:0/1170912072 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009a70 con 0x7fe3b4155570 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3aa7fc640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 0x7fe3b41ed170 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0194a0 tx=0x7fe39c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b9860 con 0x7fe3b4155570 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c0b99c0 con 0x7fe3b4155570 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b414baf0 con 0x7fe3b4155570 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b9d50 con 0x7fe3b4155570 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b41507f0 con 0x7fe3b4155570 2023-12-07T10:00:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.100+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b404e890 con 0x7fe3b4155570 2023-12-07T10:00:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.104+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe39c0ad440 con 0x7fe3b4155570 2023-12-07T10:00:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.104+0000 7fe3b0ff9640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe3940668d0 0x7fe394068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.104+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe39c11f4f0 con 0x7fe3b4155570 2023-12-07T10:00:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.104+0000 7fe3b2ffd640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe3940668d0 0x7fe394068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.104+0000 7fe3b2ffd640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe3940668d0 0x7fe394068d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40011f0 tx=0x7fe3a4007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.108+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe39c0ec870 con 0x7fe3b4155570 2023-12-07T10:00:58.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.252+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3b4162990 con 0x7fe3940668d0 2023-12-07T10:00:58.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.260+0000 7fe3b0ff9640 1 -- 172.21.15.89:0/1170912072 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288744 (secure 0 0 0) 0x7fe3a4005860 con 0x7fe3940668d0 2023-12-07T10:00:58.272 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:58.273 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe3940668d0 msgr2=0x7fe394068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe3940668d0 0x7fe394068d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40011f0 tx=0x7fe3a4007d40 comp rx=0 tx=0).stop 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 msgr2=0x7fe3b41ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 0x7fe3b41ed170 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0194a0 tx=0x7fe39c019630 comp rx=0 tx=0).stop 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 shutdown_connections 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b41587f0 0x7fe3b4146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3b4155570 0x7fe3b41ed170 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe3940668d0 0x7fe394068d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 --2- 172.21.15.89:0/1170912072 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b40a6e50 0x7fe3b41502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 >> 172.21.15.89:0/1170912072 conn(0x7fe3b40c7e60 msgr2=0x7fe3b406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 shutdown_connections 2023-12-07T10:00:58.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.264+0000 7fe3b99df640 1 -- 172.21.15.89:0/1170912072 wait complete. 2023-12-07T10:00:58.289 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-12-07T10:00:56.361452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226148,"kb_used_data":5776,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748572,"statfs":{"total":773094113280,"available":772862537728,"internally_reserved":0,"allocated":5914624,"data_stored":3145100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534184"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745243+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:00:54.745243+0000","last_peered":"2023-12-07T10:00:54.745243+0000","last_clean":"2023-12-07T10:00:54.745243+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:00:54.745243+0000","last_undegraded":"2023-12-07T10:00:54.745243+0000","last_fullsized":"2023-12-07T10:00:54.745243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433606+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:00:54.433606+0000","last_peered":"2023-12-07T10:00:54.433606+0000","last_clean":"2023-12-07T10:00:54.433606+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:00:54.433606+0000","last_undegraded":"2023-12-07T10:00:54.433606+0000","last_fullsized":"2023-12-07T10:00:54.433606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234874+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:00:54.234874+0000","last_peered":"2023-12-07T10:00:54.234874+0000","last_clean":"2023-12-07T10:00:54.234874+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:00:54.234874+0000","last_undegraded":"2023-12-07T10:00:54.234874+0000","last_fullsized":"2023-12-07T10:00:54.234874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233005+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:00:54.233005+0000","last_peered":"2023-12-07T10:00:54.233005+0000","last_clean":"2023-12-07T10:00:54.233005+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:00:54.233005+0000","last_undegraded":"2023-12-07T10:00:54.233005+0000","last_fullsized":"2023-12-07T10:00:54.233005+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745166+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:00:54.745166+0000","last_peered":"2023-12-07T10:00:54.745166+0000","last_clean":"2023-12-07T10:00:54.745166+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:00:54.745166+0000","last_undegraded":"2023-12-07T10:00:54.745166+0000","last_fullsized":"2023-12-07T10:00:54.745166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933302+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:00:54.933302+0000","last_peered":"2023-12-07T10:00:54.933302+0000","last_clean":"2023-12-07T10:00:54.933302+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:00:54.933302+0000","last_undegraded":"2023-12-07T10:00:54.933302+0000","last_fullsized":"2023-12-07T10:00:54.933302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235314+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:00:54.235314+0000","last_peered":"2023-12-07T10:00:54.235314+0000","last_clean":"2023-12-07T10:00:54.235314+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:00:54.235314+0000","last_undegraded":"2023-12-07T10:00:54.235314+0000","last_fullsized":"2023-12-07T10:00:54.235314+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433367+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:00:54.433367+0000","last_peered":"2023-12-07T10:00:54.433367+0000","last_clean":"2023-12-07T10:00:54.433367+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:00:54.433367+0000","last_undegraded":"2023-12-07T10:00:54.433367+0000","last_fullsized":"2023-12-07T10:00:54.433367+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234621+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:00:54.234621+0000","last_peered":"2023-12-07T10:00:54.234621+0000","last_clean":"2023-12-07T10:00:54.234621+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:00:54.234621+0000","last_undegraded":"2023-12-07T10:00:54.234621+0000","last_fullsized":"2023-12-07T10:00:54.234621+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731818+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:00:54.731818+0000","last_peered":"2023-12-07T10:00:54.731818+0000","last_clean":"2023-12-07T10:00:54.731818+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:00:54.731818+0000","last_undegraded":"2023-12-07T10:00:54.731818+0000","last_fullsized":"2023-12-07T10:00:54.731818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731747+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:00:54.731747+0000","last_peered":"2023-12-07T10:00:54.731747+0000","last_clean":"2023-12-07T10:00:54.731747+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:00:54.731747+0000","last_undegraded":"2023-12-07T10:00:54.731747+0000","last_fullsized":"2023-12-07T10:00:54.731747+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233083+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:00:54.233083+0000","last_peered":"2023-12-07T10:00:54.233083+0000","last_clean":"2023-12-07T10:00:54.233083+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:00:54.233083+0000","last_undegraded":"2023-12-07T10:00:54.233083+0000","last_fullsized":"2023-12-07T10:00:54.233083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934683+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:00:54.934683+0000","last_peered":"2023-12-07T10:00:54.934683+0000","last_clean":"2023-12-07T10:00:54.934683+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:00:54.934683+0000","last_undegraded":"2023-12-07T10:00:54.934683+0000","last_fullsized":"2023-12-07T10:00:54.934683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235139+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:00:54.235139+0000","last_peered":"2023-12-07T10:00:54.235139+0000","last_clean":"2023-12-07T10:00:54.235139+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:00:54.235139+0000","last_undegraded":"2023-12-07T10:00:54.235139+0000","last_fullsized":"2023-12-07T10:00:54.235139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234858+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:00:54.234858+0000","last_peered":"2023-12-07T10:00:54.234858+0000","last_clean":"2023-12-07T10:00:54.234858+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:00:54.234858+0000","last_undegraded":"2023-12-07T10:00:54.234858+0000","last_fullsized":"2023-12-07T10:00:54.234858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933303+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:00:54.933303+0000","last_peered":"2023-12-07T10:00:54.933303+0000","last_clean":"2023-12-07T10:00:54.933303+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:00:54.933303+0000","last_undegraded":"2023-12-07T10:00:54.933303+0000","last_fullsized":"2023-12-07T10:00:54.933303+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433779+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:00:54.433779+0000","last_peered":"2023-12-07T10:00:54.433779+0000","last_clean":"2023-12-07T10:00:54.433779+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:00:54.433779+0000","last_undegraded":"2023-12-07T10:00:54.433779+0000","last_fullsized":"2023-12-07T10:00:54.433779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235139+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:00:54.235139+0000","last_peered":"2023-12-07T10:00:54.235139+0000","last_clean":"2023-12-07T10:00:54.235139+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:00:54.235139+0000","last_undegraded":"2023-12-07T10:00:54.235139+0000","last_fullsized":"2023-12-07T10:00:54.235139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745082+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:00:54.745082+0000","last_peered":"2023-12-07T10:00:54.745082+0000","last_clean":"2023-12-07T10:00:54.745082+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:00:54.745082+0000","last_undegraded":"2023-12-07T10:00:54.745082+0000","last_fullsized":"2023-12-07T10:00:54.745082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433302+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:54.433302+0000","last_peered":"2023-12-07T10:00:54.433302+0000","last_clean":"2023-12-07T10:00:54.433302+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:00:54.433302+0000","last_undegraded":"2023-12-07T10:00:54.433302+0000","last_fullsized":"2023-12-07T10:00:54.433302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234441+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:00:54.234441+0000","last_peered":"2023-12-07T10:00:54.234441+0000","last_clean":"2023-12-07T10:00:54.234441+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:00:54.234441+0000","last_undegraded":"2023-12-07T10:00:54.234441+0000","last_fullsized":"2023-12-07T10:00:54.234441+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433428+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:00:54.433428+0000","last_peered":"2023-12-07T10:00:54.433428+0000","last_clean":"2023-12-07T10:00:54.433428+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:00:54.433428+0000","last_undegraded":"2023-12-07T10:00:54.433428+0000","last_fullsized":"2023-12-07T10:00:54.433428+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234614+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:00:54.234614+0000","last_peered":"2023-12-07T10:00:54.234614+0000","last_clean":"2023-12-07T10:00:54.234614+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:00:54.234614+0000","last_undegraded":"2023-12-07T10:00:54.234614+0000","last_fullsized":"2023-12-07T10:00:54.234614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934498+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:00:54.934498+0000","last_peered":"2023-12-07T10:00:54.934498+0000","last_clean":"2023-12-07T10:00:54.934498+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:00:54.934498+0000","last_undegraded":"2023-12-07T10:00:54.934498+0000","last_fullsized":"2023-12-07T10:00:54.934498+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745242+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:00:54.745242+0000","last_peered":"2023-12-07T10:00:54.745242+0000","last_clean":"2023-12-07T10:00:54.745242+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:00:54.745242+0000","last_undegraded":"2023-12-07T10:00:54.745242+0000","last_fullsized":"2023-12-07T10:00:54.745242+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233354+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:00:54.233354+0000","last_peered":"2023-12-07T10:00:54.233354+0000","last_clean":"2023-12-07T10:00:54.233354+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:00:54.233354+0000","last_undegraded":"2023-12-07T10:00:54.233354+0000","last_fullsized":"2023-12-07T10:00:54.233354+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933584+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:00:54.933584+0000","last_peered":"2023-12-07T10:00:54.933584+0000","last_clean":"2023-12-07T10:00:54.933584+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:00:54.933584+0000","last_undegraded":"2023-12-07T10:00:54.933584+0000","last_fullsized":"2023-12-07T10:00:54.933584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.745090+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:00:54.745090+0000","last_peered":"2023-12-07T10:00:54.745090+0000","last_clean":"2023-12-07T10:00:54.745090+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:00:54.745090+0000","last_undegraded":"2023-12-07T10:00:54.745090+0000","last_fullsized":"2023-12-07T10:00:54.745090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433562+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:00:54.433562+0000","last_peered":"2023-12-07T10:00:54.433562+0000","last_clean":"2023-12-07T10:00:54.433562+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:00:54.433562+0000","last_undegraded":"2023-12-07T10:00:54.433562+0000","last_fullsized":"2023-12-07T10:00:54.433562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234429+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:00:54.234429+0000","last_peered":"2023-12-07T10:00:54.234429+0000","last_clean":"2023-12-07T10:00:54.234429+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:00:54.234429+0000","last_undegraded":"2023-12-07T10:00:54.234429+0000","last_fullsized":"2023-12-07T10:00:54.234429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.744921+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:00:54.744921+0000","last_peered":"2023-12-07T10:00:54.744921+0000","last_clean":"2023-12-07T10:00:54.744921+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:00:54.744921+0000","last_undegraded":"2023-12-07T10:00:54.744921+0000","last_fullsized":"2023-12-07T10:00:54.744921+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933458+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:00:54.933458+0000","last_peered":"2023-12-07T10:00:54.933458+0000","last_clean":"2023-12-07T10:00:54.933458+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:00:54.933458+0000","last_undegraded":"2023-12-07T10:00:54.933458+0000","last_fullsized":"2023-12-07T10:00:54.933458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933656+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:00:54.933656+0000","last_peered":"2023-12-07T10:00:54.933656+0000","last_clean":"2023-12-07T10:00:54.933656+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:00:54.933656+0000","last_undegraded":"2023-12-07T10:00:54.933656+0000","last_fullsized":"2023-12-07T10:00:54.933656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933752+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:00:54.933752+0000","last_peered":"2023-12-07T10:00:54.933752+0000","last_clean":"2023-12-07T10:00:54.933752+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:00:54.933752+0000","last_undegraded":"2023-12-07T10:00:54.933752+0000","last_fullsized":"2023-12-07T10:00:54.933752+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731921+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:00:54.731921+0000","last_peered":"2023-12-07T10:00:54.731921+0000","last_clean":"2023-12-07T10:00:54.731921+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:00:54.731921+0000","last_undegraded":"2023-12-07T10:00:54.731921+0000","last_fullsized":"2023-12-07T10:00:54.731921+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433593+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:00:54.433593+0000","last_peered":"2023-12-07T10:00:54.433593+0000","last_clean":"2023-12-07T10:00:54.433593+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:00:54.433593+0000","last_undegraded":"2023-12-07T10:00:54.433593+0000","last_fullsized":"2023-12-07T10:00:54.433593+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933582+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:00:54.933582+0000","last_peered":"2023-12-07T10:00:54.933582+0000","last_clean":"2023-12-07T10:00:54.933582+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:00:54.933582+0000","last_undegraded":"2023-12-07T10:00:54.933582+0000","last_fullsized":"2023-12-07T10:00:54.933582+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933700+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:00:54.933700+0000","last_peered":"2023-12-07T10:00:54.933700+0000","last_clean":"2023-12-07T10:00:54.933700+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:00:54.933700+0000","last_undegraded":"2023-12-07T10:00:54.933700+0000","last_fullsized":"2023-12-07T10:00:54.933700+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933602+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:00:54.933602+0000","last_peered":"2023-12-07T10:00:54.933602+0000","last_clean":"2023-12-07T10:00:54.933602+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:00:54.933602+0000","last_undegraded":"2023-12-07T10:00:54.933602+0000","last_fullsized":"2023-12-07T10:00:54.933602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233188+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:00:54.233188+0000","last_peered":"2023-12-07T10:00:54.233188+0000","last_clean":"2023-12-07T10:00:54.233188+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:00:54.233188+0000","last_undegraded":"2023-12-07T10:00:54.233188+0000","last_fullsized":"2023-12-07T10:00:54.233188+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433268+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:00:54.433268+0000","last_peered":"2023-12-07T10:00:54.433268+0000","last_clean":"2023-12-07T10:00:54.433268+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:00:54.433268+0000","last_undegraded":"2023-12-07T10:00:54.433268+0000","last_fullsized":"2023-12-07T10:00:54.433268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234594+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:00:54.234594+0000","last_peered":"2023-12-07T10:00:54.234594+0000","last_clean":"2023-12-07T10:00:54.234594+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:00:54.234594+0000","last_undegraded":"2023-12-07T10:00:54.234594+0000","last_fullsized":"2023-12-07T10:00:54.234594+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433340+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:54.433340+0000","last_peered":"2023-12-07T10:00:54.433340+0000","last_clean":"2023-12-07T10:00:54.433340+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:00:54.433340+0000","last_undegraded":"2023-12-07T10:00:54.433340+0000","last_fullsized":"2023-12-07T10:00:54.433340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933339+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:00:54.933339+0000","last_peered":"2023-12-07T10:00:54.933339+0000","last_clean":"2023-12-07T10:00:54.933339+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:00:54.933339+0000","last_undegraded":"2023-12-07T10:00:54.933339+0000","last_fullsized":"2023-12-07T10:00:54.933339+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934707+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:00:54.934707+0000","last_peered":"2023-12-07T10:00:54.934707+0000","last_clean":"2023-12-07T10:00:54.934707+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:00:54.934707+0000","last_undegraded":"2023-12-07T10:00:54.934707+0000","last_fullsized":"2023-12-07T10:00:54.934707+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232693+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:00:54.232693+0000","last_peered":"2023-12-07T10:00:54.232693+0000","last_clean":"2023-12-07T10:00:54.232693+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:00:54.232693+0000","last_undegraded":"2023-12-07T10:00:54.232693+0000","last_fullsized":"2023-12-07T10:00:54.232693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433227+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:00:54.433227+0000","last_peered":"2023-12-07T10:00:54.433227+0000","last_clean":"2023-12-07T10:00:54.433227+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:00:54.433227+0000","last_undegraded":"2023-12-07T10:00:54.433227+0000","last_fullsized":"2023-12-07T10:00:54.433227+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234205+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:00:54.234205+0000","last_peered":"2023-12-07T10:00:54.234205+0000","last_clean":"2023-12-07T10:00:54.234205+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:00:54.234205+0000","last_undegraded":"2023-12-07T10:00:54.234205+0000","last_fullsized":"2023-12-07T10:00:54.234205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234655+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:00:54.234655+0000","last_peered":"2023-12-07T10:00:54.234655+0000","last_clean":"2023-12-07T10:00:54.234655+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:00:54.234655+0000","last_undegraded":"2023-12-07T10:00:54.234655+0000","last_fullsized":"2023-12-07T10:00:54.234655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235305+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:00:54.235305+0000","last_peered":"2023-12-07T10:00:54.235305+0000","last_clean":"2023-12-07T10:00:54.235305+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:00:54.235305+0000","last_undegraded":"2023-12-07T10:00:54.235305+0000","last_fullsized":"2023-12-07T10:00:54.235305+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235194+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:00:54.235194+0000","last_peered":"2023-12-07T10:00:54.235194+0000","last_clean":"2023-12-07T10:00:54.235194+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:00:54.235194+0000","last_undegraded":"2023-12-07T10:00:54.235194+0000","last_fullsized":"2023-12-07T10:00:54.235194+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433697+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:00:54.433697+0000","last_peered":"2023-12-07T10:00:54.433697+0000","last_clean":"2023-12-07T10:00:54.433697+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:00:54.433697+0000","last_undegraded":"2023-12-07T10:00:54.433697+0000","last_fullsized":"2023-12-07T10:00:54.433697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731561+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:00:54.731561+0000","last_peered":"2023-12-07T10:00:54.731561+0000","last_clean":"2023-12-07T10:00:54.731561+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:00:54.731561+0000","last_undegraded":"2023-12-07T10:00:54.731561+0000","last_fullsized":"2023-12-07T10:00:54.731561+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235209+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:00:54.235209+0000","last_peered":"2023-12-07T10:00:54.235209+0000","last_clean":"2023-12-07T10:00:54.235209+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:00:54.235209+0000","last_undegraded":"2023-12-07T10:00:54.235209+0000","last_fullsized":"2023-12-07T10:00:54.235209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235009+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:00:54.235009+0000","last_peered":"2023-12-07T10:00:54.235009+0000","last_clean":"2023-12-07T10:00:54.235009+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:00:54.235009+0000","last_undegraded":"2023-12-07T10:00:54.235009+0000","last_fullsized":"2023-12-07T10:00:54.235009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"48'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234887+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:00:54.234887+0000","last_peered":"2023-12-07T10:00:54.234887+0000","last_clean":"2023-12-07T10:00:54.234887+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:00:54.234887+0000","last_undegraded":"2023-12-07T10:00:54.234887+0000","last_fullsized":"2023-12-07T10:00:54.234887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232907+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:00:54.232907+0000","last_peered":"2023-12-07T10:00:54.232907+0000","last_clean":"2023-12-07T10:00:54.232907+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:00:54.232907+0000","last_undegraded":"2023-12-07T10:00:54.232907+0000","last_fullsized":"2023-12-07T10:00:54.232907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433341+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:00:54.433341+0000","last_peered":"2023-12-07T10:00:54.433341+0000","last_clean":"2023-12-07T10:00:54.433341+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:00:54.433341+0000","last_undegraded":"2023-12-07T10:00:54.433341+0000","last_fullsized":"2023-12-07T10:00:54.433341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234614+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:00:54.234614+0000","last_peered":"2023-12-07T10:00:54.234614+0000","last_clean":"2023-12-07T10:00:54.234614+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:00:54.234614+0000","last_undegraded":"2023-12-07T10:00:54.234614+0000","last_fullsized":"2023-12-07T10:00:54.234614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934600+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:00:54.934600+0000","last_peered":"2023-12-07T10:00:54.934600+0000","last_clean":"2023-12-07T10:00:54.934600+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:00:54.934600+0000","last_undegraded":"2023-12-07T10:00:54.934600+0000","last_fullsized":"2023-12-07T10:00:54.934600+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234215+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:00:54.234215+0000","last_peered":"2023-12-07T10:00:54.234215+0000","last_clean":"2023-12-07T10:00:54.234215+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:00:54.234215+0000","last_undegraded":"2023-12-07T10:00:54.234215+0000","last_fullsized":"2023-12-07T10:00:54.234215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232802+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:00:54.232802+0000","last_peered":"2023-12-07T10:00:54.232802+0000","last_clean":"2023-12-07T10:00:54.232802+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:00:54.232802+0000","last_undegraded":"2023-12-07T10:00:54.232802+0000","last_fullsized":"2023-12-07T10:00:54.232802+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234655+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:00:54.234655+0000","last_peered":"2023-12-07T10:00:54.234655+0000","last_clean":"2023-12-07T10:00:54.234655+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:00:54.234655+0000","last_undegraded":"2023-12-07T10:00:54.234655+0000","last_fullsized":"2023-12-07T10:00:54.234655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234741+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:00:54.234741+0000","last_peered":"2023-12-07T10:00:54.234741+0000","last_clean":"2023-12-07T10:00:54.234741+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:00:54.234741+0000","last_undegraded":"2023-12-07T10:00:54.234741+0000","last_fullsized":"2023-12-07T10:00:54.234741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235159+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:00:54.235159+0000","last_peered":"2023-12-07T10:00:54.235159+0000","last_clean":"2023-12-07T10:00:54.235159+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:00:54.235159+0000","last_undegraded":"2023-12-07T10:00:54.235159+0000","last_fullsized":"2023-12-07T10:00:54.235159+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433785+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:00:54.433785+0000","last_peered":"2023-12-07T10:00:54.433785+0000","last_clean":"2023-12-07T10:00:54.433785+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:00:54.433785+0000","last_undegraded":"2023-12-07T10:00:54.433785+0000","last_fullsized":"2023-12-07T10:00:54.433785+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233503+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:00:54.233503+0000","last_peered":"2023-12-07T10:00:54.233503+0000","last_clean":"2023-12-07T10:00:54.233503+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:00:54.233503+0000","last_undegraded":"2023-12-07T10:00:54.233503+0000","last_fullsized":"2023-12-07T10:00:54.233503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933640+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:00:54.933640+0000","last_peered":"2023-12-07T10:00:54.933640+0000","last_clean":"2023-12-07T10:00:54.933640+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:00:54.933640+0000","last_undegraded":"2023-12-07T10:00:54.933640+0000","last_fullsized":"2023-12-07T10:00:54.933640+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433390+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:00:54.433390+0000","last_peered":"2023-12-07T10:00:54.433390+0000","last_clean":"2023-12-07T10:00:54.433390+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:00:54.433390+0000","last_undegraded":"2023-12-07T10:00:54.433390+0000","last_fullsized":"2023-12-07T10:00:54.433390+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233314+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:00:54.233314+0000","last_peered":"2023-12-07T10:00:54.233314+0000","last_clean":"2023-12-07T10:00:54.233314+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:00:54.233314+0000","last_undegraded":"2023-12-07T10:00:54.233314+0000","last_fullsized":"2023-12-07T10:00:54.233314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235144+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:00:54.235144+0000","last_peered":"2023-12-07T10:00:54.235144+0000","last_clean":"2023-12-07T10:00:54.235144+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:00:54.235144+0000","last_undegraded":"2023-12-07T10:00:54.235144+0000","last_fullsized":"2023-12-07T10:00:54.235144+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933498+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:00:54.933498+0000","last_peered":"2023-12-07T10:00:54.933498+0000","last_clean":"2023-12-07T10:00:54.933498+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:00:54.933498+0000","last_undegraded":"2023-12-07T10:00:54.933498+0000","last_fullsized":"2023-12-07T10:00:54.933498+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232955+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:00:54.232955+0000","last_peered":"2023-12-07T10:00:54.232955+0000","last_clean":"2023-12-07T10:00:54.232955+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:00:54.232955+0000","last_undegraded":"2023-12-07T10:00:54.232955+0000","last_fullsized":"2023-12-07T10:00:54.232955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433453+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:00:54.433453+0000","last_peered":"2023-12-07T10:00:54.433453+0000","last_clean":"2023-12-07T10:00:54.433453+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:00:54.433453+0000","last_undegraded":"2023-12-07T10:00:54.433453+0000","last_fullsized":"2023-12-07T10:00:54.433453+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933426+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:00:54.933426+0000","last_peered":"2023-12-07T10:00:54.933426+0000","last_clean":"2023-12-07T10:00:54.933426+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:00:54.933426+0000","last_undegraded":"2023-12-07T10:00:54.933426+0000","last_fullsized":"2023-12-07T10:00:54.933426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731504+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:00:54.731504+0000","last_peered":"2023-12-07T10:00:54.731504+0000","last_clean":"2023-12-07T10:00:54.731504+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:00:54.731504+0000","last_undegraded":"2023-12-07T10:00:54.731504+0000","last_fullsized":"2023-12-07T10:00:54.731504+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933293+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:00:54.933293+0000","last_peered":"2023-12-07T10:00:54.933293+0000","last_clean":"2023-12-07T10:00:54.933293+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:00:54.933293+0000","last_undegraded":"2023-12-07T10:00:54.933293+0000","last_fullsized":"2023-12-07T10:00:54.933293+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.232694+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:00:54.232694+0000","last_peered":"2023-12-07T10:00:54.232694+0000","last_clean":"2023-12-07T10:00:54.232694+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:00:54.232694+0000","last_undegraded":"2023-12-07T10:00:54.232694+0000","last_fullsized":"2023-12-07T10:00:54.232694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233492+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:00:54.233492+0000","last_peered":"2023-12-07T10:00:54.233492+0000","last_clean":"2023-12-07T10:00:54.233492+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:00:54.233492+0000","last_undegraded":"2023-12-07T10:00:54.233492+0000","last_fullsized":"2023-12-07T10:00:54.233492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731916+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:00:54.731916+0000","last_peered":"2023-12-07T10:00:54.731916+0000","last_clean":"2023-12-07T10:00:54.731916+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:00:54.731916+0000","last_undegraded":"2023-12-07T10:00:54.731916+0000","last_fullsized":"2023-12-07T10:00:54.731916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233588+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:00:54.233588+0000","last_peered":"2023-12-07T10:00:54.233588+0000","last_clean":"2023-12-07T10:00:54.233588+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:00:54.233588+0000","last_undegraded":"2023-12-07T10:00:54.233588+0000","last_fullsized":"2023-12-07T10:00:54.233588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933736+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:00:54.933736+0000","last_peered":"2023-12-07T10:00:54.933736+0000","last_clean":"2023-12-07T10:00:54.933736+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:00:54.933736+0000","last_undegraded":"2023-12-07T10:00:54.933736+0000","last_fullsized":"2023-12-07T10:00:54.933736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731572+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:00:54.731572+0000","last_peered":"2023-12-07T10:00:54.731572+0000","last_clean":"2023-12-07T10:00:54.731572+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:00:54.731572+0000","last_undegraded":"2023-12-07T10:00:54.731572+0000","last_fullsized":"2023-12-07T10:00:54.731572+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934596+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:00:54.934596+0000","last_peered":"2023-12-07T10:00:54.934596+0000","last_clean":"2023-12-07T10:00:54.934596+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:00:54.934596+0000","last_undegraded":"2023-12-07T10:00:54.934596+0000","last_fullsized":"2023-12-07T10:00:54.934596+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.933721+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:00:54.933721+0000","last_peered":"2023-12-07T10:00:54.933721+0000","last_clean":"2023-12-07T10:00:54.933721+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:00:54.933721+0000","last_undegraded":"2023-12-07T10:00:54.933721+0000","last_fullsized":"2023-12-07T10:00:54.933721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.233316+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:00:54.233316+0000","last_peered":"2023-12-07T10:00:54.233316+0000","last_clean":"2023-12-07T10:00:54.233316+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:00:54.233316+0000","last_undegraded":"2023-12-07T10:00:54.233316+0000","last_fullsized":"2023-12-07T10:00:54.233316+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433441+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:00:54.433441+0000","last_peered":"2023-12-07T10:00:54.433441+0000","last_clean":"2023-12-07T10:00:54.433441+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:00:54.433441+0000","last_undegraded":"2023-12-07T10:00:54.433441+0000","last_fullsized":"2023-12-07T10:00:54.433441+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731421+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:00:54.731421+0000","last_peered":"2023-12-07T10:00:54.731421+0000","last_clean":"2023-12-07T10:00:54.731421+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:00:54.731421+0000","last_undegraded":"2023-12-07T10:00:54.731421+0000","last_fullsized":"2023-12-07T10:00:54.731421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.234767+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:00:54.234767+0000","last_peered":"2023-12-07T10:00:54.234767+0000","last_clean":"2023-12-07T10:00:54.234767+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:00:54.234767+0000","last_undegraded":"2023-12-07T10:00:54.234767+0000","last_fullsized":"2023-12-07T10:00:54.234767+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.235239+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:00:54.235239+0000","last_peered":"2023-12-07T10:00:54.235239+0000","last_clean":"2023-12-07T10:00:54.235239+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:00:54.235239+0000","last_undegraded":"2023-12-07T10:00:54.235239+0000","last_fullsized":"2023-12-07T10:00:54.235239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731309+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:00:54.731309+0000","last_peered":"2023-12-07T10:00:54.731309+0000","last_clean":"2023-12-07T10:00:54.731309+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:00:54.731309+0000","last_undegraded":"2023-12-07T10:00:54.731309+0000","last_fullsized":"2023-12-07T10:00:54.731309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.731369+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:00:54.731369+0000","last_peered":"2023-12-07T10:00:54.731369+0000","last_clean":"2023-12-07T10:00:54.731369+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:00:54.731369+0000","last_undegraded":"2023-12-07T10:00:54.731369+0000","last_fullsized":"2023-12-07T10:00:54.731369+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433364+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:00:54.433364+0000","last_peered":"2023-12-07T10:00:54.433364+0000","last_clean":"2023-12-07T10:00:54.433364+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:00:54.433364+0000","last_undegraded":"2023-12-07T10:00:54.433364+0000","last_fullsized":"2023-12-07T10:00:54.433364+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433567+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:00:54.433567+0000","last_peered":"2023-12-07T10:00:54.433567+0000","last_clean":"2023-12-07T10:00:54.433567+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:00:54.433567+0000","last_undegraded":"2023-12-07T10:00:54.433567+0000","last_fullsized":"2023-12-07T10:00:54.433567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.433443+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:00:54.433443+0000","last_peered":"2023-12-07T10:00:54.433443+0000","last_clean":"2023-12-07T10:00:54.433443+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:00:54.433443+0000","last_undegraded":"2023-12-07T10:00:54.433443+0000","last_fullsized":"2023-12-07T10:00:54.433443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:54.934554+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:00:54.934554+0000","last_peered":"2023-12-07T10:00:54.934554+0000","last_clean":"2023-12-07T10:00:54.934554+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:00:54.934554+0000","last_undegraded":"2023-12-07T10:00:54.934554+0000","last_fullsized":"2023-12-07T10:00:54.934554+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-07T10:00:53.232362+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:00:53.232362+0000","last_peered":"2023-12-07T10:00:53.232362+0000","last_clean":"2023-12-07T10:00:53.232362+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:00:53.232362+0000","last_undegraded":"2023-12-07T10:00:53.232362+0000","last_fullsized":"2023-12-07T10:00:53.232362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":837046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.624},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.49399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":240218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.501}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":247170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.441}]},{"osd":6,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.502},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":598016,"data_stored":248130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.516,"5min":5.516,"15min":5.516},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.5030000000000001,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Dec 7 10:00:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.468,"5min":3.468,"15min":3.468},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":13.016,"5min":13.016,"15min":13.016},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":13.166,"5min":13.166,"15min":13.166},"last":0.373}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.1690000000000005,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.0809999999999995,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.502}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.7680000000000007,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":1.0089999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":5.75,"5min":5.75,"15min":5.75},"last":0.872}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":9.8239999999999998,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7050000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":1.028}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":240308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.006}]},{"osd":7,"last update":"Thu Dec 7 10:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.94199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":839080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.495},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.879},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:00:58.295 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T10:00:58.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-07T10:00:58.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.472+0000 7f958a85f640 1 Processor -- start 2023-12-07T10:00:58.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.472+0000 7f958a85f640 1 -- start start 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f958a85f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 0x7f95840a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f958a85f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9584156600 0x7f958414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f958a85f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9584152d90 con 0x7f958414fb30 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f958a85f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9584152480 con 0x7f9584156600 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f958a85f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840a9760 con 0x7f95840a86d0 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 0x7f95840a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 0x7f95840a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:60212/0 (socket says 172.21.15.89:60212) 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 -- 172.21.15.89:0/4109965253 learned_addr learned my addr 172.21.15.89:0/4109965253 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:58.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f95837fe640 1 --2- 172.21.15.89:0/4109965253 >> v2:172.21.15.97:3300/0 conn(0x7f9584156600 0x7f958414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 -- 172.21.15.89:0/4109965253 >> v2:172.21.15.97:3300/0 conn(0x7f9584156600 msgr2=0x7f958414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:58.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 --2- 172.21.15.89:0/4109965253 >> v2:172.21.15.97:3300/0 conn(0x7f9584156600 0x7f958414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 -- 172.21.15.89:0/4109965253 >> v1:172.21.15.97:6789/0 conn(0x7f958414fb30 legacy=0x7f95840aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.476+0000 7f9583fff640 1 -- 172.21.15.89:0/4109965253 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584152740 con 0x7f95840a86d0 2023-12-07T10:00:58.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f9583fff640 1 --2- 172.21.15.89:0/4109965253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 0x7f95840a8f30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9574009870 tx=0x7f957401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d0dbe98eeb6965 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f9582ffd640 1 -- 172.21.15.89:0/4109965253 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740ab600 con 0x7f95840a86d0 2023-12-07T10:00:58.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f9582ffd640 1 -- 172.21.15.89:0/4109965253 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95740a7050 con 0x7f95840a86d0 2023-12-07T10:00:58.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f9582ffd640 1 -- 172.21.15.89:0/4109965253 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740ab980 con 0x7f95840a86d0 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 -- 172.21.15.89:0/4109965253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 msgr2=0x7f95840a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 --2- 172.21.15.89:0/4109965253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 0x7f95840a8f30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9574009870 tx=0x7f957401c540 comp rx=0 tx=0).stop 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 -- 172.21.15.89:0/4109965253 shutdown_connections 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 --2- 172.21.15.89:0/4109965253 >> v2:172.21.15.97:3300/0 conn(0x7f9584156600 0x7f958414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 --2- 172.21.15.89:0/4109965253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95840a86d0 0x7f95840a8f30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 -- 172.21.15.89:0/4109965253 >> 172.21.15.89:0/4109965253 conn(0x7f95840c2a60 msgr2=0x7f95840c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 -- 172.21.15.89:0/4109965253 shutdown_connections 2023-12-07T10:00:58.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 -- 172.21.15.89:0/4109965253 wait complete. 2023-12-07T10:00:58.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.480+0000 7f958a85f640 1 Processor -- start 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- start start 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 0x7f9584149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f958414fb30 0x7f9584147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9584156600 0x7f9584148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841547d0 con 0x7f95840a86d0 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584149560 con 0x7f9584156600 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958406c870 con 0x7f958414fb30 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 0x7f9584149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 0x7f9584149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57878/0 (socket says 172.21.15.89:57878) 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 -- 172.21.15.89:0/4110754002 learned_addr learned my addr 172.21.15.89:0/4110754002 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:58.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f95837fe640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f958414fb30 0x7f9584147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9588dfc640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9584156600 0x7f9584148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 -- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f958414fb30 msgr2=0x7f9584147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f958414fb30 0x7f9584147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 -- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9584156600 msgr2=0x7f9584148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9584156600 0x7f9584148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 -- 172.21.15.89:0/4110754002 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740094d0 con 0x7f95840a86d0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9588dfc640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9584156600 0x7f9584148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9583fff640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 0x7f9584149ef0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f957401abf0 tx=0x7f95740192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740b6440 con 0x7f95840a86d0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95740b65c0 con 0x7f95840a86d0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740b6970 con 0x7f95840a86d0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9584149800 con 0x7f95840a86d0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95841544f0 con 0x7f95840a86d0 2023-12-07T10:00:58.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.484+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958404e890 con 0x7f95840a86d0 2023-12-07T10:00:58.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.488+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95740b2040 con 0x7f95840a86d0 2023-12-07T10:00:58.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.488+0000 7f9580ff9640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95700668d0 0x7f9570068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.488+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f957411e3b0 con 0x7f95840a86d0 2023-12-07T10:00:58.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.488+0000 7f95837fe640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95700668d0 0x7f9570068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.488+0000 7f95837fe640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95700668d0 0x7f9570068d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f95841efa00 tx=0x7f9578009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.492+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95740eb5e0 con 0x7f95840a86d0 2023-12-07T10:00:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.692+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f95840c48f0 con 0x7f95840a86d0 2023-12-07T10:00:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.696+0000 7f9580ff9640 1 -- 172.21.15.89:0/4110754002 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f95740eec00 con 0x7f95840a86d0 2023-12-07T10:00:58.702 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-07T10:00:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg== 2023-12-07T10:00:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-12-07T10:00:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:00:58.702 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-07T10:00:58.703 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.0 2023-12-07T10:00:58.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95700668d0 msgr2=0x7f9570068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95700668d0 0x7f9570068d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f95841efa00 tx=0x7f9578009190 comp rx=0 tx=0).stop 2023-12-07T10:00:58.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 msgr2=0x7f9584149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 0x7f9584149ef0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f957401abf0 tx=0x7f95740192e0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 shutdown_connections 2023-12-07T10:00:58.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9584156600 0x7f9584148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95700668d0 0x7f9570068d90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f958414fb30 0x7f9584147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 --2- 172.21.15.89:0/4110754002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95840a86d0 0x7f9584149ef0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 >> 172.21.15.89:0/4110754002 conn(0x7f95840c2a60 msgr2=0x7f95840c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:58.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 shutdown_connections 2023-12-07T10:00:58.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.700+0000 7f958a85f640 1 -- 172.21.15.89:0/4110754002 wait complete. 2023-12-07T10:00:58.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:00:58.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f68352c8640 1 Processor -- start 2023-12-07T10:00:58.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f68352c8640 1 -- start start 2023-12-07T10:00:58.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f68352c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300c4890 0x7f68300caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f68352c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683006b7d0 con 0x7f68300bd5a0 2023-12-07T10:00:58.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f68352c8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6830155160 con 0x7f68300ca620 2023-12-07T10:00:58.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f68352c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683006b180 con 0x7f68300c4890 2023-12-07T10:00:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f6834ac7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f68300bd5a0 0x7f68300c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47154/0 (socket says 172.21.15.89:47154) 2023-12-07T10:00:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f6834ac7640 1 -- 172.21.15.89:0/1064834308 learned_addr learned my addr 172.21.15.89:0/1064834308 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f682f7fe640 1 --2- 172.21.15.89:0/1064834308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300c4890 0x7f68300caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f682effd640 1 -- 172.21.15.89:0/1064834308 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790914125 0 0) 0x7f683006b7d0 con 0x7f68300bd5a0 2023-12-07T10:00:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f682effd640 1 -- 172.21.15.89:0/1064834308 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6818003530 con 0x7f68300bd5a0 2023-12-07T10:00:58.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f682f7fe640 1 -- 172.21.15.89:0/1064834308 >> v1:172.21.15.97:6789/0 conn(0x7f68300ca620 legacy=0x7f68300c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f682f7fe640 1 -- 172.21.15.89:0/1064834308 >> v1:172.21.15.89:6789/0 conn(0x7f68300bd5a0 legacy=0x7f68300c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.856+0000 7f682f7fe640 1 -- 172.21.15.89:0/1064834308 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683006b460 con 0x7f68300c4890 2023-12-07T10:00:58.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f682f7fe640 1 --2- 172.21.15.89:0/1064834308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300c4890 0x7f68300caa00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68240097f0 tx=0x7f682401c080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add039934ba9de9e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f682effd640 1 -- 172.21.15.89:0/1064834308 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240a4830 con 0x7f68300c4890 2023-12-07T10:00:58.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f682effd640 1 -- 172.21.15.89:0/1064834308 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68300c9da0 con 0x7f68300c4890 2023-12-07T10:00:58.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f682effd640 1 -- 172.21.15.89:0/1064834308 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240a4bb0 con 0x7f68300c4890 2023-12-07T10:00:58.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 -- 172.21.15.89:0/1064834308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300c4890 msgr2=0x7f68300caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 --2- 172.21.15.89:0/1064834308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300c4890 0x7f68300caa00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68240097f0 tx=0x7f682401c080 comp rx=0 tx=0).stop 2023-12-07T10:00:58.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 -- 172.21.15.89:0/1064834308 shutdown_connections 2023-12-07T10:00:58.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 --2- 172.21.15.89:0/1064834308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300c4890 0x7f68300caa00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 -- 172.21.15.89:0/1064834308 >> 172.21.15.89:0/1064834308 conn(0x7f68300ac0a0 msgr2=0x7f68300c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:58.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 -- 172.21.15.89:0/1064834308 shutdown_connections 2023-12-07T10:00:58.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.860+0000 7f68352c8640 1 -- 172.21.15.89:0/1064834308 wait complete. 2023-12-07T10:00:58.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 Processor -- start 2023-12-07T10:00:58.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- start start 2023-12-07T10:00:58.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68300bd5a0 0x7f6830158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 0x7f68300c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300ca620 0x7f68301f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830157350 con 0x7f68300c4890 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68300c0380 con 0x7f68300bd5a0 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68301587b0 con 0x7f68300ca620 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 0x7f68300c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 0x7f68300c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57888/0 (socket says 172.21.15.89:57888) 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 -- 172.21.15.89:0/4244624298 learned_addr learned my addr 172.21.15.89:0/4244624298 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682ffff640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68300bd5a0 0x7f6830158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f6834ac7640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300ca620 0x7f68301f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 -- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300ca620 msgr2=0x7f68301f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300ca620 0x7f68301f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 -- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68300bd5a0 msgr2=0x7f6830158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68300bd5a0 0x7f6830158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:58.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 -- 172.21.15.89:0/4244624298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009420 con 0x7f68300c4890 2023-12-07T10:00:58.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682f7fe640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 0x7f68300c27d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6824018fb0 tx=0x7f6824019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240ac650 con 0x7f68300c4890 2023-12-07T10:00:58.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68240ac7f0 con 0x7f68300c4890 2023-12-07T10:00:58.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240acba0 con 0x7f68300c4890 2023-12-07T10:00:58.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68300c0640 con 0x7f68300c4890 2023-12-07T10:00:58.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6830151760 con 0x7f68300c4890 2023-12-07T10:00:58.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.864+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68300c0b60 con 0x7f68300c4890 2023-12-07T10:00:58.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.868+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f68240b3040 con 0x7f68300c4890 2023-12-07T10:00:58.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.868+0000 7f682cff9640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f681c0668d0 0x7f681c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:58.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.868+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f682411dad0 con 0x7f68300c4890 2023-12-07T10:00:58.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.868+0000 7f682ffff640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f681c0668d0 0x7f681c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:58.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.868+0000 7f682ffff640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f681c0668d0 0x7f681c068d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6820000f70 tx=0x7f6820009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:58.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:58.872+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68300c0b60 con 0x7f68300c4890 2023-12-07T10:00:59.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68300c0b60 con 0x7f68300c4890 2023-12-07T10:00:59.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f682cff9640 1 -- 172.21.15.89:0/4244624298 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f68300c0b60 con 0x7f68300c4890 2023-12-07T10:00:59.058 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:00:59.058 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-07T10:00:59.058 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 33 2023-12-07T10:00:59.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f681c0668d0 msgr2=0x7f681c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f681c0668d0 0x7f681c068d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6820000f70 tx=0x7f6820009040 comp rx=0 tx=0).stop 2023-12-07T10:00:59.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 msgr2=0x7f68300c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 0x7f68300c27d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6824018fb0 tx=0x7f6824019140 comp rx=0 tx=0).stop 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 shutdown_connections 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f681c0668d0 0x7f681c068d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f68300ca620 0x7f68301f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68300c4890 0x7f68300c27d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 --2- 172.21.15.89:0/4244624298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68300bd5a0 0x7f6830158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 >> 172.21.15.89:0/4244624298 conn(0x7f68300ac0a0 msgr2=0x7f68300c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 shutdown_connections 2023-12-07T10:00:59.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.052+0000 7f68352c8640 1 -- 172.21.15.89:0/4244624298 wait complete. 2023-12-07T10:00:59.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T10:00:53.212873+0000', 'modified': '2023-12-07T10:00:56.223970+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5841}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5841': {'gid': 5841, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6837/416367230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6835', 'nonce': 416367230}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 416367230}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-07T10:00:59.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T10:00:59.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-07T10:00:59.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.616+0000 7f64a4bf8640 1 Processor -- start 2023-12-07T10:00:59.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.616+0000 7f64a4bf8640 1 -- start start 2023-12-07T10:00:59.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f64a4bf8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64a0154870 0x7f64a006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f64a4bf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00700a0 0x7f64a006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f64a4bf8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a0072780 con 0x7f64a00aacd0 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f64a4bf8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a00ac160 con 0x7f64a0154870 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f64a4bf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00abe80 con 0x7f64a00700a0 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64a0154870 0x7f64a006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649e59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f64a00aacd0 0x7f64a0154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48062/0 (socket says 172.21.15.89:48062) 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649e59c640 1 -- 172.21.15.89:0/3333884242 learned_addr learned my addr 172.21.15.89:0/3333884242 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:59.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649ed9d640 1 --2- 172.21.15.89:0/3333884242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00700a0 0x7f64a006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649dd9b640 1 -- 172.21.15.89:0/3333884242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00700a0 msgr2=0x7f64a006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649dd9b640 1 --2- 172.21.15.89:0/3333884242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00700a0 0x7f64a006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649dd9b640 1 -- 172.21.15.89:0/3333884242 >> v1:172.21.15.89:6789/0 conn(0x7f64a00aacd0 legacy=0x7f64a0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.620+0000 7f649dd9b640 1 -- 172.21.15.89:0/3333884242 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a0154cf0 con 0x7f64a0154870 2023-12-07T10:00:59.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f649dd9b640 1 --2- 172.21.15.89:0/3333884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a0154870 0x7f64a006c950 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f64940097c0 tx=0x7f649401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e2baa2f90e1377 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f649d59a640 1 -- 172.21.15.89:0/3333884242 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940ac620 con 0x7f64a0154870 2023-12-07T10:00:59.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f649d59a640 1 -- 172.21.15.89:0/3333884242 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940ac780 con 0x7f64a0154870 2023-12-07T10:00:59.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f649d59a640 1 -- 172.21.15.89:0/3333884242 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940acb10 con 0x7f64a0154870 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 -- 172.21.15.89:0/3333884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a0154870 msgr2=0x7f64a006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/3333884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a0154870 0x7f64a006c950 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f64940097c0 tx=0x7f649401c3c0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 -- 172.21.15.89:0/3333884242 shutdown_connections 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/3333884242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00700a0 0x7f64a006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/3333884242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a0154870 0x7f64a006c950 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 -- 172.21.15.89:0/3333884242 >> 172.21.15.89:0/3333884242 conn(0x7f64a00c2ad0 msgr2=0x7f64a00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 -- 172.21.15.89:0/3333884242 shutdown_connections 2023-12-07T10:00:59.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 -- 172.21.15.89:0/3333884242 wait complete. 2023-12-07T10:00:59.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 Processor -- start 2023-12-07T10:00:59.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.624+0000 7f64a4bf8640 1 -- start start 2023-12-07T10:00:59.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 0x7f64a0149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00aacd0 0x7f64a00a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a0154870 0x7f64a0146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a01eba50 con 0x7f64a00700a0 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a014a340 con 0x7f64a0154870 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a01eae40 con 0x7f64a00aacd0 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 0x7f64a0149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 0x7f64a0149e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55240/0 (socket says 172.21.15.89:55240) 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 -- 172.21.15.89:0/1080773325 learned_addr learned my addr 172.21.15.89:0/1080773325 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 -- 172.21.15.89:0/1080773325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00aacd0 msgr2=0x7f64a00a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00aacd0 0x7f64a00a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 -- 172.21.15.89:0/1080773325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a0154870 msgr2=0x7f64a0146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a0154870 0x7f64a0146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 -- 172.21.15.89:0/1080773325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009420 con 0x7f64a00700a0 2023-12-07T10:00:59.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f649e59c640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 0x7f64a0149e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f649000c530 tx=0x7f649000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f648effd640 1 -- 172.21.15.89:0/1080773325 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490005cf0 con 0x7f64a00700a0 2023-12-07T10:00:59.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f648effd640 1 -- 172.21.15.89:0/1080773325 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490005e50 con 0x7f64a00700a0 2023-12-07T10:00:59.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f648effd640 1 -- 172.21.15.89:0/1080773325 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490007270 con 0x7f64a00700a0 2023-12-07T10:00:59.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a01eb120 con 0x7f64a00700a0 2023-12-07T10:00:59.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a01eb6e0 con 0x7f64a00700a0 2023-12-07T10:00:59.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.628+0000 7f648effd640 1 -- 172.21.15.89:0/1080773325 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f64900073d0 con 0x7f64a00700a0 2023-12-07T10:00:59.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f648effd640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f64800668d0 0x7f6480068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f648effd640 1 -- 172.21.15.89:0/1080773325 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64900838b0 con 0x7f64a00700a0 2023-12-07T10:00:59.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 Processor -- start 2023-12-07T10:00:59.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649dd9b640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f64800668d0 0x7f6480068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 -- start start 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649dd9b640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f64800668d0 0x7f6480068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f64940ae000 tx=0x7f6494004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810cc73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cc7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 0x557810d11ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810b90110 con 0x557810cc8200 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810b209a0 con 0x557810cc6fc0 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x557810b1ded0 con 0x557810cc78e0 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 0x557810d11ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 0x557810d11ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55250/0 (socket says 172.21.15.89:55250) 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 -- 172.21.15.89:0/1583501679 learned_addr learned my addr 172.21.15.89:0/1583501679 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649dd9b640 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cc7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649e59c640 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810cc73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 -- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 msgr2=0x557810cc7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cc7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 -- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 msgr2=0x557810cc73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810cc73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 -- 172.21.15.89:0/1583501679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557810811890 con 0x557810cc8200 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f649ed9d640 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 0x557810d11ad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6498009f10 tx=0x7f6498007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9854af0b5e37618 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f647ffff640 1 -- 172.21.15.89:0/1583501679 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498012710 con 0x557810cc8200 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f647ffff640 1 -- 172.21.15.89:0/1583501679 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6498012870 con 0x557810cc8200 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f647ffff640 1 -- 172.21.15.89:0/1583501679 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498012c20 con 0x557810cc8200 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1583501679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 msgr2=0x557810d11ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.632+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 0x557810d11ad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6498009f10 tx=0x7f6498007700 comp rx=0 tx=0).stop 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1583501679 shutdown_connections 2023-12-07T10:00:59.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc8200 0x557810d11ad0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cc7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1583501679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810cc73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1583501679 >> 172.21.15.89:0/1583501679 conn(0x557810d05830 msgr2=0x557810d07c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1583501679 shutdown_connections 2023-12-07T10:00:59.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1583501679 wait complete. 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- start start 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 Processor -- start 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810ccde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc8200 0x557810cce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810b197c0 con 0x557810cc6fc0 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810ad1bf0 con 0x557810cc8200 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x557810ad7a90 con 0x557810cc78e0 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 10 client.0 _ll_register_callbacks cb 0x557810cb4e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810ccde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810ccde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55252/0 (socket says 172.21.15.89:55252) 2023-12-07T10:00:59.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 -- 172.21.15.89:0/2245221089 learned_addr learned my addr 172.21.15.89:0/2245221089 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649dd9b640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649ed9d640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc8200 0x557810cce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 -- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 msgr2=0x557810cce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 -- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc8200 msgr2=0x557810cce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc8200 0x557810cce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 -- 172.21.15.89:0/2245221089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6498009b40 con 0x557810cc6fc0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649ed9d640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc8200 0x557810cce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f649e59c640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810ccde20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6490054550 tx=0x7f6490052cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab3f0b60c33834f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f647d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f647d7fa640 1 -- 172.21.15.89:0/2245221089 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649005c610 con 0x557810cc6fc0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f647d7fa640 1 -- 172.21.15.89:0/2245221089 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f649005c770 con 0x557810cc6fc0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557810adb470 con 0x557810cc6fc0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f647d7fa640 1 -- 172.21.15.89:0/2245221089 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6490050640 con 0x557810cc6fc0 2023-12-07T10:00:59.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 10 client.5994 fetch_fsmap learned FSMap version 33 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557810ada190 con 0x557810cc6fc0 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f647d7fa640 1 -- 172.21.15.89:0/2245221089 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557810adb470 con 0x557810cc6fc0 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f647d7fa640 1 -- 172.21.15.89:0/2245221089 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f64900507a0 con 0x557810cc6fc0 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 10 client.5994 fetch_fsmap finished waiting for FSMap version 33 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 10 client.5994 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 20 client.5994 populate_metadata read hostname 'smithi089' 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810d1ae40 0x557810d1d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 4 client.5994 mds_command: new command op to 5841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.636+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 --> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557810adeb50 con 0x557810d1ae40 2023-12-07T10:00:59.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f649dd9b640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810d1ae40 0x557810d1d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f649dd9b640 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810d1ae40 0x557810d1d230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a132aaf186d261 server_cookie=419539bed1b0766f in_seq=0 out_seq=0 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f647d7fa640 10 client.5994 ms_handle_connect on v2:172.21.15.89:6835/416367230 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f647d7fa640 1 -- 172.21.15.89:0/2245221089 <== mds.0 v2:172.21.15.89:6835/416367230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557810adeb50 con 0x557810d1ae40 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f647d7fa640 10 client.5994 handle_command_reply: tid=0 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 client.5994 shutdown 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 msgr2=0x557810ccde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810ccde20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6490054550 tx=0x7f6490052cb0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 shutdown_connections 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810d1ae40 0x557810d1d230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc8200 0x557810cce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810cce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f647d7fa640 0 client.5994 ms_handle_reset on v2:172.21.15.89:6835/416367230 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/2245221089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810ccde20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 >> 172.21.15.89:0/2245221089 conn(0x557810d05830 msgr2=0x557810d07c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 shutdown_connections 2023-12-07T10:00:59.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 1 -- 172.21.15.89:0/2245221089 wait complete. 2023-12-07T10:00:59.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.640+0000 7f64a7f6c000 20 client.5994 trim_cache size 0 max 16384 2023-12-07T10:00:59.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 Processor -- start 2023-12-07T10:00:59.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 -- start start 2023-12-07T10:00:59.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810d05830 0x557810d5dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810d5e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810d5ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810ccb690 con 0x557810cc6fc0 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578107d2940 con 0x557810d05830 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x557810cd1510 con 0x557810cc78e0 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810d5e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810d5e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55254/0 (socket says 172.21.15.89:55254) 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 -- 172.21.15.89:0/3810610667 learned_addr learned my addr 172.21.15.89:0/3810610667 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 -- 172.21.15.89:0/3810610667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 msgr2=0x557810d5ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810d5ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 -- 172.21.15.89:0/3810610667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810d05830 msgr2=0x557810d5dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810d05830 0x557810d5dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 -- 172.21.15.89:0/3810610667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557810ac0490 con 0x557810cc6fc0 2023-12-07T10:00:59.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f649dd9b640 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810d5e530 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f649401c8a0 tx=0x7f64940a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37b8a2b196cb6b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f648cff9640 1 -- 172.21.15.89:0/3810610667 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494003620 con 0x557810cc6fc0 2023-12-07T10:00:59.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f648cff9640 1 -- 172.21.15.89:0/3810610667 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494003780 con 0x557810cc6fc0 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.656+0000 7f648cff9640 1 -- 172.21.15.89:0/3810610667 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494003af0 con 0x557810cc6fc0 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/3810610667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 msgr2=0x557810d5e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810d5e530 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f649401c8a0 tx=0x7f64940a9000 comp rx=0 tx=0).stop 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/3810610667 shutdown_connections 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810cc78e0 0x557810d5ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc6fc0 0x557810d5e530 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/3810610667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810d05830 0x557810d5dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/3810610667 >> 172.21.15.89:0/3810610667 conn(0x557810cca960 msgr2=0x557810cc6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/3810610667 shutdown_connections 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/3810610667 wait complete. 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- start start 2023-12-07T10:00:59.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 Processor -- start 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810d33ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 0x557810d34000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810d05830 0x557810d34540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810b1d7c0 con 0x557810cc78e0 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x557810b16fd0 con 0x557810cc6fc0 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x557810b18650 con 0x557810d05830 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 10 client.0 _ll_register_callbacks cb 0x557810b248e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 0x557810d34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 0x557810d34000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55262/0 (socket says 172.21.15.89:55262) 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810d33ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 -- 172.21.15.89:0/1521879397 learned_addr learned my addr 172.21.15.89:0/1521879397 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:59.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649ed9d640 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810d05830 0x557810d34540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 -- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810d05830 msgr2=0x557810d34540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810d05830 0x557810d34540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 -- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 msgr2=0x557810d33ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810d33ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 -- 172.21.15.89:0/1521879397 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a0154cf0 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f649dd9b640 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 0x557810d34000 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f64940af040 tx=0x7f649401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51eb81fb31e7de server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f647d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f647d7fa640 1 -- 172.21.15.89:0/1521879397 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940043d0 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f647d7fa640 1 -- 172.21.15.89:0/1521879397 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64940bc040 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557810ccbf20 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f647d7fa640 1 -- 172.21.15.89:0/1521879397 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6494004530 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 10 client.6000 fetch_fsmap learned FSMap version 33 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557810811cc0 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f647d7fa640 1 -- 172.21.15.89:0/1521879397 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557810ccbf20 con 0x557810cc78e0 2023-12-07T10:00:59.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f647d7fa640 1 -- 172.21.15.89:0/1521879397 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f64940038f0 con 0x557810cc78e0 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 10 client.6000 fetch_fsmap finished waiting for FSMap version 33 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 10 client.6000 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 20 client.6000 populate_metadata read hostname 'smithi089' 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.660+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810cc8200 0x557810d78780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 4 client.6000 mds_command: new command op to 5841 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 --> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557810b18110 con 0x557810cc8200 2023-12-07T10:00:59.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f649e59c640 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810cc8200 0x557810d78780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f649e59c640 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810cc8200 0x557810d78780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=193c84334324eced server_cookie=8474d16110eb7c73 in_seq=0 out_seq=0 2023-12-07T10:00:59.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f647d7fa640 10 client.6000 ms_handle_connect on v2:172.21.15.89:6835/416367230 2023-12-07T10:00:59.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f647d7fa640 1 -- 172.21.15.89:0/1521879397 <== mds.0 v2:172.21.15.89:6835/416367230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557810b18110 con 0x557810cc8200 2023-12-07T10:00:59.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f647d7fa640 10 client.6000 handle_command_reply: tid=0 2023-12-07T10:00:59.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 client.6000 shutdown 2023-12-07T10:00:59.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 msgr2=0x557810d34000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 0x557810d34000 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f64940af040 tx=0x7f649401ac00 comp rx=0 tx=0).stop 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 shutdown_connections 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:6835/416367230,v1:172.21.15.89:6837/416367230] conn(0x557810cc8200 0x557810d78780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x557810d05830 0x557810d34540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f647d7fa640 0 client.6000 ms_handle_reset on v2:172.21.15.89:6835/416367230 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557810cc78e0 0x557810d34000 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 --2- 172.21.15.89:0/1521879397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557810cc6fc0 0x557810d33ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 >> 172.21.15.89:0/1521879397 conn(0x557810cca960 msgr2=0x557810d2ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 shutdown_connections 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 1 -- 172.21.15.89:0/1521879397 wait complete. 2023-12-07T10:00:59.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a7f6c000 20 client.6000 trim_cache size 0 max 16384 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "06923b89-f6c6-4736-b27e-9e03456ddc01", 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5841, 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 5.8302247950000003, 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 33, 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 49, 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 49, 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 11.783386831 2023-12-07T10:00:59.673 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f64800668d0 msgr2=0x7f6480068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f64800668d0 0x7f6480068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f64940ae000 tx=0x7f6494004740 comp rx=0 tx=0).stop 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 msgr2=0x7f64a0149e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 0x7f64a0149e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f649000c530 tx=0x7f649000c9f0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 shutdown_connections 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a0154870 0x7f64a0146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f64800668d0 0x7f6480068d90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f64a00aacd0 0x7f64a00a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 --2- 172.21.15.89:0/1080773325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64a00700a0 0x7f64a0149e00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 >> 172.21.15.89:0/1080773325 conn(0x7f64a00c2ad0 msgr2=0x7f64a015cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 shutdown_connections 2023-12-07T10:00:59.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.664+0000 7f64a4bf8640 1 -- 172.21.15.89:0/1080773325 wait complete. 2023-12-07T10:00:59.688 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:00:59.819 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-12-07T10:00:59.812+0000 7f0b772f7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:00:59.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.820+0000 7f7793165640 1 Processor -- start 2023-12-07T10:00:59.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.820+0000 7f7793165640 1 -- start start 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7793165640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f778c14e9d0 0x7f778c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7793165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c070b80 0x7f778c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7793165640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778c06d320 con 0x7f778c0c1f20 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7793165640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0721b0 con 0x7f778c14e9d0 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7793165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0c2830 con 0x7f778c070b80 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7790f01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f778c14e9d0 0x7f778c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7791702640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f778c0c1f20 0x7f778c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48074/0 (socket says 172.21.15.89:48074) 2023-12-07T10:00:59.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7791702640 1 -- 172.21.15.89:0/751640082 learned_addr learned my addr 172.21.15.89:0/751640082 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:00:59.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7783fff640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c070b80 0x7f778c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7790f01640 1 -- 172.21.15.89:0/751640082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c070b80 msgr2=0x7f778c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:00:59.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7790f01640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c070b80 0x7f778c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7790f01640 1 -- 172.21.15.89:0/751640082 >> v1:172.21.15.89:6789/0 conn(0x7f778c0c1f20 legacy=0x7f778c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7790f01640 1 -- 172.21.15.89:0/751640082 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c072450 con 0x7f778c14e9d0 2023-12-07T10:00:59.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7783fff640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c070b80 0x7f778c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:59.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.824+0000 7f7790f01640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c151e60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f77880097c0 tx=0x7f778801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d92b53b7f272bde server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f77837fe640 1 -- 172.21.15.89:0/751640082 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880ab600 con 0x7f778c14e9d0 2023-12-07T10:00:59.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f77837fe640 1 -- 172.21.15.89:0/751640082 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77880a7050 con 0x7f778c14e9d0 2023-12-07T10:00:59.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f77837fe640 1 -- 172.21.15.89:0/751640082 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880ab980 con 0x7f778c14e9d0 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- 172.21.15.89:0/751640082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 msgr2=0x7f778c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c151e60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f77880097c0 tx=0x7f778801c3f0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- 172.21.15.89:0/751640082 shutdown_connections 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c070b80 0x7f778c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 --2- 172.21.15.89:0/751640082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c151e60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- 172.21.15.89:0/751640082 >> 172.21.15.89:0/751640082 conn(0x7f778c0c2ad0 msgr2=0x7f778c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- 172.21.15.89:0/751640082 shutdown_connections 2023-12-07T10:00:59.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- 172.21.15.89:0/751640082 wait complete. 2023-12-07T10:00:59.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 Processor -- start 2023-12-07T10:00:59.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- start start 2023-12-07T10:00:59.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f778c070b80 0x7f778c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c0c1f20 0x7f778c1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c1ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1ecdc0 con 0x7f778c14e9d0 2023-12-07T10:00:59.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1ee230 con 0x7f778c070b80 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7793165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c154e80 con 0x7f778c0c1f20 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7791702640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c1ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7791702640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c1ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55294/0 (socket says 172.21.15.89:55294) 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7791702640 1 -- 172.21.15.89:0/3818779921 learned_addr learned my addr 172.21.15.89:0/3818779921 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.828+0000 7f7783fff640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c0c1f20 0x7f778c1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7790f01640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f778c070b80 0x7f778c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7791702640 1 -- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c0c1f20 msgr2=0x7f778c1483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7791702640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c0c1f20 0x7f778c1483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7791702640 1 -- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f778c070b80 msgr2=0x7f778c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7791702640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f778c070b80 0x7f778c1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7791702640 1 -- 172.21.15.89:0/3818779921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009420 con 0x7f778c14e9d0 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7790f01640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f778c070b80 0x7f778c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7783fff640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c0c1f20 0x7f778c1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:00:59.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7791702640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c1ef720 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f778400cbc0 tx=0x7f778400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400ad40 con 0x7f778c14e9d0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784012400 con 0x7f778c14e9d0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c153dd0 con 0x7f778c14e9d0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400aea0 con 0x7f778c14e9d0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c153530 con 0x7f778c14e9d0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c1ecf30 con 0x7f778c14e9d0 2023-12-07T10:00:59.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7784007070 con 0x7f778c14e9d0 2023-12-07T10:00:59.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f77817fa640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77780668d0 0x7f7778068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:00:59.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.832+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7784084330 con 0x7f778c14e9d0 2023-12-07T10:00:59.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.836+0000 7f7790f01640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77780668d0 0x7f7778068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:00:59.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.836+0000 7f7790f01640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77780668d0 0x7f7778068d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f77880ad000 tx=0x7f77880a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:00:59.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:00:59.836+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f778c1ecf30 con 0x7f778c14e9d0 2023-12-07T10:01:00.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f778c1ecf00 con 0x7f778c14e9d0 2023-12-07T10:01:00.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f77817fa640 1 -- 172.21.15.89:0/3818779921 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7784017060 con 0x7f778c14e9d0 2023-12-07T10:01:00.029 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:01:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77780668d0 msgr2=0x7f7778068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77780668d0 0x7f7778068d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f77880ad000 tx=0x7f77880a4f90 comp rx=0 tx=0).stop 2023-12-07T10:01:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 msgr2=0x7f778c1ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c1ef720 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f778400cbc0 tx=0x7f778400a430 comp rx=0 tx=0).stop 2023-12-07T10:01:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 shutdown_connections 2023-12-07T10:01:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778c14e9d0 0x7f778c1ef720 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77780668d0 0x7f7778068d90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f778c0c1f20 0x7f778c1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 --2- 172.21.15.89:0/3818779921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f778c070b80 0x7f778c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 >> 172.21.15.89:0/3818779921 conn(0x7f778c0c2ad0 msgr2=0x7f778c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 shutdown_connections 2023-12-07T10:01:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.024+0000 7f7793165640 1 -- 172.21.15.89:0/3818779921 wait complete. 2023-12-07T10:01:00.050 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:01:00.051 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:01:00.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.051 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T10:01:00.061 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:01:00.061 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:01:00.061 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:01:00.061 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.061 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42299sec preferred_lft 42299sec 2023-12-07T10:01:00.062 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:01:00.063 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:00.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.064 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:01:00.123 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T10:01:00.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.125 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T10:01:00.178 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T10:01:00.178 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:01:00.178 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:01:00.178 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:01:00.178 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:01:00.179 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:01:00.179 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:00.179 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:00.179 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:00.179 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:01:00.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.179 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T10:01:00.179 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T10:01:00.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:01:00.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:01:00.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:01:00.180 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T10:01:00.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.271 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:01:00.280 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:01:00.281 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:01:00.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T10:01:00.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:00.346 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:00.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:00.401 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:00.451 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-07T10:01:00.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:00.545 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:00.545 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:01:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 0@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:01:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:01:00.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:01:00.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:00.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:00.587 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:01:00.649 INFO:teuthology.orchestra.run.smithi089.stdout:client5318 2023-12-07T10:01:00.649 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:00.650 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:00.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:01:00.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 Processor -- start 2023-12-07T10:01:00.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 -- start start 2023-12-07T10:01:00.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c600bd720 0x7f9c60158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:00.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c6006cd90 0x7f9c60158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:00.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c60155790 con 0x7f9c600ca610 2023-12-07T10:01:00.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600c4b00 con 0x7f9c6006cd90 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c67879640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600c4de0 con 0x7f9c600bd720 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c65615640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9c600ca610 0x7f9c600c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48080/0 (socket says 172.21.15.89:48080) 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c65615640 1 -- 172.21.15.89:0/1423187975 learned_addr learned my addr 172.21.15.89:0/1423187975 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c64e14640 1 --2- 172.21.15.89:0/1423187975 >> v2:172.21.15.97:3300/0 conn(0x7f9c600bd720 0x7f9c60158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.880+0000 7f9c65e16640 1 --2- 172.21.15.89:0/1423187975 >> v2:172.21.15.89:3300/0 conn(0x7f9c6006cd90 0x7f9c60158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.884+0000 7f9c64e14640 1 -- 172.21.15.89:0/1423187975 >> v2:172.21.15.89:3300/0 conn(0x7f9c6006cd90 msgr2=0x7f9c60158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:00.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.884+0000 7f9c64e14640 1 --2- 172.21.15.89:0/1423187975 >> v2:172.21.15.89:3300/0 conn(0x7f9c6006cd90 0x7f9c60158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.884+0000 7f9c64e14640 1 -- 172.21.15.89:0/1423187975 >> v1:172.21.15.89:6789/0 conn(0x7f9c600ca610 legacy=0x7f9c600c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:00.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.884+0000 7f9c64e14640 1 -- 172.21.15.89:0/1423187975 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60157e30 con 0x7f9c600bd720 2023-12-07T10:01:00.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.884+0000 7f9c64e14640 1 --2- 172.21.15.89:0/1423187975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c60158350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c600ca380 tx=0x7f9c5001c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b04f65b59806651 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:00.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c57fff640 1 -- 172.21.15.89:0/1423187975 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600c52d0 con 0x7f9c600bd720 2023-12-07T10:01:00.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c57fff640 1 -- 172.21.15.89:0/1423187975 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c500a7050 con 0x7f9c600bd720 2023-12-07T10:01:00.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c57fff640 1 -- 172.21.15.89:0/1423187975 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500ab820 con 0x7f9c600bd720 2023-12-07T10:01:00.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 -- 172.21.15.89:0/1423187975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 msgr2=0x7f9c60158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:00.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 --2- 172.21.15.89:0/1423187975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c60158350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c600ca380 tx=0x7f9c5001c340 comp rx=0 tx=0).stop 2023-12-07T10:01:00.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 -- 172.21.15.89:0/1423187975 shutdown_connections 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 --2- 172.21.15.89:0/1423187975 >> v2:172.21.15.89:3300/0 conn(0x7f9c6006cd90 0x7f9c60158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 --2- 172.21.15.89:0/1423187975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c60158350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 -- 172.21.15.89:0/1423187975 >> 172.21.15.89:0/1423187975 conn(0x7f9c60071ea0 msgr2=0x7f9c600722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 -- 172.21.15.89:0/1423187975 shutdown_connections 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.888+0000 7f9c67879640 1 -- 172.21.15.89:0/1423187975 wait complete. 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 Processor -- start 2023-12-07T10:01:00.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 -- start start 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c6006cd90 0x7f9c60149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c601518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 0x7f9c60148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600ac570 con 0x7f9c600ca610 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600ac810 con 0x7f9c600bd720 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60150af0 con 0x7f9c6006cd90 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 0x7f9c60148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c64e14640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c601518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:00.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 0x7f9c60148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55324/0 (socket says 172.21.15.89:55324) 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 -- 172.21.15.89:0/2420548923 learned_addr learned my addr 172.21.15.89:0/2420548923 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65615640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c6006cd90 0x7f9c60149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 -- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c6006cd90 msgr2=0x7f9c60149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c6006cd90 0x7f9c60149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 -- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 msgr2=0x7f9c601518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c601518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 -- 172.21.15.89:0/2420548923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009420 con 0x7f9c600ca610 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c65e16640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 0x7f9c60148570 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800efc0 tx=0x7f9c5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58014480 con 0x7f9c600ca610 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5800f040 con 0x7f9c600ca610 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60150dd0 con 0x7f9c600ca610 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58014820 con 0x7f9c600ca610 2023-12-07T10:01:00.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.892+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c60151390 con 0x7f9c600ca610 2023-12-07T10:01:00.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.896+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c600c9de0 con 0x7f9c600ca610 2023-12-07T10:01:00.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.896+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c58014980 con 0x7f9c600ca610 2023-12-07T10:01:00.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.896+0000 7f9c55ffb640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c440668d0 0x7f9c44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:00.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.896+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c58084ee0 con 0x7f9c600ca610 2023-12-07T10:01:00.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.896+0000 7f9c65615640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c440668d0 0x7f9c44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:00.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.896+0000 7f9c65615640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c440668d0 0x7f9c44068d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c005890 tx=0x7f9c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:00.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:00.900+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c580521c0 con 0x7f9c600ca610 2023-12-07T10:01:01.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.084+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c6004e890 con 0x7f9c600ca610 2023-12-07T10:01:01.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.084+0000 7f9c55ffb640 1 -- 172.21.15.89:0/2420548923 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9c58018060 con 0x7f9c600ca610 2023-12-07T10:01:01.090 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:01:01.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c440668d0 msgr2=0x7f9c44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:01.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c440668d0 0x7f9c44068d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c005890 tx=0x7f9c5c009040 comp rx=0 tx=0).stop 2023-12-07T10:01:01.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 msgr2=0x7f9c60148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:01.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 0x7f9c60148570 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800efc0 tx=0x7f9c5800c490 comp rx=0 tx=0).stop 2023-12-07T10:01:01.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 shutdown_connections 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c600ca610 0x7f9c60148570 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c600bd720 0x7f9c601518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c440668d0 0x7f9c44068d90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 --2- 172.21.15.89:0/2420548923 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c6006cd90 0x7f9c60149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 >> 172.21.15.89:0/2420548923 conn(0x7f9c60071ea0 msgr2=0x7f9c60072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 shutdown_connections 2023-12-07T10:01:01.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.088+0000 7f9c67879640 1 -- 172.21.15.89:0/2420548923 wait complete. 2023-12-07T10:01:01.110 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:01:01.111 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:01:01.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:01:01.121 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42315sec preferred_lft 42315sec 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:01:01.122 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:01:01.123 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:01.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.124 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:01:01.187 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:01:01.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.190 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:01:01.248 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:01:01.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.250 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:01:01.250 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:01:01.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:01:01.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:01:01.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:01:01.250 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:01:01.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.350 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:01:01.359 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:01:01.360 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:01:01.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:01:01.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:01.425 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:01.477 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:01:01.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:01.477 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:01.528 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-07T10:01:01.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.528 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:01.622 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:01.622 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:01.635 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:01.635 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:01.635 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:01:01.635 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:01:01.635 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:01:01.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:01:01.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.639 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:01.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:01.659 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:01:01.712 INFO:teuthology.orchestra.run.smithi097.stdout:client6018 2023-12-07T10:01:01.712 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:01.712 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:01.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-07T10:01:01.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 Processor -- start 2023-12-07T10:01:01.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 -- start start 2023-12-07T10:01:01.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37500ca620 0x7f37500caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:01.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37500c4890 0x7f37500c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375006b7d0 con 0x7f37500bd5a0 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3750155160 con 0x7f37500ca620 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f375543a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375006b180 con 0x7f37500c4890 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37500ca620 0x7f37500caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37500ca620 0x7f37500caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55334/0 (socket says 172.21.15.89:55334) 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 -- 172.21.15.89:0/11860540 learned_addr learned my addr 172.21.15.89:0/11860540 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374f7fe640 1 --2- 172.21.15.89:0/11860540 >> v2:172.21.15.97:3300/0 conn(0x7f37500c4890 0x7f37500c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 -- 172.21.15.89:0/11860540 >> v2:172.21.15.97:3300/0 conn(0x7f37500c4890 msgr2=0x7f37500c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 --2- 172.21.15.89:0/11860540 >> v2:172.21.15.97:3300/0 conn(0x7f37500c4890 0x7f37500c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 -- 172.21.15.89:0/11860540 >> v1:172.21.15.97:6789/0 conn(0x7f37500bd5a0 legacy=0x7f37500c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:01.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.900+0000 7f374ffff640 1 -- 172.21.15.89:0/11860540 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375006b460 con 0x7f37500ca620 2023-12-07T10:01:01.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f374ffff640 1 --2- 172.21.15.89:0/11860540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f37500caa00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f37500c9380 tx=0x7f374001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a163cc74b89bfb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:01.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f374effd640 1 -- 172.21.15.89:0/11860540 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400ab600 con 0x7f37500ca620 2023-12-07T10:01:01.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f374effd640 1 -- 172.21.15.89:0/11860540 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400ab760 con 0x7f37500ca620 2023-12-07T10:01:01.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f374effd640 1 -- 172.21.15.89:0/11860540 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400abaf0 con 0x7f37500ca620 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 -- 172.21.15.89:0/11860540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 msgr2=0x7f37500caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 --2- 172.21.15.89:0/11860540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f37500caa00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f37500c9380 tx=0x7f374001c470 comp rx=0 tx=0).stop 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 -- 172.21.15.89:0/11860540 shutdown_connections 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 --2- 172.21.15.89:0/11860540 >> v2:172.21.15.97:3300/0 conn(0x7f37500c4890 0x7f37500c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 --2- 172.21.15.89:0/11860540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f37500caa00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 -- 172.21.15.89:0/11860540 >> 172.21.15.89:0/11860540 conn(0x7f37500ac0a0 msgr2=0x7f37500c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 -- 172.21.15.89:0/11860540 shutdown_connections 2023-12-07T10:01:01.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.904+0000 7f375543a640 1 -- 172.21.15.89:0/11860540 wait complete. 2023-12-07T10:01:01.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 Processor -- start 2023-12-07T10:01:01.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 -- start start 2023-12-07T10:01:01.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 0x7f375014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:01.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37500c4890 0x7f37501558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:01.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f3750157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:01.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37501f0170 con 0x7f37500ca620 2023-12-07T10:01:01.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37501579f0 con 0x7f37500bd5a0 2023-12-07T10:01:01.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3750155e10 con 0x7f37500c4890 2023-12-07T10:01:01.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f3750157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:01.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 0x7f375014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:01.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 0x7f375014bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:58746/0 (socket says 172.21.15.89:58746) 2023-12-07T10:01:01.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374ffff640 1 -- 172.21.15.89:0/3515208329 learned_addr learned my addr 172.21.15.89:0/3515208329 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:01.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374f7fe640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37500c4890 0x7f37501558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 -- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37500c4890 msgr2=0x7f37501558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37500c4890 0x7f37501558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 -- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 msgr2=0x7f375014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 0x7f375014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 -- 172.21.15.89:0/3515208329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400094d0 con 0x7f37500ca620 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374ffff640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 0x7f375014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374f7fe640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37500c4890 0x7f37501558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f3754c39640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f3750157e80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f374800c760 tx=0x7f374800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:01.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748003b80 con 0x7f37500ca620 2023-12-07T10:01:01.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3748003ce0 con 0x7f37500ca620 2023-12-07T10:01:01.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37501583c0 con 0x7f37500ca620 2023-12-07T10:01:01.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800aa30 con 0x7f37500ca620 2023-12-07T10:01:01.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.908+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3750157680 con 0x7f37500ca620 2023-12-07T10:01:01.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.912+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3750157840 con 0x7f37500ca620 2023-12-07T10:01:01.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.912+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f374800ab90 con 0x7f37500ca620 2023-12-07T10:01:01.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.912+0000 7f374cff9640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f373c0668d0 0x7f373c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:01.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.912+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3748083f10 con 0x7f37500ca620 2023-12-07T10:01:01.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.912+0000 7f374ffff640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f373c0668d0 0x7f373c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:01.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.912+0000 7f374ffff640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f373c0668d0 0x7f373c068d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f374001c4b0 tx=0x7f37400b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:01.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:01.916+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3748051290 con 0x7f37500ca620 2023-12-07T10:01:02.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.116+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f375004e890 con 0x7f37500ca620 2023-12-07T10:01:02.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f374cff9640 1 -- 172.21.15.89:0/3515208329 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f37480548b0 con 0x7f37500ca620 2023-12-07T10:01:02.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f373c0668d0 msgr2=0x7f373c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f373c0668d0 0x7f373c068d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f374001c4b0 tx=0x7f37400b6040 comp rx=0 tx=0).stop 2023-12-07T10:01:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 msgr2=0x7f3750157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f3750157e80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f374800c760 tx=0x7f374800cc20 comp rx=0 tx=0).stop 2023-12-07T10:01:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 shutdown_connections 2023-12-07T10:01:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37500ca620 0x7f3750157e80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f373c0668d0 0x7f373c068d90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37500c4890 0x7f37501558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 --2- 172.21.15.89:0/3515208329 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37500bd5a0 0x7f375014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 >> 172.21.15.89:0/3515208329 conn(0x7f37500ac0a0 msgr2=0x7f37500c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:02.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 shutdown_connections 2023-12-07T10:01:02.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.120+0000 7f375543a640 1 -- 172.21.15.89:0/3515208329 wait complete. 2023-12-07T10:01:02.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:02.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.276+0000 7f0fed5aa640 1 Processor -- start 2023-12-07T10:01:02.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fed5aa640 1 -- start start 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fed5aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0fe80c65d0 0x7f0fe81601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fed5aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe80c5a30 con 0x7f0fe8151ee0 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fed5aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe81522c0 con 0x7f0fe80c49e0 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fed5aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe806bc70 con 0x7f0fe80c65d0 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe6ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0fe8151ee0 0x7f0fe806b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48096/0 (socket says 172.21.15.89:48096) 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe6ffd640 1 -- 172.21.15.89:0/1270266263 learned_addr learned my addr 172.21.15.89:0/1270266263 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:02.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe77fe640 1 --2- 172.21.15.89:0/1270266263 >> v2:172.21.15.97:3300/0 conn(0x7f0fe80c65d0 0x7f0fe81601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623541094 0 0) 0x7f0fe80c5a30 con 0x7f0fe8151ee0 2023-12-07T10:01:02.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd0003530 con 0x7f0fe8151ee0 2023-12-07T10:01:02.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278050870 0 0) 0x7f0fe81522c0 con 0x7f0fe80c49e0 2023-12-07T10:01:02.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe80c5a30 con 0x7f0fe80c49e0 2023-12-07T10:01:02.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe77fe640 1 -- 172.21.15.89:0/1270266263 >> v1:172.21.15.97:6789/0 conn(0x7f0fe80c49e0 legacy=0x7f0fe80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe77fe640 1 -- 172.21.15.89:0/1270266263 >> v1:172.21.15.89:6789/0 conn(0x7f0fe8151ee0 legacy=0x7f0fe806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.280+0000 7f0fe77fe640 1 -- 172.21.15.89:0/1270266263 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8155490 con 0x7f0fe80c65d0 2023-12-07T10:01:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fe77fe640 1 --2- 172.21.15.89:0/1270266263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81601e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009d90 tx=0x7f0fe001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c775e3bafbb04bb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00a58e0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe00a5a40 con 0x7f0fe80c65d0 2023-12-07T10:01:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fe5ffb640 1 -- 172.21.15.89:0/1270266263 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00a5dd0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 -- 172.21.15.89:0/1270266263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe80c65d0 msgr2=0x7f0fe81601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/1270266263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81601e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009d90 tx=0x7f0fe001c890 comp rx=0 tx=0).stop 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 -- 172.21.15.89:0/1270266263 shutdown_connections 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/1270266263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81601e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 -- 172.21.15.89:0/1270266263 >> 172.21.15.89:0/1270266263 conn(0x7f0fe80ca060 msgr2=0x7f0fe80ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 -- 172.21.15.89:0/1270266263 shutdown_connections 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 -- 172.21.15.89:0/1270266263 wait complete. 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 Processor -- start 2023-12-07T10:01:02.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.284+0000 7f0fed5aa640 1 -- start start 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fe80c49e0 0x7f0fe8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe8151ee0 0x7f0fe80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe8154390 con 0x7f0fe80c65d0 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe81524f0 con 0x7f0fe8151ee0 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe81527d0 con 0x7f0fe80c49e0 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55362/0 (socket says 172.21.15.89:55362) 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 -- 172.21.15.89:0/749732294 learned_addr learned my addr 172.21.15.89:0/749732294 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe6ffd640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fe80c49e0 0x7f0fe8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe77fe640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe8151ee0 0x7f0fe80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 -- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fe80c49e0 msgr2=0x7f0fe8153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fe80c49e0 0x7f0fe8153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 -- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe8151ee0 msgr2=0x7f0fe80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe8151ee0 0x7f0fe80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 -- 172.21.15.89:0/749732294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0009a70 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fe67fc640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81532b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00c430 tx=0x7f0fdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0052d0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc005450 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc003840 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe8152ab0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe80ab1d0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.288+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe8152fd0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.292+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0fdc0039a0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.292+0000 7f0fcf7fe640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fd4066900 0x7f0fd4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.292+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fdc083a10 con 0x7f0fe80c65d0 2023-12-07T10:01:02.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.292+0000 7f0fe6ffd640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fd4066900 0x7f0fd4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.292+0000 7f0fe6ffd640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fd4066900 0x7f0fd4068dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80011f0 tx=0x7f0fd8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.296+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0fe8152fd0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.448+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fe8152fd0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.448+0000 7f0fcf7fe640 1 -- 172.21.15.89:0/749732294 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f0fe8152fd0 con 0x7f0fe80c65d0 2023-12-07T10:01:02.454 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:02.454 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":49,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:00:54.224366+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fd4066900 msgr2=0x7f0fd4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fd4066900 0x7f0fd4068dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80011f0 tx=0x7f0fd8007d40 comp rx=0 tx=0).stop 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 msgr2=0x7f0fe81532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81532b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00c430 tx=0x7f0fdc00c8f0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 shutdown_connections 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fe8151ee0 0x7f0fe80aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fe80c65d0 0x7f0fe81532b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fd4066900 0x7f0fd4068dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 --2- 172.21.15.89:0/749732294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0fe80c49e0 0x7f0fe8153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 >> 172.21.15.89:0/749732294 conn(0x7f0fe80ca060 msgr2=0x7f0fe8150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:02.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 shutdown_connections 2023-12-07T10:01:02.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.452+0000 7f0fed5aa640 1 -- 172.21.15.89:0/749732294 wait complete. 2023-12-07T10:01:02.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:00:50.933921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:00:52.211886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:02.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f8591cfe640 1 Processor -- start 2023-12-07T10:01:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f8591cfe640 1 -- start start 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f8591cfe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f858c14fd00 0x7f858c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f8591cfe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c152d90 con 0x7f858c156600 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f8591cfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c152480 con 0x7f858c0a86d0 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f8591cfe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c0a9760 con 0x7f858c14fd00 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f858c14fd00 0x7f858c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f858c14fd00 0x7f858c0aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55374/0 (socket says 172.21.15.89:55374) 2023-12-07T10:01:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858bfff640 1 -- 172.21.15.89:0/31597044 learned_addr learned my addr 172.21.15.89:0/31597044 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:02.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858bfff640 1 -- 172.21.15.89:0/31597044 >> v1:172.21.15.97:6789/0 conn(0x7f858c0a86d0 legacy=0x7f858c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:02.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858bfff640 1 -- 172.21.15.89:0/31597044 >> v1:172.21.15.89:6789/0 conn(0x7f858c156600 legacy=0x7f858c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858bfff640 1 -- 172.21.15.89:0/31597044 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c152740 con 0x7f858c14fd00 2023-12-07T10:01:02.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.612+0000 7f858a7fc640 1 -- 172.21.15.89:0/31597044 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741649590 0 0) 0x7f858c152d90 con 0x7f858c156600 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f858bfff640 1 --2- 172.21.15.89:0/31597044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c14fd00 0x7f858c0aae40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8584009e80 tx=0x7f858401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d277f4a039005b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f858a7fc640 1 -- 172.21.15.89:0/31597044 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85840a57a0 con 0x7f858c14fd00 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f858a7fc640 1 -- 172.21.15.89:0/31597044 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85840a5900 con 0x7f858c14fd00 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f858a7fc640 1 -- 172.21.15.89:0/31597044 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85840a5c90 con 0x7f858c14fd00 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 -- 172.21.15.89:0/31597044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c14fd00 msgr2=0x7f858c0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 --2- 172.21.15.89:0/31597044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c14fd00 0x7f858c0aae40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8584009e80 tx=0x7f858401c9f0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 -- 172.21.15.89:0/31597044 shutdown_connections 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 --2- 172.21.15.89:0/31597044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c14fd00 0x7f858c0aae40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 -- 172.21.15.89:0/31597044 >> 172.21.15.89:0/31597044 conn(0x7f858c0c2a60 msgr2=0x7f858c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 -- 172.21.15.89:0/31597044 shutdown_connections 2023-12-07T10:01:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.616+0000 7f8591cfe640 1 -- 172.21.15.89:0/31597044 wait complete. 2023-12-07T10:01:02.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 Processor -- start 2023-12-07T10:01:02.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 -- start start 2023-12-07T10:01:02.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 0x7f858c14b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f858c14fd00 0x7f858c1f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f858c156600 0x7f858c1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c149590 con 0x7f858c0a86d0 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1f4f30 con 0x7f858c14fd00 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c14dc60 con 0x7f858c156600 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 0x7f858c14b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 0x7f858c14b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55376/0 (socket says 172.21.15.89:55376) 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 -- 172.21.15.89:0/168359953 learned_addr learned my addr 172.21.15.89:0/168359953 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858bfff640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f858c156600 0x7f858c1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858affd640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f858c14fd00 0x7f858c1f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 -- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f858c156600 msgr2=0x7f858c1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f858c156600 0x7f858c1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 -- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f858c14fd00 msgr2=0x7f858c1f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f858c14fd00 0x7f858c1f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 -- 172.21.15.89:0/168359953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8584009b30 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f858b7fe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 0x7f858c14b340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c3f0 tx=0x7f857c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0052d0 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c005430 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c003840 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c149a80 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.620+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c06d1d0 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.624+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c04e890 con 0x7f858c0a86d0 2023-12-07T10:01:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.624+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f857c0039a0 con 0x7f858c0a86d0 2023-12-07T10:01:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.624+0000 7f8573fff640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f85780668d0 0x7f8578068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.624+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f857c0839b0 con 0x7f858c0a86d0 2023-12-07T10:01:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.624+0000 7f858affd640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f85780668d0 0x7f8578068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.624+0000 7f858affd640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f85780668d0 0x7f8578068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f858c06d6b0 tx=0x7f8580009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.628+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f857c050bf0 con 0x7f858c0a86d0 2023-12-07T10:01:02.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.776+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f858c0725d0 con 0x7f858c0a86d0 2023-12-07T10:01:02.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.776+0000 7f8573fff640 1 -- 172.21.15.89:0/168359953 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f857c017020 con 0x7f858c0a86d0 2023-12-07T10:01:02.783 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f85780668d0 msgr2=0x7f8578068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f85780668d0 0x7f8578068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f858c06d6b0 tx=0x7f8580009040 comp rx=0 tx=0).stop 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 msgr2=0x7f858c14b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 0x7f858c14b340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c3f0 tx=0x7f857c00c8b0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 shutdown_connections 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f85780668d0 0x7f8578068d90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f858c156600 0x7f858c1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f858c14fd00 0x7f858c1f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 --2- 172.21.15.89:0/168359953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0a86d0 0x7f858c14b340 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 >> 172.21.15.89:0/168359953 conn(0x7f858c0c2a60 msgr2=0x7f858c0c22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:02.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 shutdown_connections 2023-12-07T10:01:02.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.780+0000 7f8591cfe640 1 -- 172.21.15.89:0/168359953 wait complete. 2023-12-07T10:01:02.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:01:02.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 Processor -- start 2023-12-07T10:01:02.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 -- start start 2023-12-07T10:01:02.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f534c151ee0 0x7f534c072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c0c1ae0 0x7f534c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c1522c0 con 0x7f534c06aae0 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c072870 con 0x7f534c151ee0 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f5351bb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c155040 con 0x7f534c0c1ae0 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f534c151ee0 0x7f534c072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f534c151ee0 0x7f534c072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55392/0 (socket says 172.21.15.89:55392) 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 -- 172.21.15.89:0/3432352157 learned_addr learned my addr 172.21.15.89:0/3432352157 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 -- 172.21.15.89:0/3432352157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c0c1ae0 msgr2=0x7f534c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 --2- 172.21.15.89:0/3432352157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c0c1ae0 0x7f534c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 -- 172.21.15.89:0/3432352157 >> v1:172.21.15.97:6789/0 conn(0x7f534c06aae0 legacy=0x7f534c0c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:02.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.940+0000 7f534b7fe640 1 -- 172.21.15.89:0/3432352157 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c1555c0 con 0x7f534c151ee0 2023-12-07T10:01:02.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f534b7fe640 1 --2- 172.21.15.89:0/3432352157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c151ee0 0x7f534c072330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f534c0729b0 tx=0x7f533c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3f40c8de714b5b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f534a7fc640 1 -- 172.21.15.89:0/3432352157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ab610 con 0x7f534c151ee0 2023-12-07T10:01:02.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f534a7fc640 1 -- 172.21.15.89:0/3432352157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0ab770 con 0x7f534c151ee0 2023-12-07T10:01:02.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f534a7fc640 1 -- 172.21.15.89:0/3432352157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0abb00 con 0x7f534c151ee0 2023-12-07T10:01:02.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 -- 172.21.15.89:0/3432352157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c151ee0 msgr2=0x7f534c072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 --2- 172.21.15.89:0/3432352157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c151ee0 0x7f534c072330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f534c0729b0 tx=0x7f533c01c450 comp rx=0 tx=0).stop 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 -- 172.21.15.89:0/3432352157 shutdown_connections 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 --2- 172.21.15.89:0/3432352157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c0c1ae0 0x7f534c06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 --2- 172.21.15.89:0/3432352157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c151ee0 0x7f534c072330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 -- 172.21.15.89:0/3432352157 >> 172.21.15.89:0/3432352157 conn(0x7f534c0c3b70 msgr2=0x7f534c0c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 -- 172.21.15.89:0/3432352157 shutdown_connections 2023-12-07T10:01:02.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.944+0000 7f5351bb8640 1 -- 172.21.15.89:0/3432352157 wait complete. 2023-12-07T10:01:02.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 Processor -- start 2023-12-07T10:01:02.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 -- start start 2023-12-07T10:01:02.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c06aae0 0x7f534c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 0x7f534c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534c151ee0 0x7f534c1f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c14ffb0 con 0x7f534c0c1ae0 2023-12-07T10:01:02.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1ed7c0 con 0x7f534c151ee0 2023-12-07T10:01:02.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0ac760 con 0x7f534c06aae0 2023-12-07T10:01:02.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 0x7f534c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 0x7f534c153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55404/0 (socket says 172.21.15.89:55404) 2023-12-07T10:01:02.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 -- 172.21.15.89:0/402792819 learned_addr learned my addr 172.21.15.89:0/402792819 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:02.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534b7fe640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c06aae0 0x7f534c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534bfff640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534c151ee0 0x7f534c1f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 -- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c06aae0 msgr2=0x7f534c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c06aae0 0x7f534c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 -- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534c151ee0 msgr2=0x7f534c1f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534c151ee0 0x7f534c1f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 -- 172.21.15.89:0/402792819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0094d0 con 0x7f534c0c1ae0 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f534affd640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 0x7f534c153ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f534000b480 tx=0x7f534000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340010870 con 0x7f534c0c1ae0 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53400109d0 con 0x7f534c0c1ae0 2023-12-07T10:01:02.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0ac480 con 0x7f534c0c1ae0 2023-12-07T10:01:02.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340010d80 con 0x7f534c0c1ae0 2023-12-07T10:01:02.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.948+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c1ed3e0 con 0x7f534c0c1ae0 2023-12-07T10:01:02.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.952+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c04e890 con 0x7f534c0c1ae0 2023-12-07T10:01:02.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.952+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f534000f3c0 con 0x7f534c0c1ae0 2023-12-07T10:01:02.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.952+0000 7f5333fff640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5338066900 0x7f5338068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:02.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.952+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53400843c0 con 0x7f534c0c1ae0 2023-12-07T10:01:02.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.952+0000 7f534b7fe640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5338066900 0x7f5338068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:02.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.952+0000 7f534b7fe640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5338066900 0x7f5338068dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f533c0af000 tx=0x7f533c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:02.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:02.956+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53400516a0 con 0x7f534c0c1ae0 2023-12-07T10:01:03.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.104+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f534c06eeb0 con 0x7f534c0c1ae0 2023-12-07T10:01:03.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.104+0000 7f5333fff640 1 -- 172.21.15.89:0/402792819 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5340054cc0 con 0x7f534c0c1ae0 2023-12-07T10:01:03.110 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5338066900 msgr2=0x7f5338068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5338066900 0x7f5338068dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f533c0af000 tx=0x7f533c0b6040 comp rx=0 tx=0).stop 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 msgr2=0x7f534c153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 0x7f534c153ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f534000b480 tx=0x7f534000b940 comp rx=0 tx=0).stop 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 shutdown_connections 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f534c151ee0 0x7f534c1f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f534c0c1ae0 0x7f534c153ec0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5338066900 0x7f5338068dc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 --2- 172.21.15.89:0/402792819 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f534c06aae0 0x7f534c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 >> 172.21.15.89:0/402792819 conn(0x7f534c0c3b70 msgr2=0x7f534c15e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 shutdown_connections 2023-12-07T10:01:03.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.108+0000 7f5351bb8640 1 -- 172.21.15.89:0/402792819 wait complete. 2023-12-07T10:01:03.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:01:03.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.264+0000 7f158c7f5640 1 Processor -- start 2023-12-07T10:01:03.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158c7f5640 1 -- start start 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158c7f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f158414eaf0 0x7f1584151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158c7f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 0x7f158406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158c7f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158406de00 con 0x7f1584151f90 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158c7f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1584070390 con 0x7f158414eaf0 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158c7f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158414eed0 con 0x7f15840c0370 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1584151f90 0x7f158406d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48108/0 (socket says 172.21.15.89:48108) 2023-12-07T10:01:03.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 -- 172.21.15.89:0/3895136586 learned_addr learned my addr 172.21.15.89:0/3895136586 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:03.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158ad92640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 0x7f158406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158a591640 1 --2- 172.21.15.89:0/3895136586 >> v2:172.21.15.97:3300/0 conn(0x7f158414eaf0 0x7f1584151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359952921 0 0) 0x7f158406de00 con 0x7f1584151f90 2023-12-07T10:01:03.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1570003530 con 0x7f1584151f90 2023-12-07T10:01:03.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637758857 0 0) 0x7f1570003530 con 0x7f1584151f90 2023-12-07T10:01:03.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 msgr2=0x7f158406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 0x7f158406d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 >> v2:172.21.15.97:3300/0 conn(0x7f158414eaf0 msgr2=0x7f1584151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 --2- 172.21.15.89:0/3895136586 >> v2:172.21.15.97:3300/0 conn(0x7f158414eaf0 0x7f1584151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584151270 con 0x7f1584151f90 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f1574001680 con 0x7f1584151f90 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 >> v1:172.21.15.89:6789/0 conn(0x7f1584151f90 legacy=0x7f158406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1570003980 0x7f1570003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15700047d0 0x7f1570004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 0x7f1570005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584070390 con 0x7f15700047d0 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158414eed0 con 0x7f1570003980 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157000ba10 con 0x7f15840c0370 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15700047d0 0x7f1570004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158a591640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1570003980 0x7f1570003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f158ad92640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 0x7f1570005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 -- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 msgr2=0x7f1570005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c0370 0x7f1570005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 -- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1570003980 msgr2=0x7f1570003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1570003980 0x7f1570003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.268+0000 7f1589d90640 1 -- 172.21.15.89:0/3895136586 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570003530 con 0x7f15700047d0 2023-12-07T10:01:03.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f1589d90640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15700047d0 0x7f1570004c50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f157400c240 tx=0x7f157401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350bae0a4f70683f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740a5910 con 0x7f15700047d0 2023-12-07T10:01:03.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15740a5a70 con 0x7f15700047d0 2023-12-07T10:01:03.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158958f640 1 -- 172.21.15.89:0/3895136586 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740a5e40 con 0x7f15700047d0 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158c7f5640 1 -- 172.21.15.89:0/3895136586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15700047d0 msgr2=0x7f1570004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158c7f5640 1 --2- 172.21.15.89:0/3895136586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15700047d0 0x7f1570004c50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f157400c240 tx=0x7f157401cc30 comp rx=0 tx=0).stop 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158ad92640 1 -- 172.21.15.89:0/3895136586 reap_dead start 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158c7f5640 1 -- 172.21.15.89:0/3895136586 shutdown_connections 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158c7f5640 1 -- 172.21.15.89:0/3895136586 >> 172.21.15.89:0/3895136586 conn(0x7f15840c2a60 msgr2=0x7f15840c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158c7f5640 1 -- 172.21.15.89:0/3895136586 shutdown_connections 2023-12-07T10:01:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.272+0000 7f158c7f5640 1 -- 172.21.15.89:0/3895136586 wait complete. 2023-12-07T10:01:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 Processor -- start 2023-12-07T10:01:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 -- start start 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15700047d0 0x7f1584146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c2500 0x7f158414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 0x7f15841f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158414a1e0 con 0x7f15841ed160 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584146140 con 0x7f15700047d0 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1584146420 con 0x7f15840c2500 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 0x7f15841f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 0x7f15841f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55418/0 (socket says 172.21.15.89:55418) 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 -- 172.21.15.89:0/2176150784 learned_addr learned my addr 172.21.15.89:0/2176150784 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:03.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 -- 172.21.15.89:0/2176150784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c2500 msgr2=0x7f158414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c2500 0x7f158414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 -- 172.21.15.89:0/2176150784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15700047d0 msgr2=0x7f1584146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15700047d0 0x7f1584146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 -- 172.21.15.89:0/2176150784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15841f07c0 con 0x7f15841ed160 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158ad92640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 0x7f15841f0ce0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f158406f520 tx=0x7f157c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00e040 con 0x7f15841ed160 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00f040 con 0x7f15841ed160 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158414dd60 con 0x7f15841ed160 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c003c00 con 0x7f15841ed160 2023-12-07T10:01:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.276+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1584149980 con 0x7f15841ed160 2023-12-07T10:01:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.280+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15841f09b0 con 0x7f15841ed160 2023-12-07T10:01:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.280+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f157c004030 con 0x7f15841ed160 2023-12-07T10:01:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.280+0000 7f157affd640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15680668d0 0x7f1568068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.280+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f157c084cc0 con 0x7f15841ed160 2023-12-07T10:01:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.280+0000 7f158a591640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15680668d0 0x7f1568068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.280+0000 7f158a591640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15680668d0 0x7f1568068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1580006b20 tx=0x7f1580006ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.284+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f157c08b080 con 0x7f15841ed160 2023-12-07T10:01:03.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.432+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f158404e890 con 0x7f15841ed160 2023-12-07T10:01:03.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f157affd640 1 -- 172.21.15.89:0/2176150784 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f157c051ef0 con 0x7f15841ed160 2023-12-07T10:01:03.440 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15680668d0 msgr2=0x7f1568068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15680668d0 0x7f1568068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1580006b20 tx=0x7f1580006ab0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 msgr2=0x7f15841f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 0x7f15841f0ce0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f158406f520 tx=0x7f157c00f580 comp rx=0 tx=0).stop 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 shutdown_connections 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15841ed160 0x7f15841f0ce0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15680668d0 0x7f1568068d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f15840c2500 0x7f158414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 --2- 172.21.15.89:0/2176150784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15700047d0 0x7f1584146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 >> 172.21.15.89:0/2176150784 conn(0x7f15840c2a60 msgr2=0x7f15840bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 shutdown_connections 2023-12-07T10:01:03.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.436+0000 7f158c7f5640 1 -- 172.21.15.89:0/2176150784 wait complete. 2023-12-07T10:01:03.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T10:01:03.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.592+0000 7fc1795e6640 1 Processor -- start 2023-12-07T10:01:03.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.592+0000 7fc1795e6640 1 -- start start 2023-12-07T10:01:03.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.592+0000 7fc1795e6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc17414fcc0 0x7fc174156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.592+0000 7fc1795e6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740ab580 con 0x7fc17406d980 2023-12-07T10:01:03.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.592+0000 7fc1795e6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc174152fe0 con 0x7fc1740c19e0 2023-12-07T10:01:03.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.592+0000 7fc1795e6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740aa340 con 0x7fc17414fcc0 2023-12-07T10:01:03.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc16bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc17406d980 0x7fc1740aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48116/0 (socket says 172.21.15.89:48116) 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc16bfff640 1 -- 172.21.15.89:0/3414619336 learned_addr learned my addr 172.21.15.89:0/3414619336 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc172ffd640 1 --2- 172.21.15.89:0/3414619336 >> v2:172.21.15.97:3300/0 conn(0x7fc17414fcc0 0x7fc174156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806811924 0 0) 0x7fc1740ab580 con 0x7fc17406d980 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc160003530 con 0x7fc17406d980 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095894137 0 0) 0x7fc174152fe0 con 0x7fc1740c19e0 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1740ab580 con 0x7fc1740c19e0 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc172ffd640 1 -- 172.21.15.89:0/3414619336 >> v1:172.21.15.97:6789/0 conn(0x7fc1740c19e0 legacy=0x7fc1740c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc172ffd640 1 -- 172.21.15.89:0/3414619336 >> v1:172.21.15.89:6789/0 conn(0x7fc17406d980 legacy=0x7fc1740aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc172ffd640 1 -- 172.21.15.89:0/3414619336 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1741532c0 con 0x7fc17414fcc0 2023-12-07T10:01:03.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc172ffd640 1 --2- 172.21.15.89:0/3414619336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc17414fcc0 0x7fc174156500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1640097c0 tx=0x7fc16401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a8416ea01e91cf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.596+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640ab650 con 0x7fc17414fcc0 2023-12-07T10:01:03.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640ab7b0 con 0x7fc17414fcc0 2023-12-07T10:01:03.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1727fc640 1 -- 172.21.15.89:0/3414619336 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640abb20 con 0x7fc17414fcc0 2023-12-07T10:01:03.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- 172.21.15.89:0/3414619336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc17414fcc0 msgr2=0x7fc174156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 --2- 172.21.15.89:0/3414619336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc17414fcc0 0x7fc174156500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1640097c0 tx=0x7fc16401c450 comp rx=0 tx=0).stop 2023-12-07T10:01:03.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- 172.21.15.89:0/3414619336 shutdown_connections 2023-12-07T10:01:03.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 --2- 172.21.15.89:0/3414619336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc17414fcc0 0x7fc174156500 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- 172.21.15.89:0/3414619336 >> 172.21.15.89:0/3414619336 conn(0x7fc1740c2ad0 msgr2=0x7fc1740c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:03.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- 172.21.15.89:0/3414619336 shutdown_connections 2023-12-07T10:01:03.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- 172.21.15.89:0/3414619336 wait complete. 2023-12-07T10:01:03.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 Processor -- start 2023-12-07T10:01:03.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- start start 2023-12-07T10:01:03.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc17406d980 0x7fc17414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1740c19e0 0x7fc1740710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 0x7fc1740bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1741f4440 con 0x7fc1740bd280 2023-12-07T10:01:03.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740bf410 con 0x7fc1740c19e0 2023-12-07T10:01:03.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1795e6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740bb190 con 0x7fc17406d980 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 0x7fc1740bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 0x7fc1740bbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55422/0 (socket says 172.21.15.89:55422) 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc1737fe640 1 -- 172.21.15.89:0/695412491 learned_addr learned my addr 172.21.15.89:0/695412491 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc16bfff640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1740c19e0 0x7fc1740710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.600+0000 7fc172ffd640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc17406d980 0x7fc17414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1737fe640 1 -- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc17406d980 msgr2=0x7fc17414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1737fe640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc17406d980 0x7fc17414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1737fe640 1 -- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1740c19e0 msgr2=0x7fc1740710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1737fe640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1740c19e0 0x7fc1740710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1737fe640 1 -- 172.21.15.89:0/695412491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009420 con 0x7fc1740bd280 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1737fe640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 0x7fc1740bbf50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c790 tx=0x7fc16c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00cea0 con 0x7fc1740bd280 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c003b80 con 0x7fc1740bd280 2023-12-07T10:01:03.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00a7f0 con 0x7fc1740bd280 2023-12-07T10:01:03.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740bb470 con 0x7fc1740bd280 2023-12-07T10:01:03.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740bba30 con 0x7fc1740bd280 2023-12-07T10:01:03.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17406dd60 con 0x7fc1740bd280 2023-12-07T10:01:03.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc16c00a950 con 0x7fc1740bd280 2023-12-07T10:01:03.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc16b7fe640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1540668d0 0x7fc154068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc16c0841e0 con 0x7fc1740bd280 2023-12-07T10:01:03.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.604+0000 7fc172ffd640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1540668d0 0x7fc154068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.608+0000 7fc172ffd640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1540668d0 0x7fc154068d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc1640af000 tx=0x7fc1640a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.608+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc17406dd60 con 0x7fc1740bd280 2023-12-07T10:01:03.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.760+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc17406dd60 con 0x7fc1740bd280 2023-12-07T10:01:03.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.760+0000 7fc16b7fe640 1 -- 172.21.15.89:0/695412491 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+207 (secure 0 0 0) 0x7fc17406dd60 con 0x7fc1740bd280 2023-12-07T10:01:03.767 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 8, 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "cephfs_metadata" 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 9, 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "cephfs_data" 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:03.768 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T10:01:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1540668d0 msgr2=0x7fc154068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1540668d0 0x7fc154068d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc1640af000 tx=0x7fc1640a7000 comp rx=0 tx=0).stop 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 msgr2=0x7fc1740bbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 0x7fc1740bbf50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c790 tx=0x7fc16c00cc50 comp rx=0 tx=0).stop 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 shutdown_connections 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1740bd280 0x7fc1740bbf50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1740c19e0 0x7fc1740710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc1540668d0 0x7fc154068d90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 --2- 172.21.15.89:0/695412491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc17406d980 0x7fc17414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 >> 172.21.15.89:0/695412491 conn(0x7fc1740c2ad0 msgr2=0x7fc17406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 shutdown_connections 2023-12-07T10:01:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.764+0000 7fc1795e6640 1 -- 172.21.15.89:0/695412491 wait complete. 2023-12-07T10:01:03.788 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-07T10:01:03.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-07T10:01:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.924+0000 7f77e35f5640 1 Processor -- start 2023-12-07T10:01:03.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.924+0000 7f77e35f5640 1 -- start start 2023-12-07T10:01:03.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e35f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f77dc0a9770 0x7f77dc06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e35f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77dc0c2070 0x7f77dc0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e35f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc1569f0 con 0x7f77dc155f00 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e35f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc0abb60 con 0x7f77dc0c2070 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e35f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc06c7a0 con 0x7f77dc0a9770 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77dc0c2070 0x7f77dc0c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77dc0c2070 0x7f77dc0c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55438/0 (socket says 172.21.15.89:55438) 2023-12-07T10:01:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 -- 172.21.15.89:0/1468035392 learned_addr learned my addr 172.21.15.89:0/1468035392 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:03.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e0b90640 1 --2- 172.21.15.89:0/1468035392 >> v2:172.21.15.97:3300/0 conn(0x7f77dc0a9770 0x7f77dc06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 -- 172.21.15.89:0/1468035392 >> v2:172.21.15.97:3300/0 conn(0x7f77dc0a9770 msgr2=0x7f77dc06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:03.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 --2- 172.21.15.89:0/1468035392 >> v2:172.21.15.97:3300/0 conn(0x7f77dc0a9770 0x7f77dc06cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 -- 172.21.15.89:0/1468035392 >> v1:172.21.15.97:6789/0 conn(0x7f77dc155f00 legacy=0x7f77dc1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:03.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e1b92640 1 -- 172.21.15.89:0/1468035392 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0abdb0 con 0x7f77dc0c2070 2023-12-07T10:01:03.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.928+0000 7f77e0b90640 1 --2- 172.21.15.89:0/1468035392 >> v2:172.21.15.97:3300/0 conn(0x7f77dc0a9770 0x7f77dc06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:03.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e1b92640 1 --2- 172.21.15.89:0/1468035392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc0c24e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009e50 tx=0x7f77d401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39dfb2a2333cd29 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77d3fff640 1 -- 172.21.15.89:0/1468035392 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40a55c0 con 0x7f77dc0c2070 2023-12-07T10:01:03.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77d3fff640 1 -- 172.21.15.89:0/1468035392 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40a5720 con 0x7f77dc0c2070 2023-12-07T10:01:03.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77d3fff640 1 -- 172.21.15.89:0/1468035392 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40a5ab0 con 0x7f77dc0c2070 2023-12-07T10:01:03.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 -- 172.21.15.89:0/1468035392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 msgr2=0x7f77dc0c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 --2- 172.21.15.89:0/1468035392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc0c24e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009e50 tx=0x7f77d401c900 comp rx=0 tx=0).stop 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 -- 172.21.15.89:0/1468035392 shutdown_connections 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 --2- 172.21.15.89:0/1468035392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc0c24e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 --2- 172.21.15.89:0/1468035392 >> v2:172.21.15.97:3300/0 conn(0x7f77dc0a9770 0x7f77dc06cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 -- 172.21.15.89:0/1468035392 >> 172.21.15.89:0/1468035392 conn(0x7f77dc06a5a0 msgr2=0x7f77dc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 -- 172.21.15.89:0/1468035392 shutdown_connections 2023-12-07T10:01:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 -- 172.21.15.89:0/1468035392 wait complete. 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 Processor -- start 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.932+0000 7f77e35f5640 1 -- start start 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77dc0a9770 0x7f77dc142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77dc155f00 0x7f77dc15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc141500 con 0x7f77dc0c2070 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc141da0 con 0x7f77dc0a9770 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc072090 con 0x7f77dc155f00 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc071a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55440/0 (socket says 172.21.15.89:55440) 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e1391640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77dc0a9770 0x7f77dc142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 -- 172.21.15.89:0/116422317 learned_addr learned my addr 172.21.15.89:0/116422317 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e1b92640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77dc155f00 0x7f77dc15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 -- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77dc155f00 msgr2=0x7f77dc15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77dc155f00 0x7f77dc15b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 -- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77dc0a9770 msgr2=0x7f77dc142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77dc0a9770 0x7f77dc142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 -- 172.21.15.89:0/116422317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4009b30 con 0x7f77dc0c2070 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e0b90640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc071a00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c820 tx=0x7f77cc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc007a30 con 0x7f77dc0c2070 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc007b90 con 0x7f77dc0c2070 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc141750 con 0x7f77dc0c2070 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00ce10 con 0x7f77dc0c2070 2023-12-07T10:01:03.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc147d40 con 0x7f77dc0c2070 2023-12-07T10:01:03.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc04e890 con 0x7f77dc0c2070 2023-12-07T10:01:03.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.936+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f77cc0113f0 con 0x7f77dc0c2070 2023-12-07T10:01:03.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.940+0000 7f77d1ffb640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77c00668d0 0x7f77c0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:03.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.940+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77cc084590 con 0x7f77dc0c2070 2023-12-07T10:01:03.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.940+0000 7f77e1391640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77c00668d0 0x7f77c0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:03.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.940+0000 7f77e1391640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77c00668d0 0x7f77c0068d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f77d8007fd0 tx=0x7f77d8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:03.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:03.944+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77cc0517e0 con 0x7f77dc0c2070 2023-12-07T10:01:04.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.092+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f77dc141ee0 con 0x7f77dc0c2070 2023-12-07T10:01:04.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77d1ffb640 1 -- 172.21.15.89:0/116422317 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v50) v1 ==== 140+0+0 (secure 0 0 0) 0x7f77cc054e00 con 0x7f77dc0c2070 2023-12-07T10:01:04.905 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_metadata' created 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77c00668d0 msgr2=0x7f77c0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77c00668d0 0x7f77c0068d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f77d8007fd0 tx=0x7f77d8007e40 comp rx=0 tx=0).stop 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 msgr2=0x7f77dc071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc071a00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c820 tx=0x7f77cc00cce0 comp rx=0 tx=0).stop 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 shutdown_connections 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77c00668d0 0x7f77c0068d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f77dc155f00 0x7f77dc15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77dc0c2070 0x7f77dc071a00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 --2- 172.21.15.89:0/116422317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77dc0a9770 0x7f77dc142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 >> 172.21.15.89:0/116422317 conn(0x7f77dc06a5a0 msgr2=0x7f77dc155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 shutdown_connections 2023-12-07T10:01:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:04.900+0000 7f77e35f5640 1 -- 172.21.15.89:0/116422317 wait complete. 2023-12-07T10:01:04.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T10:01:05.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.072+0000 7f53a525a640 1 Processor -- start 2023-12-07T10:01:05.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.072+0000 7f53a525a640 1 -- start start 2023-12-07T10:01:05.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f53a525a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a00a86d0 0x7f53a00a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:05.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f53a525a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a0152d90 con 0x7f53a014fd00 2023-12-07T10:01:05.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f53a525a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a0152480 con 0x7f53a0156600 2023-12-07T10:01:05.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f53a525a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00a9760 con 0x7f53a00a86d0 2023-12-07T10:01:05.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539f59e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f53a014fd00 0x7f53a00aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48124/0 (socket says 172.21.15.89:48124) 2023-12-07T10:01:05.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539f59e640 1 -- 172.21.15.89:0/3424605087 learned_addr learned my addr 172.21.15.89:0/3424605087 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:05.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539ed9d640 1 --2- 172.21.15.89:0/3424605087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a00a86d0 0x7f53a00a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:05.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053764942 0 0) 0x7f53a0152d90 con 0x7f53a014fd00 2023-12-07T10:01:05.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f538c003530 con 0x7f53a014fd00 2023-12-07T10:01:05.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53830664 0 0) 0x7f53a0152480 con 0x7f53a0156600 2023-12-07T10:01:05.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a0152d90 con 0x7f53a0156600 2023-12-07T10:01:05.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539ed9d640 1 -- 172.21.15.89:0/3424605087 >> v1:172.21.15.97:6789/0 conn(0x7f53a0156600 legacy=0x7f53a014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539ed9d640 1 -- 172.21.15.89:0/3424605087 >> v1:172.21.15.89:6789/0 conn(0x7f53a014fd00 legacy=0x7f53a00aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.076+0000 7f539ed9d640 1 -- 172.21.15.89:0/3424605087 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a0152740 con 0x7f53a00a86d0 2023-12-07T10:01:05.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f539ed9d640 1 --2- 172.21.15.89:0/3424605087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a00a86d0 0x7f53a00a8f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5390009dc0 tx=0x7f539001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8608dba1472e643 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:05.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5900 con 0x7f53a00a86d0 2023-12-07T10:01:05.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900a5a60 con 0x7f53a00a86d0 2023-12-07T10:01:05.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f539e59c640 1 -- 172.21.15.89:0/3424605087 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5df0 con 0x7f53a00a86d0 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 -- 172.21.15.89:0/3424605087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a00a86d0 msgr2=0x7f53a00a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 --2- 172.21.15.89:0/3424605087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a00a86d0 0x7f53a00a8f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5390009dc0 tx=0x7f539001c970 comp rx=0 tx=0).stop 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 -- 172.21.15.89:0/3424605087 shutdown_connections 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 --2- 172.21.15.89:0/3424605087 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a00a86d0 0x7f53a00a8f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 -- 172.21.15.89:0/3424605087 >> 172.21.15.89:0/3424605087 conn(0x7f53a00c2a60 msgr2=0x7f53a00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 -- 172.21.15.89:0/3424605087 shutdown_connections 2023-12-07T10:01:05.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 -- 172.21.15.89:0/3424605087 wait complete. 2023-12-07T10:01:05.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 Processor -- start 2023-12-07T10:01:05.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.080+0000 7f53a525a640 1 -- start start 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 0x7f53a0148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a014fd00 0x7f53a014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a0156600 0x7f53a014a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a01479d0 con 0x7f53a014fd00 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a014d5d0 con 0x7f53a00a86d0 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a0151280 con 0x7f53a0156600 2023-12-07T10:01:05.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a014fd00 0x7f53a014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:05.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 0x7f53a0148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:05.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 0x7f53a0148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:58840/0 (socket says 172.21.15.89:58840) 2023-12-07T10:01:05.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539f59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a0156600 0x7f53a014a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:05.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 -- 172.21.15.89:0/1234610449 learned_addr learned my addr 172.21.15.89:0/1234610449 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 -- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a0156600 msgr2=0x7f53a014a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a0156600 0x7f53a014a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 -- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a014fd00 msgr2=0x7f53a014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a014fd00 0x7f53a014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 -- 172.21.15.89:0/1234610449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390009a70 con 0x7f53a00a86d0 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539659c640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a014fd00 0x7f53a014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f539ed9d640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 0x7f53a0148c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5390019580 tx=0x7f5390019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:05.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5900 con 0x7f53a00a86d0 2023-12-07T10:01:05.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900ad850 con 0x7f53a00a86d0 2023-12-07T10:01:05.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a0150d80 con 0x7f53a00a86d0 2023-12-07T10:01:05.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900adc20 con 0x7f53a00a86d0 2023-12-07T10:01:05.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a01f1190 con 0x7f53a00a86d0 2023-12-07T10:01:05.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0150f10 con 0x7f53a00a86d0 2023-12-07T10:01:05.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.084+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53900b4050 con 0x7f53a00a86d0 2023-12-07T10:01:05.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.088+0000 7f5397fff640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53800668d0 0x7f5380068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:05.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.088+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f539011f410 con 0x7f53a00a86d0 2023-12-07T10:01:05.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.088+0000 7f539659c640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53800668d0 0x7f5380068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:05.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.088+0000 7f539659c640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53800668d0 0x7f5380068d90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f53a0150980 tx=0x7f5388009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:05.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.092+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53a0150f10 con 0x7f53a00a86d0 2023-12-07T10:01:05.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.240+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f53a0150f10 con 0x7f53a00a86d0 2023-12-07T10:01:05.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.908+0000 7f5397fff640 1 -- 172.21.15.89:0/1234610449 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v51) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53a0150f10 con 0x7f53a00a86d0 2023-12-07T10:01:05.923 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_data' created 2023-12-07T10:01:05.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.920+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53800668d0 msgr2=0x7f5380068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.920+0000 7f53a525a640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53800668d0 0x7f5380068d90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f53a0150980 tx=0x7f5388009040 comp rx=0 tx=0).stop 2023-12-07T10:01:05.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.920+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 msgr2=0x7f53a0148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:05.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.920+0000 7f53a525a640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 0x7f53a0148c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5390019580 tx=0x7f5390019710 comp rx=0 tx=0).stop 2023-12-07T10:01:05.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 shutdown_connections 2023-12-07T10:01:05.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53800668d0 0x7f5380068d90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53a0156600 0x7f53a014a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a014fd00 0x7f53a014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 --2- 172.21.15.89:0/1234610449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53a00a86d0 0x7f53a0148c10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:05.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 >> 172.21.15.89:0/1234610449 conn(0x7f53a00c2a60 msgr2=0x7f53a014f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:05.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 shutdown_connections 2023-12-07T10:01:05.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:05.924+0000 7f53a525a640 1 -- 172.21.15.89:0/1234610449 wait complete. 2023-12-07T10:01:05.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-07T10:01:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.096+0000 7f949f510640 1 Processor -- start 2023-12-07T10:01:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.096+0000 7f949f510640 1 -- start start 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.096+0000 7f949f510640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9498154ad0 0x7f9498154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949f510640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498151fc0 con 0x7f9498151be0 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949f510640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498154640 con 0x7f94980c7d60 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949f510640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980c6910 con 0x7f9498154ad0 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949e50e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9498151be0 0x7f9498158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48140/0 (socket says 172.21.15.89:48140) 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949e50e640 1 -- 172.21.15.89:0/1598510749 learned_addr learned my addr 172.21.15.89:0/1598510749 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949ed0f640 1 --2- 172.21.15.89:0/1598510749 >> v2:172.21.15.89:3300/0 conn(0x7f9498154ad0 0x7f9498154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949d50c640 1 -- 172.21.15.89:0/1598510749 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327828416 0 0) 0x7f9494001120 con 0x7f9498151be0 2023-12-07T10:01:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949d50c640 1 -- 172.21.15.89:0/1598510749 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9484003530 con 0x7f9498151be0 2023-12-07T10:01:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949ed0f640 1 -- 172.21.15.89:0/1598510749 >> v1:172.21.15.97:6789/0 conn(0x7f94980c7d60 legacy=0x7f94980c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949ed0f640 1 -- 172.21.15.89:0/1598510749 >> v1:172.21.15.89:6789/0 conn(0x7f9498151be0 legacy=0x7f9498158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949ed0f640 1 -- 172.21.15.89:0/1598510749 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980c77e0 con 0x7f9498154ad0 2023-12-07T10:01:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949ed0f640 1 --2- 172.21.15.89:0/1598510749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f9498154f80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9490009d90 tx=0x7f949001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7f9e94c10d87b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949d50c640 1 -- 172.21.15.89:0/1598510749 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900a5870 con 0x7f9498154ad0 2023-12-07T10:01:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949d50c640 1 -- 172.21.15.89:0/1598510749 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94900a59d0 con 0x7f9498154ad0 2023-12-07T10:01:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.100+0000 7f949d50c640 1 -- 172.21.15.89:0/1598510749 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900a5d60 con 0x7f9498154ad0 2023-12-07T10:01:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- 172.21.15.89:0/1598510749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 msgr2=0x7f9498154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 --2- 172.21.15.89:0/1598510749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f9498154f80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9490009d90 tx=0x7f949001c8c0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- 172.21.15.89:0/1598510749 shutdown_connections 2023-12-07T10:01:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 --2- 172.21.15.89:0/1598510749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f9498154f80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- 172.21.15.89:0/1598510749 >> 172.21.15.89:0/1598510749 conn(0x7f94980aba30 msgr2=0x7f94980abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:06.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- 172.21.15.89:0/1598510749 shutdown_connections 2023-12-07T10:01:06.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- 172.21.15.89:0/1598510749 wait complete. 2023-12-07T10:01:06.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 Processor -- start 2023-12-07T10:01:06.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- start start 2023-12-07T10:01:06.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94980c7d60 0x7f94980c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:06.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9498151be0 0x7f94981535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:06.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f94980c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:06.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94980c14f0 con 0x7f9498154ad0 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94980c3db0 con 0x7f9498151be0 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949f510640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94980c0f30 con 0x7f94980c7d60 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949ed0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f94980c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949ed0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f94980c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55488/0 (socket says 172.21.15.89:55488) 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949ed0f640 1 -- 172.21.15.89:0/2092326962 learned_addr learned my addr 172.21.15.89:0/2092326962 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949dd0d640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9498151be0 0x7f94981535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.104+0000 7f949e50e640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94980c7d60 0x7f94980c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949ed0f640 1 -- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94980c7d60 msgr2=0x7f94980c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949ed0f640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94980c7d60 0x7f94980c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949ed0f640 1 -- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9498151be0 msgr2=0x7f94981535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949ed0f640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9498151be0 0x7f94981535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949ed0f640 1 -- 172.21.15.89:0/2092326962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490009a70 con 0x7f9498154ad0 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949e50e640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94980c7d60 0x7f94980c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949ed0f640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f94980c1910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f949001a4f0 tx=0x7f9490019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900b9860 con 0x7f9498154ad0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94900b99c0 con 0x7f9498154ad0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498144e20 con 0x7f9498154ad0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900b9d30 con 0x7f9498154ad0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94980c0680 con 0x7f9498154ad0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94980c1630 con 0x7f9498154ad0 2023-12-07T10:01:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f94900ad440 con 0x7f9498154ad0 2023-12-07T10:01:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f948effd640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f947c066900 0x7f947c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f949011fae0 con 0x7f9498154ad0 2023-12-07T10:01:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.108+0000 7f949e50e640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f947c066900 0x7f947c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:06.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.112+0000 7f949e50e640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f947c066900 0x7f947c068dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9494001280 tx=0x7f9494009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:06.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.116+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94980c1630 con 0x7f9498154ad0 2023-12-07T10:01:06.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.296+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f94980c1630 con 0x7f9498154ad0 2023-12-07T10:01:06.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.932+0000 7f948effd640 1 -- 172.21.15.89:0/2092326962 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v34) v1 ==== 177+0+0 (secure 0 0 0) 0x7f94980c1630 con 0x7f9498154ad0 2023-12-07T10:01:06.940 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 10 and data pool 11 2023-12-07T10:01:06.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f947c066900 msgr2=0x7f947c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:06.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f947c066900 0x7f947c068dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9494001280 tx=0x7f9494009040 comp rx=0 tx=0).stop 2023-12-07T10:01:06.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 msgr2=0x7f94980c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:06.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f94980c1910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f949001a4f0 tx=0x7f9490019660 comp rx=0 tx=0).stop 2023-12-07T10:01:06.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 shutdown_connections 2023-12-07T10:01:06.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9498154ad0 0x7f94980c1910 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9498151be0 0x7f94981535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f947c066900 0x7f947c068dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 --2- 172.21.15.89:0/2092326962 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f94980c7d60 0x7f94980c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:06.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.940+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 >> 172.21.15.89:0/2092326962 conn(0x7f94980aba30 msgr2=0x7f94980c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:06.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.944+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 shutdown_connections 2023-12-07T10:01:06.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:06.944+0000 7f949f510640 1 -- 172.21.15.89:0/2092326962 wait complete. 2023-12-07T10:01:06.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:07.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.116+0000 7f7c26ff8640 1 Processor -- start 2023-12-07T10:01:07.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.116+0000 7f7c26ff8640 1 -- start start 2023-12-07T10:01:07.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c26ff8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c2014e9d0 0x7f7c20151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c26ff8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2006d320 con 0x7f7c200a8470 2023-12-07T10:01:07.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c26ff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200721b0 con 0x7f7c20070b80 2023-12-07T10:01:07.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c26ff8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200c2830 con 0x7f7c2014e9d0 2023-12-07T10:01:07.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c25595640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7c200a8470 0x7f7c2006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48146/0 (socket says 172.21.15.89:48146) 2023-12-07T10:01:07.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c25595640 1 -- 172.21.15.89:0/611491252 learned_addr learned my addr 172.21.15.89:0/611491252 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c24d94640 1 --2- 172.21.15.89:0/611491252 >> v2:172.21.15.97:3300/0 conn(0x7f7c2014e9d0 0x7f7c20151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307670611 0 0) 0x7f7c2006d320 con 0x7f7c200a8470 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003530 con 0x7f7c200a8470 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180359043 0 0) 0x7f7c200721b0 con 0x7f7c20070b80 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c2006d320 con 0x7f7c20070b80 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c24d94640 1 -- 172.21.15.89:0/611491252 >> v1:172.21.15.97:6789/0 conn(0x7f7c20070b80 legacy=0x7f7c200c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59434889 0 0) 0x7f7c08003530 con 0x7f7c200a8470 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c24d94640 1 -- 172.21.15.89:0/611491252 >> v1:172.21.15.89:6789/0 conn(0x7f7c200a8470 legacy=0x7f7c2006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.120+0000 7f7c24d94640 1 -- 172.21.15.89:0/611491252 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20072450 con 0x7f7c2014e9d0 2023-12-07T10:01:07.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c24d94640 1 --2- 172.21.15.89:0/611491252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20151e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097c0 tx=0x7f7c1c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05edf6587c045f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18001a00 con 0x7f7c2014e9d0 2023-12-07T10:01:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0a7050 con 0x7f7c2014e9d0 2023-12-07T10:01:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c177fe640 1 -- 172.21.15.89:0/611491252 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0ab620 con 0x7f7c2014e9d0 2023-12-07T10:01:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 -- 172.21.15.89:0/611491252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 msgr2=0x7f7c20151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/611491252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20151e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097c0 tx=0x7f7c1c01c310 comp rx=0 tx=0).stop 2023-12-07T10:01:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 -- 172.21.15.89:0/611491252 shutdown_connections 2023-12-07T10:01:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/611491252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20151e60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 -- 172.21.15.89:0/611491252 >> 172.21.15.89:0/611491252 conn(0x7f7c200c2ad0 msgr2=0x7f7c200c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 -- 172.21.15.89:0/611491252 shutdown_connections 2023-12-07T10:01:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 -- 172.21.15.89:0/611491252 wait complete. 2023-12-07T10:01:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 Processor -- start 2023-12-07T10:01:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.124+0000 7f7c26ff8640 1 -- start start 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c20070b80 0x7f7c20146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 0x7f7c201ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201473f0 con 0x7f7c200a8470 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20150780 con 0x7f7c2014e9d0 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20147640 con 0x7f7c20070b80 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 0x7f7c201ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 0x7f7c201ecc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55494/0 (socket says 172.21.15.89:55494) 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 -- 172.21.15.89:0/4194620387 learned_addr learned my addr 172.21.15.89:0/4194620387 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c24d94640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c20070b80 0x7f7c20146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c25595640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 -- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c20070b80 msgr2=0x7f7c20146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c20070b80 0x7f7c20146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 -- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 msgr2=0x7f7c20150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 -- 172.21.15.89:0/4194620387 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009420 con 0x7f7c200a8470 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c17fff640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 0x7f7c201ecc50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c500 tx=0x7f7c1000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c100052d0 con 0x7f7c200a8470 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c10005430 con 0x7f7c200a8470 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20147920 con 0x7f7c200a8470 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10003820 con 0x7f7c200a8470 2023-12-07T10:01:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c20151150 con 0x7f7c200a8470 2023-12-07T10:01:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.128+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20067a40 con 0x7f7c200a8470 2023-12-07T10:01:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.132+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c10003980 con 0x7f7c200a8470 2023-12-07T10:01:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.132+0000 7f7c157fa640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c0c0668d0 0x7f7c0c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.132+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7c10083d80 con 0x7f7c200a8470 2023-12-07T10:01:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.132+0000 7f7c24d94640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c0c0668d0 0x7f7c0c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.132+0000 7f7c24d94640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c0c0668d0 0x7f7c0c068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ad000 tx=0x7f7c1c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.136+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c10050c80 con 0x7f7c200a8470 2023-12-07T10:01:07.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.288+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c20147b60 con 0x7f7c200a8470 2023-12-07T10:01:07.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.288+0000 7f7c157fa640 1 -- 172.21.15.89:0/4194620387 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+20233 (secure 0 0 0) 0x7f7c100542a0 con 0x7f7c200a8470 2023-12-07T10:01:07.294 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:07.294 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":52,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:06.298957+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.288+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c0c0668d0 msgr2=0x7f7c0c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.288+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c0c0668d0 0x7f7c0c068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ad000 tx=0x7f7c1c0a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 msgr2=0x7f7c201ecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 0x7f7c201ecc50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c500 tx=0x7f7c1000c9c0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 shutdown_connections 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c2014e9d0 0x7f7c20150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c200a8470 0x7f7c201ecc50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c0c0668d0 0x7f7c0c068d90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 --2- 172.21.15.89:0/4194620387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c20070b80 0x7f7c20146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 >> 172.21.15.89:0/4194620387 conn(0x7f7c200c2ad0 msgr2=0x7f7c200c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 shutdown_connections 2023-12-07T10:01:07.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.292+0000 7f7c26ff8640 1 -- 172.21.15.89:0/4194620387 wait complete. 2023-12-07T10:01:07.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:07.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 Processor -- start 2023-12-07T10:01:07.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 -- start start 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8b4014e7b0 0x7f8b4006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b40070cd0 0x7f8b40154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b40155670 con 0x7f8b40070cd0 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b401553d0 con 0x7f8b4014e7b0 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b44878640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4006cab0 con 0x7f8b400c0e30 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b3f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b40070cd0 0x7f8b40154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b3f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b40070cd0 0x7f8b40154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55510/0 (socket says 172.21.15.89:55510) 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.448+0000 7f8b3f59e640 1 -- 172.21.15.89:0/1035815098 learned_addr learned my addr 172.21.15.89:0/1035815098 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3ed9d640 1 --2- 172.21.15.89:0/1035815098 >> v2:172.21.15.97:3300/0 conn(0x7f8b4014e7b0 0x7f8b4006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3e59c640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3f59e640 1 -- 172.21.15.89:0/1035815098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 msgr2=0x7f8b40070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3f59e640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3f59e640 1 -- 172.21.15.89:0/1035815098 >> v2:172.21.15.97:3300/0 conn(0x7f8b4014e7b0 msgr2=0x7f8b4006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3f59e640 1 --2- 172.21.15.89:0/1035815098 >> v2:172.21.15.97:3300/0 conn(0x7f8b4014e7b0 0x7f8b4006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3f59e640 1 -- 172.21.15.89:0/1035815098 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4006cd90 con 0x7f8b40070cd0 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3ed9d640 1 --2- 172.21.15.89:0/1035815098 >> v2:172.21.15.97:3300/0 conn(0x7f8b4014e7b0 0x7f8b4006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:07.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3e59c640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:07.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3f59e640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40154890 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009e50 tx=0x7f8b3801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edca3d9139fac4f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3dd9b640 1 -- 172.21.15.89:0/1035815098 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380a56a0 con 0x7f8b40070cd0 2023-12-07T10:01:07.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3dd9b640 1 -- 172.21.15.89:0/1035815098 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b380a5800 con 0x7f8b40070cd0 2023-12-07T10:01:07.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b3dd9b640 1 -- 172.21.15.89:0/1035815098 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380a5b90 con 0x7f8b40070cd0 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b44878640 1 -- 172.21.15.89:0/1035815098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 msgr2=0x7f8b40154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b44878640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40154890 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009e50 tx=0x7f8b3801c910 comp rx=0 tx=0).stop 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b44878640 1 -- 172.21.15.89:0/1035815098 shutdown_connections 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.452+0000 7f8b44878640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40154890 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 --2- 172.21.15.89:0/1035815098 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 --2- 172.21.15.89:0/1035815098 >> v2:172.21.15.97:3300/0 conn(0x7f8b4014e7b0 0x7f8b4006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- 172.21.15.89:0/1035815098 >> 172.21.15.89:0/1035815098 conn(0x7f8b400c5fd0 msgr2=0x7f8b400c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- 172.21.15.89:0/1035815098 shutdown_connections 2023-12-07T10:01:07.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- 172.21.15.89:0/1035815098 wait complete. 2023-12-07T10:01:07.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 Processor -- start 2023-12-07T10:01:07.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- start start 2023-12-07T10:01:07.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4014e7b0 0x7f8b401406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401ecf50 con 0x7f8b40070cd0 2023-12-07T10:01:07.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401edee0 con 0x7f8b4014e7b0 2023-12-07T10:01:07.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b44878640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401eda50 con 0x7f8b400c0e30 2023-12-07T10:01:07.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55512/0 (socket says 172.21.15.89:55512) 2023-12-07T10:01:07.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 -- 172.21.15.89:0/2893861516 learned_addr learned my addr 172.21.15.89:0/2893861516 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:07.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3e59c640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3f59e640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4014e7b0 0x7f8b401406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 -- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 msgr2=0x7f8b40149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 -- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4014e7b0 msgr2=0x7f8b401406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4014e7b0 0x7f8b401406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.456+0000 7f8b3ed9d640 1 -- 172.21.15.89:0/2893861516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009b30 con 0x7f8b40070cd0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b3ed9d640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40150cf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000c820 tx=0x7f8b3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30007a30 con 0x7f8b40070cd0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30007b90 con 0x7f8b40070cd0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b401ed140 con 0x7f8b40070cd0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000ce10 con 0x7f8b40070cd0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b401ed6e0 con 0x7f8b40070cd0 2023-12-07T10:01:07.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4004e890 con 0x7f8b40070cd0 2023-12-07T10:01:07.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8b300113f0 con 0x7f8b40070cd0 2023-12-07T10:01:07.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b277fe640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8b30084720 con 0x7f8b40070cd0 2023-12-07T10:01:07.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.460+0000 7f8b3e59c640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.464+0000 7f8b3e59c640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b40154800 tx=0x7f8b34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.464+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b300516b0 con 0x7f8b40070cd0 2023-12-07T10:01:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.616+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b4006daf0 con 0x7f8b40070cd0 2023-12-07T10:01:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b277fe640 1 -- 172.21.15.89:0/2893861516 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+20233 (secure 0 0 0) 0x7f8b30054cd0 con 0x7f8b40070cd0 2023-12-07T10:01:07.624 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":52,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:06.298957+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 msgr2=0x7f8b2c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b40154800 tx=0x7f8b34008040 comp rx=0 tx=0).stop 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 msgr2=0x7f8b40150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40150cf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000c820 tx=0x7f8b3000cce0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 shutdown_connections 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b4014e7b0 0x7f8b401406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8b2c066900 0x7f8b2c068dc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8b400c0e30 0x7f8b40149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 --2- 172.21.15.89:0/2893861516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b40070cd0 0x7f8b40150cf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 >> 172.21.15.89:0/2893861516 conn(0x7f8b400c5fd0 msgr2=0x7f8b400c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 shutdown_connections 2023-12-07T10:01:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.620+0000 7f8b44878640 1 -- 172.21.15.89:0/2893861516 wait complete. 2023-12-07T10:01:07.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-07T10:01:07.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 Processor -- start 2023-12-07T10:01:07.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 -- start start 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3f014eaf0 0x7fd3f0151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f0151f90 0x7fd3f006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f006de00 con 0x7fd3f00c0370 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f0070390 con 0x7fd3f014eaf0 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.780+0000 7fd3f5780640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f014eed0 con 0x7fd3f0151f90 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3ef7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd3f00c0370 0x7fd3f006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:54562/0 (socket says 172.21.15.89:54562) 2023-12-07T10:01:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3eeffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3f014eaf0 0x7fd3f0151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3ef7fe640 1 -- 172.21.15.89:0/3641643926 learned_addr learned my addr 172.21.15.89:0/3641643926 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3ee7fc640 1 --2- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f0151f90 0x7fd3f006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3eeffd640 1 -- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f0151f90 msgr2=0x7fd3f006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3eeffd640 1 --2- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f0151f90 0x7fd3f006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3eeffd640 1 -- 172.21.15.89:0/3641643926 >> v1:172.21.15.97:6789/0 conn(0x7fd3f00c0370 legacy=0x7fd3f006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3eeffd640 1 -- 172.21.15.89:0/3641643926 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0151270 con 0x7fd3f014eaf0 2023-12-07T10:01:07.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.784+0000 7fd3eeffd640 1 --2- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f0151a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00097c0 tx=0x7fd3e001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4be719eeb313dee5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3edffb640 1 -- 172.21.15.89:0/3641643926 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00ab600 con 0x7fd3f014eaf0 2023-12-07T10:01:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3edffb640 1 -- 172.21.15.89:0/3641643926 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e00a7050 con 0x7fd3f014eaf0 2023-12-07T10:01:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3edffb640 1 -- 172.21.15.89:0/3641643926 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00ab980 con 0x7fd3f014eaf0 2023-12-07T10:01:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 msgr2=0x7fd3f0151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f0151a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00097c0 tx=0x7fd3e001c330 comp rx=0 tx=0).stop 2023-12-07T10:01:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- 172.21.15.89:0/3641643926 shutdown_connections 2023-12-07T10:01:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f0151f90 0x7fd3f006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3641643926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f0151a50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- 172.21.15.89:0/3641643926 >> 172.21.15.89:0/3641643926 conn(0x7fd3f00c2a60 msgr2=0x7fd3f00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- 172.21.15.89:0/3641643926 shutdown_connections 2023-12-07T10:01:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- 172.21.15.89:0/3641643926 wait complete. 2023-12-07T10:01:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 Processor -- start 2023-12-07T10:01:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- start start 2023-12-07T10:01:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f00c0370 0x7fd3f01ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f00c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 0x7fd3f01463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01ec910 con 0x7fd3f01485b0 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0144760 con 0x7fd3f014eaf0 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3f5780640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0145d30 con 0x7fd3f00c0370 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3ef7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 0x7fd3f01463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3ef7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 0x7fd3f01463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55528/0 (socket says 172.21.15.89:55528) 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3ef7fe640 1 -- 172.21.15.89:0/3775275771 learned_addr learned my addr 172.21.15.89:0/3775275771 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3ee7fc640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f00c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.788+0000 7fd3eeffd640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f00c0370 0x7fd3f01ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3ef7fe640 1 -- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f00c0370 msgr2=0x7fd3f01ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3ef7fe640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f00c0370 0x7fd3f01ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3ef7fe640 1 -- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 msgr2=0x7fd3f00c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3ef7fe640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f00c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3ef7fe640 1 -- 172.21.15.89:0/3775275771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009420 con 0x7fd3f01485b0 2023-12-07T10:01:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3ef7fe640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 0x7fd3f01463c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800cbc0 tx=0x7fd3e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800ace0 con 0x7fd3f01485b0 2023-12-07T10:01:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800ae40 con 0x7fd3f01485b0 2023-12-07T10:01:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8012600 con 0x7fd3f01485b0 2023-12-07T10:01:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f01449b0 con 0x7fd3f01485b0 2023-12-07T10:01:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f01ec5a0 con 0x7fd3f01485b0 2023-12-07T10:01:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f0144cf0 con 0x7fd3f01485b0 2023-12-07T10:01:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd3e8007070 con 0x7fd3f01485b0 2023-12-07T10:01:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3d77fe640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3dc0668d0 0x7fd3dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd3e8084650 con 0x7fd3f01485b0 2023-12-07T10:01:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.792+0000 7fd3eeffd640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3dc0668d0 0x7fd3dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.796+0000 7fd3eeffd640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3dc0668d0 0x7fd3dc068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00ad000 tx=0x7fd3e00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.796+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3e8051540 con 0x7fd3f01485b0 2023-12-07T10:01:07.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:07.988+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd3f004e890 con 0x7fd3f01485b0 2023-12-07T10:01:08.814 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-12-07T10:01:08.808+0000 7f0d0b652640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:01:08.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3d77fe640 1 -- 172.21.15.89:0/3775275771 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7fd3e8054b60 con 0x7fd3f01485b0 2023-12-07T10:01:08.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3dc0668d0 msgr2=0x7fd3dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3dc0668d0 0x7fd3dc068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00ad000 tx=0x7fd3e00a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 msgr2=0x7fd3f01463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 0x7fd3f01463c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800cbc0 tx=0x7fd3e800a430 comp rx=0 tx=0).stop 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 shutdown_connections 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f01485b0 0x7fd3f01463c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3f014eaf0 0x7fd3f00c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd3dc0668d0 0x7fd3dc068d90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 --2- 172.21.15.89:0/3775275771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3f00c0370 0x7fd3f01ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.956+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 >> 172.21.15.89:0/3775275771 conn(0x7fd3f00c2a60 msgr2=0x7fd3f014ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.960+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 shutdown_connections 2023-12-07T10:01:08.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:08.960+0000 7fd3f5780640 1 -- 172.21.15.89:0/3775275771 wait complete. 2023-12-07T10:01:08.983 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T10:01:08.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-07T10:01:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 Processor -- start 2023-12-07T10:01:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 -- start start 2023-12-07T10:01:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be00a86d0 0x7f2be00a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2be0156600 0x7f2be014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2be014fb30 0x7f2be00aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be0152d90 con 0x7f2be0156600 2023-12-07T10:01:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be0152480 con 0x7f2be014fb30 2023-12-07T10:01:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2be5157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00a9760 con 0x7f2be00a86d0 2023-12-07T10:01:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2be0156600 0x7f2be014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2be0156600 0x7f2be014f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55540/0 (socket says 172.21.15.89:55540) 2023-12-07T10:01:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 -- 172.21.15.89:0/3791707278 learned_addr learned my addr 172.21.15.89:0/3791707278 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bdf59e640 1 --2- 172.21.15.89:0/3791707278 >> v2:172.21.15.97:3300/0 conn(0x7f2be014fb30 0x7f2be00aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bded9d640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be00a86d0 0x7f2be00a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 -- 172.21.15.89:0/3791707278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be00a86d0 msgr2=0x7f2be00a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be00a86d0 0x7f2be00a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 -- 172.21.15.89:0/3791707278 >> v2:172.21.15.97:3300/0 conn(0x7f2be014fb30 msgr2=0x7f2be00aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 --2- 172.21.15.89:0/3791707278 >> v2:172.21.15.97:3300/0 conn(0x7f2be014fb30 0x7f2be00aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bd7fff640 1 -- 172.21.15.89:0/3791707278 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0152740 con 0x7f2be0156600 2023-12-07T10:01:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.120+0000 7f2bded9d640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be00a86d0 0x7f2be00a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2bd7fff640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be014f5f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2be0074300 tx=0x7f2bc801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f31d8b68664fb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2bde59c640 1 -- 172.21.15.89:0/3791707278 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80ab600 con 0x7f2be0156600 2023-12-07T10:01:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2bde59c640 1 -- 172.21.15.89:0/3791707278 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc80a7050 con 0x7f2be0156600 2023-12-07T10:01:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2bde59c640 1 -- 172.21.15.89:0/3791707278 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80ab980 con 0x7f2be0156600 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 -- 172.21.15.89:0/3791707278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 msgr2=0x7f2be014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be014f5f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2be0074300 tx=0x7f2bc801c500 comp rx=0 tx=0).stop 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 -- 172.21.15.89:0/3791707278 shutdown_connections 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 --2- 172.21.15.89:0/3791707278 >> v2:172.21.15.97:3300/0 conn(0x7f2be014fb30 0x7f2be00aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be014f5f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 --2- 172.21.15.89:0/3791707278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be00a86d0 0x7f2be00a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 -- 172.21.15.89:0/3791707278 >> 172.21.15.89:0/3791707278 conn(0x7f2be00c2a60 msgr2=0x7f2be00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 -- 172.21.15.89:0/3791707278 shutdown_connections 2023-12-07T10:01:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.124+0000 7f2be5157640 1 -- 172.21.15.89:0/3791707278 wait complete. 2023-12-07T10:01:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 Processor -- start 2023-12-07T10:01:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- start start 2023-12-07T10:01:09.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be00a86d0 0x7f2be0144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be014fb30 0x7f2be0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be006c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0144b30 con 0x7f2be0156600 2023-12-07T10:01:09.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be006cdc0 con 0x7f2be00a86d0 2023-12-07T10:01:09.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be006d0a0 con 0x7f2be014fb30 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be006c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55550/0 (socket says 172.21.15.89:55550) 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 -- 172.21.15.89:0/3092421852 learned_addr learned my addr 172.21.15.89:0/3092421852 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bd7fff640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be014fb30 0x7f2be0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bded9d640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be00a86d0 0x7f2be0144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 -- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be014fb30 msgr2=0x7f2be0151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be014fb30 0x7f2be0151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 -- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be00a86d0 msgr2=0x7f2be0144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be00a86d0 0x7f2be0144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 -- 172.21.15.89:0/3092421852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80094d0 con 0x7f2be0156600 2023-12-07T10:01:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bdf59e640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be006c110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007e40 tx=0x7f2bd800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8014620 con 0x7f2be0156600 2023-12-07T10:01:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800ee90 con 0x7f2be0156600 2023-12-07T10:01:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80149e0 con 0x7f2be0156600 2023-12-07T10:01:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be006d380 con 0x7f2be0156600 2023-12-07T10:01:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be006c650 con 0x7f2be0156600 2023-12-07T10:01:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.128+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be004e890 con 0x7f2be0156600 2023-12-07T10:01:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.132+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2bd8014b40 con 0x7f2be0156600 2023-12-07T10:01:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.132+0000 7f2bd77fe640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc00668d0 0x7f2bc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.132+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2bd8084f10 con 0x7f2be0156600 2023-12-07T10:01:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.132+0000 7f2bded9d640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc00668d0 0x7f2bc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.132+0000 7f2bded9d640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc00668d0 0x7f2bc0068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0006fd0 tx=0x7f2bd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:09.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.136+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bd8051f30 con 0x7f2be0156600 2023-12-07T10:01:09.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.320+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2be015cb00 con 0x7f2be0156600 2023-12-07T10:01:09.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.956+0000 7f2bd77fe640 1 -- 172.21.15.89:0/3092421852 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2bd8055550 con 0x7f2be0156600 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc00668d0 msgr2=0x7f2bc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc00668d0 0x7f2bc0068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0006fd0 tx=0x7f2bd0008040 comp rx=0 tx=0).stop 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 msgr2=0x7f2be006c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be006c110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007e40 tx=0x7f2bd800e4b0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 shutdown_connections 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2be0156600 0x7f2be006c110 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc00668d0 0x7f2bc0068d90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2be014fb30 0x7f2be0151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 --2- 172.21.15.89:0/3092421852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2be00a86d0 0x7f2be0144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:09.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 >> 172.21.15.89:0/3092421852 conn(0x7f2be00c2a60 msgr2=0x7f2be00c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:09.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 shutdown_connections 2023-12-07T10:01:09.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:09.960+0000 7f2be5157640 1 -- 172.21.15.89:0/3092421852 wait complete. 2023-12-07T10:01:09.987 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-07T10:01:09.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 Processor -- start 2023-12-07T10:01:10.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 -- start start 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56780ca610 0x7f56780c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780bd720 0x7f56780c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f567806cd90 0x7f5678158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5678155790 con 0x7f56780ca610 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780c4b00 con 0x7f567806cd90 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f568031d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780c4de0 con 0x7f56780bd720 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56780ca610 0x7f56780c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56780ca610 0x7f56780c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41546/0 (socket says 172.21.15.89:41546) 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 -- 172.21.15.89:0/1195432604 learned_addr learned my addr 172.21.15.89:0/1195432604 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e8ba640 1 --2- 172.21.15.89:0/1195432604 >> v2:172.21.15.97:3300/0 conn(0x7f567806cd90 0x7f5678158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567d8b8640 1 --2- 172.21.15.89:0/1195432604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780bd720 0x7f56780c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 -- 172.21.15.89:0/1195432604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780bd720 msgr2=0x7f56780c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 --2- 172.21.15.89:0/1195432604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780bd720 0x7f56780c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 -- 172.21.15.89:0/1195432604 >> v2:172.21.15.97:3300/0 conn(0x7f567806cd90 msgr2=0x7f5678158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 --2- 172.21.15.89:0/1195432604 >> v2:172.21.15.97:3300/0 conn(0x7f567806cd90 0x7f5678158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.120+0000 7f567e0b9640 1 -- 172.21.15.89:0/1195432604 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5678157e30 con 0x7f56780ca610 2023-12-07T10:01:10.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f567e0b9640 1 --2- 172.21.15.89:0/1195432604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56780ca610 0x7f56780c94c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5678152370 tx=0x7f567401c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39277e48bb0a9a07 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f567d0b7640 1 -- 172.21.15.89:0/1195432604 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56780c52d0 con 0x7f56780ca610 2023-12-07T10:01:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f567d0b7640 1 -- 172.21.15.89:0/1195432604 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740a4880 con 0x7f56780ca610 2023-12-07T10:01:10.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f567d0b7640 1 -- 172.21.15.89:0/1195432604 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a4c10 con 0x7f56780ca610 2023-12-07T10:01:10.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 -- 172.21.15.89:0/1195432604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56780ca610 msgr2=0x7f56780c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 --2- 172.21.15.89:0/1195432604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56780ca610 0x7f56780c94c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5678152370 tx=0x7f567401c0c0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 -- 172.21.15.89:0/1195432604 shutdown_connections 2023-12-07T10:01:10.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 --2- 172.21.15.89:0/1195432604 >> v2:172.21.15.97:3300/0 conn(0x7f567806cd90 0x7f5678158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 --2- 172.21.15.89:0/1195432604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780bd720 0x7f56780c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 --2- 172.21.15.89:0/1195432604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56780ca610 0x7f56780c94c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 -- 172.21.15.89:0/1195432604 >> 172.21.15.89:0/1195432604 conn(0x7f5678071ea0 msgr2=0x7f56780722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:10.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 -- 172.21.15.89:0/1195432604 shutdown_connections 2023-12-07T10:01:10.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.124+0000 7f568031d640 1 -- 172.21.15.89:0/1195432604 wait complete. 2023-12-07T10:01:10.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 Processor -- start 2023-12-07T10:01:10.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 -- start start 2023-12-07T10:01:10.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 0x7f56781538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56780bd720 0x7f56780ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780ca610 0x7f56780a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780ab6f0 con 0x7f567806cd90 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780c3e10 con 0x7f56780bd720 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780c40f0 con 0x7f56780ca610 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 0x7f56781538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 0x7f56781538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41560/0 (socket says 172.21.15.89:41560) 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 -- 172.21.15.89:0/1326808394 learned_addr learned my addr 172.21.15.89:0/1326808394 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567d8b8640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56780bd720 0x7f56780ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e8ba640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780ca610 0x7f56780a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 -- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780ca610 msgr2=0x7f56780a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780ca610 0x7f56780a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 -- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56780bd720 msgr2=0x7f56780ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56780bd720 0x7f56780ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 -- 172.21.15.89:0/1326808394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740094d0 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f567e0b9640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 0x7f56781538c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f56740af040 tx=0x7f5674019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740ac700 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740ac880 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740acc30 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56780ab310 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.128+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56780c43d0 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.132+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567804e890 con 0x7f567806cd90 2023-12-07T10:01:10.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.132+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f56740b3070 con 0x7f567806cd90 2023-12-07T10:01:10.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.132+0000 7f566effd640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f565c0668d0 0x7f565c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.132+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f56780cac00 con 0x7f567806cd90 2023-12-07T10:01:10.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.132+0000 7f567d8b8640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f565c0668d0 0x7f565c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.132+0000 7f567d8b8640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f565c0668d0 0x7f565c068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56780c5b90 tx=0x7f5668008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.136+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56740eb2d0 con 0x7f567806cd90 2023-12-07T10:01:10.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.316+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f567806cb70 con 0x7f567806cd90 2023-12-07T10:01:10.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.316+0000 7f566effd640 1 -- 172.21.15.89:0/1326808394 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f56740ee8f0 con 0x7f567806cd90 2023-12-07T10:01:10.322 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:10.322 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:10.322 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 37 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f565c0668d0 msgr2=0x7f565c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f565c0668d0 0x7f565c068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56780c5b90 tx=0x7f5668008040 comp rx=0 tx=0).stop 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 msgr2=0x7f56781538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 0x7f56781538c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f56740af040 tx=0x7f5674019180 comp rx=0 tx=0).stop 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 shutdown_connections 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f565c0668d0 0x7f565c068d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56780ca610 0x7f56780a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56780bd720 0x7f56780ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 --2- 172.21.15.89:0/1326808394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f567806cd90 0x7f56781538c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 >> 172.21.15.89:0/1326808394 conn(0x7f5678071ea0 msgr2=0x7f56780ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:10.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 shutdown_connections 2023-12-07T10:01:10.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.320+0000 7f568031d640 1 -- 172.21.15.89:0/1326808394 wait complete. 2023-12-07T10:01:10.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:10.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.476+0000 7f406ff01640 1 Processor -- start 2023-12-07T10:01:10.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.476+0000 7f406ff01640 1 -- start start 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406ff01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4068155360 0x7f406806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406ff01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f406806baf0 0x7f406806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406ff01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406806e280 con 0x7f406806ed00 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406ff01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40680c2150 con 0x7f406806baf0 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406ff01640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4068157c60 con 0x7f4068155360 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f406806baf0 0x7f406806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f406806baf0 0x7f406806e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41574/0 (socket says 172.21.15.89:41574) 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 -- 172.21.15.89:0/3004851514 learned_addr learned my addr 172.21.15.89:0/3004851514 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:10.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406dc9d640 1 --2- 172.21.15.89:0/3004851514 >> v2:172.21.15.97:3300/0 conn(0x7f4068155360 0x7f406806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 -- 172.21.15.89:0/3004851514 >> v2:172.21.15.97:3300/0 conn(0x7f4068155360 msgr2=0x7f406806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:10.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 --2- 172.21.15.89:0/3004851514 >> v2:172.21.15.97:3300/0 conn(0x7f4068155360 0x7f406806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 -- 172.21.15.89:0/3004851514 >> v1:172.21.15.97:6789/0 conn(0x7f406806ed00 legacy=0x7f40681580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.480+0000 7f406d49c640 1 -- 172.21.15.89:0/3004851514 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680c1bd0 con 0x7f406806baf0 2023-12-07T10:01:10.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406d49c640 1 --2- 172.21.15.89:0/3004851514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f406806baf0 0x7f406806e7c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f40680c0c10 tx=0x7f405801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a7fa656db1af46 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406cc9b640 1 -- 172.21.15.89:0/3004851514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580ab600 con 0x7f406806baf0 2023-12-07T10:01:10.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406cc9b640 1 -- 172.21.15.89:0/3004851514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580a7050 con 0x7f406806baf0 2023-12-07T10:01:10.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406cc9b640 1 -- 172.21.15.89:0/3004851514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580ab980 con 0x7f406806baf0 2023-12-07T10:01:10.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 -- 172.21.15.89:0/3004851514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f406806baf0 msgr2=0x7f406806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 --2- 172.21.15.89:0/3004851514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f406806baf0 0x7f406806e7c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f40680c0c10 tx=0x7f405801c500 comp rx=0 tx=0).stop 2023-12-07T10:01:10.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 -- 172.21.15.89:0/3004851514 shutdown_connections 2023-12-07T10:01:10.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 --2- 172.21.15.89:0/3004851514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f406806baf0 0x7f406806e7c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 --2- 172.21.15.89:0/3004851514 >> v2:172.21.15.97:3300/0 conn(0x7f4068155360 0x7f406806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 -- 172.21.15.89:0/3004851514 >> 172.21.15.89:0/3004851514 conn(0x7f40680c3240 msgr2=0x7f40680c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 -- 172.21.15.89:0/3004851514 shutdown_connections 2023-12-07T10:01:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 -- 172.21.15.89:0/3004851514 wait complete. 2023-12-07T10:01:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 Processor -- start 2023-12-07T10:01:10.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.484+0000 7f406ff01640 1 -- start start 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f406806baf0 0x7f4068146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f406806ed00 0x7f406814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 0x7f40681f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40681ed790 con 0x7f4068155360 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406814cd00 con 0x7f406806ed00 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406814f380 con 0x7f406806baf0 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 0x7f40681f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 0x7f40681f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41588/0 (socket says 172.21.15.89:41588) 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 -- 172.21.15.89:0/2924404812 learned_addr learned my addr 172.21.15.89:0/2924404812 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406d49c640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f406806ed00 0x7f406814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406dc9d640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f406806baf0 0x7f4068146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 -- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f406806baf0 msgr2=0x7f4068146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f406806baf0 0x7f4068146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 -- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f406806ed00 msgr2=0x7f406814c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f406806ed00 0x7f406814c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 -- 172.21.15.89:0/2924404812 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580094d0 con 0x7f4068155360 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406e49e640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 0x7f40681f0120 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f406000c7a0 tx=0x7f406000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060003b80 con 0x7f4068155360 2023-12-07T10:01:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060003ce0 con 0x7f4068155360 2023-12-07T10:01:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406000aa30 con 0x7f4068155360 2023-12-07T10:01:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40681ecb30 con 0x7f4068155360 2023-12-07T10:01:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40681ed0d0 con 0x7f4068155360 2023-12-07T10:01:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40681ed8d0 con 0x7f4068155360 2023-12-07T10:01:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.488+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f406000ab90 con 0x7f4068155360 2023-12-07T10:01:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.492+0000 7f405e7fc640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f404c0668d0 0x7f404c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.492+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f40600844c0 con 0x7f4068155360 2023-12-07T10:01:10.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.492+0000 7f406dc9d640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f404c0668d0 0x7f404c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.492+0000 7f406dc9d640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f404c0668d0 0x7f404c068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4064009ac0 tx=0x7f4064009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.492+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40681ed8d0 con 0x7f4068155360 2023-12-07T10:01:10.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.644+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40681ed8d0 con 0x7f4068155360 2023-12-07T10:01:10.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f405e7fc640 1 -- 172.21.15.89:0/2924404812 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7f40681ed8d0 con 0x7f4068155360 2023-12-07T10:01:10.652 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:10.652 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f404c0668d0 msgr2=0x7f404c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f404c0668d0 0x7f404c068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4064009ac0 tx=0x7f4064009190 comp rx=0 tx=0).stop 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 msgr2=0x7f40681f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 0x7f40681f0120 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f406000c7a0 tx=0x7f406000cc60 comp rx=0 tx=0).stop 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 shutdown_connections 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4068155360 0x7f40681f0120 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f406806ed00 0x7f406814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f404c0668d0 0x7f404c068d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 --2- 172.21.15.89:0/2924404812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f406806baf0 0x7f4068146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 >> 172.21.15.89:0/2924404812 conn(0x7f40680c3240 msgr2=0x7f40680c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:10.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 shutdown_connections 2023-12-07T10:01:10.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.648+0000 7f406ff01640 1 -- 172.21.15.89:0/2924404812 wait complete. 2023-12-07T10:01:10.673 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T10:01:10.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:10.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.804+0000 7f0ae0e5f640 1 Processor -- start 2023-12-07T10:01:10.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.804+0000 7f0ae0e5f640 1 -- start start 2023-12-07T10:01:10.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ae0e5f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0adc0700a0 0x7f0adc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ae0e5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc072780 con 0x7f0adc0aacd0 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ae0e5f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0ac160 con 0x7f0adc154870 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ae0e5f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0abe80 con 0x7f0adc0700a0 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ada59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0adc0aacd0 0x7f0adc154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42104/0 (socket says 172.21.15.89:42104) 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ada59c640 1 -- 172.21.15.89:0/169742230 learned_addr learned my addr 172.21.15.89:0/169742230 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0adad9d640 1 --2- 172.21.15.89:0/169742230 >> v2:172.21.15.97:3300/0 conn(0x7f0adc0700a0 0x7f0adc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305989593 0 0) 0x7f0adc072780 con 0x7f0adc0aacd0 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac4003530 con 0x7f0adc0aacd0 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623884012 0 0) 0x7f0adc0ac160 con 0x7f0adc154870 2023-12-07T10:01:10.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0adc072780 con 0x7f0adc154870 2023-12-07T10:01:10.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0adad9d640 1 -- 172.21.15.89:0/169742230 >> v1:172.21.15.97:6789/0 conn(0x7f0adc154870 legacy=0x7f0adc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0adad9d640 1 -- 172.21.15.89:0/169742230 >> v1:172.21.15.89:6789/0 conn(0x7f0adc0aacd0 legacy=0x7f0adc154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.808+0000 7f0adad9d640 1 -- 172.21.15.89:0/169742230 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc154cf0 con 0x7f0adc0700a0 2023-12-07T10:01:10.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0adad9d640 1 --2- 172.21.15.89:0/169742230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc06d060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009c80 tx=0x7f0ad401c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f6a10045afdada server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40a5940 con 0x7f0adc0700a0 2023-12-07T10:01:10.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40a5aa0 con 0x7f0adc0700a0 2023-12-07T10:01:10.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ad959a640 1 -- 172.21.15.89:0/169742230 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40a5e30 con 0x7f0adc0700a0 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/169742230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 msgr2=0x7f0adc06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/169742230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc06d060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009c80 tx=0x7f0ad401c880 comp rx=0 tx=0).stop 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/169742230 shutdown_connections 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/169742230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc06d060 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/169742230 >> 172.21.15.89:0/169742230 conn(0x7f0adc0c2ad0 msgr2=0x7f0adc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/169742230 shutdown_connections 2023-12-07T10:01:10.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/169742230 wait complete. 2023-12-07T10:01:10.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 Processor -- start 2023-12-07T10:01:10.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.812+0000 7f0ae0e5f640 1 -- start start 2023-12-07T10:01:10.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 0x7f0adc1ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0adc154870 0x7f0adc145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc146fb0 con 0x7f0adc0aacd0 2023-12-07T10:01:10.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1ed450 con 0x7f0adc0700a0 2023-12-07T10:01:10.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1488d0 con 0x7f0adc154870 2023-12-07T10:01:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 0x7f0adc1ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 0x7f0adc1ecf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41604/0 (socket says 172.21.15.89:41604) 2023-12-07T10:01:10.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 -- 172.21.15.89:0/331519725 learned_addr learned my addr 172.21.15.89:0/331519725 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0adad9d640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0adc154870 0x7f0adc145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ada59c640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 -- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0adc154870 msgr2=0x7f0adc145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0adc154870 0x7f0adc145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 -- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 msgr2=0x7f0adc1481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc1481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 -- 172.21.15.89:0/331519725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad400d040 con 0x7f0adc0aacd0 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ada59c640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:10.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ad9d9b640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 0x7f0adc1ecf10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c490 tx=0x7f0ad000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00052d0 con 0x7f0adc0aacd0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0005430 con 0x7f0adc0aacd0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0012870 con 0x7f0adc0aacd0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc148bb0 con 0x7f0adc0aacd0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc1ec9f0 con 0x7f0adc0aacd0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc1ec570 con 0x7f0adc0aacd0 2023-12-07T10:01:10.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.816+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ad00129d0 con 0x7f0adc0aacd0 2023-12-07T10:01:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.820+0000 7f0acaffd640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0abc066900 0x7f0abc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.820+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ad00843d0 con 0x7f0adc0aacd0 2023-12-07T10:01:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.820+0000 7f0ada59c640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0abc066900 0x7f0abc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:10.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.820+0000 7f0ada59c640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0abc066900 0x7f0abc068dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0011f0 tx=0x7f0acc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:10.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.824+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0adc1ec570 con 0x7f0adc0aacd0 2023-12-07T10:01:10.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:10.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:10.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.972+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0adc1ec570 con 0x7f0abc066900 2023-12-07T10:01:10.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.988+0000 7f0acaffd640 1 -- 172.21.15.89:0/331519725 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+515523 (secure 0 0 0) 0x7f0adc1ec570 con 0x7f0abc066900 2023-12-07T10:01:10.998 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:11.002 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0abc066900 msgr2=0x7f0abc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0abc066900 0x7f0abc068dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0011f0 tx=0x7f0acc009040 comp rx=0 tx=0).stop 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 msgr2=0x7f0adc1ecf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 0x7f0adc1ecf10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c490 tx=0x7f0ad000c950 comp rx=0 tx=0).stop 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 shutdown_connections 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0abc066900 0x7f0abc068dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0adc154870 0x7f0adc145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0adc0aacd0 0x7f0adc1ecf10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 --2- 172.21.15.89:0/331519725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0700a0 0x7f0adc1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 >> 172.21.15.89:0/331519725 conn(0x7f0adc0c2ad0 msgr2=0x7f0adc0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 shutdown_connections 2023-12-07T10:01:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:10.992+0000 7f0ae0e5f640 1 -- 172.21.15.89:0/331519725 wait complete. 2023-12-07T10:01:11.016 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-12-07T10:01:10.364662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226196,"kb_used_data":5824,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748524,"statfs":{"total":773094113280,"available":772862488576,"internally_reserved":0,"allocated":5963776,"data_stored":3174032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460979"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374674+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:00:55.374674+0000","last_peered":"2023-12-07T10:00:55.374674+0000","last_clean":"2023-12-07T10:00:55.374674+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:00:55.374674+0000","last_undegraded":"2023-12-07T10:00:55.374674+0000","last_fullsized":"2023-12-07T10:00:55.374674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377313+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:00:55.377313+0000","last_peered":"2023-12-07T10:00:55.377313+0000","last_clean":"2023-12-07T10:00:55.377313+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:00:55.377313+0000","last_undegraded":"2023-12-07T10:00:55.377313+0000","last_fullsized":"2023-12-07T10:00:55.377313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374913+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:00:55.374913+0000","last_peered":"2023-12-07T10:00:55.374913+0000","last_clean":"2023-12-07T10:00:55.374913+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:00:55.374913+0000","last_undegraded":"2023-12-07T10:00:55.374913+0000","last_fullsized":"2023-12-07T10:00:55.374913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377273+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:00:55.377273+0000","last_peered":"2023-12-07T10:00:55.377273+0000","last_clean":"2023-12-07T10:00:55.377273+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:00:55.377273+0000","last_undegraded":"2023-12-07T10:00:55.377273+0000","last_fullsized":"2023-12-07T10:00:55.377273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374624+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:00:55.374624+0000","last_peered":"2023-12-07T10:00:55.374624+0000","last_clean":"2023-12-07T10:00:55.374624+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:00:55.374624+0000","last_undegraded":"2023-12-07T10:00:55.374624+0000","last_fullsized":"2023-12-07T10:00:55.374624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380545+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:00:55.380545+0000","last_peered":"2023-12-07T10:00:55.380545+0000","last_clean":"2023-12-07T10:00:55.380545+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:00:55.380545+0000","last_undegraded":"2023-12-07T10:00:55.380545+0000","last_fullsized":"2023-12-07T10:00:55.380545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374856+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:00:55.374856+0000","last_peered":"2023-12-07T10:00:55.374856+0000","last_clean":"2023-12-07T10:00:55.374856+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:00:55.374856+0000","last_undegraded":"2023-12-07T10:00:55.374856+0000","last_fullsized":"2023-12-07T10:00:55.374856+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377081+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:00:55.377081+0000","last_peered":"2023-12-07T10:00:55.377081+0000","last_clean":"2023-12-07T10:00:55.377081+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:00:55.377081+0000","last_undegraded":"2023-12-07T10:00:55.377081+0000","last_fullsized":"2023-12-07T10:00:55.377081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375003+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:00:55.375003+0000","last_peered":"2023-12-07T10:00:55.375003+0000","last_clean":"2023-12-07T10:00:55.375003+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:00:55.375003+0000","last_undegraded":"2023-12-07T10:00:55.375003+0000","last_fullsized":"2023-12-07T10:00:55.375003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381048+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:00:55.381048+0000","last_peered":"2023-12-07T10:00:55.381048+0000","last_clean":"2023-12-07T10:00:55.381048+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:00:55.381048+0000","last_undegraded":"2023-12-07T10:00:55.381048+0000","last_fullsized":"2023-12-07T10:00:55.381048+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381040+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:00:55.381040+0000","last_peered":"2023-12-07T10:00:55.381040+0000","last_clean":"2023-12-07T10:00:55.381040+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:00:55.381040+0000","last_undegraded":"2023-12-07T10:00:55.381040+0000","last_fullsized":"2023-12-07T10:00:55.381040+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377283+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:00:55.377283+0000","last_peered":"2023-12-07T10:00:55.377283+0000","last_clean":"2023-12-07T10:00:55.377283+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:00:55.377283+0000","last_undegraded":"2023-12-07T10:00:55.377283+0000","last_fullsized":"2023-12-07T10:00:55.377283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374647+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:00:55.374647+0000","last_peered":"2023-12-07T10:00:55.374647+0000","last_clean":"2023-12-07T10:00:55.374647+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:00:55.374647+0000","last_undegraded":"2023-12-07T10:00:55.374647+0000","last_fullsized":"2023-12-07T10:00:55.374647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374895+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:00:55.374895+0000","last_peered":"2023-12-07T10:00:55.374895+0000","last_clean":"2023-12-07T10:00:55.374895+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:00:55.374895+0000","last_undegraded":"2023-12-07T10:00:55.374895+0000","last_fullsized":"2023-12-07T10:00:55.374895+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374877+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:00:55.374877+0000","last_peered":"2023-12-07T10:00:55.374877+0000","last_clean":"2023-12-07T10:00:55.374877+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:00:55.374877+0000","last_undegraded":"2023-12-07T10:00:55.374877+0000","last_fullsized":"2023-12-07T10:00:55.374877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380512+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:00:55.380512+0000","last_peered":"2023-12-07T10:00:55.380512+0000","last_clean":"2023-12-07T10:00:55.380512+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:00:55.380512+0000","last_undegraded":"2023-12-07T10:00:55.380512+0000","last_fullsized":"2023-12-07T10:00:55.380512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377344+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:00:55.377344+0000","last_peered":"2023-12-07T10:00:55.377344+0000","last_clean":"2023-12-07T10:00:55.377344+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:00:55.377344+0000","last_undegraded":"2023-12-07T10:00:55.377344+0000","last_fullsized":"2023-12-07T10:00:55.377344+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374997+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:00:55.374997+0000","last_peered":"2023-12-07T10:00:55.374997+0000","last_clean":"2023-12-07T10:00:55.374997+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:00:55.374997+0000","last_undegraded":"2023-12-07T10:00:55.374997+0000","last_fullsized":"2023-12-07T10:00:55.374997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374658+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:00:55.374658+0000","last_peered":"2023-12-07T10:00:55.374658+0000","last_clean":"2023-12-07T10:00:55.374658+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:00:55.374658+0000","last_undegraded":"2023-12-07T10:00:55.374658+0000","last_fullsized":"2023-12-07T10:00:55.374658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377274+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:55.377274+0000","last_peered":"2023-12-07T10:00:55.377274+0000","last_clean":"2023-12-07T10:00:55.377274+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:00:55.377274+0000","last_undegraded":"2023-12-07T10:00:55.377274+0000","last_fullsized":"2023-12-07T10:00:55.377274+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374856+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:00:55.374856+0000","last_peered":"2023-12-07T10:00:55.374856+0000","last_clean":"2023-12-07T10:00:55.374856+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:00:55.374856+0000","last_undegraded":"2023-12-07T10:00:55.374856+0000","last_fullsized":"2023-12-07T10:00:55.374856+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377152+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:00:55.377152+0000","last_peered":"2023-12-07T10:00:55.377152+0000","last_clean":"2023-12-07T10:00:55.377152+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:00:55.377152+0000","last_undegraded":"2023-12-07T10:00:55.377152+0000","last_fullsized":"2023-12-07T10:00:55.377152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374789+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:00:55.374789+0000","last_peered":"2023-12-07T10:00:55.374789+0000","last_clean":"2023-12-07T10:00:55.374789+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:00:55.374789+0000","last_undegraded":"2023-12-07T10:00:55.374789+0000","last_fullsized":"2023-12-07T10:00:55.374789+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374602+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:00:55.374602+0000","last_peered":"2023-12-07T10:00:55.374602+0000","last_clean":"2023-12-07T10:00:55.374602+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:00:55.374602+0000","last_undegraded":"2023-12-07T10:00:55.374602+0000","last_fullsized":"2023-12-07T10:00:55.374602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374683+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:00:55.374683+0000","last_peered":"2023-12-07T10:00:55.374683+0000","last_clean":"2023-12-07T10:00:55.374683+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:00:55.374683+0000","last_undegraded":"2023-12-07T10:00:55.374683+0000","last_fullsized":"2023-12-07T10:00:55.374683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377324+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:00:55.377324+0000","last_peered":"2023-12-07T10:00:55.377324+0000","last_clean":"2023-12-07T10:00:55.377324+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:00:55.377324+0000","last_undegraded":"2023-12-07T10:00:55.377324+0000","last_fullsized":"2023-12-07T10:00:55.377324+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380627+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:00:55.380627+0000","last_peered":"2023-12-07T10:00:55.380627+0000","last_clean":"2023-12-07T10:00:55.380627+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:00:55.380627+0000","last_undegraded":"2023-12-07T10:00:55.380627+0000","last_fullsized":"2023-12-07T10:00:55.380627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374641+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:00:55.374641+0000","last_peered":"2023-12-07T10:00:55.374641+0000","last_clean":"2023-12-07T10:00:55.374641+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:00:55.374641+0000","last_undegraded":"2023-12-07T10:00:55.374641+0000","last_fullsized":"2023-12-07T10:00:55.374641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377241+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:00:55.377241+0000","last_peered":"2023-12-07T10:00:55.377241+0000","last_clean":"2023-12-07T10:00:55.377241+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:00:55.377241+0000","last_undegraded":"2023-12-07T10:00:55.377241+0000","last_fullsized":"2023-12-07T10:00:55.377241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374837+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:00:55.374837+0000","last_peered":"2023-12-07T10:00:55.374837+0000","last_clean":"2023-12-07T10:00:55.374837+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:00:55.374837+0000","last_undegraded":"2023-12-07T10:00:55.374837+0000","last_fullsized":"2023-12-07T10:00:55.374837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374599+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:00:55.374599+0000","last_peered":"2023-12-07T10:00:55.374599+0000","last_clean":"2023-12-07T10:00:55.374599+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:00:55.374599+0000","last_undegraded":"2023-12-07T10:00:55.374599+0000","last_fullsized":"2023-12-07T10:00:55.374599+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380527+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:00:55.380527+0000","last_peered":"2023-12-07T10:00:55.380527+0000","last_clean":"2023-12-07T10:00:55.380527+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:00:55.380527+0000","last_undegraded":"2023-12-07T10:00:55.380527+0000","last_fullsized":"2023-12-07T10:00:55.380527+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907098+0000","last_change":"2023-12-07T10:01:04.907098+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907098+0000","last_undegraded":"2023-12-07T10:01:04.907098+0000","last_fullsized":"2023-12-07T10:01:04.907098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380664+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:00:55.380664+0000","last_peered":"2023-12-07T10:00:55.380664+0000","last_clean":"2023-12-07T10:00:55.380664+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:00:55.380664+0000","last_undegraded":"2023-12-07T10:00:55.380664+0000","last_fullsized":"2023-12-07T10:00:55.380664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380690+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:00:55.380690+0000","last_peered":"2023-12-07T10:00:55.380690+0000","last_clean":"2023-12-07T10:00:55.380690+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:00:55.380690+0000","last_undegraded":"2023-12-07T10:00:55.380690+0000","last_fullsized":"2023-12-07T10:00:55.380690+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912983+0000","last_change":"2023-12-07T10:01:04.912983+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912983+0000","last_undegraded":"2023-12-07T10:01:04.912983+0000","last_fullsized":"2023-12-07T10:01:04.912983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381057+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:00:55.381057+0000","last_peered":"2023-12-07T10:00:55.381057+0000","last_clean":"2023-12-07T10:00:55.381057+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:00:55.381057+0000","last_undegraded":"2023-12-07T10:00:55.381057+0000","last_fullsized":"2023-12-07T10:00:55.381057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377324+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:00:55.377324+0000","last_peered":"2023-12-07T10:00:55.377324+0000","last_clean":"2023-12-07T10:00:55.377324+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:00:55.377324+0000","last_undegraded":"2023-12-07T10:00:55.377324+0000","last_fullsized":"2023-12-07T10:00:55.377324+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906747+0000","last_change":"2023-12-07T10:01:04.906747+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906747+0000","last_undegraded":"2023-12-07T10:01:04.906747+0000","last_fullsized":"2023-12-07T10:01:04.906747+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380599+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:00:55.380599+0000","last_peered":"2023-12-07T10:00:55.380599+0000","last_clean":"2023-12-07T10:00:55.380599+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:00:55.380599+0000","last_undegraded":"2023-12-07T10:00:55.380599+0000","last_fullsized":"2023-12-07T10:00:55.380599+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380654+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:00:55.380654+0000","last_peered":"2023-12-07T10:00:55.380654+0000","last_clean":"2023-12-07T10:00:55.380654+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:00:55.380654+0000","last_undegraded":"2023-12-07T10:00:55.380654+0000","last_fullsized":"2023-12-07T10:00:55.380654+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.917938+0000","last_change":"2023-12-07T10:01:04.917938+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.917938+0000","last_undegraded":"2023-12-07T10:01:04.917938+0000","last_fullsized":"2023-12-07T10:01:04.917938+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380638+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:00:55.380638+0000","last_peered":"2023-12-07T10:00:55.380638+0000","last_clean":"2023-12-07T10:00:55.380638+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:00:55.380638+0000","last_undegraded":"2023-12-07T10:00:55.380638+0000","last_fullsized":"2023-12-07T10:00:55.380638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377293+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:00:55.377293+0000","last_peered":"2023-12-07T10:00:55.377293+0000","last_clean":"2023-12-07T10:00:55.377293+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:00:55.377293+0000","last_undegraded":"2023-12-07T10:00:55.377293+0000","last_fullsized":"2023-12-07T10:00:55.377293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.908994+0000","last_change":"2023-12-07T10:01:04.908994+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.908994+0000","last_undegraded":"2023-12-07T10:01:04.908994+0000","last_fullsized":"2023-12-07T10:01:04.908994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377170+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:00:55.377170+0000","last_peered":"2023-12-07T10:00:55.377170+0000","last_clean":"2023-12-07T10:00:55.377170+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:00:55.377170+0000","last_undegraded":"2023-12-07T10:00:55.377170+0000","last_fullsized":"2023-12-07T10:00:55.377170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374938+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:00:55.374938+0000","last_peered":"2023-12-07T10:00:55.374938+0000","last_clean":"2023-12-07T10:00:55.374938+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:00:55.374938+0000","last_undegraded":"2023-12-07T10:00:55.374938+0000","last_fullsized":"2023-12-07T10:00:55.374938+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912170+0000","last_change":"2023-12-07T10:01:04.912170+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912170+0000","last_undegraded":"2023-12-07T10:01:04.912170+0000","last_fullsized":"2023-12-07T10:01:04.912170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377204+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:55.377204+0000","last_peered":"2023-12-07T10:00:55.377204+0000","last_clean":"2023-12-07T10:00:55.377204+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:00:55.377204+0000","last_undegraded":"2023-12-07T10:00:55.377204+0000","last_fullsized":"2023-12-07T10:00:55.377204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380559+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:00:55.380559+0000","last_peered":"2023-12-07T10:00:55.380559+0000","last_clean":"2023-12-07T10:00:55.380559+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:00:55.380559+0000","last_undegraded":"2023-12-07T10:00:55.380559+0000","last_fullsized":"2023-12-07T10:00:55.380559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909871+0000","last_change":"2023-12-07T10:01:04.909871+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909871+0000","last_undegraded":"2023-12-07T10:01:04.909871+0000","last_fullsized":"2023-12-07T10:01:04.909871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374617+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:00:55.374617+0000","last_peered":"2023-12-07T10:00:55.374617+0000","last_clean":"2023-12-07T10:00:55.374617+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:00:55.374617+0000","last_undegraded":"2023-12-07T10:00:55.374617+0000","last_fullsized":"2023-12-07T10:00:55.374617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377229+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:00:55.377229+0000","last_peered":"2023-12-07T10:00:55.377229+0000","last_clean":"2023-12-07T10:00:55.377229+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:00:55.377229+0000","last_undegraded":"2023-12-07T10:00:55.377229+0000","last_fullsized":"2023-12-07T10:00:55.377229+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912603+0000","last_change":"2023-12-07T10:01:04.912603+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912603+0000","last_undegraded":"2023-12-07T10:01:04.912603+0000","last_fullsized":"2023-12-07T10:01:04.912603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377127+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:00:55.377127+0000","last_peered":"2023-12-07T10:00:55.377127+0000","last_clean":"2023-12-07T10:00:55.377127+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:00:55.377127+0000","last_undegraded":"2023-12-07T10:00:55.377127+0000","last_fullsized":"2023-12-07T10:00:55.377127+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374835+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:00:55.374835+0000","last_peered":"2023-12-07T10:00:55.374835+0000","last_clean":"2023-12-07T10:00:55.374835+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:00:55.374835+0000","last_undegraded":"2023-12-07T10:00:55.374835+0000","last_fullsized":"2023-12-07T10:00:55.374835+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.910314+0000","last_change":"2023-12-07T10:01:04.910314+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.910314+0000","last_undegraded":"2023-12-07T10:01:04.910314+0000","last_fullsized":"2023-12-07T10:01:04.910314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374982+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:00:55.374982+0000","last_peered":"2023-12-07T10:00:55.374982+0000","last_clean":"2023-12-07T10:00:55.374982+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:00:55.374982+0000","last_undegraded":"2023-12-07T10:00:55.374982+0000","last_fullsized":"2023-12-07T10:00:55.374982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375062+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:00:55.375062+0000","last_peered":"2023-12-07T10:00:55.375062+0000","last_clean":"2023-12-07T10:00:55.375062+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:00:55.375062+0000","last_undegraded":"2023-12-07T10:00:55.375062+0000","last_fullsized":"2023-12-07T10:00:55.375062+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909012+0000","last_change":"2023-12-07T10:01:04.909012+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909012+0000","last_undegraded":"2023-12-07T10:01:04.909012+0000","last_fullsized":"2023-12-07T10:01:04.909012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375041+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:00:55.375041+0000","last_peered":"2023-12-07T10:00:55.375041+0000","last_clean":"2023-12-07T10:00:55.375041+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:00:55.375041+0000","last_undegraded":"2023-12-07T10:00:55.375041+0000","last_fullsized":"2023-12-07T10:00:55.375041+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377333+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:00:55.377333+0000","last_peered":"2023-12-07T10:00:55.377333+0000","last_clean":"2023-12-07T10:00:55.377333+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:00:55.377333+0000","last_undegraded":"2023-12-07T10:00:55.377333+0000","last_fullsized":"2023-12-07T10:00:55.377333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907569+0000","last_change":"2023-12-07T10:01:04.907569+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907569+0000","last_undegraded":"2023-12-07T10:01:04.907569+0000","last_fullsized":"2023-12-07T10:01:04.907569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381021+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:00:55.381021+0000","last_peered":"2023-12-07T10:00:55.381021+0000","last_clean":"2023-12-07T10:00:55.381021+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:00:55.381021+0000","last_undegraded":"2023-12-07T10:00:55.381021+0000","last_fullsized":"2023-12-07T10:00:55.381021+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374975+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:00:55.374975+0000","last_peered":"2023-12-07T10:00:55.374975+0000","last_clean":"2023-12-07T10:00:55.374975+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:00:55.374975+0000","last_undegraded":"2023-12-07T10:00:55.374975+0000","last_fullsized":"2023-12-07T10:00:55.374975+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913689+0000","last_change":"2023-12-07T10:01:04.913689+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913689+0000","last_undegraded":"2023-12-07T10:01:04.913689+0000","last_fullsized":"2023-12-07T10:01:04.913689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374933+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:00:55.374933+0000","last_peered":"2023-12-07T10:00:55.374933+0000","last_clean":"2023-12-07T10:00:55.374933+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:00:55.374933+0000","last_undegraded":"2023-12-07T10:00:55.374933+0000","last_fullsized":"2023-12-07T10:00:55.374933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:01:01.631697+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:01:01.631697+0000","last_peered":"2023-12-07T10:01:01.631697+0000","last_clean":"2023-12-07T10:01:01.631697+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:01:01.631697+0000","last_undegraded":"2023-12-07T10:01:01.631697+0000","last_fullsized":"2023-12-07T10:01:01.631697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913550+0000","last_change":"2023-12-07T10:01:04.913550+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913550+0000","last_undegraded":"2023-12-07T10:01:04.913550+0000","last_fullsized":"2023-12-07T10:01:04.913550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377249+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:00:55.377249+0000","last_peered":"2023-12-07T10:00:55.377249+0000","last_clean":"2023-12-07T10:00:55.377249+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:00:55.377249+0000","last_undegraded":"2023-12-07T10:00:55.377249+0000","last_fullsized":"2023-12-07T10:00:55.377249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377222+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:00:55.377222+0000","last_peered":"2023-12-07T10:00:55.377222+0000","last_clean":"2023-12-07T10:00:55.377222+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:00:55.377222+0000","last_undegraded":"2023-12-07T10:00:55.377222+0000","last_fullsized":"2023-12-07T10:00:55.377222+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906496+0000","last_change":"2023-12-07T10:01:04.906496+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906496+0000","last_undegraded":"2023-12-07T10:01:04.906496+0000","last_fullsized":"2023-12-07T10:01:04.906496+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374873+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:00:55.374873+0000","last_peered":"2023-12-07T10:00:55.374873+0000","last_clean":"2023-12-07T10:00:55.374873+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:00:55.374873+0000","last_undegraded":"2023-12-07T10:00:55.374873+0000","last_fullsized":"2023-12-07T10:00:55.374873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374637+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:00:55.374637+0000","last_peered":"2023-12-07T10:00:55.374637+0000","last_clean":"2023-12-07T10:00:55.374637+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:00:55.374637+0000","last_undegraded":"2023-12-07T10:00:55.374637+0000","last_fullsized":"2023-12-07T10:00:55.374637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.908993+0000","last_change":"2023-12-07T10:01:04.908993+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.908993+0000","last_undegraded":"2023-12-07T10:01:04.908993+0000","last_fullsized":"2023-12-07T10:01:04.908993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374811+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:00:55.374811+0000","last_peered":"2023-12-07T10:00:55.374811+0000","last_clean":"2023-12-07T10:00:55.374811+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:00:55.374811+0000","last_undegraded":"2023-12-07T10:00:55.374811+0000","last_fullsized":"2023-12-07T10:00:55.374811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377240+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:00:55.377240+0000","last_peered":"2023-12-07T10:00:55.377240+0000","last_clean":"2023-12-07T10:00:55.377240+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:00:55.377240+0000","last_undegraded":"2023-12-07T10:00:55.377240+0000","last_fullsized":"2023-12-07T10:00:55.377240+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912237+0000","last_change":"2023-12-07T10:01:04.912237+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912237+0000","last_undegraded":"2023-12-07T10:01:04.912237+0000","last_fullsized":"2023-12-07T10:01:04.912237+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374815+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:00:55.374815+0000","last_peered":"2023-12-07T10:00:55.374815+0000","last_clean":"2023-12-07T10:00:55.374815+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:00:55.374815+0000","last_undegraded":"2023-12-07T10:00:55.374815+0000","last_fullsized":"2023-12-07T10:00:55.374815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374754+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:00:55.374754+0000","last_peered":"2023-12-07T10:00:55.374754+0000","last_clean":"2023-12-07T10:00:55.374754+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:00:55.374754+0000","last_undegraded":"2023-12-07T10:00:55.374754+0000","last_fullsized":"2023-12-07T10:00:55.374754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913034+0000","last_change":"2023-12-07T10:01:04.913034+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913034+0000","last_undegraded":"2023-12-07T10:01:04.913034+0000","last_fullsized":"2023-12-07T10:01:04.913034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375020+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:00:55.375020+0000","last_peered":"2023-12-07T10:00:55.375020+0000","last_clean":"2023-12-07T10:00:55.375020+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:00:55.375020+0000","last_undegraded":"2023-12-07T10:00:55.375020+0000","last_fullsized":"2023-12-07T10:00:55.375020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377354+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:00:55.377354+0000","last_peered":"2023-12-07T10:00:55.377354+0000","last_clean":"2023-12-07T10:00:55.377354+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:00:55.377354+0000","last_undegraded":"2023-12-07T10:00:55.377354+0000","last_fullsized":"2023-12-07T10:00:55.377354+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907675+0000","last_change":"2023-12-07T10:01:04.907675+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907675+0000","last_undegraded":"2023-12-07T10:01:04.907675+0000","last_fullsized":"2023-12-07T10:01:04.907675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377345+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:00:55.377345+0000","last_peered":"2023-12-07T10:00:55.377345+0000","last_clean":"2023-12-07T10:00:55.377345+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:00:55.377345+0000","last_undegraded":"2023-12-07T10:00:55.377345+0000","last_fullsized":"2023-12-07T10:00:55.377345+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380673+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:00:55.380673+0000","last_peered":"2023-12-07T10:00:55.380673+0000","last_clean":"2023-12-07T10:00:55.380673+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:00:55.380673+0000","last_undegraded":"2023-12-07T10:00:55.380673+0000","last_fullsized":"2023-12-07T10:00:55.380673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914961+0000","last_change":"2023-12-07T10:01:04.914961+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914961+0000","last_undegraded":"2023-12-07T10:01:04.914961+0000","last_fullsized":"2023-12-07T10:01:04.914961+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377283+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:00:55.377283+0000","last_peered":"2023-12-07T10:00:55.377283+0000","last_clean":"2023-12-07T10:00:55.377283+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:00:55.377283+0000","last_undegraded":"2023-12-07T10:00:55.377283+0000","last_fullsized":"2023-12-07T10:00:55.377283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377314+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:00:55.377314+0000","last_peered":"2023-12-07T10:00:55.377314+0000","last_clean":"2023-12-07T10:00:55.377314+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:00:55.377314+0000","last_undegraded":"2023-12-07T10:00:55.377314+0000","last_fullsized":"2023-12-07T10:00:55.377314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907007+0000","last_change":"2023-12-07T10:01:04.907007+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907007+0000","last_undegraded":"2023-12-07T10:01:04.907007+0000","last_fullsized":"2023-12-07T10:01:04.907007+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374956+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:00:55.374956+0000","last_peered":"2023-12-07T10:00:55.374956+0000","last_clean":"2023-12-07T10:00:55.374956+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:00:55.374956+0000","last_undegraded":"2023-12-07T10:00:55.374956+0000","last_fullsized":"2023-12-07T10:00:55.374956+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380618+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:00:55.380618+0000","last_peered":"2023-12-07T10:00:55.380618+0000","last_clean":"2023-12-07T10:00:55.380618+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:00:55.380618+0000","last_undegraded":"2023-12-07T10:00:55.380618+0000","last_fullsized":"2023-12-07T10:00:55.380618+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914140+0000","last_change":"2023-12-07T10:01:04.914140+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914140+0000","last_undegraded":"2023-12-07T10:01:04.914140+0000","last_fullsized":"2023-12-07T10:01:04.914140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377261+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:00:55.377261+0000","last_peered":"2023-12-07T10:00:55.377261+0000","last_clean":"2023-12-07T10:00:55.377261+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:00:55.377261+0000","last_undegraded":"2023-12-07T10:00:55.377261+0000","last_fullsized":"2023-12-07T10:00:55.377261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377261+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:00:55.377261+0000","last_peered":"2023-12-07T10:00:55.377261+0000","last_clean":"2023-12-07T10:00:55.377261+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:00:55.377261+0000","last_undegraded":"2023-12-07T10:00:55.377261+0000","last_fullsized":"2023-12-07T10:00:55.377261+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.915494+0000","last_change":"2023-12-07T10:01:04.915494+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.915494+0000","last_undegraded":"2023-12-07T10:01:04.915494+0000","last_fullsized":"2023-12-07T10:01:04.915494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380580+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:00:55.380580+0000","last_peered":"2023-12-07T10:00:55.380580+0000","last_clean":"2023-12-07T10:00:55.380580+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:00:55.380580+0000","last_undegraded":"2023-12-07T10:00:55.380580+0000","last_fullsized":"2023-12-07T10:00:55.380580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381003+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:00:55.381003+0000","last_peered":"2023-12-07T10:00:55.381003+0000","last_clean":"2023-12-07T10:00:55.381003+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:00:55.381003+0000","last_undegraded":"2023-12-07T10:00:55.381003+0000","last_fullsized":"2023-12-07T10:00:55.381003+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911714+0000","last_change":"2023-12-07T10:01:04.911714+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911714+0000","last_undegraded":"2023-12-07T10:01:04.911714+0000","last_fullsized":"2023-12-07T10:01:04.911714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380536+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:00:55.380536+0000","last_peered":"2023-12-07T10:00:55.380536+0000","last_clean":"2023-12-07T10:00:55.380536+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:00:55.380536+0000","last_undegraded":"2023-12-07T10:00:55.380536+0000","last_fullsized":"2023-12-07T10:00:55.380536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377210+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:00:55.377210+0000","last_peered":"2023-12-07T10:00:55.377210+0000","last_clean":"2023-12-07T10:00:55.377210+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:00:55.377210+0000","last_undegraded":"2023-12-07T10:00:55.377210+0000","last_fullsized":"2023-12-07T10:00:55.377210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912300+0000","last_change":"2023-12-07T10:01:04.912300+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912300+0000","last_undegraded":"2023-12-07T10:01:04.912300+0000","last_fullsized":"2023-12-07T10:01:04.912300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377335+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:00:55.377335+0000","last_peered":"2023-12-07T10:00:55.377335+0000","last_clean":"2023-12-07T10:00:55.377335+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:00:55.377335+0000","last_undegraded":"2023-12-07T10:00:55.377335+0000","last_fullsized":"2023-12-07T10:00:55.377335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381067+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:00:55.381067+0000","last_peered":"2023-12-07T10:00:55.381067+0000","last_clean":"2023-12-07T10:00:55.381067+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:00:55.381067+0000","last_undegraded":"2023-12-07T10:00:55.381067+0000","last_fullsized":"2023-12-07T10:00:55.381067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.915702+0000","last_change":"2023-12-07T10:01:04.915702+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.915702+0000","last_undegraded":"2023-12-07T10:01:04.915702+0000","last_fullsized":"2023-12-07T10:01:04.915702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377354+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:00:55.377354+0000","last_peered":"2023-12-07T10:00:55.377354+0000","last_clean":"2023-12-07T10:00:55.377354+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:00:55.377354+0000","last_undegraded":"2023-12-07T10:00:55.377354+0000","last_fullsized":"2023-12-07T10:00:55.377354+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"49'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:57.888682+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:00:57.888682+0000","last_peered":"2023-12-07T10:00:57.888682+0000","last_clean":"2023-12-07T10:00:57.888682+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:00:57.888682+0000","last_undegraded":"2023-12-07T10:00:57.888682+0000","last_fullsized":"2023-12-07T10:00:57.888682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914368+0000","last_change":"2023-12-07T10:01:04.914368+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914368+0000","last_undegraded":"2023-12-07T10:01:04.914368+0000","last_fullsized":"2023-12-07T10:01:04.914368+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381031+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:00:55.381031+0000","last_peered":"2023-12-07T10:00:55.381031+0000","last_clean":"2023-12-07T10:00:55.381031+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:00:55.381031+0000","last_undegraded":"2023-12-07T10:00:55.381031+0000","last_fullsized":"2023-12-07T10:00:55.381031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374656+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:00:55.374656+0000","last_peered":"2023-12-07T10:00:55.374656+0000","last_clean":"2023-12-07T10:00:55.374656+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:00:55.374656+0000","last_undegraded":"2023-12-07T10:00:55.374656+0000","last_fullsized":"2023-12-07T10:00:55.374656+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914376+0000","last_change":"2023-12-07T10:01:04.914376+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914376+0000","last_undegraded":"2023-12-07T10:01:04.914376+0000","last_fullsized":"2023-12-07T10:01:04.914376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380646+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:00:55.380646+0000","last_peered":"2023-12-07T10:00:55.380646+0000","last_clean":"2023-12-07T10:00:55.380646+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:00:55.380646+0000","last_undegraded":"2023-12-07T10:00:55.380646+0000","last_fullsized":"2023-12-07T10:00:55.380646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377304+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:00:55.377304+0000","last_peered":"2023-12-07T10:00:55.377304+0000","last_clean":"2023-12-07T10:00:55.377304+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:00:55.377304+0000","last_undegraded":"2023-12-07T10:00:55.377304+0000","last_fullsized":"2023-12-07T10:00:55.377304+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906505+0000","last_change":"2023-12-07T10:01:04.906505+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906505+0000","last_undegraded":"2023-12-07T10:01:04.906505+0000","last_fullsized":"2023-12-07T10:01:04.906505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377188+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:00:55.377188+0000","last_peered":"2023-12-07T10:00:55.377188+0000","last_clean":"2023-12-07T10:00:55.377188+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:00:55.377188+0000","last_undegraded":"2023-12-07T10:00:55.377188+0000","last_fullsized":"2023-12-07T10:00:55.377188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381012+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:00:55.381012+0000","last_peered":"2023-12-07T10:00:55.381012+0000","last_clean":"2023-12-07T10:00:55.381012+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:00:55.381012+0000","last_undegraded":"2023-12-07T10:00:55.381012+0000","last_fullsized":"2023-12-07T10:00:55.381012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911565+0000","last_change":"2023-12-07T10:01:04.911565+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911565+0000","last_undegraded":"2023-12-07T10:01:04.911565+0000","last_fullsized":"2023-12-07T10:01:04.911565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374894+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:00:55.374894+0000","last_peered":"2023-12-07T10:00:55.374894+0000","last_clean":"2023-12-07T10:00:55.374894+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:00:55.374894+0000","last_undegraded":"2023-12-07T10:00:55.374894+0000","last_fullsized":"2023-12-07T10:00:55.374894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374916+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:00:55.374916+0000","last_peered":"2023-12-07T10:00:55.374916+0000","last_clean":"2023-12-07T10:00:55.374916+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:00:55.374916+0000","last_undegraded":"2023-12-07T10:00:55.374916+0000","last_fullsized":"2023-12-07T10:00:55.374916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912141+0000","last_change":"2023-12-07T10:01:04.912141+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912141+0000","last_undegraded":"2023-12-07T10:01:04.912141+0000","last_fullsized":"2023-12-07T10:01:04.912141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380978+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:00:55.380978+0000","last_peered":"2023-12-07T10:00:55.380978+0000","last_clean":"2023-12-07T10:00:55.380978+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:00:55.380978+0000","last_undegraded":"2023-12-07T10:00:55.380978+0000","last_fullsized":"2023-12-07T10:00:55.380978+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380993+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:00:55.380993+0000","last_peered":"2023-12-07T10:00:55.380993+0000","last_clean":"2023-12-07T10:00:55.380993+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:00:55.380993+0000","last_undegraded":"2023-12-07T10:00:55.380993+0000","last_fullsized":"2023-12-07T10:00:55.380993+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909124+0000","last_change":"2023-12-07T10:01:04.909124+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909124+0000","last_undegraded":"2023-12-07T10:01:04.909124+0000","last_fullsized":"2023-12-07T10:01:04.909124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377136+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:00:55.377136+0000","last_peered":"2023-12-07T10:00:55.377136+0000","last_clean":"2023-12-07T10:00:55.377136+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:00:55.377136+0000","last_undegraded":"2023-12-07T10:00:55.377136+0000","last_fullsized":"2023-12-07T10:00:55.377136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377117+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:00:55.377117+0000","last_peered":"2023-12-07T10:00:55.377117+0000","last_clean":"2023-12-07T10:00:55.377117+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:00:55.377117+0000","last_undegraded":"2023-12-07T10:00:55.377117+0000","last_fullsized":"2023-12-07T10:00:55.377117+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911657+0000","last_change":"2023-12-07T10:01:04.911657+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911657+0000","last_undegraded":"2023-12-07T10:01:04.911657+0000","last_fullsized":"2023-12-07T10:01:04.911657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377104+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:00:55.377104+0000","last_peered":"2023-12-07T10:00:55.377104+0000","last_clean":"2023-12-07T10:00:55.377104+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:00:55.377104+0000","last_undegraded":"2023-12-07T10:00:55.377104+0000","last_fullsized":"2023-12-07T10:00:55.377104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374627+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:00:55.374627+0000","last_peered":"2023-12-07T10:00:55.374627+0000","last_clean":"2023-12-07T10:00:55.374627+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:00:55.374627+0000","last_undegraded":"2023-12-07T10:00:55.374627+0000","last_fullsized":"2023-12-07T10:00:55.374627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-07T10:01:04.906782+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:04.906782+0000","last_peered":"2023-12-07T10:01:04.906782+0000","last_clean":"2023-12-07T10:01:04.906782+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:04.906782+0000","last_undegraded":"2023-12-07T10:01:04.906782+0000","last_fullsized":"2023-12-07T10:01:04.906782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":837046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.505}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.55600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.442},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.622},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.5}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":247170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":256296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.62}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.85599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.432}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":246608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":847246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.378}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.624},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.499},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:11.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:11.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.188+0000 7f961e632640 1 Processor -- start 2023-12-07T10:01:11.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.188+0000 7f961e632640 1 -- start start 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961e632640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f961814e9d0 0x7f9618151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961e632640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96180a8470 0x7f961806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961e632640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961806d320 con 0x7f9618070b80 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961e632640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180721b0 con 0x7f96180a8470 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961e632640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180c2830 con 0x7f961814e9d0 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96180a8470 0x7f961806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96180a8470 0x7f961806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41606/0 (socket says 172.21.15.89:41606) 2023-12-07T10:01:11.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 -- 172.21.15.89:0/1372027223 learned_addr learned my addr 172.21.15.89:0/1372027223 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:11.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 -- 172.21.15.89:0/1372027223 >> v2:172.21.15.97:3300/0 conn(0x7f961814e9d0 msgr2=0x7f9618151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:11.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f9617fff640 1 --2- 172.21.15.89:0/1372027223 >> v2:172.21.15.97:3300/0 conn(0x7f961814e9d0 0x7f9618151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 --2- 172.21.15.89:0/1372027223 >> v2:172.21.15.97:3300/0 conn(0x7f961814e9d0 0x7f9618151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 -- 172.21.15.89:0/1372027223 >> v1:172.21.15.97:6789/0 conn(0x7f9618070b80 legacy=0x7f96180c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:11.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f961cbcf640 1 -- 172.21.15.89:0/1372027223 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618072450 con 0x7f96180a8470 2023-12-07T10:01:11.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.192+0000 7f9617fff640 1 --2- 172.21.15.89:0/1372027223 >> v2:172.21.15.97:3300/0 conn(0x7f961814e9d0 0x7f9618151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:11.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961cbcf640 1 --2- 172.21.15.89:0/1372027223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96180a8470 0x7f961806d7b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f96180c3980 tx=0x7f961001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ed3a7a4580528d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f9616ffd640 1 -- 172.21.15.89:0/1372027223 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a56d0 con 0x7f96180a8470 2023-12-07T10:01:11.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f9616ffd640 1 -- 172.21.15.89:0/1372027223 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100a5830 con 0x7f96180a8470 2023-12-07T10:01:11.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f9616ffd640 1 -- 172.21.15.89:0/1372027223 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a5bc0 con 0x7f96180a8470 2023-12-07T10:01:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 -- 172.21.15.89:0/1372027223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96180a8470 msgr2=0x7f961806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 --2- 172.21.15.89:0/1372027223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96180a8470 0x7f961806d7b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f96180c3980 tx=0x7f961001c900 comp rx=0 tx=0).stop 2023-12-07T10:01:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 -- 172.21.15.89:0/1372027223 shutdown_connections 2023-12-07T10:01:11.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 --2- 172.21.15.89:0/1372027223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96180a8470 0x7f961806d7b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 --2- 172.21.15.89:0/1372027223 >> v2:172.21.15.97:3300/0 conn(0x7f961814e9d0 0x7f9618151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 -- 172.21.15.89:0/1372027223 >> 172.21.15.89:0/1372027223 conn(0x7f96180c2ad0 msgr2=0x7f96180c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 -- 172.21.15.89:0/1372027223 shutdown_connections 2023-12-07T10:01:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 -- 172.21.15.89:0/1372027223 wait complete. 2023-12-07T10:01:11.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 Processor -- start 2023-12-07T10:01:11.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.196+0000 7f961e632640 1 -- start start 2023-12-07T10:01:11.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9618070b80 0x7f96181f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96180a8470 0x7f961813a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 0x7f961813ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618152a70 con 0x7f961814e9d0 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961814ce30 con 0x7f9618070b80 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961814c520 con 0x7f96180a8470 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 0x7f961813ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 0x7f961813ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41610/0 (socket says 172.21.15.89:41610) 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 -- 172.21.15.89:0/824764857 learned_addr learned my addr 172.21.15.89:0/824764857 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f9617fff640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9618070b80 0x7f96181f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f96177fe640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96180a8470 0x7f961813a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 -- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96180a8470 msgr2=0x7f961813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96180a8470 0x7f961813a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 -- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9618070b80 msgr2=0x7f96181f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9618070b80 0x7f96181f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 -- 172.21.15.89:0/824764857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009b30 con 0x7f961814e9d0 2023-12-07T10:01:11.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f96177fe640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96180a8470 0x7f961813a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:11.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961cbcf640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 0x7f961813ad90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f961001a530 tx=0x7f96100196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100b8670 con 0x7f961814e9d0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100b87d0 con 0x7f961814e9d0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100b8b40 con 0x7f961814e9d0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96181f0ce0 con 0x7f961814e9d0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961814cac0 con 0x7f961814e9d0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.200+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961804e890 con 0x7f961814e9d0 2023-12-07T10:01:11.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.204+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f96100b8ca0 con 0x7f961814e9d0 2023-12-07T10:01:11.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.204+0000 7f9614ff9640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96040668d0 0x7f9604068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.204+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f961011fc90 con 0x7f961814e9d0 2023-12-07T10:01:11.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.204+0000 7f9617fff640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96040668d0 0x7f9604068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.204+0000 7f9617fff640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96040668d0 0x7f9604068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9608006fd0 tx=0x7f9608008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.208+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96100ecad0 con 0x7f961814e9d0 2023-12-07T10:01:11.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.352+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f961806be00 con 0x7f96040668d0 2023-12-07T10:01:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.364+0000 7f9614ff9640 1 -- 172.21.15.89:0/824764857 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+515523 (secure 0 0 0) 0x7f960800c040 con 0x7f96040668d0 2023-12-07T10:01:11.376 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:11.380 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:11.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96040668d0 msgr2=0x7f9604068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96040668d0 0x7f9604068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9608006fd0 tx=0x7f9608008040 comp rx=0 tx=0).stop 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 msgr2=0x7f961813ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 0x7f961813ad90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f961001a530 tx=0x7f96100196a0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 shutdown_connections 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f961814e9d0 0x7f961813ad90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f96040668d0 0x7f9604068d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96180a8470 0x7f961813a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 --2- 172.21.15.89:0/824764857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9618070b80 0x7f96181f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 >> 172.21.15.89:0/824764857 conn(0x7f96180c2ad0 msgr2=0x7f961806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 shutdown_connections 2023-12-07T10:01:11.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.372+0000 7f961e632640 1 -- 172.21.15.89:0/824764857 wait complete. 2023-12-07T10:01:11.395 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-12-07T10:01:10.364662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226196,"kb_used_data":5824,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748524,"statfs":{"total":773094113280,"available":772862488576,"internally_reserved":0,"allocated":5963776,"data_stored":3174032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460979"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374674+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:00:55.374674+0000","last_peered":"2023-12-07T10:00:55.374674+0000","last_clean":"2023-12-07T10:00:55.374674+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:00:55.374674+0000","last_undegraded":"2023-12-07T10:00:55.374674+0000","last_fullsized":"2023-12-07T10:00:55.374674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377313+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:00:55.377313+0000","last_peered":"2023-12-07T10:00:55.377313+0000","last_clean":"2023-12-07T10:00:55.377313+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:00:55.377313+0000","last_undegraded":"2023-12-07T10:00:55.377313+0000","last_fullsized":"2023-12-07T10:00:55.377313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374913+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:00:55.374913+0000","last_peered":"2023-12-07T10:00:55.374913+0000","last_clean":"2023-12-07T10:00:55.374913+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:00:55.374913+0000","last_undegraded":"2023-12-07T10:00:55.374913+0000","last_fullsized":"2023-12-07T10:00:55.374913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377273+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:00:55.377273+0000","last_peered":"2023-12-07T10:00:55.377273+0000","last_clean":"2023-12-07T10:00:55.377273+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:00:55.377273+0000","last_undegraded":"2023-12-07T10:00:55.377273+0000","last_fullsized":"2023-12-07T10:00:55.377273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374624+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:00:55.374624+0000","last_peered":"2023-12-07T10:00:55.374624+0000","last_clean":"2023-12-07T10:00:55.374624+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:00:55.374624+0000","last_undegraded":"2023-12-07T10:00:55.374624+0000","last_fullsized":"2023-12-07T10:00:55.374624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380545+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:00:55.380545+0000","last_peered":"2023-12-07T10:00:55.380545+0000","last_clean":"2023-12-07T10:00:55.380545+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:00:55.380545+0000","last_undegraded":"2023-12-07T10:00:55.380545+0000","last_fullsized":"2023-12-07T10:00:55.380545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374856+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:00:55.374856+0000","last_peered":"2023-12-07T10:00:55.374856+0000","last_clean":"2023-12-07T10:00:55.374856+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:00:55.374856+0000","last_undegraded":"2023-12-07T10:00:55.374856+0000","last_fullsized":"2023-12-07T10:00:55.374856+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377081+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:00:55.377081+0000","last_peered":"2023-12-07T10:00:55.377081+0000","last_clean":"2023-12-07T10:00:55.377081+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:00:55.377081+0000","last_undegraded":"2023-12-07T10:00:55.377081+0000","last_fullsized":"2023-12-07T10:00:55.377081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375003+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:00:55.375003+0000","last_peered":"2023-12-07T10:00:55.375003+0000","last_clean":"2023-12-07T10:00:55.375003+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:00:55.375003+0000","last_undegraded":"2023-12-07T10:00:55.375003+0000","last_fullsized":"2023-12-07T10:00:55.375003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381048+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:00:55.381048+0000","last_peered":"2023-12-07T10:00:55.381048+0000","last_clean":"2023-12-07T10:00:55.381048+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:00:55.381048+0000","last_undegraded":"2023-12-07T10:00:55.381048+0000","last_fullsized":"2023-12-07T10:00:55.381048+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381040+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:00:55.381040+0000","last_peered":"2023-12-07T10:00:55.381040+0000","last_clean":"2023-12-07T10:00:55.381040+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:00:55.381040+0000","last_undegraded":"2023-12-07T10:00:55.381040+0000","last_fullsized":"2023-12-07T10:00:55.381040+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377283+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:00:55.377283+0000","last_peered":"2023-12-07T10:00:55.377283+0000","last_clean":"2023-12-07T10:00:55.377283+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:00:55.377283+0000","last_undegraded":"2023-12-07T10:00:55.377283+0000","last_fullsized":"2023-12-07T10:00:55.377283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374647+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:00:55.374647+0000","last_peered":"2023-12-07T10:00:55.374647+0000","last_clean":"2023-12-07T10:00:55.374647+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:00:55.374647+0000","last_undegraded":"2023-12-07T10:00:55.374647+0000","last_fullsized":"2023-12-07T10:00:55.374647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374895+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:00:55.374895+0000","last_peered":"2023-12-07T10:00:55.374895+0000","last_clean":"2023-12-07T10:00:55.374895+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:00:55.374895+0000","last_undegraded":"2023-12-07T10:00:55.374895+0000","last_fullsized":"2023-12-07T10:00:55.374895+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374877+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:00:55.374877+0000","last_peered":"2023-12-07T10:00:55.374877+0000","last_clean":"2023-12-07T10:00:55.374877+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:00:55.374877+0000","last_undegraded":"2023-12-07T10:00:55.374877+0000","last_fullsized":"2023-12-07T10:00:55.374877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380512+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:00:55.380512+0000","last_peered":"2023-12-07T10:00:55.380512+0000","last_clean":"2023-12-07T10:00:55.380512+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:00:55.380512+0000","last_undegraded":"2023-12-07T10:00:55.380512+0000","last_fullsized":"2023-12-07T10:00:55.380512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377344+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:00:55.377344+0000","last_peered":"2023-12-07T10:00:55.377344+0000","last_clean":"2023-12-07T10:00:55.377344+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:00:55.377344+0000","last_undegraded":"2023-12-07T10:00:55.377344+0000","last_fullsized":"2023-12-07T10:00:55.377344+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374997+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:00:55.374997+0000","last_peered":"2023-12-07T10:00:55.374997+0000","last_clean":"2023-12-07T10:00:55.374997+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:00:55.374997+0000","last_undegraded":"2023-12-07T10:00:55.374997+0000","last_fullsized":"2023-12-07T10:00:55.374997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374658+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:00:55.374658+0000","last_peered":"2023-12-07T10:00:55.374658+0000","last_clean":"2023-12-07T10:00:55.374658+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:00:55.374658+0000","last_undegraded":"2023-12-07T10:00:55.374658+0000","last_fullsized":"2023-12-07T10:00:55.374658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377274+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:55.377274+0000","last_peered":"2023-12-07T10:00:55.377274+0000","last_clean":"2023-12-07T10:00:55.377274+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:00:55.377274+0000","last_undegraded":"2023-12-07T10:00:55.377274+0000","last_fullsized":"2023-12-07T10:00:55.377274+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374856+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:00:55.374856+0000","last_peered":"2023-12-07T10:00:55.374856+0000","last_clean":"2023-12-07T10:00:55.374856+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:00:55.374856+0000","last_undegraded":"2023-12-07T10:00:55.374856+0000","last_fullsized":"2023-12-07T10:00:55.374856+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377152+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:00:55.377152+0000","last_peered":"2023-12-07T10:00:55.377152+0000","last_clean":"2023-12-07T10:00:55.377152+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:00:55.377152+0000","last_undegraded":"2023-12-07T10:00:55.377152+0000","last_fullsized":"2023-12-07T10:00:55.377152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374789+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:00:55.374789+0000","last_peered":"2023-12-07T10:00:55.374789+0000","last_clean":"2023-12-07T10:00:55.374789+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:00:55.374789+0000","last_undegraded":"2023-12-07T10:00:55.374789+0000","last_fullsized":"2023-12-07T10:00:55.374789+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374602+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:00:55.374602+0000","last_peered":"2023-12-07T10:00:55.374602+0000","last_clean":"2023-12-07T10:00:55.374602+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:00:55.374602+0000","last_undegraded":"2023-12-07T10:00:55.374602+0000","last_fullsized":"2023-12-07T10:00:55.374602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374683+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:00:55.374683+0000","last_peered":"2023-12-07T10:00:55.374683+0000","last_clean":"2023-12-07T10:00:55.374683+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:00:55.374683+0000","last_undegraded":"2023-12-07T10:00:55.374683+0000","last_fullsized":"2023-12-07T10:00:55.374683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377324+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:00:55.377324+0000","last_peered":"2023-12-07T10:00:55.377324+0000","last_clean":"2023-12-07T10:00:55.377324+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:00:55.377324+0000","last_undegraded":"2023-12-07T10:00:55.377324+0000","last_fullsized":"2023-12-07T10:00:55.377324+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380627+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:00:55.380627+0000","last_peered":"2023-12-07T10:00:55.380627+0000","last_clean":"2023-12-07T10:00:55.380627+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:00:55.380627+0000","last_undegraded":"2023-12-07T10:00:55.380627+0000","last_fullsized":"2023-12-07T10:00:55.380627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374641+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:00:55.374641+0000","last_peered":"2023-12-07T10:00:55.374641+0000","last_clean":"2023-12-07T10:00:55.374641+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:00:55.374641+0000","last_undegraded":"2023-12-07T10:00:55.374641+0000","last_fullsized":"2023-12-07T10:00:55.374641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377241+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:00:55.377241+0000","last_peered":"2023-12-07T10:00:55.377241+0000","last_clean":"2023-12-07T10:00:55.377241+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:00:55.377241+0000","last_undegraded":"2023-12-07T10:00:55.377241+0000","last_fullsized":"2023-12-07T10:00:55.377241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374837+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:00:55.374837+0000","last_peered":"2023-12-07T10:00:55.374837+0000","last_clean":"2023-12-07T10:00:55.374837+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:00:55.374837+0000","last_undegraded":"2023-12-07T10:00:55.374837+0000","last_fullsized":"2023-12-07T10:00:55.374837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374599+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:00:55.374599+0000","last_peered":"2023-12-07T10:00:55.374599+0000","last_clean":"2023-12-07T10:00:55.374599+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:00:55.374599+0000","last_undegraded":"2023-12-07T10:00:55.374599+0000","last_fullsized":"2023-12-07T10:00:55.374599+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380527+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:00:55.380527+0000","last_peered":"2023-12-07T10:00:55.380527+0000","last_clean":"2023-12-07T10:00:55.380527+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:00:55.380527+0000","last_undegraded":"2023-12-07T10:00:55.380527+0000","last_fullsized":"2023-12-07T10:00:55.380527+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907098+0000","last_change":"2023-12-07T10:01:04.907098+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907098+0000","last_undegraded":"2023-12-07T10:01:04.907098+0000","last_fullsized":"2023-12-07T10:01:04.907098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380664+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:00:55.380664+0000","last_peered":"2023-12-07T10:00:55.380664+0000","last_clean":"2023-12-07T10:00:55.380664+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:00:55.380664+0000","last_undegraded":"2023-12-07T10:00:55.380664+0000","last_fullsized":"2023-12-07T10:00:55.380664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380690+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:00:55.380690+0000","last_peered":"2023-12-07T10:00:55.380690+0000","last_clean":"2023-12-07T10:00:55.380690+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:00:55.380690+0000","last_undegraded":"2023-12-07T10:00:55.380690+0000","last_fullsized":"2023-12-07T10:00:55.380690+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912983+0000","last_change":"2023-12-07T10:01:04.912983+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912983+0000","last_undegraded":"2023-12-07T10:01:04.912983+0000","last_fullsized":"2023-12-07T10:01:04.912983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381057+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:00:55.381057+0000","last_peered":"2023-12-07T10:00:55.381057+0000","last_clean":"2023-12-07T10:00:55.381057+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:00:55.381057+0000","last_undegraded":"2023-12-07T10:00:55.381057+0000","last_fullsized":"2023-12-07T10:00:55.381057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377324+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:00:55.377324+0000","last_peered":"2023-12-07T10:00:55.377324+0000","last_clean":"2023-12-07T10:00:55.377324+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:00:55.377324+0000","last_undegraded":"2023-12-07T10:00:55.377324+0000","last_fullsized":"2023-12-07T10:00:55.377324+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906747+0000","last_change":"2023-12-07T10:01:04.906747+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906747+0000","last_undegraded":"2023-12-07T10:01:04.906747+0000","last_fullsized":"2023-12-07T10:01:04.906747+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380599+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:00:55.380599+0000","last_peered":"2023-12-07T10:00:55.380599+0000","last_clean":"2023-12-07T10:00:55.380599+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:00:55.380599+0000","last_undegraded":"2023-12-07T10:00:55.380599+0000","last_fullsized":"2023-12-07T10:00:55.380599+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380654+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:00:55.380654+0000","last_peered":"2023-12-07T10:00:55.380654+0000","last_clean":"2023-12-07T10:00:55.380654+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:00:55.380654+0000","last_undegraded":"2023-12-07T10:00:55.380654+0000","last_fullsized":"2023-12-07T10:00:55.380654+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.917938+0000","last_change":"2023-12-07T10:01:04.917938+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.917938+0000","last_undegraded":"2023-12-07T10:01:04.917938+0000","last_fullsized":"2023-12-07T10:01:04.917938+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380638+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:00:55.380638+0000","last_peered":"2023-12-07T10:00:55.380638+0000","last_clean":"2023-12-07T10:00:55.380638+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:00:55.380638+0000","last_undegraded":"2023-12-07T10:00:55.380638+0000","last_fullsized":"2023-12-07T10:00:55.380638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377293+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:00:55.377293+0000","last_peered":"2023-12-07T10:00:55.377293+0000","last_clean":"2023-12-07T10:00:55.377293+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:00:55.377293+0000","last_undegraded":"2023-12-07T10:00:55.377293+0000","last_fullsized":"2023-12-07T10:00:55.377293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.908994+0000","last_change":"2023-12-07T10:01:04.908994+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.908994+0000","last_undegraded":"2023-12-07T10:01:04.908994+0000","last_fullsized":"2023-12-07T10:01:04.908994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377170+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:00:55.377170+0000","last_peered":"2023-12-07T10:00:55.377170+0000","last_clean":"2023-12-07T10:00:55.377170+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:00:55.377170+0000","last_undegraded":"2023-12-07T10:00:55.377170+0000","last_fullsized":"2023-12-07T10:00:55.377170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374938+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:00:55.374938+0000","last_peered":"2023-12-07T10:00:55.374938+0000","last_clean":"2023-12-07T10:00:55.374938+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:00:55.374938+0000","last_undegraded":"2023-12-07T10:00:55.374938+0000","last_fullsized":"2023-12-07T10:00:55.374938+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912170+0000","last_change":"2023-12-07T10:01:04.912170+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912170+0000","last_undegraded":"2023-12-07T10:01:04.912170+0000","last_fullsized":"2023-12-07T10:01:04.912170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377204+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:55.377204+0000","last_peered":"2023-12-07T10:00:55.377204+0000","last_clean":"2023-12-07T10:00:55.377204+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:00:55.377204+0000","last_undegraded":"2023-12-07T10:00:55.377204+0000","last_fullsized":"2023-12-07T10:00:55.377204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380559+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:00:55.380559+0000","last_peered":"2023-12-07T10:00:55.380559+0000","last_clean":"2023-12-07T10:00:55.380559+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:00:55.380559+0000","last_undegraded":"2023-12-07T10:00:55.380559+0000","last_fullsized":"2023-12-07T10:00:55.380559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909871+0000","last_change":"2023-12-07T10:01:04.909871+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909871+0000","last_undegraded":"2023-12-07T10:01:04.909871+0000","last_fullsized":"2023-12-07T10:01:04.909871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374617+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:00:55.374617+0000","last_peered":"2023-12-07T10:00:55.374617+0000","last_clean":"2023-12-07T10:00:55.374617+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:00:55.374617+0000","last_undegraded":"2023-12-07T10:00:55.374617+0000","last_fullsized":"2023-12-07T10:00:55.374617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377229+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:00:55.377229+0000","last_peered":"2023-12-07T10:00:55.377229+0000","last_clean":"2023-12-07T10:00:55.377229+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:00:55.377229+0000","last_undegraded":"2023-12-07T10:00:55.377229+0000","last_fullsized":"2023-12-07T10:00:55.377229+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912603+0000","last_change":"2023-12-07T10:01:04.912603+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912603+0000","last_undegraded":"2023-12-07T10:01:04.912603+0000","last_fullsized":"2023-12-07T10:01:04.912603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377127+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:00:55.377127+0000","last_peered":"2023-12-07T10:00:55.377127+0000","last_clean":"2023-12-07T10:00:55.377127+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:00:55.377127+0000","last_undegraded":"2023-12-07T10:00:55.377127+0000","last_fullsized":"2023-12-07T10:00:55.377127+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374835+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:00:55.374835+0000","last_peered":"2023-12-07T10:00:55.374835+0000","last_clean":"2023-12-07T10:00:55.374835+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:00:55.374835+0000","last_undegraded":"2023-12-07T10:00:55.374835+0000","last_fullsized":"2023-12-07T10:00:55.374835+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.910314+0000","last_change":"2023-12-07T10:01:04.910314+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.910314+0000","last_undegraded":"2023-12-07T10:01:04.910314+0000","last_fullsized":"2023-12-07T10:01:04.910314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374982+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:00:55.374982+0000","last_peered":"2023-12-07T10:00:55.374982+0000","last_clean":"2023-12-07T10:00:55.374982+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:00:55.374982+0000","last_undegraded":"2023-12-07T10:00:55.374982+0000","last_fullsized":"2023-12-07T10:00:55.374982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375062+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:00:55.375062+0000","last_peered":"2023-12-07T10:00:55.375062+0000","last_clean":"2023-12-07T10:00:55.375062+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:00:55.375062+0000","last_undegraded":"2023-12-07T10:00:55.375062+0000","last_fullsized":"2023-12-07T10:00:55.375062+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909012+0000","last_change":"2023-12-07T10:01:04.909012+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909012+0000","last_undegraded":"2023-12-07T10:01:04.909012+0000","last_fullsized":"2023-12-07T10:01:04.909012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375041+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:00:55.375041+0000","last_peered":"2023-12-07T10:00:55.375041+0000","last_clean":"2023-12-07T10:00:55.375041+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:00:55.375041+0000","last_undegraded":"2023-12-07T10:00:55.375041+0000","last_fullsized":"2023-12-07T10:00:55.375041+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377333+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:00:55.377333+0000","last_peered":"2023-12-07T10:00:55.377333+0000","last_clean":"2023-12-07T10:00:55.377333+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:00:55.377333+0000","last_undegraded":"2023-12-07T10:00:55.377333+0000","last_fullsized":"2023-12-07T10:00:55.377333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907569+0000","last_change":"2023-12-07T10:01:04.907569+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907569+0000","last_undegraded":"2023-12-07T10:01:04.907569+0000","last_fullsized":"2023-12-07T10:01:04.907569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381021+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:00:55.381021+0000","last_peered":"2023-12-07T10:00:55.381021+0000","last_clean":"2023-12-07T10:00:55.381021+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:00:55.381021+0000","last_undegraded":"2023-12-07T10:00:55.381021+0000","last_fullsized":"2023-12-07T10:00:55.381021+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374975+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:00:55.374975+0000","last_peered":"2023-12-07T10:00:55.374975+0000","last_clean":"2023-12-07T10:00:55.374975+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:00:55.374975+0000","last_undegraded":"2023-12-07T10:00:55.374975+0000","last_fullsized":"2023-12-07T10:00:55.374975+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913689+0000","last_change":"2023-12-07T10:01:04.913689+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913689+0000","last_undegraded":"2023-12-07T10:01:04.913689+0000","last_fullsized":"2023-12-07T10:01:04.913689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374933+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:00:55.374933+0000","last_peered":"2023-12-07T10:00:55.374933+0000","last_clean":"2023-12-07T10:00:55.374933+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:00:55.374933+0000","last_undegraded":"2023-12-07T10:00:55.374933+0000","last_fullsized":"2023-12-07T10:00:55.374933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:01:01.631697+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:01:01.631697+0000","last_peered":"2023-12-07T10:01:01.631697+0000","last_clean":"2023-12-07T10:01:01.631697+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:01:01.631697+0000","last_undegraded":"2023-12-07T10:01:01.631697+0000","last_fullsized":"2023-12-07T10:01:01.631697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913550+0000","last_change":"2023-12-07T10:01:04.913550+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913550+0000","last_undegraded":"2023-12-07T10:01:04.913550+0000","last_fullsized":"2023-12-07T10:01:04.913550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377249+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:00:55.377249+0000","last_peered":"2023-12-07T10:00:55.377249+0000","last_clean":"2023-12-07T10:00:55.377249+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:00:55.377249+0000","last_undegraded":"2023-12-07T10:00:55.377249+0000","last_fullsized":"2023-12-07T10:00:55.377249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377222+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:00:55.377222+0000","last_peered":"2023-12-07T10:00:55.377222+0000","last_clean":"2023-12-07T10:00:55.377222+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:00:55.377222+0000","last_undegraded":"2023-12-07T10:00:55.377222+0000","last_fullsized":"2023-12-07T10:00:55.377222+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906496+0000","last_change":"2023-12-07T10:01:04.906496+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906496+0000","last_undegraded":"2023-12-07T10:01:04.906496+0000","last_fullsized":"2023-12-07T10:01:04.906496+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374873+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:00:55.374873+0000","last_peered":"2023-12-07T10:00:55.374873+0000","last_clean":"2023-12-07T10:00:55.374873+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:00:55.374873+0000","last_undegraded":"2023-12-07T10:00:55.374873+0000","last_fullsized":"2023-12-07T10:00:55.374873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374637+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:00:55.374637+0000","last_peered":"2023-12-07T10:00:55.374637+0000","last_clean":"2023-12-07T10:00:55.374637+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:00:55.374637+0000","last_undegraded":"2023-12-07T10:00:55.374637+0000","last_fullsized":"2023-12-07T10:00:55.374637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.908993+0000","last_change":"2023-12-07T10:01:04.908993+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.908993+0000","last_undegraded":"2023-12-07T10:01:04.908993+0000","last_fullsized":"2023-12-07T10:01:04.908993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374811+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:00:55.374811+0000","last_peered":"2023-12-07T10:00:55.374811+0000","last_clean":"2023-12-07T10:00:55.374811+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:00:55.374811+0000","last_undegraded":"2023-12-07T10:00:55.374811+0000","last_fullsized":"2023-12-07T10:00:55.374811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377240+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:00:55.377240+0000","last_peered":"2023-12-07T10:00:55.377240+0000","last_clean":"2023-12-07T10:00:55.377240+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:00:55.377240+0000","last_undegraded":"2023-12-07T10:00:55.377240+0000","last_fullsized":"2023-12-07T10:00:55.377240+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912237+0000","last_change":"2023-12-07T10:01:04.912237+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912237+0000","last_undegraded":"2023-12-07T10:01:04.912237+0000","last_fullsized":"2023-12-07T10:01:04.912237+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374815+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:00:55.374815+0000","last_peered":"2023-12-07T10:00:55.374815+0000","last_clean":"2023-12-07T10:00:55.374815+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:00:55.374815+0000","last_undegraded":"2023-12-07T10:00:55.374815+0000","last_fullsized":"2023-12-07T10:00:55.374815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374754+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:00:55.374754+0000","last_peered":"2023-12-07T10:00:55.374754+0000","last_clean":"2023-12-07T10:00:55.374754+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:00:55.374754+0000","last_undegraded":"2023-12-07T10:00:55.374754+0000","last_fullsized":"2023-12-07T10:00:55.374754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913034+0000","last_change":"2023-12-07T10:01:04.913034+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913034+0000","last_undegraded":"2023-12-07T10:01:04.913034+0000","last_fullsized":"2023-12-07T10:01:04.913034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375020+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:00:55.375020+0000","last_peered":"2023-12-07T10:00:55.375020+0000","last_clean":"2023-12-07T10:00:55.375020+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:00:55.375020+0000","last_undegraded":"2023-12-07T10:00:55.375020+0000","last_fullsized":"2023-12-07T10:00:55.375020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377354+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:00:55.377354+0000","last_peered":"2023-12-07T10:00:55.377354+0000","last_clean":"2023-12-07T10:00:55.377354+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:00:55.377354+0000","last_undegraded":"2023-12-07T10:00:55.377354+0000","last_fullsized":"2023-12-07T10:00:55.377354+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907675+0000","last_change":"2023-12-07T10:01:04.907675+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907675+0000","last_undegraded":"2023-12-07T10:01:04.907675+0000","last_fullsized":"2023-12-07T10:01:04.907675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377345+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:00:55.377345+0000","last_peered":"2023-12-07T10:00:55.377345+0000","last_clean":"2023-12-07T10:00:55.377345+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:00:55.377345+0000","last_undegraded":"2023-12-07T10:00:55.377345+0000","last_fullsized":"2023-12-07T10:00:55.377345+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380673+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:00:55.380673+0000","last_peered":"2023-12-07T10:00:55.380673+0000","last_clean":"2023-12-07T10:00:55.380673+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:00:55.380673+0000","last_undegraded":"2023-12-07T10:00:55.380673+0000","last_fullsized":"2023-12-07T10:00:55.380673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914961+0000","last_change":"2023-12-07T10:01:04.914961+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914961+0000","last_undegraded":"2023-12-07T10:01:04.914961+0000","last_fullsized":"2023-12-07T10:01:04.914961+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377283+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:00:55.377283+0000","last_peered":"2023-12-07T10:00:55.377283+0000","last_clean":"2023-12-07T10:00:55.377283+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:00:55.377283+0000","last_undegraded":"2023-12-07T10:00:55.377283+0000","last_fullsized":"2023-12-07T10:00:55.377283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377314+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:00:55.377314+0000","last_peered":"2023-12-07T10:00:55.377314+0000","last_clean":"2023-12-07T10:00:55.377314+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:00:55.377314+0000","last_undegraded":"2023-12-07T10:00:55.377314+0000","last_fullsized":"2023-12-07T10:00:55.377314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907007+0000","last_change":"2023-12-07T10:01:04.907007+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907007+0000","last_undegraded":"2023-12-07T10:01:04.907007+0000","last_fullsized":"2023-12-07T10:01:04.907007+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374956+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:00:55.374956+0000","last_peered":"2023-12-07T10:00:55.374956+0000","last_clean":"2023-12-07T10:00:55.374956+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:00:55.374956+0000","last_undegraded":"2023-12-07T10:00:55.374956+0000","last_fullsized":"2023-12-07T10:00:55.374956+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380618+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:00:55.380618+0000","last_peered":"2023-12-07T10:00:55.380618+0000","last_clean":"2023-12-07T10:00:55.380618+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:00:55.380618+0000","last_undegraded":"2023-12-07T10:00:55.380618+0000","last_fullsized":"2023-12-07T10:00:55.380618+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914140+0000","last_change":"2023-12-07T10:01:04.914140+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914140+0000","last_undegraded":"2023-12-07T10:01:04.914140+0000","last_fullsized":"2023-12-07T10:01:04.914140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377261+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:00:55.377261+0000","last_peered":"2023-12-07T10:00:55.377261+0000","last_clean":"2023-12-07T10:00:55.377261+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:00:55.377261+0000","last_undegraded":"2023-12-07T10:00:55.377261+0000","last_fullsized":"2023-12-07T10:00:55.377261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377261+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:00:55.377261+0000","last_peered":"2023-12-07T10:00:55.377261+0000","last_clean":"2023-12-07T10:00:55.377261+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:00:55.377261+0000","last_undegraded":"2023-12-07T10:00:55.377261+0000","last_fullsized":"2023-12-07T10:00:55.377261+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.915494+0000","last_change":"2023-12-07T10:01:04.915494+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.915494+0000","last_undegraded":"2023-12-07T10:01:04.915494+0000","last_fullsized":"2023-12-07T10:01:04.915494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380580+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:00:55.380580+0000","last_peered":"2023-12-07T10:00:55.380580+0000","last_clean":"2023-12-07T10:00:55.380580+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:00:55.380580+0000","last_undegraded":"2023-12-07T10:00:55.380580+0000","last_fullsized":"2023-12-07T10:00:55.380580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381003+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:00:55.381003+0000","last_peered":"2023-12-07T10:00:55.381003+0000","last_clean":"2023-12-07T10:00:55.381003+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:00:55.381003+0000","last_undegraded":"2023-12-07T10:00:55.381003+0000","last_fullsized":"2023-12-07T10:00:55.381003+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911714+0000","last_change":"2023-12-07T10:01:04.911714+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911714+0000","last_undegraded":"2023-12-07T10:01:04.911714+0000","last_fullsized":"2023-12-07T10:01:04.911714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380536+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:00:55.380536+0000","last_peered":"2023-12-07T10:00:55.380536+0000","last_clean":"2023-12-07T10:00:55.380536+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:00:55.380536+0000","last_undegraded":"2023-12-07T10:00:55.380536+0000","last_fullsized":"2023-12-07T10:00:55.380536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377210+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:00:55.377210+0000","last_peered":"2023-12-07T10:00:55.377210+0000","last_clean":"2023-12-07T10:00:55.377210+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:00:55.377210+0000","last_undegraded":"2023-12-07T10:00:55.377210+0000","last_fullsized":"2023-12-07T10:00:55.377210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912300+0000","last_change":"2023-12-07T10:01:04.912300+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912300+0000","last_undegraded":"2023-12-07T10:01:04.912300+0000","last_fullsized":"2023-12-07T10:01:04.912300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377335+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:00:55.377335+0000","last_peered":"2023-12-07T10:00:55.377335+0000","last_clean":"2023-12-07T10:00:55.377335+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:00:55.377335+0000","last_undegraded":"2023-12-07T10:00:55.377335+0000","last_fullsized":"2023-12-07T10:00:55.377335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381067+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:00:55.381067+0000","last_peered":"2023-12-07T10:00:55.381067+0000","last_clean":"2023-12-07T10:00:55.381067+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:00:55.381067+0000","last_undegraded":"2023-12-07T10:00:55.381067+0000","last_fullsized":"2023-12-07T10:00:55.381067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.915702+0000","last_change":"2023-12-07T10:01:04.915702+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.915702+0000","last_undegraded":"2023-12-07T10:01:04.915702+0000","last_fullsized":"2023-12-07T10:01:04.915702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377354+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:00:55.377354+0000","last_peered":"2023-12-07T10:00:55.377354+0000","last_clean":"2023-12-07T10:00:55.377354+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:00:55.377354+0000","last_undegraded":"2023-12-07T10:00:55.377354+0000","last_fullsized":"2023-12-07T10:00:55.377354+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"49'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:57.888682+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:00:57.888682+0000","last_peered":"2023-12-07T10:00:57.888682+0000","last_clean":"2023-12-07T10:00:57.888682+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:00:57.888682+0000","last_undegraded":"2023-12-07T10:00:57.888682+0000","last_fullsized":"2023-12-07T10:00:57.888682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914368+0000","last_change":"2023-12-07T10:01:04.914368+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914368+0000","last_undegraded":"2023-12-07T10:01:04.914368+0000","last_fullsized":"2023-12-07T10:01:04.914368+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381031+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:00:55.381031+0000","last_peered":"2023-12-07T10:00:55.381031+0000","last_clean":"2023-12-07T10:00:55.381031+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:00:55.381031+0000","last_undegraded":"2023-12-07T10:00:55.381031+0000","last_fullsized":"2023-12-07T10:00:55.381031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374656+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:00:55.374656+0000","last_peered":"2023-12-07T10:00:55.374656+0000","last_clean":"2023-12-07T10:00:55.374656+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:00:55.374656+0000","last_undegraded":"2023-12-07T10:00:55.374656+0000","last_fullsized":"2023-12-07T10:00:55.374656+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914376+0000","last_change":"2023-12-07T10:01:04.914376+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914376+0000","last_undegraded":"2023-12-07T10:01:04.914376+0000","last_fullsized":"2023-12-07T10:01:04.914376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380646+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:00:55.380646+0000","last_peered":"2023-12-07T10:00:55.380646+0000","last_clean":"2023-12-07T10:00:55.380646+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:00:55.380646+0000","last_undegraded":"2023-12-07T10:00:55.380646+0000","last_fullsized":"2023-12-07T10:00:55.380646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377304+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:00:55.377304+0000","last_peered":"2023-12-07T10:00:55.377304+0000","last_clean":"2023-12-07T10:00:55.377304+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:00:55.377304+0000","last_undegraded":"2023-12-07T10:00:55.377304+0000","last_fullsized":"2023-12-07T10:00:55.377304+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906505+0000","last_change":"2023-12-07T10:01:04.906505+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906505+0000","last_undegraded":"2023-12-07T10:01:04.906505+0000","last_fullsized":"2023-12-07T10:01:04.906505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377188+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:00:55.377188+0000","last_peered":"2023-12-07T10:00:55.377188+0000","last_clean":"2023-12-07T10:00:55.377188+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:00:55.377188+0000","last_undegraded":"2023-12-07T10:00:55.377188+0000","last_fullsized":"2023-12-07T10:00:55.377188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381012+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:00:55.381012+0000","last_peered":"2023-12-07T10:00:55.381012+0000","last_clean":"2023-12-07T10:00:55.381012+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:00:55.381012+0000","last_undegraded":"2023-12-07T10:00:55.381012+0000","last_fullsized":"2023-12-07T10:00:55.381012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911565+0000","last_change":"2023-12-07T10:01:04.911565+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911565+0000","last_undegraded":"2023-12-07T10:01:04.911565+0000","last_fullsized":"2023-12-07T10:01:04.911565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374894+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:00:55.374894+0000","last_peered":"2023-12-07T10:00:55.374894+0000","last_clean":"2023-12-07T10:00:55.374894+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:00:55.374894+0000","last_undegraded":"2023-12-07T10:00:55.374894+0000","last_fullsized":"2023-12-07T10:00:55.374894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374916+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:00:55.374916+0000","last_peered":"2023-12-07T10:00:55.374916+0000","last_clean":"2023-12-07T10:00:55.374916+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:00:55.374916+0000","last_undegraded":"2023-12-07T10:00:55.374916+0000","last_fullsized":"2023-12-07T10:00:55.374916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912141+0000","last_change":"2023-12-07T10:01:04.912141+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912141+0000","last_undegraded":"2023-12-07T10:01:04.912141+0000","last_fullsized":"2023-12-07T10:01:04.912141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380978+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:00:55.380978+0000","last_peered":"2023-12-07T10:00:55.380978+0000","last_clean":"2023-12-07T10:00:55.380978+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:00:55.380978+0000","last_undegraded":"2023-12-07T10:00:55.380978+0000","last_fullsized":"2023-12-07T10:00:55.380978+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380993+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:00:55.380993+0000","last_peered":"2023-12-07T10:00:55.380993+0000","last_clean":"2023-12-07T10:00:55.380993+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:00:55.380993+0000","last_undegraded":"2023-12-07T10:00:55.380993+0000","last_fullsized":"2023-12-07T10:00:55.380993+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909124+0000","last_change":"2023-12-07T10:01:04.909124+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909124+0000","last_undegraded":"2023-12-07T10:01:04.909124+0000","last_fullsized":"2023-12-07T10:01:04.909124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377136+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:00:55.377136+0000","last_peered":"2023-12-07T10:00:55.377136+0000","last_clean":"2023-12-07T10:00:55.377136+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:00:55.377136+0000","last_undegraded":"2023-12-07T10:00:55.377136+0000","last_fullsized":"2023-12-07T10:00:55.377136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377117+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:00:55.377117+0000","last_peered":"2023-12-07T10:00:55.377117+0000","last_clean":"2023-12-07T10:00:55.377117+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:00:55.377117+0000","last_undegraded":"2023-12-07T10:00:55.377117+0000","last_fullsized":"2023-12-07T10:00:55.377117+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911657+0000","last_change":"2023-12-07T10:01:04.911657+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911657+0000","last_undegraded":"2023-12-07T10:01:04.911657+0000","last_fullsized":"2023-12-07T10:01:04.911657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377104+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:00:55.377104+0000","last_peered":"2023-12-07T10:00:55.377104+0000","last_clean":"2023-12-07T10:00:55.377104+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:00:55.377104+0000","last_undegraded":"2023-12-07T10:00:55.377104+0000","last_fullsized":"2023-12-07T10:00:55.377104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374627+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:00:55.374627+0000","last_peered":"2023-12-07T10:00:55.374627+0000","last_clean":"2023-12-07T10:00:55.374627+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:00:55.374627+0000","last_undegraded":"2023-12-07T10:00:55.374627+0000","last_fullsized":"2023-12-07T10:00:55.374627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-07T10:01:04.906782+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:04.906782+0000","last_peered":"2023-12-07T10:01:04.906782+0000","last_clean":"2023-12-07T10:01:04.906782+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:04.906782+0000","last_undegraded":"2023-12-07T10:01:04.906782+0000","last_fullsized":"2023-12-07T10:01:04.906782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":837046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.505}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.55600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.442},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.622},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.5}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":247170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":256296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.62}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.85599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.432}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":246608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":847246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.378}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.624},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.499},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:11.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.580+0000 7fcd17454640 1 Processor -- start 2023-12-07T10:01:11.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.580+0000 7fcd17454640 1 -- start start 2023-12-07T10:01:11.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd17454640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd100ca610 0x7fcd100c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd17454640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100bd720 0x7fcd100c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd17454640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcd1006cd90 0x7fcd10158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd17454640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd10155790 con 0x7fcd100ca610 2023-12-07T10:01:11.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd17454640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd100c4b00 con 0x7fcd1006cd90 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd17454640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100c4de0 con 0x7fcd100bd720 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd100ca610 0x7fcd100c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd100ca610 0x7fcd100c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41616/0 (socket says 172.21.15.89:41616) 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 -- 172.21.15.89:0/3294794803 learned_addr learned my addr 172.21.15.89:0/3294794803 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd159f1640 1 --2- 172.21.15.89:0/3294794803 >> v2:172.21.15.97:3300/0 conn(0x7fcd1006cd90 0x7fcd10158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd149ef640 1 --2- 172.21.15.89:0/3294794803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100bd720 0x7fcd100c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 -- 172.21.15.89:0/3294794803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100bd720 msgr2=0x7fcd100c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 --2- 172.21.15.89:0/3294794803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100bd720 0x7fcd100c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 -- 172.21.15.89:0/3294794803 >> v2:172.21.15.97:3300/0 conn(0x7fcd1006cd90 msgr2=0x7fcd10158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 --2- 172.21.15.89:0/3294794803 >> v2:172.21.15.97:3300/0 conn(0x7fcd1006cd90 0x7fcd10158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 -- 172.21.15.89:0/3294794803 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10157e30 con 0x7fcd100ca610 2023-12-07T10:01:11.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.584+0000 7fcd151f0640 1 --2- 172.21.15.89:0/3294794803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100ca610 0x7fcd100c94c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcd10152370 tx=0x7fcd0c01c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f202e24d6f7aaf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd07fff640 1 -- 172.21.15.89:0/3294794803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100c52d0 con 0x7fcd100ca610 2023-12-07T10:01:11.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd07fff640 1 -- 172.21.15.89:0/3294794803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0a4880 con 0x7fcd100ca610 2023-12-07T10:01:11.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd07fff640 1 -- 172.21.15.89:0/3294794803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0a4c10 con 0x7fcd100ca610 2023-12-07T10:01:11.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- 172.21.15.89:0/3294794803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100ca610 msgr2=0x7fcd100c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- 172.21.15.89:0/3294794803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100ca610 0x7fcd100c94c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcd10152370 tx=0x7fcd0c01c0c0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- 172.21.15.89:0/3294794803 shutdown_connections 2023-12-07T10:01:11.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- 172.21.15.89:0/3294794803 >> v2:172.21.15.97:3300/0 conn(0x7fcd1006cd90 0x7fcd10158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- 172.21.15.89:0/3294794803 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100bd720 0x7fcd100c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- 172.21.15.89:0/3294794803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100ca610 0x7fcd100c94c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- 172.21.15.89:0/3294794803 >> 172.21.15.89:0/3294794803 conn(0x7fcd10071ea0 msgr2=0x7fcd100722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- 172.21.15.89:0/3294794803 shutdown_connections 2023-12-07T10:01:11.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- 172.21.15.89:0/3294794803 wait complete. 2023-12-07T10:01:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 Processor -- start 2023-12-07T10:01:11.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- start start 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd1006cd90 0x7fcd1014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 0x7fcd100abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100ca610 0x7fcd101ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100c0150 con 0x7fcd100bd720 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd101f2550 con 0x7fcd1006cd90 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd17454640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd101512e0 con 0x7fcd100ca610 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd149ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 0x7fcd100abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd149ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 0x7fcd100abce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41628/0 (socket says 172.21.15.89:41628) 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd149ef640 1 -- 172.21.15.89:0/2906095563 learned_addr learned my addr 172.21.15.89:0/2906095563 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:11.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd159f1640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100ca610 0x7fcd101ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.588+0000 7fcd151f0640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd1006cd90 0x7fcd1014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd149ef640 1 -- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100ca610 msgr2=0x7fcd101ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd149ef640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100ca610 0x7fcd101ee660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd149ef640 1 -- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd1006cd90 msgr2=0x7fcd1014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd149ef640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd1006cd90 0x7fcd1014d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd149ef640 1 -- 172.21.15.89:0/2906095563 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0094d0 con 0x7fcd100bd720 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd151f0640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd1006cd90 0x7fcd1014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd159f1640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100ca610 0x7fcd101ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd149ef640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 0x7fcd100abce0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000d800 tx=0x7fcd0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000b6c0 con 0x7fcd100bd720 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000b820 con 0x7fcd100bd720 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd101515c0 con 0x7fcd100bd720 2023-12-07T10:01:11.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000bb90 con 0x7fcd100bd720 2023-12-07T10:01:11.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd100ac220 con 0x7fcd100bd720 2023-12-07T10:01:11.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1004e890 con 0x7fcd100bd720 2023-12-07T10:01:11.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcd0000bcf0 con 0x7fcd100bd720 2023-12-07T10:01:11.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd05ffb640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fccf40668d0 0x7fccf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd00084d00 con 0x7fcd100bd720 2023-12-07T10:01:11.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.592+0000 7fcd151f0640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fccf40668d0 0x7fccf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.596+0000 7fcd151f0640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fccf40668d0 0x7fccf4068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0ae000 tx=0x7fcd0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.596+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd00051c10 con 0x7fcd100bd720 2023-12-07T10:01:11.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.744+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd10151450 con 0x7fccf40668d0 2023-12-07T10:01:11.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.756+0000 7fcd05ffb640 1 -- 172.21.15.89:0/2906095563 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+515523 (secure 0 0 0) 0x7fcd10151450 con 0x7fccf40668d0 2023-12-07T10:01:11.767 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fccf40668d0 msgr2=0x7fccf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fccf40668d0 0x7fccf4068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0ae000 tx=0x7fcd0c008040 comp rx=0 tx=0).stop 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 msgr2=0x7fcd100abce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 0x7fcd100abce0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000d800 tx=0x7fcd0000dcc0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 shutdown_connections 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fccf40668d0 0x7fccf4068d90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcd100ca610 0x7fcd101ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd100bd720 0x7fcd100abce0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 --2- 172.21.15.89:0/2906095563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd1006cd90 0x7fcd1014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 >> 172.21.15.89:0/2906095563 conn(0x7fcd10071ea0 msgr2=0x7fcd10072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 shutdown_connections 2023-12-07T10:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.760+0000 7fcd17454640 1 -- 172.21.15.89:0/2906095563 wait complete. 2023-12-07T10:01:11.786 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-12-07T10:01:10.364662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226196,"kb_used_data":5824,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748524,"statfs":{"total":773094113280,"available":772862488576,"internally_reserved":0,"allocated":5963776,"data_stored":3174032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460979"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374674+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:00:55.374674+0000","last_peered":"2023-12-07T10:00:55.374674+0000","last_clean":"2023-12-07T10:00:55.374674+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:00:55.374674+0000","last_undegraded":"2023-12-07T10:00:55.374674+0000","last_fullsized":"2023-12-07T10:00:55.374674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377313+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:00:55.377313+0000","last_peered":"2023-12-07T10:00:55.377313+0000","last_clean":"2023-12-07T10:00:55.377313+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:00:55.377313+0000","last_undegraded":"2023-12-07T10:00:55.377313+0000","last_fullsized":"2023-12-07T10:00:55.377313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374913+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:00:55.374913+0000","last_peered":"2023-12-07T10:00:55.374913+0000","last_clean":"2023-12-07T10:00:55.374913+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:00:55.374913+0000","last_undegraded":"2023-12-07T10:00:55.374913+0000","last_fullsized":"2023-12-07T10:00:55.374913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377273+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:00:55.377273+0000","last_peered":"2023-12-07T10:00:55.377273+0000","last_clean":"2023-12-07T10:00:55.377273+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:00:55.377273+0000","last_undegraded":"2023-12-07T10:00:55.377273+0000","last_fullsized":"2023-12-07T10:00:55.377273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374624+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:00:55.374624+0000","last_peered":"2023-12-07T10:00:55.374624+0000","last_clean":"2023-12-07T10:00:55.374624+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:00:55.374624+0000","last_undegraded":"2023-12-07T10:00:55.374624+0000","last_fullsized":"2023-12-07T10:00:55.374624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380545+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:00:55.380545+0000","last_peered":"2023-12-07T10:00:55.380545+0000","last_clean":"2023-12-07T10:00:55.380545+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:00:55.380545+0000","last_undegraded":"2023-12-07T10:00:55.380545+0000","last_fullsized":"2023-12-07T10:00:55.380545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374856+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:00:55.374856+0000","last_peered":"2023-12-07T10:00:55.374856+0000","last_clean":"2023-12-07T10:00:55.374856+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:00:55.374856+0000","last_undegraded":"2023-12-07T10:00:55.374856+0000","last_fullsized":"2023-12-07T10:00:55.374856+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377081+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:00:55.377081+0000","last_peered":"2023-12-07T10:00:55.377081+0000","last_clean":"2023-12-07T10:00:55.377081+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:00:55.377081+0000","last_undegraded":"2023-12-07T10:00:55.377081+0000","last_fullsized":"2023-12-07T10:00:55.377081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375003+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:00:55.375003+0000","last_peered":"2023-12-07T10:00:55.375003+0000","last_clean":"2023-12-07T10:00:55.375003+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:00:55.375003+0000","last_undegraded":"2023-12-07T10:00:55.375003+0000","last_fullsized":"2023-12-07T10:00:55.375003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381048+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:00:55.381048+0000","last_peered":"2023-12-07T10:00:55.381048+0000","last_clean":"2023-12-07T10:00:55.381048+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:00:55.381048+0000","last_undegraded":"2023-12-07T10:00:55.381048+0000","last_fullsized":"2023-12-07T10:00:55.381048+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381040+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:00:55.381040+0000","last_peered":"2023-12-07T10:00:55.381040+0000","last_clean":"2023-12-07T10:00:55.381040+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:00:55.381040+0000","last_undegraded":"2023-12-07T10:00:55.381040+0000","last_fullsized":"2023-12-07T10:00:55.381040+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377283+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:00:55.377283+0000","last_peered":"2023-12-07T10:00:55.377283+0000","last_clean":"2023-12-07T10:00:55.377283+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:00:55.377283+0000","last_undegraded":"2023-12-07T10:00:55.377283+0000","last_fullsized":"2023-12-07T10:00:55.377283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374647+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:00:55.374647+0000","last_peered":"2023-12-07T10:00:55.374647+0000","last_clean":"2023-12-07T10:00:55.374647+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:00:55.374647+0000","last_undegraded":"2023-12-07T10:00:55.374647+0000","last_fullsized":"2023-12-07T10:00:55.374647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374895+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:00:55.374895+0000","last_peered":"2023-12-07T10:00:55.374895+0000","last_clean":"2023-12-07T10:00:55.374895+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:00:55.374895+0000","last_undegraded":"2023-12-07T10:00:55.374895+0000","last_fullsized":"2023-12-07T10:00:55.374895+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374877+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:00:55.374877+0000","last_peered":"2023-12-07T10:00:55.374877+0000","last_clean":"2023-12-07T10:00:55.374877+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:00:55.374877+0000","last_undegraded":"2023-12-07T10:00:55.374877+0000","last_fullsized":"2023-12-07T10:00:55.374877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380512+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:00:55.380512+0000","last_peered":"2023-12-07T10:00:55.380512+0000","last_clean":"2023-12-07T10:00:55.380512+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:00:55.380512+0000","last_undegraded":"2023-12-07T10:00:55.380512+0000","last_fullsized":"2023-12-07T10:00:55.380512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377344+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:00:55.377344+0000","last_peered":"2023-12-07T10:00:55.377344+0000","last_clean":"2023-12-07T10:00:55.377344+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:00:55.377344+0000","last_undegraded":"2023-12-07T10:00:55.377344+0000","last_fullsized":"2023-12-07T10:00:55.377344+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374997+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:00:55.374997+0000","last_peered":"2023-12-07T10:00:55.374997+0000","last_clean":"2023-12-07T10:00:55.374997+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:00:55.374997+0000","last_undegraded":"2023-12-07T10:00:55.374997+0000","last_fullsized":"2023-12-07T10:00:55.374997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374658+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:00:55.374658+0000","last_peered":"2023-12-07T10:00:55.374658+0000","last_clean":"2023-12-07T10:00:55.374658+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:00:55.374658+0000","last_undegraded":"2023-12-07T10:00:55.374658+0000","last_fullsized":"2023-12-07T10:00:55.374658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377274+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:55.377274+0000","last_peered":"2023-12-07T10:00:55.377274+0000","last_clean":"2023-12-07T10:00:55.377274+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:00:55.377274+0000","last_undegraded":"2023-12-07T10:00:55.377274+0000","last_fullsized":"2023-12-07T10:00:55.377274+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374856+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:00:55.374856+0000","last_peered":"2023-12-07T10:00:55.374856+0000","last_clean":"2023-12-07T10:00:55.374856+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:00:55.374856+0000","last_undegraded":"2023-12-07T10:00:55.374856+0000","last_fullsized":"2023-12-07T10:00:55.374856+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377152+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:00:55.377152+0000","last_peered":"2023-12-07T10:00:55.377152+0000","last_clean":"2023-12-07T10:00:55.377152+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:00:55.377152+0000","last_undegraded":"2023-12-07T10:00:55.377152+0000","last_fullsized":"2023-12-07T10:00:55.377152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374789+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:00:55.374789+0000","last_peered":"2023-12-07T10:00:55.374789+0000","last_clean":"2023-12-07T10:00:55.374789+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:00:55.374789+0000","last_undegraded":"2023-12-07T10:00:55.374789+0000","last_fullsized":"2023-12-07T10:00:55.374789+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374602+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:00:55.374602+0000","last_peered":"2023-12-07T10:00:55.374602+0000","last_clean":"2023-12-07T10:00:55.374602+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:00:55.374602+0000","last_undegraded":"2023-12-07T10:00:55.374602+0000","last_fullsized":"2023-12-07T10:00:55.374602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374683+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:00:55.374683+0000","last_peered":"2023-12-07T10:00:55.374683+0000","last_clean":"2023-12-07T10:00:55.374683+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:00:55.374683+0000","last_undegraded":"2023-12-07T10:00:55.374683+0000","last_fullsized":"2023-12-07T10:00:55.374683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377324+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:00:55.377324+0000","last_peered":"2023-12-07T10:00:55.377324+0000","last_clean":"2023-12-07T10:00:55.377324+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:00:55.377324+0000","last_undegraded":"2023-12-07T10:00:55.377324+0000","last_fullsized":"2023-12-07T10:00:55.377324+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380627+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:00:55.380627+0000","last_peered":"2023-12-07T10:00:55.380627+0000","last_clean":"2023-12-07T10:00:55.380627+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:00:55.380627+0000","last_undegraded":"2023-12-07T10:00:55.380627+0000","last_fullsized":"2023-12-07T10:00:55.380627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374641+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:00:55.374641+0000","last_peered":"2023-12-07T10:00:55.374641+0000","last_clean":"2023-12-07T10:00:55.374641+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:00:55.374641+0000","last_undegraded":"2023-12-07T10:00:55.374641+0000","last_fullsized":"2023-12-07T10:00:55.374641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377241+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:00:55.377241+0000","last_peered":"2023-12-07T10:00:55.377241+0000","last_clean":"2023-12-07T10:00:55.377241+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:00:55.377241+0000","last_undegraded":"2023-12-07T10:00:55.377241+0000","last_fullsized":"2023-12-07T10:00:55.377241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374837+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:00:55.374837+0000","last_peered":"2023-12-07T10:00:55.374837+0000","last_clean":"2023-12-07T10:00:55.374837+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:00:55.374837+0000","last_undegraded":"2023-12-07T10:00:55.374837+0000","last_fullsized":"2023-12-07T10:00:55.374837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374599+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:00:55.374599+0000","last_peered":"2023-12-07T10:00:55.374599+0000","last_clean":"2023-12-07T10:00:55.374599+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:00:55.374599+0000","last_undegraded":"2023-12-07T10:00:55.374599+0000","last_fullsized":"2023-12-07T10:00:55.374599+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380527+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:00:55.380527+0000","last_peered":"2023-12-07T10:00:55.380527+0000","last_clean":"2023-12-07T10:00:55.380527+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:00:55.380527+0000","last_undegraded":"2023-12-07T10:00:55.380527+0000","last_fullsized":"2023-12-07T10:00:55.380527+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907098+0000","last_change":"2023-12-07T10:01:04.907098+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907098+0000","last_undegraded":"2023-12-07T10:01:04.907098+0000","last_fullsized":"2023-12-07T10:01:04.907098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380664+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:00:55.380664+0000","last_peered":"2023-12-07T10:00:55.380664+0000","last_clean":"2023-12-07T10:00:55.380664+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:00:55.380664+0000","last_undegraded":"2023-12-07T10:00:55.380664+0000","last_fullsized":"2023-12-07T10:00:55.380664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380690+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:00:55.380690+0000","last_peered":"2023-12-07T10:00:55.380690+0000","last_clean":"2023-12-07T10:00:55.380690+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:00:55.380690+0000","last_undegraded":"2023-12-07T10:00:55.380690+0000","last_fullsized":"2023-12-07T10:00:55.380690+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912983+0000","last_change":"2023-12-07T10:01:04.912983+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912983+0000","last_undegraded":"2023-12-07T10:01:04.912983+0000","last_fullsized":"2023-12-07T10:01:04.912983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381057+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:00:55.381057+0000","last_peered":"2023-12-07T10:00:55.381057+0000","last_clean":"2023-12-07T10:00:55.381057+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:00:55.381057+0000","last_undegraded":"2023-12-07T10:00:55.381057+0000","last_fullsized":"2023-12-07T10:00:55.381057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377324+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:00:55.377324+0000","last_peered":"2023-12-07T10:00:55.377324+0000","last_clean":"2023-12-07T10:00:55.377324+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:00:55.377324+0000","last_undegraded":"2023-12-07T10:00:55.377324+0000","last_fullsized":"2023-12-07T10:00:55.377324+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906747+0000","last_change":"2023-12-07T10:01:04.906747+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906747+0000","last_undegraded":"2023-12-07T10:01:04.906747+0000","last_fullsized":"2023-12-07T10:01:04.906747+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380599+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:00:55.380599+0000","last_peered":"2023-12-07T10:00:55.380599+0000","last_clean":"2023-12-07T10:00:55.380599+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:00:55.380599+0000","last_undegraded":"2023-12-07T10:00:55.380599+0000","last_fullsized":"2023-12-07T10:00:55.380599+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380654+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:00:55.380654+0000","last_peered":"2023-12-07T10:00:55.380654+0000","last_clean":"2023-12-07T10:00:55.380654+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:00:55.380654+0000","last_undegraded":"2023-12-07T10:00:55.380654+0000","last_fullsized":"2023-12-07T10:00:55.380654+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.917938+0000","last_change":"2023-12-07T10:01:04.917938+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.917938+0000","last_undegraded":"2023-12-07T10:01:04.917938+0000","last_fullsized":"2023-12-07T10:01:04.917938+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380638+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:00:55.380638+0000","last_peered":"2023-12-07T10:00:55.380638+0000","last_clean":"2023-12-07T10:00:55.380638+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:00:55.380638+0000","last_undegraded":"2023-12-07T10:00:55.380638+0000","last_fullsized":"2023-12-07T10:00:55.380638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377293+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:00:55.377293+0000","last_peered":"2023-12-07T10:00:55.377293+0000","last_clean":"2023-12-07T10:00:55.377293+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:00:55.377293+0000","last_undegraded":"2023-12-07T10:00:55.377293+0000","last_fullsized":"2023-12-07T10:00:55.377293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.908994+0000","last_change":"2023-12-07T10:01:04.908994+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.908994+0000","last_undegraded":"2023-12-07T10:01:04.908994+0000","last_fullsized":"2023-12-07T10:01:04.908994+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377170+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:00:55.377170+0000","last_peered":"2023-12-07T10:00:55.377170+0000","last_clean":"2023-12-07T10:00:55.377170+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:00:55.377170+0000","last_undegraded":"2023-12-07T10:00:55.377170+0000","last_fullsized":"2023-12-07T10:00:55.377170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374938+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:00:55.374938+0000","last_peered":"2023-12-07T10:00:55.374938+0000","last_clean":"2023-12-07T10:00:55.374938+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:00:55.374938+0000","last_undegraded":"2023-12-07T10:00:55.374938+0000","last_fullsized":"2023-12-07T10:00:55.374938+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912170+0000","last_change":"2023-12-07T10:01:04.912170+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912170+0000","last_undegraded":"2023-12-07T10:01:04.912170+0000","last_fullsized":"2023-12-07T10:01:04.912170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377204+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:00:55.377204+0000","last_peered":"2023-12-07T10:00:55.377204+0000","last_clean":"2023-12-07T10:00:55.377204+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:00:55.377204+0000","last_undegraded":"2023-12-07T10:00:55.377204+0000","last_fullsized":"2023-12-07T10:00:55.377204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380559+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:00:55.380559+0000","last_peered":"2023-12-07T10:00:55.380559+0000","last_clean":"2023-12-07T10:00:55.380559+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:00:55.380559+0000","last_undegraded":"2023-12-07T10:00:55.380559+0000","last_fullsized":"2023-12-07T10:00:55.380559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909871+0000","last_change":"2023-12-07T10:01:04.909871+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909871+0000","last_undegraded":"2023-12-07T10:01:04.909871+0000","last_fullsized":"2023-12-07T10:01:04.909871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374617+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:00:55.374617+0000","last_peered":"2023-12-07T10:00:55.374617+0000","last_clean":"2023-12-07T10:00:55.374617+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:00:55.374617+0000","last_undegraded":"2023-12-07T10:00:55.374617+0000","last_fullsized":"2023-12-07T10:00:55.374617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377229+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:00:55.377229+0000","last_peered":"2023-12-07T10:00:55.377229+0000","last_clean":"2023-12-07T10:00:55.377229+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:00:55.377229+0000","last_undegraded":"2023-12-07T10:00:55.377229+0000","last_fullsized":"2023-12-07T10:00:55.377229+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912603+0000","last_change":"2023-12-07T10:01:04.912603+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912603+0000","last_undegraded":"2023-12-07T10:01:04.912603+0000","last_fullsized":"2023-12-07T10:01:04.912603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377127+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:00:55.377127+0000","last_peered":"2023-12-07T10:00:55.377127+0000","last_clean":"2023-12-07T10:00:55.377127+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:00:55.377127+0000","last_undegraded":"2023-12-07T10:00:55.377127+0000","last_fullsized":"2023-12-07T10:00:55.377127+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374835+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:00:55.374835+0000","last_peered":"2023-12-07T10:00:55.374835+0000","last_clean":"2023-12-07T10:00:55.374835+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:00:55.374835+0000","last_undegraded":"2023-12-07T10:00:55.374835+0000","last_fullsized":"2023-12-07T10:00:55.374835+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.910314+0000","last_change":"2023-12-07T10:01:04.910314+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.910314+0000","last_undegraded":"2023-12-07T10:01:04.910314+0000","last_fullsized":"2023-12-07T10:01:04.910314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374982+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:00:55.374982+0000","last_peered":"2023-12-07T10:00:55.374982+0000","last_clean":"2023-12-07T10:00:55.374982+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:00:55.374982+0000","last_undegraded":"2023-12-07T10:00:55.374982+0000","last_fullsized":"2023-12-07T10:00:55.374982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375062+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:00:55.375062+0000","last_peered":"2023-12-07T10:00:55.375062+0000","last_clean":"2023-12-07T10:00:55.375062+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:00:55.375062+0000","last_undegraded":"2023-12-07T10:00:55.375062+0000","last_fullsized":"2023-12-07T10:00:55.375062+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909012+0000","last_change":"2023-12-07T10:01:04.909012+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909012+0000","last_undegraded":"2023-12-07T10:01:04.909012+0000","last_fullsized":"2023-12-07T10:01:04.909012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375041+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:00:55.375041+0000","last_peered":"2023-12-07T10:00:55.375041+0000","last_clean":"2023-12-07T10:00:55.375041+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:00:55.375041+0000","last_undegraded":"2023-12-07T10:00:55.375041+0000","last_fullsized":"2023-12-07T10:00:55.375041+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377333+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:00:55.377333+0000","last_peered":"2023-12-07T10:00:55.377333+0000","last_clean":"2023-12-07T10:00:55.377333+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:00:55.377333+0000","last_undegraded":"2023-12-07T10:00:55.377333+0000","last_fullsized":"2023-12-07T10:00:55.377333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907569+0000","last_change":"2023-12-07T10:01:04.907569+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907569+0000","last_undegraded":"2023-12-07T10:01:04.907569+0000","last_fullsized":"2023-12-07T10:01:04.907569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381021+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:00:55.381021+0000","last_peered":"2023-12-07T10:00:55.381021+0000","last_clean":"2023-12-07T10:00:55.381021+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:00:55.381021+0000","last_undegraded":"2023-12-07T10:00:55.381021+0000","last_fullsized":"2023-12-07T10:00:55.381021+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374975+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:00:55.374975+0000","last_peered":"2023-12-07T10:00:55.374975+0000","last_clean":"2023-12-07T10:00:55.374975+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:00:55.374975+0000","last_undegraded":"2023-12-07T10:00:55.374975+0000","last_fullsized":"2023-12-07T10:00:55.374975+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913689+0000","last_change":"2023-12-07T10:01:04.913689+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913689+0000","last_undegraded":"2023-12-07T10:01:04.913689+0000","last_fullsized":"2023-12-07T10:01:04.913689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374933+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:00:55.374933+0000","last_peered":"2023-12-07T10:00:55.374933+0000","last_clean":"2023-12-07T10:00:55.374933+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:00:55.374933+0000","last_undegraded":"2023-12-07T10:00:55.374933+0000","last_fullsized":"2023-12-07T10:00:55.374933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:01:01.631697+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:01:01.631697+0000","last_peered":"2023-12-07T10:01:01.631697+0000","last_clean":"2023-12-07T10:01:01.631697+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:01:01.631697+0000","last_undegraded":"2023-12-07T10:01:01.631697+0000","last_fullsized":"2023-12-07T10:01:01.631697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913550+0000","last_change":"2023-12-07T10:01:04.913550+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913550+0000","last_undegraded":"2023-12-07T10:01:04.913550+0000","last_fullsized":"2023-12-07T10:01:04.913550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377249+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:00:55.377249+0000","last_peered":"2023-12-07T10:00:55.377249+0000","last_clean":"2023-12-07T10:00:55.377249+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:00:55.377249+0000","last_undegraded":"2023-12-07T10:00:55.377249+0000","last_fullsized":"2023-12-07T10:00:55.377249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377222+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:00:55.377222+0000","last_peered":"2023-12-07T10:00:55.377222+0000","last_clean":"2023-12-07T10:00:55.377222+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:00:55.377222+0000","last_undegraded":"2023-12-07T10:00:55.377222+0000","last_fullsized":"2023-12-07T10:00:55.377222+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906496+0000","last_change":"2023-12-07T10:01:04.906496+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906496+0000","last_undegraded":"2023-12-07T10:01:04.906496+0000","last_fullsized":"2023-12-07T10:01:04.906496+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374873+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:00:55.374873+0000","last_peered":"2023-12-07T10:00:55.374873+0000","last_clean":"2023-12-07T10:00:55.374873+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:00:55.374873+0000","last_undegraded":"2023-12-07T10:00:55.374873+0000","last_fullsized":"2023-12-07T10:00:55.374873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374637+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:00:55.374637+0000","last_peered":"2023-12-07T10:00:55.374637+0000","last_clean":"2023-12-07T10:00:55.374637+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:00:55.374637+0000","last_undegraded":"2023-12-07T10:00:55.374637+0000","last_fullsized":"2023-12-07T10:00:55.374637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.908993+0000","last_change":"2023-12-07T10:01:04.908993+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.908993+0000","last_undegraded":"2023-12-07T10:01:04.908993+0000","last_fullsized":"2023-12-07T10:01:04.908993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374811+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:00:55.374811+0000","last_peered":"2023-12-07T10:00:55.374811+0000","last_clean":"2023-12-07T10:00:55.374811+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:00:55.374811+0000","last_undegraded":"2023-12-07T10:00:55.374811+0000","last_fullsized":"2023-12-07T10:00:55.374811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377240+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:00:55.377240+0000","last_peered":"2023-12-07T10:00:55.377240+0000","last_clean":"2023-12-07T10:00:55.377240+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:00:55.377240+0000","last_undegraded":"2023-12-07T10:00:55.377240+0000","last_fullsized":"2023-12-07T10:00:55.377240+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912237+0000","last_change":"2023-12-07T10:01:04.912237+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912237+0000","last_undegraded":"2023-12-07T10:01:04.912237+0000","last_fullsized":"2023-12-07T10:01:04.912237+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374815+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:00:55.374815+0000","last_peered":"2023-12-07T10:00:55.374815+0000","last_clean":"2023-12-07T10:00:55.374815+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:00:55.374815+0000","last_undegraded":"2023-12-07T10:00:55.374815+0000","last_fullsized":"2023-12-07T10:00:55.374815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374754+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:00:55.374754+0000","last_peered":"2023-12-07T10:00:55.374754+0000","last_clean":"2023-12-07T10:00:55.374754+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:00:55.374754+0000","last_undegraded":"2023-12-07T10:00:55.374754+0000","last_fullsized":"2023-12-07T10:00:55.374754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.913034+0000","last_change":"2023-12-07T10:01:04.913034+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.913034+0000","last_undegraded":"2023-12-07T10:01:04.913034+0000","last_fullsized":"2023-12-07T10:01:04.913034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.375020+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:00:55.375020+0000","last_peered":"2023-12-07T10:00:55.375020+0000","last_clean":"2023-12-07T10:00:55.375020+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:00:55.375020+0000","last_undegraded":"2023-12-07T10:00:55.375020+0000","last_fullsized":"2023-12-07T10:00:55.375020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377354+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:00:55.377354+0000","last_peered":"2023-12-07T10:00:55.377354+0000","last_clean":"2023-12-07T10:00:55.377354+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:00:55.377354+0000","last_undegraded":"2023-12-07T10:00:55.377354+0000","last_fullsized":"2023-12-07T10:00:55.377354+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907675+0000","last_change":"2023-12-07T10:01:04.907675+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907675+0000","last_undegraded":"2023-12-07T10:01:04.907675+0000","last_fullsized":"2023-12-07T10:01:04.907675+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377345+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:00:55.377345+0000","last_peered":"2023-12-07T10:00:55.377345+0000","last_clean":"2023-12-07T10:00:55.377345+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:00:55.377345+0000","last_undegraded":"2023-12-07T10:00:55.377345+0000","last_fullsized":"2023-12-07T10:00:55.377345+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380673+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:00:55.380673+0000","last_peered":"2023-12-07T10:00:55.380673+0000","last_clean":"2023-12-07T10:00:55.380673+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:00:55.380673+0000","last_undegraded":"2023-12-07T10:00:55.380673+0000","last_fullsized":"2023-12-07T10:00:55.380673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914961+0000","last_change":"2023-12-07T10:01:04.914961+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914961+0000","last_undegraded":"2023-12-07T10:01:04.914961+0000","last_fullsized":"2023-12-07T10:01:04.914961+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377283+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:00:55.377283+0000","last_peered":"2023-12-07T10:00:55.377283+0000","last_clean":"2023-12-07T10:00:55.377283+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:00:55.377283+0000","last_undegraded":"2023-12-07T10:00:55.377283+0000","last_fullsized":"2023-12-07T10:00:55.377283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377314+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:00:55.377314+0000","last_peered":"2023-12-07T10:00:55.377314+0000","last_clean":"2023-12-07T10:00:55.377314+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:00:55.377314+0000","last_undegraded":"2023-12-07T10:00:55.377314+0000","last_fullsized":"2023-12-07T10:00:55.377314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.907007+0000","last_change":"2023-12-07T10:01:04.907007+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.907007+0000","last_undegraded":"2023-12-07T10:01:04.907007+0000","last_fullsized":"2023-12-07T10:01:04.907007+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374956+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:00:55.374956+0000","last_peered":"2023-12-07T10:00:55.374956+0000","last_clean":"2023-12-07T10:00:55.374956+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:00:55.374956+0000","last_undegraded":"2023-12-07T10:00:55.374956+0000","last_fullsized":"2023-12-07T10:00:55.374956+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380618+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:00:55.380618+0000","last_peered":"2023-12-07T10:00:55.380618+0000","last_clean":"2023-12-07T10:00:55.380618+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:00:55.380618+0000","last_undegraded":"2023-12-07T10:00:55.380618+0000","last_fullsized":"2023-12-07T10:00:55.380618+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914140+0000","last_change":"2023-12-07T10:01:04.914140+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914140+0000","last_undegraded":"2023-12-07T10:01:04.914140+0000","last_fullsized":"2023-12-07T10:01:04.914140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377261+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:00:55.377261+0000","last_peered":"2023-12-07T10:00:55.377261+0000","last_clean":"2023-12-07T10:00:55.377261+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:00:55.377261+0000","last_undegraded":"2023-12-07T10:00:55.377261+0000","last_fullsized":"2023-12-07T10:00:55.377261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377261+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:00:55.377261+0000","last_peered":"2023-12-07T10:00:55.377261+0000","last_clean":"2023-12-07T10:00:55.377261+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:00:55.377261+0000","last_undegraded":"2023-12-07T10:00:55.377261+0000","last_fullsized":"2023-12-07T10:00:55.377261+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.915494+0000","last_change":"2023-12-07T10:01:04.915494+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.915494+0000","last_undegraded":"2023-12-07T10:01:04.915494+0000","last_fullsized":"2023-12-07T10:01:04.915494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380580+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:00:55.380580+0000","last_peered":"2023-12-07T10:00:55.380580+0000","last_clean":"2023-12-07T10:00:55.380580+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:00:55.380580+0000","last_undegraded":"2023-12-07T10:00:55.380580+0000","last_fullsized":"2023-12-07T10:00:55.380580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381003+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:00:55.381003+0000","last_peered":"2023-12-07T10:00:55.381003+0000","last_clean":"2023-12-07T10:00:55.381003+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:00:55.381003+0000","last_undegraded":"2023-12-07T10:00:55.381003+0000","last_fullsized":"2023-12-07T10:00:55.381003+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911714+0000","last_change":"2023-12-07T10:01:04.911714+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911714+0000","last_undegraded":"2023-12-07T10:01:04.911714+0000","last_fullsized":"2023-12-07T10:01:04.911714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380536+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:00:55.380536+0000","last_peered":"2023-12-07T10:00:55.380536+0000","last_clean":"2023-12-07T10:00:55.380536+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:00:55.380536+0000","last_undegraded":"2023-12-07T10:00:55.380536+0000","last_fullsized":"2023-12-07T10:00:55.380536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377210+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:00:55.377210+0000","last_peered":"2023-12-07T10:00:55.377210+0000","last_clean":"2023-12-07T10:00:55.377210+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:00:55.377210+0000","last_undegraded":"2023-12-07T10:00:55.377210+0000","last_fullsized":"2023-12-07T10:00:55.377210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912300+0000","last_change":"2023-12-07T10:01:04.912300+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912300+0000","last_undegraded":"2023-12-07T10:01:04.912300+0000","last_fullsized":"2023-12-07T10:01:04.912300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377335+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:00:55.377335+0000","last_peered":"2023-12-07T10:00:55.377335+0000","last_clean":"2023-12-07T10:00:55.377335+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:00:55.377335+0000","last_undegraded":"2023-12-07T10:00:55.377335+0000","last_fullsized":"2023-12-07T10:00:55.377335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381067+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:00:55.381067+0000","last_peered":"2023-12-07T10:00:55.381067+0000","last_clean":"2023-12-07T10:00:55.381067+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:00:55.381067+0000","last_undegraded":"2023-12-07T10:00:55.381067+0000","last_fullsized":"2023-12-07T10:00:55.381067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.915702+0000","last_change":"2023-12-07T10:01:04.915702+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.915702+0000","last_undegraded":"2023-12-07T10:01:04.915702+0000","last_fullsized":"2023-12-07T10:01:04.915702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377354+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:00:55.377354+0000","last_peered":"2023-12-07T10:00:55.377354+0000","last_clean":"2023-12-07T10:00:55.377354+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:00:55.377354+0000","last_undegraded":"2023-12-07T10:00:55.377354+0000","last_fullsized":"2023-12-07T10:00:55.377354+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"49'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:57.888682+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:00:57.888682+0000","last_peered":"2023-12-07T10:00:57.888682+0000","last_clean":"2023-12-07T10:00:57.888682+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:00:57.888682+0000","last_undegraded":"2023-12-07T10:00:57.888682+0000","last_fullsized":"2023-12-07T10:00:57.888682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914368+0000","last_change":"2023-12-07T10:01:04.914368+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914368+0000","last_undegraded":"2023-12-07T10:01:04.914368+0000","last_fullsized":"2023-12-07T10:01:04.914368+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381031+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:00:55.381031+0000","last_peered":"2023-12-07T10:00:55.381031+0000","last_clean":"2023-12-07T10:00:55.381031+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:00:55.381031+0000","last_undegraded":"2023-12-07T10:00:55.381031+0000","last_fullsized":"2023-12-07T10:00:55.381031+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374656+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:00:55.374656+0000","last_peered":"2023-12-07T10:00:55.374656+0000","last_clean":"2023-12-07T10:00:55.374656+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:00:55.374656+0000","last_undegraded":"2023-12-07T10:00:55.374656+0000","last_fullsized":"2023-12-07T10:00:55.374656+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.914376+0000","last_change":"2023-12-07T10:01:04.914376+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.914376+0000","last_undegraded":"2023-12-07T10:01:04.914376+0000","last_fullsized":"2023-12-07T10:01:04.914376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380646+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:00:55.380646+0000","last_peered":"2023-12-07T10:00:55.380646+0000","last_clean":"2023-12-07T10:00:55.380646+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:00:55.380646+0000","last_undegraded":"2023-12-07T10:00:55.380646+0000","last_fullsized":"2023-12-07T10:00:55.380646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377304+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:00:55.377304+0000","last_peered":"2023-12-07T10:00:55.377304+0000","last_clean":"2023-12-07T10:00:55.377304+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:00:55.377304+0000","last_undegraded":"2023-12-07T10:00:55.377304+0000","last_fullsized":"2023-12-07T10:00:55.377304+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.906505+0000","last_change":"2023-12-07T10:01:04.906505+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.906505+0000","last_undegraded":"2023-12-07T10:01:04.906505+0000","last_fullsized":"2023-12-07T10:01:04.906505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377188+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:00:55.377188+0000","last_peered":"2023-12-07T10:00:55.377188+0000","last_clean":"2023-12-07T10:00:55.377188+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:00:55.377188+0000","last_undegraded":"2023-12-07T10:00:55.377188+0000","last_fullsized":"2023-12-07T10:00:55.377188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.381012+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:00:55.381012+0000","last_peered":"2023-12-07T10:00:55.381012+0000","last_clean":"2023-12-07T10:00:55.381012+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:00:55.381012+0000","last_undegraded":"2023-12-07T10:00:55.381012+0000","last_fullsized":"2023-12-07T10:00:55.381012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911565+0000","last_change":"2023-12-07T10:01:04.911565+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911565+0000","last_undegraded":"2023-12-07T10:01:04.911565+0000","last_fullsized":"2023-12-07T10:01:04.911565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374894+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:00:55.374894+0000","last_peered":"2023-12-07T10:00:55.374894+0000","last_clean":"2023-12-07T10:00:55.374894+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:00:55.374894+0000","last_undegraded":"2023-12-07T10:00:55.374894+0000","last_fullsized":"2023-12-07T10:00:55.374894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374916+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:00:55.374916+0000","last_peered":"2023-12-07T10:00:55.374916+0000","last_clean":"2023-12-07T10:00:55.374916+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:00:55.374916+0000","last_undegraded":"2023-12-07T10:00:55.374916+0000","last_fullsized":"2023-12-07T10:00:55.374916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.912141+0000","last_change":"2023-12-07T10:01:04.912141+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.912141+0000","last_undegraded":"2023-12-07T10:01:04.912141+0000","last_fullsized":"2023-12-07T10:01:04.912141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380978+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:00:55.380978+0000","last_peered":"2023-12-07T10:00:55.380978+0000","last_clean":"2023-12-07T10:00:55.380978+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:00:55.380978+0000","last_undegraded":"2023-12-07T10:00:55.380978+0000","last_fullsized":"2023-12-07T10:00:55.380978+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.380993+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:00:55.380993+0000","last_peered":"2023-12-07T10:00:55.380993+0000","last_clean":"2023-12-07T10:00:55.380993+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:00:55.380993+0000","last_undegraded":"2023-12-07T10:00:55.380993+0000","last_fullsized":"2023-12-07T10:00:55.380993+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.909124+0000","last_change":"2023-12-07T10:01:04.909124+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.909124+0000","last_undegraded":"2023-12-07T10:01:04.909124+0000","last_fullsized":"2023-12-07T10:01:04.909124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377136+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:00:55.377136+0000","last_peered":"2023-12-07T10:00:55.377136+0000","last_clean":"2023-12-07T10:00:55.377136+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:00:55.377136+0000","last_undegraded":"2023-12-07T10:00:55.377136+0000","last_fullsized":"2023-12-07T10:00:55.377136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377117+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:00:55.377117+0000","last_peered":"2023-12-07T10:00:55.377117+0000","last_clean":"2023-12-07T10:00:55.377117+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:00:55.377117+0000","last_undegraded":"2023-12-07T10:00:55.377117+0000","last_fullsized":"2023-12-07T10:00:55.377117+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-07T10:01:05.902275+0000","last_change":"2023-12-07T10:01:05.902275+0000","last_active":"2023-12-07T10:01:05.902275+0000","last_peered":"2023-12-07T10:01:05.902275+0000","last_clean":"2023-12-07T10:01:05.902275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:05.902275+0000","last_undegraded":"2023-12-07T10:01:05.902275+0000","last_fullsized":"2023-12-07T10:01:05.902275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2023-12-07T10:01:04.911657+0000","last_change":"2023-12-07T10:01:04.911657+0000","last_active":"2023-12-07T10:01:04.894425+0000","last_peered":"2023-12-07T10:01:04.894425+0000","last_clean":"2023-12-07T10:01:04.894425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:04.911657+0000","last_undegraded":"2023-12-07T10:01:04.911657+0000","last_fullsized":"2023-12-07T10:01:04.911657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.377104+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:00:55.377104+0000","last_peered":"2023-12-07T10:00:55.377104+0000","last_clean":"2023-12-07T10:00:55.377104+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:00:55.377104+0000","last_undegraded":"2023-12-07T10:00:55.377104+0000","last_fullsized":"2023-12-07T10:00:55.377104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-07T10:00:55.374627+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:00:55.374627+0000","last_peered":"2023-12-07T10:00:55.374627+0000","last_clean":"2023-12-07T10:00:55.374627+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:00:55.374627+0000","last_undegraded":"2023-12-07T10:00:55.374627+0000","last_fullsized":"2023-12-07T10:00:55.374627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-07T10:01:04.906782+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:04.906782+0000","last_peered":"2023-12-07T10:01:04.906782+0000","last_clean":"2023-12-07T10:01:04.906782+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:04.906782+0000","last_undegraded":"2023-12-07T10:01:04.906782+0000","last_fullsized":"2023-12-07T10:01:04.906782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":837046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.505}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.55600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":246518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.442},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.622},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.5}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":247170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":256296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.62}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.85599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":593920,"data_stored":246574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.432}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":246608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":847246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.378}]},{"osd":3,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.624},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:00:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.499},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-12-07T10:01:11.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-12-07T10:01:11.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-12-07T10:01:11.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-12-07T10:01:11.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-12-07T10:01:11.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-12-07T10:01:11.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.907098+0000', 'last_change': '2023-12-07T10:01:04.907098+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.907098+0000', 'last_undegraded': '2023-12-07T10:01:04.907098+0000', 'last_fullsized': '2023-12-07T10:01:04.907098+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.912983+0000', 'last_change': '2023-12-07T10:01:04.912983+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.912983+0000', 'last_undegraded': '2023-12-07T10:01:04.912983+0000', 'last_fullsized': '2023-12-07T10:01:04.912983+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.906747+0000', 'last_change': '2023-12-07T10:01:04.906747+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.906747+0000', 'last_undegraded': '2023-12-07T10:01:04.906747+0000', 'last_fullsized': '2023-12-07T10:01:04.906747+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-12-07T10:01:11.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.917938+0000', 'last_change': '2023-12-07T10:01:04.917938+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.917938+0000', 'last_undegraded': '2023-12-07T10:01:04.917938+0000', 'last_fullsized': '2023-12-07T10:01:04.917938+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.908994+0000', 'last_change': '2023-12-07T10:01:04.908994+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.908994+0000', 'last_undegraded': '2023-12-07T10:01:04.908994+0000', 'last_fullsized': '2023-12-07T10:01:04.908994+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.912170+0000', 'last_change': '2023-12-07T10:01:04.912170+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.912170+0000', 'last_undegraded': '2023-12-07T10:01:04.912170+0000', 'last_fullsized': '2023-12-07T10:01:04.912170+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:11.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.909871+0000', 'last_change': '2023-12-07T10:01:04.909871+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.909871+0000', 'last_undegraded': '2023-12-07T10:01:04.909871+0000', 'last_fullsized': '2023-12-07T10:01:04.909871+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.912603+0000', 'last_change': '2023-12-07T10:01:04.912603+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.912603+0000', 'last_undegraded': '2023-12-07T10:01:04.912603+0000', 'last_fullsized': '2023-12-07T10:01:04.912603+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-12-07T10:01:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.910314+0000', 'last_change': '2023-12-07T10:01:04.910314+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.910314+0000', 'last_undegraded': '2023-12-07T10:01:04.910314+0000', 'last_fullsized': '2023-12-07T10:01:04.910314+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.909012+0000', 'last_change': '2023-12-07T10:01:04.909012+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.909012+0000', 'last_undegraded': '2023-12-07T10:01:04.909012+0000', 'last_fullsized': '2023-12-07T10:01:04.909012+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.907569+0000', 'last_change': '2023-12-07T10:01:04.907569+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.907569+0000', 'last_undegraded': '2023-12-07T10:01:04.907569+0000', 'last_fullsized': '2023-12-07T10:01:04.907569+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-12-07T10:01:11.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.913689+0000', 'last_change': '2023-12-07T10:01:04.913689+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.913689+0000', 'last_undegraded': '2023-12-07T10:01:04.913689+0000', 'last_fullsized': '2023-12-07T10:01:04.913689+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.913550+0000', 'last_change': '2023-12-07T10:01:04.913550+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.913550+0000', 'last_undegraded': '2023-12-07T10:01:04.913550+0000', 'last_fullsized': '2023-12-07T10:01:04.913550+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.906496+0000', 'last_change': '2023-12-07T10:01:04.906496+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.906496+0000', 'last_undegraded': '2023-12-07T10:01:04.906496+0000', 'last_fullsized': '2023-12-07T10:01:04.906496+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-12-07T10:01:11.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.908993+0000', 'last_change': '2023-12-07T10:01:04.908993+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.908993+0000', 'last_undegraded': '2023-12-07T10:01:04.908993+0000', 'last_fullsized': '2023-12-07T10:01:04.908993+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.912237+0000', 'last_change': '2023-12-07T10:01:04.912237+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.912237+0000', 'last_undegraded': '2023-12-07T10:01:04.912237+0000', 'last_fullsized': '2023-12-07T10:01:04.912237+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-12-07T10:01:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.913034+0000', 'last_change': '2023-12-07T10:01:04.913034+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.913034+0000', 'last_undegraded': '2023-12-07T10:01:04.913034+0000', 'last_fullsized': '2023-12-07T10:01:04.913034+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.907675+0000', 'last_change': '2023-12-07T10:01:04.907675+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.907675+0000', 'last_undegraded': '2023-12-07T10:01:04.907675+0000', 'last_fullsized': '2023-12-07T10:01:04.907675+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.914961+0000', 'last_change': '2023-12-07T10:01:04.914961+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.914961+0000', 'last_undegraded': '2023-12-07T10:01:04.914961+0000', 'last_fullsized': '2023-12-07T10:01:04.914961+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-12-07T10:01:11.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.907007+0000', 'last_change': '2023-12-07T10:01:04.907007+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.907007+0000', 'last_undegraded': '2023-12-07T10:01:04.907007+0000', 'last_fullsized': '2023-12-07T10:01:04.907007+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.914140+0000', 'last_change': '2023-12-07T10:01:04.914140+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.914140+0000', 'last_undegraded': '2023-12-07T10:01:04.914140+0000', 'last_fullsized': '2023-12-07T10:01:04.914140+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.915494+0000', 'last_change': '2023-12-07T10:01:04.915494+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.915494+0000', 'last_undegraded': '2023-12-07T10:01:04.915494+0000', 'last_fullsized': '2023-12-07T10:01:04.915494+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.911714+0000', 'last_change': '2023-12-07T10:01:04.911714+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.911714+0000', 'last_undegraded': '2023-12-07T10:01:04.911714+0000', 'last_fullsized': '2023-12-07T10:01:04.911714+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.912300+0000', 'last_change': '2023-12-07T10:01:04.912300+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.912300+0000', 'last_undegraded': '2023-12-07T10:01:04.912300+0000', 'last_fullsized': '2023-12-07T10:01:04.912300+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-12-07T10:01:11.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.915702+0000', 'last_change': '2023-12-07T10:01:04.915702+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.915702+0000', 'last_undegraded': '2023-12-07T10:01:04.915702+0000', 'last_fullsized': '2023-12-07T10:01:04.915702+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.914368+0000', 'last_change': '2023-12-07T10:01:04.914368+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.914368+0000', 'last_undegraded': '2023-12-07T10:01:04.914368+0000', 'last_fullsized': '2023-12-07T10:01:04.914368+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-12-07T10:01:11.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.914376+0000', 'last_change': '2023-12-07T10:01:04.914376+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.914376+0000', 'last_undegraded': '2023-12-07T10:01:04.914376+0000', 'last_fullsized': '2023-12-07T10:01:04.914376+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.906505+0000', 'last_change': '2023-12-07T10:01:04.906505+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.906505+0000', 'last_undegraded': '2023-12-07T10:01:04.906505+0000', 'last_fullsized': '2023-12-07T10:01:04.906505+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.911565+0000', 'last_change': '2023-12-07T10:01:04.911565+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.911565+0000', 'last_undegraded': '2023-12-07T10:01:04.911565+0000', 'last_fullsized': '2023-12-07T10:01:04.911565+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.912141+0000', 'last_change': '2023-12-07T10:01:04.912141+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.912141+0000', 'last_undegraded': '2023-12-07T10:01:04.912141+0000', 'last_fullsized': '2023-12-07T10:01:04.912141+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.909124+0000', 'last_change': '2023-12-07T10:01:04.909124+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.909124+0000', 'last_undegraded': '2023-12-07T10:01:04.909124+0000', 'last_fullsized': '2023-12-07T10:01:04.909124+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-07T10:01:05.902275+0000', 'last_change': '2023-12-07T10:01:05.902275+0000', 'last_active': '2023-12-07T10:01:05.902275+0000', 'last_peered': '2023-12-07T10:01:05.902275+0000', 'last_clean': '2023-12-07T10:01:05.902275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:05.902275+0000', 'last_undegraded': '2023-12-07T10:01:05.902275+0000', 'last_fullsized': '2023-12-07T10:01:05.902275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:05.902275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-12-07T10:01:11.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:04.911657+0000', 'last_change': '2023-12-07T10:01:04.911657+0000', 'last_active': '2023-12-07T10:01:04.894425+0000', 'last_peered': '2023-12-07T10:01:04.894425+0000', 'last_clean': '2023-12-07T10:01:04.894425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:04.911657+0000', 'last_undegraded': '2023-12-07T10:01:04.911657+0000', 'last_fullsized': '2023-12-07T10:01:04.911657+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:04.894425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:11.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-07T10:01:11.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.956+0000 7f55f329c640 1 Processor -- start 2023-12-07T10:01:11.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.956+0000 7f55f329c640 1 -- start start 2023-12-07T10:01:11.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f329c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 0x7f55ec06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f329c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55ec0bd5e0 0x7f55ec0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f329c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec1559f0 con 0x7f55ec0c91f0 2023-12-07T10:01:11.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f329c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec157930 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f329c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec151f20 con 0x7f55ec06b100 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f229a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 0x7f55ec06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f1a99640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55ec0bd5e0 0x7f55ec0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f2a9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f55ec0c91f0 0x7f55ec157af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:49648/0 (socket says 172.21.15.89:49648) 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f229a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 0x7f55ec06b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:39942/0 (socket says 172.21.15.89:39942) 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f2a9b640 1 -- 172.21.15.89:0/207517575 learned_addr learned my addr 172.21.15.89:0/207517575 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f1a99640 1 -- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 msgr2=0x7f55ec06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:11.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f1a99640 1 --2- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 0x7f55ec06b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f1a99640 1 -- 172.21.15.89:0/207517575 >> v1:172.21.15.97:6789/0 conn(0x7f55ec0c91f0 legacy=0x7f55ec157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f1a99640 1 -- 172.21.15.89:0/207517575 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0aff20 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.960+0000 7f55f229a640 1 --2- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 0x7f55ec06b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:11.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f1a99640 1 --2- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec0c8cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097c0 tx=0x7f55dc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0672dd5aa4a31f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f1298640 1 -- 172.21.15.89:0/207517575 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0ab600 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f1298640 1 -- 172.21.15.89:0/207517575 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc0a7050 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f1298640 1 -- 172.21.15.89:0/207517575 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0ab980 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 -- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec0bd5e0 msgr2=0x7f55ec0c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 --2- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec0c8cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097c0 tx=0x7f55dc01c480 comp rx=0 tx=0).stop 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 -- 172.21.15.89:0/207517575 shutdown_connections 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 --2- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec0c8cb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 --2- 172.21.15.89:0/207517575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec06b100 0x7f55ec06b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 -- 172.21.15.89:0/207517575 >> 172.21.15.89:0/207517575 conn(0x7f55ec0ca550 msgr2=0x7f55ec0abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:11.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 -- 172.21.15.89:0/207517575 shutdown_connections 2023-12-07T10:01:11.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 -- 172.21.15.89:0/207517575 wait complete. 2023-12-07T10:01:11.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 Processor -- start 2023-12-07T10:01:11.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.964+0000 7f55f329c640 1 -- start start 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec06b100 0x7f55ec145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec0c91f0 0x7f55ec0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec14aff0 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec151510 con 0x7f55ec06b100 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec1517f0 con 0x7f55ec0c91f0 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41630/0 (socket says 172.21.15.89:41630) 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 -- 172.21.15.89:0/2622611284 learned_addr learned my addr 172.21.15.89:0/2622611284 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:11.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f229a640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec06b100 0x7f55ec145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f2a9b640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec0c91f0 0x7f55ec0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 -- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec0c91f0 msgr2=0x7f55ec0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec0c91f0 0x7f55ec0ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 -- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec06b100 msgr2=0x7f55ec145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec06b100 0x7f55ec145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 -- 172.21.15.89:0/2622611284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009420 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f1a99640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec146210 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0ae040 tx=0x7f55dc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0b4430 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc0b4590 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc009420 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0b4940 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec0adf70 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.968+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec0ae160 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.972+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f55dc0b2040 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.972+0000 7f55e2ffd640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55d0066900 0x7f55d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:11.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.972+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55dc11e600 con 0x7f55ec0bd5e0 2023-12-07T10:01:11.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.972+0000 7f55f229a640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55d0066900 0x7f55d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:11.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.972+0000 7f55f229a640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55d0066900 0x7f55d0068dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009cf0 tx=0x7f55e8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:11.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:11.976+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55dc0eb580 con 0x7f55ec0bd5e0 2023-12-07T10:01:12.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.176+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55ec04e890 con 0x7f55ec0bd5e0 2023-12-07T10:01:12.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.176+0000 7f55e2ffd640 1 -- 172.21.15.89:0/2622611284 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1694 (secure 0 0 0) 0x7f55dc0eeba0 con 0x7f55ec0bd5e0 2023-12-07T10:01:12.182 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1701943139,"num_in_osds":8,"osd_in_since":1701943129,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97},{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":231624704,"bytes_avail":772862488576,"bytes_total":773094113280,"unknown_pgs_ratio":0.33160620927810669,"inactive_pgs_ratio":0.16580310463905334,"write_bytes_sec":562,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":37,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":5835},{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5841}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-12-07T10:00:34.357942+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55d0066900 msgr2=0x7f55d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55d0066900 0x7f55d0068dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009cf0 tx=0x7f55e8009190 comp rx=0 tx=0).stop 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 msgr2=0x7f55ec146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec146210 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0ae040 tx=0x7f55dc019220 comp rx=0 tx=0).stop 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 shutdown_connections 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55d0066900 0x7f55d0068dc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55ec0c91f0 0x7f55ec0ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55ec0bd5e0 0x7f55ec146210 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 --2- 172.21.15.89:0/2622611284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55ec06b100 0x7f55ec145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 >> 172.21.15.89:0/2622611284 conn(0x7f55ec0ca550 msgr2=0x7f55ec154a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 shutdown_connections 2023-12-07T10:01:12.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.180+0000 7f55f329c640 1 -- 172.21.15.89:0/2622611284 wait complete. 2023-12-07T10:01:12.203 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-07T10:01:12.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:12.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 Processor -- start 2023-12-07T10:01:12.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 -- start start 2023-12-07T10:01:12.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb33c070b80 0x7fb33c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:12.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c0a8470 0x7fb33c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:12.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c06d320 con 0x7fb33c14e9d0 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c0721b0 con 0x7fb33c070b80 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb343efe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0c2830 con 0x7fb33c0a8470 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb33c070b80 0x7fb33c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb33c070b80 0x7fb33c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41640/0 (socket says 172.21.15.89:41640) 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 -- 172.21.15.89:0/341121692 learned_addr learned my addr 172.21.15.89:0/341121692 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb34249b640 1 --2- 172.21.15.89:0/341121692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c0a8470 0x7fb33c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 -- 172.21.15.89:0/341121692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c0a8470 msgr2=0x7fb33c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 --2- 172.21.15.89:0/341121692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c0a8470 0x7fb33c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 -- 172.21.15.89:0/341121692 >> v1:172.21.15.97:6789/0 conn(0x7fb33c14e9d0 legacy=0x7fb33c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.336+0000 7fb341499640 1 -- 172.21.15.89:0/341121692 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c072450 con 0x7fb33c070b80 2023-12-07T10:01:12.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb341499640 1 --2- 172.21.15.89:0/341121692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c151e60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009870 tx=0x7fb32c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9017a2d93f2c7d12 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:12.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb340c98640 1 -- 172.21.15.89:0/341121692 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0ac620 con 0x7fb33c070b80 2023-12-07T10:01:12.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb340c98640 1 -- 172.21.15.89:0/341121692 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c0ac780 con 0x7fb33c070b80 2023-12-07T10:01:12.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb340c98640 1 -- 172.21.15.89:0/341121692 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0acb10 con 0x7fb33c070b80 2023-12-07T10:01:12.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 -- 172.21.15.89:0/341121692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 msgr2=0x7fb33c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 --2- 172.21.15.89:0/341121692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c151e60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009870 tx=0x7fb32c01c4b0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 -- 172.21.15.89:0/341121692 shutdown_connections 2023-12-07T10:01:12.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 --2- 172.21.15.89:0/341121692 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c0a8470 0x7fb33c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 --2- 172.21.15.89:0/341121692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c151e60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 -- 172.21.15.89:0/341121692 >> 172.21.15.89:0/341121692 conn(0x7fb33c0c2ad0 msgr2=0x7fb33c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:12.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 -- 172.21.15.89:0/341121692 shutdown_connections 2023-12-07T10:01:12.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.340+0000 7fb343efe640 1 -- 172.21.15.89:0/341121692 wait complete. 2023-12-07T10:01:12.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 Processor -- start 2023-12-07T10:01:12.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 -- start start 2023-12-07T10:01:12.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c1eb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:12.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33c0a8470 0x7fb33c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c14e9d0 0x7fb33c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1513b0 con 0x7fb33c070b80 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1509e0 con 0x7fb33c0a8470 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1532d0 con 0x7fb33c14e9d0 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c1eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c1eb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41656/0 (socket says 172.21.15.89:41656) 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 -- 172.21.15.89:0/3082329813 learned_addr learned my addr 172.21.15.89:0/3082329813 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341499640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33c0a8470 0x7fb33c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb34249b640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c14e9d0 0x7fb33c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 -- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c14e9d0 msgr2=0x7fb33c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c14e9d0 0x7fb33c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 -- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33c0a8470 msgr2=0x7fb33c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33c0a8470 0x7fb33c150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 -- 172.21.15.89:0/3082329813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c0094d0 con 0x7fb33c070b80 2023-12-07T10:01:12.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb341c9a640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c1eb580 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c3c0 tx=0x7fb33800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380052d0 con 0x7fb33c070b80 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338005430 con 0x7fb33c070b80 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c1503d0 con 0x7fb33c070b80 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb338003840 con 0x7fb33c070b80 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.344+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c150670 con 0x7fb33c070b80 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.348+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c04e890 con 0x7fb33c070b80 2023-12-07T10:01:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.348+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb3380039a0 con 0x7fb33c070b80 2023-12-07T10:01:12.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.348+0000 7fb3327fc640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3200668d0 0x7fb320068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:12.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.348+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb338083c20 con 0x7fb33c070b80 2023-12-07T10:01:12.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.348+0000 7fb341499640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3200668d0 0x7fb320068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:12.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.348+0000 7fb341499640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3200668d0 0x7fb320068d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ae000 tx=0x7fb32c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:12.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.352+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb338050ba0 con 0x7fb33c070b80 2023-12-07T10:01:12.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.504+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb33c15e580 con 0x7fb3200668d0 2023-12-07T10:01:12.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.516+0000 7fb3327fc640 1 -- 172.21.15.89:0/3082329813 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527488 (secure 0 0 0) 0x7fb32c0ac8f0 con 0x7fb3200668d0 2023-12-07T10:01:12.527 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:12.531 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3200668d0 msgr2=0x7fb320068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3200668d0 0x7fb320068d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ae000 tx=0x7fb32c008040 comp rx=0 tx=0).stop 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 msgr2=0x7fb33c1eb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c1eb580 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c3c0 tx=0x7fb33800c880 comp rx=0 tx=0).stop 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 shutdown_connections 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3200668d0 0x7fb320068d90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb33c14e9d0 0x7fb33c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb33c0a8470 0x7fb33c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 --2- 172.21.15.89:0/3082329813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb33c070b80 0x7fb33c1eb580 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 >> 172.21.15.89:0/3082329813 conn(0x7fb33c0c2ad0 msgr2=0x7fb33c15b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 shutdown_connections 2023-12-07T10:01:12.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:12.520+0000 7fb343efe640 1 -- 172.21.15.89:0/3082329813 wait complete. 2023-12-07T10:01:12.546 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-12-07T10:01:12.365054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":359,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230740,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743980,"statfs":{"total":773094113280,"available":772857835520,"internally_reserved":0,"allocated":6397952,"data_stored":3394238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.456943"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941782+0000","last_change":"2023-12-07T10:01:06.954936+0000","last_active":"2023-12-07T10:01:07.941782+0000","last_peered":"2023-12-07T10:01:07.941782+0000","last_clean":"2023-12-07T10:01:07.941782+0000","last_became_active":"2023-12-07T10:01:06.954596+0000","last_became_peered":"2023-12-07T10:01:06.954596+0000","last_unstale":"2023-12-07T10:01:07.941782+0000","last_undegraded":"2023-12-07T10:01:07.941782+0000","last_fullsized":"2023-12-07T10:01:07.941782+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:06.571099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934310+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:01:06.934310+0000","last_peered":"2023-12-07T10:01:06.934310+0000","last_clean":"2023-12-07T10:01:06.934310+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:01:06.934310+0000","last_undegraded":"2023-12-07T10:01:06.934310+0000","last_fullsized":"2023-12-07T10:01:06.934310+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734597+0000","last_change":"2023-12-07T10:01:06.960711+0000","last_active":"2023-12-07T10:01:08.734597+0000","last_peered":"2023-12-07T10:01:08.734597+0000","last_clean":"2023-12-07T10:01:08.734597+0000","last_became_active":"2023-12-07T10:01:06.960402+0000","last_became_peered":"2023-12-07T10:01:06.960402+0000","last_unstale":"2023-12-07T10:01:08.734597+0000","last_undegraded":"2023-12-07T10:01:08.734597+0000","last_fullsized":"2023-12-07T10:01:08.734597+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:40:11.278879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928134+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:01:06.928134+0000","last_peered":"2023-12-07T10:01:06.928134+0000","last_clean":"2023-12-07T10:01:06.928134+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:01:06.928134+0000","last_undegraded":"2023-12-07T10:01:06.928134+0000","last_fullsized":"2023-12-07T10:01:06.928134+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947411+0000","last_change":"2023-12-07T10:01:06.954444+0000","last_active":"2023-12-07T10:01:07.947411+0000","last_peered":"2023-12-07T10:01:07.947411+0000","last_clean":"2023-12-07T10:01:07.947411+0000","last_became_active":"2023-12-07T10:01:06.954184+0000","last_became_peered":"2023-12-07T10:01:06.954184+0000","last_unstale":"2023-12-07T10:01:07.947411+0000","last_undegraded":"2023-12-07T10:01:07.947411+0000","last_fullsized":"2023-12-07T10:01:07.947411+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:19:05.544002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939602+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:01:06.939602+0000","last_peered":"2023-12-07T10:01:06.939602+0000","last_clean":"2023-12-07T10:01:06.939602+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:01:06.939602+0000","last_undegraded":"2023-12-07T10:01:06.939602+0000","last_fullsized":"2023-12-07T10:01:06.939602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949189+0000","last_change":"2023-12-07T10:01:06.965982+0000","last_active":"2023-12-07T10:01:07.949189+0000","last_peered":"2023-12-07T10:01:07.949189+0000","last_clean":"2023-12-07T10:01:07.949189+0000","last_became_active":"2023-12-07T10:01:06.962736+0000","last_became_peered":"2023-12-07T10:01:06.962736+0000","last_unstale":"2023-12-07T10:01:07.949189+0000","last_undegraded":"2023-12-07T10:01:07.949189+0000","last_fullsized":"2023-12-07T10:01:07.949189+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:59.451520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932701+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:01:06.932701+0000","last_peered":"2023-12-07T10:01:06.932701+0000","last_clean":"2023-12-07T10:01:06.932701+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:01:06.932701+0000","last_undegraded":"2023-12-07T10:01:06.932701+0000","last_fullsized":"2023-12-07T10:01:06.932701+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732955+0000","last_change":"2023-12-07T10:01:06.954857+0000","last_active":"2023-12-07T10:01:08.732955+0000","last_peered":"2023-12-07T10:01:08.732955+0000","last_clean":"2023-12-07T10:01:08.732955+0000","last_became_active":"2023-12-07T10:01:06.954577+0000","last_became_peered":"2023-12-07T10:01:06.954577+0000","last_unstale":"2023-12-07T10:01:08.732955+0000","last_undegraded":"2023-12-07T10:01:08.732955+0000","last_fullsized":"2023-12-07T10:01:08.732955+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:04.849349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933149+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:01:06.933149+0000","last_peered":"2023-12-07T10:01:06.933149+0000","last_clean":"2023-12-07T10:01:06.933149+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:01:06.933149+0000","last_undegraded":"2023-12-07T10:01:06.933149+0000","last_fullsized":"2023-12-07T10:01:06.933149+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946144+0000","last_change":"2023-12-07T10:01:06.968860+0000","last_active":"2023-12-07T10:01:07.946144+0000","last_peered":"2023-12-07T10:01:07.946144+0000","last_clean":"2023-12-07T10:01:07.946144+0000","last_became_active":"2023-12-07T10:01:06.965982+0000","last_became_peered":"2023-12-07T10:01:06.965982+0000","last_unstale":"2023-12-07T10:01:07.946144+0000","last_undegraded":"2023-12-07T10:01:07.946144+0000","last_fullsized":"2023-12-07T10:01:07.946144+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:52.052585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939631+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:01:06.939631+0000","last_peered":"2023-12-07T10:01:06.939631+0000","last_clean":"2023-12-07T10:01:06.939631+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:01:06.939631+0000","last_undegraded":"2023-12-07T10:01:06.939631+0000","last_fullsized":"2023-12-07T10:01:06.939631+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733041+0000","last_change":"2023-12-07T10:01:06.943288+0000","last_active":"2023-12-07T10:01:08.733041+0000","last_peered":"2023-12-07T10:01:08.733041+0000","last_clean":"2023-12-07T10:01:08.733041+0000","last_became_active":"2023-12-07T10:01:06.942994+0000","last_became_peered":"2023-12-07T10:01:06.942994+0000","last_unstale":"2023-12-07T10:01:08.733041+0000","last_undegraded":"2023-12-07T10:01:08.733041+0000","last_fullsized":"2023-12-07T10:01:08.733041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:23:14.710655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932215+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:01:06.932215+0000","last_peered":"2023-12-07T10:01:06.932215+0000","last_clean":"2023-12-07T10:01:06.932215+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:01:06.932215+0000","last_undegraded":"2023-12-07T10:01:06.932215+0000","last_fullsized":"2023-12-07T10:01:06.932215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947084+0000","last_change":"2023-12-07T10:01:06.963742+0000","last_active":"2023-12-07T10:01:07.947084+0000","last_peered":"2023-12-07T10:01:07.947084+0000","last_clean":"2023-12-07T10:01:07.947084+0000","last_became_active":"2023-12-07T10:01:06.963444+0000","last_became_peered":"2023-12-07T10:01:06.963444+0000","last_unstale":"2023-12-07T10:01:07.947084+0000","last_undegraded":"2023-12-07T10:01:07.947084+0000","last_fullsized":"2023-12-07T10:01:07.947084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:12:01.230270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927627+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:01:06.927627+0000","last_peered":"2023-12-07T10:01:06.927627+0000","last_clean":"2023-12-07T10:01:06.927627+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:01:06.927627+0000","last_undegraded":"2023-12-07T10:01:06.927627+0000","last_fullsized":"2023-12-07T10:01:06.927627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946696+0000","last_change":"2023-12-07T10:01:06.951459+0000","last_active":"2023-12-07T10:01:07.946696+0000","last_peered":"2023-12-07T10:01:07.946696+0000","last_clean":"2023-12-07T10:01:07.946696+0000","last_became_active":"2023-12-07T10:01:06.951076+0000","last_became_peered":"2023-12-07T10:01:06.951076+0000","last_unstale":"2023-12-07T10:01:07.946696+0000","last_undegraded":"2023-12-07T10:01:07.946696+0000","last_fullsized":"2023-12-07T10:01:07.946696+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:45:19.393712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934316+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:01:06.934316+0000","last_peered":"2023-12-07T10:01:06.934316+0000","last_clean":"2023-12-07T10:01:06.934316+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:01:06.934316+0000","last_undegraded":"2023-12-07T10:01:06.934316+0000","last_fullsized":"2023-12-07T10:01:06.934316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733946+0000","last_change":"2023-12-07T10:01:06.946514+0000","last_active":"2023-12-07T10:01:08.733946+0000","last_peered":"2023-12-07T10:01:08.733946+0000","last_clean":"2023-12-07T10:01:08.733946+0000","last_became_active":"2023-12-07T10:01:06.945901+0000","last_became_peered":"2023-12-07T10:01:06.945901+0000","last_unstale":"2023-12-07T10:01:08.733946+0000","last_undegraded":"2023-12-07T10:01:08.733946+0000","last_fullsized":"2023-12-07T10:01:08.733946+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:52.664866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935831+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:01:06.935831+0000","last_peered":"2023-12-07T10:01:06.935831+0000","last_clean":"2023-12-07T10:01:06.935831+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:01:06.935831+0000","last_undegraded":"2023-12-07T10:01:06.935831+0000","last_fullsized":"2023-12-07T10:01:06.935831+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734254+0000","last_change":"2023-12-07T10:01:06.959813+0000","last_active":"2023-12-07T10:01:08.734254+0000","last_peered":"2023-12-07T10:01:08.734254+0000","last_clean":"2023-12-07T10:01:08.734254+0000","last_became_active":"2023-12-07T10:01:06.956778+0000","last_became_peered":"2023-12-07T10:01:06.956778+0000","last_unstale":"2023-12-07T10:01:08.734254+0000","last_undegraded":"2023-12-07T10:01:08.734254+0000","last_fullsized":"2023-12-07T10:01:08.734254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:59.502341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935779+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:01:06.935779+0000","last_peered":"2023-12-07T10:01:06.935779+0000","last_clean":"2023-12-07T10:01:06.935779+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:01:06.935779+0000","last_undegraded":"2023-12-07T10:01:06.935779+0000","last_fullsized":"2023-12-07T10:01:06.935779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949871+0000","last_change":"2023-12-07T10:01:06.954444+0000","last_active":"2023-12-07T10:01:07.949871+0000","last_peered":"2023-12-07T10:01:07.949871+0000","last_clean":"2023-12-07T10:01:07.949871+0000","last_became_active":"2023-12-07T10:01:06.954126+0000","last_became_peered":"2023-12-07T10:01:06.954126+0000","last_unstale":"2023-12-07T10:01:07.949871+0000","last_undegraded":"2023-12-07T10:01:07.949871+0000","last_fullsized":"2023-12-07T10:01:07.949871+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:53.591614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934114+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:01:06.934114+0000","last_peered":"2023-12-07T10:01:06.934114+0000","last_clean":"2023-12-07T10:01:06.934114+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:01:06.934114+0000","last_undegraded":"2023-12-07T10:01:06.934114+0000","last_fullsized":"2023-12-07T10:01:06.934114+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732825+0000","last_change":"2023-12-07T10:01:06.945052+0000","last_active":"2023-12-07T10:01:08.732825+0000","last_peered":"2023-12-07T10:01:08.732825+0000","last_clean":"2023-12-07T10:01:08.732825+0000","last_became_active":"2023-12-07T10:01:06.944792+0000","last_became_peered":"2023-12-07T10:01:06.944792+0000","last_unstale":"2023-12-07T10:01:08.732825+0000","last_undegraded":"2023-12-07T10:01:08.732825+0000","last_fullsized":"2023-12-07T10:01:08.732825+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:07.953587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956143+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:01:06.956143+0000","last_peered":"2023-12-07T10:01:06.956143+0000","last_clean":"2023-12-07T10:01:06.956143+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:01:06.956143+0000","last_undegraded":"2023-12-07T10:01:06.956143+0000","last_fullsized":"2023-12-07T10:01:06.956143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948002+0000","last_change":"2023-12-07T10:01:06.964360+0000","last_active":"2023-12-07T10:01:07.948002+0000","last_peered":"2023-12-07T10:01:07.948002+0000","last_clean":"2023-12-07T10:01:07.948002+0000","last_became_active":"2023-12-07T10:01:06.964095+0000","last_became_peered":"2023-12-07T10:01:06.964095+0000","last_unstale":"2023-12-07T10:01:07.948002+0000","last_undegraded":"2023-12-07T10:01:07.948002+0000","last_fullsized":"2023-12-07T10:01:07.948002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:12.456972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932224+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:01:06.932224+0000","last_peered":"2023-12-07T10:01:06.932224+0000","last_clean":"2023-12-07T10:01:06.932224+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:01:06.932224+0000","last_undegraded":"2023-12-07T10:01:06.932224+0000","last_fullsized":"2023-12-07T10:01:06.932224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732816+0000","last_change":"2023-12-07T10:01:06.966654+0000","last_active":"2023-12-07T10:01:08.732816+0000","last_peered":"2023-12-07T10:01:08.732816+0000","last_clean":"2023-12-07T10:01:08.732816+0000","last_became_active":"2023-12-07T10:01:06.966372+0000","last_became_peered":"2023-12-07T10:01:06.966372+0000","last_unstale":"2023-12-07T10:01:08.732816+0000","last_undegraded":"2023-12-07T10:01:08.732816+0000","last_fullsized":"2023-12-07T10:01:08.732816+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:55.530961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932406+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:01:06.932406+0000","last_peered":"2023-12-07T10:01:06.932406+0000","last_clean":"2023-12-07T10:01:06.932406+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:01:06.932406+0000","last_undegraded":"2023-12-07T10:01:06.932406+0000","last_fullsized":"2023-12-07T10:01:06.932406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733196+0000","last_change":"2023-12-07T10:01:06.941718+0000","last_active":"2023-12-07T10:01:08.733196+0000","last_peered":"2023-12-07T10:01:08.733196+0000","last_clean":"2023-12-07T10:01:08.733196+0000","last_became_active":"2023-12-07T10:01:06.941358+0000","last_became_peered":"2023-12-07T10:01:06.941358+0000","last_unstale":"2023-12-07T10:01:08.733196+0000","last_undegraded":"2023-12-07T10:01:08.733196+0000","last_fullsized":"2023-12-07T10:01:08.733196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:34.951918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943971+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:01:06.943971+0000","last_peered":"2023-12-07T10:01:06.943971+0000","last_clean":"2023-12-07T10:01:06.943971+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:01:06.943971+0000","last_undegraded":"2023-12-07T10:01:06.943971+0000","last_fullsized":"2023-12-07T10:01:06.943971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948793+0000","last_change":"2023-12-07T10:01:06.964789+0000","last_active":"2023-12-07T10:01:07.948793+0000","last_peered":"2023-12-07T10:01:07.948793+0000","last_clean":"2023-12-07T10:01:07.948793+0000","last_became_active":"2023-12-07T10:01:06.961691+0000","last_became_peered":"2023-12-07T10:01:06.961691+0000","last_unstale":"2023-12-07T10:01:07.948793+0000","last_undegraded":"2023-12-07T10:01:07.948793+0000","last_fullsized":"2023-12-07T10:01:07.948793+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:55.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928879+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:01:06.928879+0000","last_peered":"2023-12-07T10:01:06.928879+0000","last_clean":"2023-12-07T10:01:06.928879+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:01:06.928879+0000","last_undegraded":"2023-12-07T10:01:06.928879+0000","last_fullsized":"2023-12-07T10:01:06.928879+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733594+0000","last_change":"2023-12-07T10:01:06.948958+0000","last_active":"2023-12-07T10:01:08.733594+0000","last_peered":"2023-12-07T10:01:08.733594+0000","last_clean":"2023-12-07T10:01:08.733594+0000","last_became_active":"2023-12-07T10:01:06.948351+0000","last_became_peered":"2023-12-07T10:01:06.948351+0000","last_unstale":"2023-12-07T10:01:08.733594+0000","last_undegraded":"2023-12-07T10:01:08.733594+0000","last_fullsized":"2023-12-07T10:01:08.733594+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:30.942820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.937652+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:01:06.937652+0000","last_peered":"2023-12-07T10:01:06.937652+0000","last_clean":"2023-12-07T10:01:06.937652+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:01:06.937652+0000","last_undegraded":"2023-12-07T10:01:06.937652+0000","last_fullsized":"2023-12-07T10:01:06.937652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.735010+0000","last_change":"2023-12-07T10:01:06.956874+0000","last_active":"2023-12-07T10:01:08.735010+0000","last_peered":"2023-12-07T10:01:08.735010+0000","last_clean":"2023-12-07T10:01:08.735010+0000","last_became_active":"2023-12-07T10:01:06.956489+0000","last_became_peered":"2023-12-07T10:01:06.956489+0000","last_unstale":"2023-12-07T10:01:08.735010+0000","last_undegraded":"2023-12-07T10:01:08.735010+0000","last_fullsized":"2023-12-07T10:01:08.735010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:39.901319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934005+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:01:06.934005+0000","last_peered":"2023-12-07T10:01:06.934005+0000","last_clean":"2023-12-07T10:01:06.934005+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:01:06.934005+0000","last_undegraded":"2023-12-07T10:01:06.934005+0000","last_fullsized":"2023-12-07T10:01:06.934005+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734187+0000","last_change":"2023-12-07T10:01:06.955523+0000","last_active":"2023-12-07T10:01:08.734187+0000","last_peered":"2023-12-07T10:01:08.734187+0000","last_clean":"2023-12-07T10:01:08.734187+0000","last_became_active":"2023-12-07T10:01:06.955269+0000","last_became_peered":"2023-12-07T10:01:06.955269+0000","last_unstale":"2023-12-07T10:01:08.734187+0000","last_undegraded":"2023-12-07T10:01:08.734187+0000","last_fullsized":"2023-12-07T10:01:08.734187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:14.664943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927839+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:01:06.927839+0000","last_peered":"2023-12-07T10:01:06.927839+0000","last_clean":"2023-12-07T10:01:06.927839+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:01:06.927839+0000","last_undegraded":"2023-12-07T10:01:06.927839+0000","last_fullsized":"2023-12-07T10:01:06.927839+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.945608+0000","last_change":"2023-12-07T10:01:06.940462+0000","last_active":"2023-12-07T10:01:07.945608+0000","last_peered":"2023-12-07T10:01:07.945608+0000","last_clean":"2023-12-07T10:01:07.945608+0000","last_became_active":"2023-12-07T10:01:06.940160+0000","last_became_peered":"2023-12-07T10:01:06.940160+0000","last_unstale":"2023-12-07T10:01:07.945608+0000","last_undegraded":"2023-12-07T10:01:07.945608+0000","last_fullsized":"2023-12-07T10:01:07.945608+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:46:28.067287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935312+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:01:06.935312+0000","last_peered":"2023-12-07T10:01:06.935312+0000","last_clean":"2023-12-07T10:01:06.935312+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:01:06.935312+0000","last_undegraded":"2023-12-07T10:01:06.935312+0000","last_fullsized":"2023-12-07T10:01:06.935312+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.945322+0000","last_change":"2023-12-07T10:01:06.963068+0000","last_active":"2023-12-07T10:01:07.945322+0000","last_peered":"2023-12-07T10:01:07.945322+0000","last_clean":"2023-12-07T10:01:07.945322+0000","last_became_active":"2023-12-07T10:01:06.962799+0000","last_became_peered":"2023-12-07T10:01:06.962799+0000","last_unstale":"2023-12-07T10:01:07.945322+0000","last_undegraded":"2023-12-07T10:01:07.945322+0000","last_fullsized":"2023-12-07T10:01:07.945322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:07.953587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927617+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:01:06.927617+0000","last_peered":"2023-12-07T10:01:06.927617+0000","last_clean":"2023-12-07T10:01:06.927617+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:01:06.927617+0000","last_undegraded":"2023-12-07T10:01:06.927617+0000","last_fullsized":"2023-12-07T10:01:06.927617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949604+0000","last_change":"2023-12-07T10:01:06.948432+0000","last_active":"2023-12-07T10:01:07.949604+0000","last_peered":"2023-12-07T10:01:07.949604+0000","last_clean":"2023-12-07T10:01:07.949604+0000","last_became_active":"2023-12-07T10:01:06.948143+0000","last_became_peered":"2023-12-07T10:01:06.948143+0000","last_unstale":"2023-12-07T10:01:07.949604+0000","last_undegraded":"2023-12-07T10:01:07.949604+0000","last_fullsized":"2023-12-07T10:01:07.949604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:58.155802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933358+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:01:06.933358+0000","last_peered":"2023-12-07T10:01:06.933358+0000","last_clean":"2023-12-07T10:01:06.933358+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:01:06.933358+0000","last_undegraded":"2023-12-07T10:01:06.933358+0000","last_fullsized":"2023-12-07T10:01:06.933358+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948733+0000","last_change":"2023-12-07T10:01:06.945211+0000","last_active":"2023-12-07T10:01:07.948733+0000","last_peered":"2023-12-07T10:01:07.948733+0000","last_clean":"2023-12-07T10:01:07.948733+0000","last_became_active":"2023-12-07T10:01:06.944919+0000","last_became_peered":"2023-12-07T10:01:06.944919+0000","last_unstale":"2023-12-07T10:01:07.948733+0000","last_undegraded":"2023-12-07T10:01:07.948733+0000","last_fullsized":"2023-12-07T10:01:07.948733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:10.038650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956521+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:01:06.956521+0000","last_peered":"2023-12-07T10:01:06.956521+0000","last_clean":"2023-12-07T10:01:06.956521+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:01:06.956521+0000","last_undegraded":"2023-12-07T10:01:06.956521+0000","last_fullsized":"2023-12-07T10:01:06.956521+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941829+0000","last_change":"2023-12-07T10:01:06.937982+0000","last_active":"2023-12-07T10:01:07.941829+0000","last_peered":"2023-12-07T10:01:07.941829+0000","last_clean":"2023-12-07T10:01:07.941829+0000","last_became_active":"2023-12-07T10:01:06.937704+0000","last_became_peered":"2023-12-07T10:01:06.937704+0000","last_unstale":"2023-12-07T10:01:07.941829+0000","last_undegraded":"2023-12-07T10:01:07.941829+0000","last_fullsized":"2023-12-07T10:01:07.941829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:10.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934357+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:01:06.934357+0000","last_peered":"2023-12-07T10:01:06.934357+0000","last_clean":"2023-12-07T10:01:06.934357+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:01:06.934357+0000","last_undegraded":"2023-12-07T10:01:06.934357+0000","last_fullsized":"2023-12-07T10:01:06.934357+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949571+0000","last_change":"2023-12-07T10:01:06.946503+0000","last_active":"2023-12-07T10:01:07.949571+0000","last_peered":"2023-12-07T10:01:07.949571+0000","last_clean":"2023-12-07T10:01:07.949571+0000","last_became_active":"2023-12-07T10:01:06.946245+0000","last_became_peered":"2023-12-07T10:01:06.946245+0000","last_unstale":"2023-12-07T10:01:07.949571+0000","last_undegraded":"2023-12-07T10:01:07.949571+0000","last_fullsized":"2023-12-07T10:01:07.949571+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:59.451520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935864+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:01:06.935864+0000","last_peered":"2023-12-07T10:01:06.935864+0000","last_clean":"2023-12-07T10:01:06.935864+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:01:06.935864+0000","last_undegraded":"2023-12-07T10:01:06.935864+0000","last_fullsized":"2023-12-07T10:01:06.935864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949866+0000","last_change":"2023-12-07T10:01:06.954196+0000","last_active":"2023-12-07T10:01:07.949866+0000","last_peered":"2023-12-07T10:01:07.949866+0000","last_clean":"2023-12-07T10:01:07.949866+0000","last_became_active":"2023-12-07T10:01:06.953986+0000","last_became_peered":"2023-12-07T10:01:06.953986+0000","last_unstale":"2023-12-07T10:01:07.949866+0000","last_undegraded":"2023-12-07T10:01:07.949866+0000","last_fullsized":"2023-12-07T10:01:07.949866+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:08:53.051587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.941840+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:01:06.941840+0000","last_peered":"2023-12-07T10:01:06.941840+0000","last_clean":"2023-12-07T10:01:06.941840+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:01:06.941840+0000","last_undegraded":"2023-12-07T10:01:06.941840+0000","last_fullsized":"2023-12-07T10:01:06.941840+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733708+0000","last_change":"2023-12-07T10:01:06.968010+0000","last_active":"2023-12-07T10:01:08.733708+0000","last_peered":"2023-12-07T10:01:08.733708+0000","last_clean":"2023-12-07T10:01:08.733708+0000","last_became_active":"2023-12-07T10:01:06.967720+0000","last_became_peered":"2023-12-07T10:01:06.967720+0000","last_unstale":"2023-12-07T10:01:08.733708+0000","last_undegraded":"2023-12-07T10:01:08.733708+0000","last_fullsized":"2023-12-07T10:01:08.733708+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:05.941060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933847+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:01:06.933847+0000","last_peered":"2023-12-07T10:01:06.933847+0000","last_clean":"2023-12-07T10:01:06.933847+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:01:06.933847+0000","last_undegraded":"2023-12-07T10:01:06.933847+0000","last_fullsized":"2023-12-07T10:01:06.933847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733059+0000","last_change":"2023-12-07T10:01:06.946505+0000","last_active":"2023-12-07T10:01:08.733059+0000","last_peered":"2023-12-07T10:01:08.733059+0000","last_clean":"2023-12-07T10:01:08.733059+0000","last_became_active":"2023-12-07T10:01:06.946220+0000","last_became_peered":"2023-12-07T10:01:06.946220+0000","last_unstale":"2023-12-07T10:01:08.733059+0000","last_undegraded":"2023-12-07T10:01:08.733059+0000","last_fullsized":"2023-12-07T10:01:08.733059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:23.288655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928381+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:01:06.928381+0000","last_peered":"2023-12-07T10:01:06.928381+0000","last_clean":"2023-12-07T10:01:06.928381+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:01:06.928381+0000","last_undegraded":"2023-12-07T10:01:06.928381+0000","last_fullsized":"2023-12-07T10:01:06.928381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946683+0000","last_change":"2023-12-07T10:01:06.956166+0000","last_active":"2023-12-07T10:01:07.946683+0000","last_peered":"2023-12-07T10:01:07.946683+0000","last_clean":"2023-12-07T10:01:07.946683+0000","last_became_active":"2023-12-07T10:01:06.955184+0000","last_became_peered":"2023-12-07T10:01:06.955184+0000","last_unstale":"2023-12-07T10:01:07.946683+0000","last_undegraded":"2023-12-07T10:01:07.946683+0000","last_fullsized":"2023-12-07T10:01:07.946683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:38.075721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933503+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:01:06.933503+0000","last_peered":"2023-12-07T10:01:06.933503+0000","last_clean":"2023-12-07T10:01:06.933503+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:01:06.933503+0000","last_undegraded":"2023-12-07T10:01:06.933503+0000","last_fullsized":"2023-12-07T10:01:06.933503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941681+0000","last_change":"2023-12-07T10:01:06.938545+0000","last_active":"2023-12-07T10:01:07.941681+0000","last_peered":"2023-12-07T10:01:07.941681+0000","last_clean":"2023-12-07T10:01:07.941681+0000","last_became_active":"2023-12-07T10:01:06.938170+0000","last_became_peered":"2023-12-07T10:01:06.938170+0000","last_unstale":"2023-12-07T10:01:07.941681+0000","last_undegraded":"2023-12-07T10:01:07.941681+0000","last_fullsized":"2023-12-07T10:01:07.941681+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:12.983029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932039+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:01:06.932039+0000","last_peered":"2023-12-07T10:01:06.932039+0000","last_clean":"2023-12-07T10:01:06.932039+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:01:06.932039+0000","last_undegraded":"2023-12-07T10:01:06.932039+0000","last_fullsized":"2023-12-07T10:01:06.932039+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733079+0000","last_change":"2023-12-07T10:01:06.950431+0000","last_active":"2023-12-07T10:01:08.733079+0000","last_peered":"2023-12-07T10:01:08.733079+0000","last_clean":"2023-12-07T10:01:08.733079+0000","last_became_active":"2023-12-07T10:01:06.950155+0000","last_became_peered":"2023-12-07T10:01:06.950155+0000","last_unstale":"2023-12-07T10:01:08.733079+0000","last_undegraded":"2023-12-07T10:01:08.733079+0000","last_fullsized":"2023-12-07T10:01:08.733079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:55.370892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.944178+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:01:06.944178+0000","last_peered":"2023-12-07T10:01:06.944178+0000","last_clean":"2023-12-07T10:01:06.944178+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:01:06.944178+0000","last_undegraded":"2023-12-07T10:01:06.944178+0000","last_fullsized":"2023-12-07T10:01:06.944178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948748+0000","last_change":"2023-12-07T10:01:06.954105+0000","last_active":"2023-12-07T10:01:07.948748+0000","last_peered":"2023-12-07T10:01:07.948748+0000","last_clean":"2023-12-07T10:01:07.948748+0000","last_became_active":"2023-12-07T10:01:06.953848+0000","last_became_peered":"2023-12-07T10:01:06.953848+0000","last_unstale":"2023-12-07T10:01:07.948748+0000","last_undegraded":"2023-12-07T10:01:07.948748+0000","last_fullsized":"2023-12-07T10:01:07.948748+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:10.038650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.970768+0000","last_change":"2023-12-07T10:01:05.937338+0000","last_active":"2023-12-07T10:01:06.970768+0000","last_peered":"2023-12-07T10:01:06.970768+0000","last_clean":"2023-12-07T10:01:06.970768+0000","last_became_active":"2023-12-07T10:01:05.937032+0000","last_became_peered":"2023-12-07T10:01:05.937032+0000","last_unstale":"2023-12-07T10:01:06.970768+0000","last_undegraded":"2023-12-07T10:01:06.970768+0000","last_fullsized":"2023-12-07T10:01:06.970768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:45.273320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943499+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:01:06.943499+0000","last_peered":"2023-12-07T10:01:06.943499+0000","last_clean":"2023-12-07T10:01:06.943499+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:01:06.943499+0000","last_undegraded":"2023-12-07T10:01:06.943499+0000","last_fullsized":"2023-12-07T10:01:06.943499+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943205+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:01:06.943205+0000","last_peered":"2023-12-07T10:01:06.943205+0000","last_clean":"2023-12-07T10:01:06.943205+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:01:06.943205+0000","last_undegraded":"2023-12-07T10:01:06.943205+0000","last_fullsized":"2023-12-07T10:01:06.943205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947062+0000","last_change":"2023-12-07T10:01:06.949633+0000","last_active":"2023-12-07T10:01:07.947062+0000","last_peered":"2023-12-07T10:01:07.947062+0000","last_clean":"2023-12-07T10:01:07.947062+0000","last_became_active":"2023-12-07T10:01:06.949343+0000","last_became_peered":"2023-12-07T10:01:06.949343+0000","last_unstale":"2023-12-07T10:01:07.947062+0000","last_undegraded":"2023-12-07T10:01:07.947062+0000","last_fullsized":"2023-12-07T10:01:07.947062+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:04:16.747141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.968931+0000","last_change":"2023-12-07T10:01:05.932989+0000","last_active":"2023-12-07T10:01:06.968931+0000","last_peered":"2023-12-07T10:01:06.968931+0000","last_clean":"2023-12-07T10:01:06.968931+0000","last_became_active":"2023-12-07T10:01:05.932716+0000","last_became_peered":"2023-12-07T10:01:05.932716+0000","last_unstale":"2023-12-07T10:01:06.968931+0000","last_undegraded":"2023-12-07T10:01:06.968931+0000","last_fullsized":"2023-12-07T10:01:06.968931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:19:02.018892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.936618+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:01:06.936618+0000","last_peered":"2023-12-07T10:01:06.936618+0000","last_clean":"2023-12-07T10:01:06.936618+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:01:06.936618+0000","last_undegraded":"2023-12-07T10:01:06.936618+0000","last_fullsized":"2023-12-07T10:01:06.936618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928321+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:01:06.928321+0000","last_peered":"2023-12-07T10:01:06.928321+0000","last_clean":"2023-12-07T10:01:06.928321+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:01:06.928321+0000","last_undegraded":"2023-12-07T10:01:06.928321+0000","last_fullsized":"2023-12-07T10:01:06.928321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947952+0000","last_change":"2023-12-07T10:01:06.967317+0000","last_active":"2023-12-07T10:01:07.947952+0000","last_peered":"2023-12-07T10:01:07.947952+0000","last_clean":"2023-12-07T10:01:07.947952+0000","last_became_active":"2023-12-07T10:01:06.966980+0000","last_became_peered":"2023-12-07T10:01:06.966980+0000","last_unstale":"2023-12-07T10:01:07.947952+0000","last_undegraded":"2023-12-07T10:01:07.947952+0000","last_fullsized":"2023-12-07T10:01:07.947952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:00.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"52'4","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.971528+0000","last_change":"2023-12-07T10:01:05.933629+0000","last_active":"2023-12-07T10:01:06.971528+0000","last_peered":"2023-12-07T10:01:06.971528+0000","last_clean":"2023-12-07T10:01:06.971528+0000","last_became_active":"2023-12-07T10:01:05.933347+0000","last_became_peered":"2023-12-07T10:01:05.933347+0000","last_unstale":"2023-12-07T10:01:06.971528+0000","last_undegraded":"2023-12-07T10:01:06.971528+0000","last_fullsized":"2023-12-07T10:01:06.971528+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:04.933210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943758+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:01:06.943758+0000","last_peered":"2023-12-07T10:01:06.943758+0000","last_clean":"2023-12-07T10:01:06.943758+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:01:06.943758+0000","last_undegraded":"2023-12-07T10:01:06.943758+0000","last_fullsized":"2023-12-07T10:01:06.943758+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.942072+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:01:06.942072+0000","last_peered":"2023-12-07T10:01:06.942072+0000","last_clean":"2023-12-07T10:01:06.942072+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:01:06.942072+0000","last_undegraded":"2023-12-07T10:01:06.942072+0000","last_fullsized":"2023-12-07T10:01:06.942072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.735097+0000","last_change":"2023-12-07T10:01:06.956695+0000","last_active":"2023-12-07T10:01:08.735097+0000","last_peered":"2023-12-07T10:01:08.735097+0000","last_clean":"2023-12-07T10:01:08.735097+0000","last_became_active":"2023-12-07T10:01:06.956416+0000","last_became_peered":"2023-12-07T10:01:06.956416+0000","last_unstale":"2023-12-07T10:01:08.735097+0000","last_undegraded":"2023-12-07T10:01:08.735097+0000","last_fullsized":"2023-12-07T10:01:08.735097+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:17.160030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.967286+0000","last_change":"2023-12-07T10:01:05.930408+0000","last_active":"2023-12-07T10:01:06.967286+0000","last_peered":"2023-12-07T10:01:06.967286+0000","last_clean":"2023-12-07T10:01:06.967286+0000","last_became_active":"2023-12-07T10:01:05.930068+0000","last_became_peered":"2023-12-07T10:01:05.930068+0000","last_unstale":"2023-12-07T10:01:06.967286+0000","last_undegraded":"2023-12-07T10:01:06.967286+0000","last_fullsized":"2023-12-07T10:01:06.967286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:50.607463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.941915+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:01:06.941915+0000","last_peered":"2023-12-07T10:01:06.941915+0000","last_clean":"2023-12-07T10:01:06.941915+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:01:06.941915+0000","last_undegraded":"2023-12-07T10:01:06.941915+0000","last_fullsized":"2023-12-07T10:01:06.941915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933919+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:01:06.933919+0000","last_peered":"2023-12-07T10:01:06.933919+0000","last_clean":"2023-12-07T10:01:06.933919+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:01:06.933919+0000","last_undegraded":"2023-12-07T10:01:06.933919+0000","last_fullsized":"2023-12-07T10:01:06.933919+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732631+0000","last_change":"2023-12-07T10:01:06.946446+0000","last_active":"2023-12-07T10:01:08.732631+0000","last_peered":"2023-12-07T10:01:08.732631+0000","last_clean":"2023-12-07T10:01:08.732631+0000","last_became_active":"2023-12-07T10:01:06.946235+0000","last_became_peered":"2023-12-07T10:01:06.946235+0000","last_unstale":"2023-12-07T10:01:08.732631+0000","last_undegraded":"2023-12-07T10:01:08.732631+0000","last_fullsized":"2023-12-07T10:01:08.732631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.373269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935200+0000","last_change":"2023-12-07T10:01:05.934543+0000","last_active":"2023-12-07T10:01:06.935200+0000","last_peered":"2023-12-07T10:01:06.935200+0000","last_clean":"2023-12-07T10:01:06.935200+0000","last_became_active":"2023-12-07T10:01:05.934279+0000","last_became_peered":"2023-12-07T10:01:05.934279+0000","last_unstale":"2023-12-07T10:01:06.935200+0000","last_undegraded":"2023-12-07T10:01:06.935200+0000","last_fullsized":"2023-12-07T10:01:06.935200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:46.458492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928058+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:01:06.928058+0000","last_peered":"2023-12-07T10:01:06.928058+0000","last_clean":"2023-12-07T10:01:06.928058+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:01:06.928058+0000","last_undegraded":"2023-12-07T10:01:06.928058+0000","last_fullsized":"2023-12-07T10:01:06.928058+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935266+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:01:06.935266+0000","last_peered":"2023-12-07T10:01:06.935266+0000","last_clean":"2023-12-07T10:01:06.935266+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:01:06.935266+0000","last_undegraded":"2023-12-07T10:01:06.935266+0000","last_fullsized":"2023-12-07T10:01:06.935266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733253+0000","last_change":"2023-12-07T10:01:06.950025+0000","last_active":"2023-12-07T10:01:08.733253+0000","last_peered":"2023-12-07T10:01:08.733253+0000","last_clean":"2023-12-07T10:01:08.733253+0000","last_became_active":"2023-12-07T10:01:06.949315+0000","last_became_peered":"2023-12-07T10:01:06.949315+0000","last_unstale":"2023-12-07T10:01:08.733253+0000","last_undegraded":"2023-12-07T10:01:08.733253+0000","last_fullsized":"2023-12-07T10:01:08.733253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:46:28.067287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.931906+0000","last_change":"2023-12-07T10:01:05.934604+0000","last_active":"2023-12-07T10:01:06.931906+0000","last_peered":"2023-12-07T10:01:06.931906+0000","last_clean":"2023-12-07T10:01:06.931906+0000","last_became_active":"2023-12-07T10:01:05.933914+0000","last_became_peered":"2023-12-07T10:01:05.933914+0000","last_unstale":"2023-12-07T10:01:06.931906+0000","last_undegraded":"2023-12-07T10:01:06.931906+0000","last_fullsized":"2023-12-07T10:01:06.931906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:49.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928172+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:01:06.928172+0000","last_peered":"2023-12-07T10:01:06.928172+0000","last_clean":"2023-12-07T10:01:06.928172+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:01:06.928172+0000","last_undegraded":"2023-12-07T10:01:06.928172+0000","last_fullsized":"2023-12-07T10:01:06.928172+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939755+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:01:06.939755+0000","last_peered":"2023-12-07T10:01:06.939755+0000","last_clean":"2023-12-07T10:01:06.939755+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:01:06.939755+0000","last_undegraded":"2023-12-07T10:01:06.939755+0000","last_fullsized":"2023-12-07T10:01:06.939755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733131+0000","last_change":"2023-12-07T10:01:06.952214+0000","last_active":"2023-12-07T10:01:08.733131+0000","last_peered":"2023-12-07T10:01:08.733131+0000","last_clean":"2023-12-07T10:01:08.733131+0000","last_became_active":"2023-12-07T10:01:06.951923+0000","last_became_peered":"2023-12-07T10:01:06.951923+0000","last_unstale":"2023-12-07T10:01:08.733131+0000","last_undegraded":"2023-12-07T10:01:08.733131+0000","last_fullsized":"2023-12-07T10:01:08.733131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:21.415236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.964618+0000","last_change":"2023-12-07T10:01:05.936746+0000","last_active":"2023-12-07T10:01:06.964618+0000","last_peered":"2023-12-07T10:01:06.964618+0000","last_clean":"2023-12-07T10:01:06.964618+0000","last_became_active":"2023-12-07T10:01:05.935754+0000","last_became_peered":"2023-12-07T10:01:05.935754+0000","last_unstale":"2023-12-07T10:01:06.964618+0000","last_undegraded":"2023-12-07T10:01:06.964618+0000","last_fullsized":"2023-12-07T10:01:06.964618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:13.665640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956620+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:01:06.956620+0000","last_peered":"2023-12-07T10:01:06.956620+0000","last_clean":"2023-12-07T10:01:06.956620+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:01:06.956620+0000","last_undegraded":"2023-12-07T10:01:06.956620+0000","last_fullsized":"2023-12-07T10:01:06.956620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934937+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:01:06.934937+0000","last_peered":"2023-12-07T10:01:06.934937+0000","last_clean":"2023-12-07T10:01:06.934937+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:01:06.934937+0000","last_undegraded":"2023-12-07T10:01:06.934937+0000","last_fullsized":"2023-12-07T10:01:06.934937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949473+0000","last_change":"2023-12-07T10:01:06.955558+0000","last_active":"2023-12-07T10:01:07.949473+0000","last_peered":"2023-12-07T10:01:07.949473+0000","last_clean":"2023-12-07T10:01:07.949473+0000","last_became_active":"2023-12-07T10:01:06.950080+0000","last_became_peered":"2023-12-07T10:01:06.950080+0000","last_unstale":"2023-12-07T10:01:07.949473+0000","last_undegraded":"2023-12-07T10:01:07.949473+0000","last_fullsized":"2023-12-07T10:01:07.949473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:55.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.967960+0000","last_change":"2023-12-07T10:01:05.931730+0000","last_active":"2023-12-07T10:01:06.967960+0000","last_peered":"2023-12-07T10:01:06.967960+0000","last_clean":"2023-12-07T10:01:06.967960+0000","last_became_active":"2023-12-07T10:01:05.930867+0000","last_became_peered":"2023-12-07T10:01:05.930867+0000","last_unstale":"2023-12-07T10:01:06.967960+0000","last_undegraded":"2023-12-07T10:01:06.967960+0000","last_fullsized":"2023-12-07T10:01:06.967960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:51.657016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927656+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:01:06.927656+0000","last_peered":"2023-12-07T10:01:06.927656+0000","last_clean":"2023-12-07T10:01:06.927656+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:01:06.927656+0000","last_undegraded":"2023-12-07T10:01:06.927656+0000","last_fullsized":"2023-12-07T10:01:06.927656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.931886+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:01:06.931886+0000","last_peered":"2023-12-07T10:01:06.931886+0000","last_clean":"2023-12-07T10:01:06.931886+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:01:06.931886+0000","last_undegraded":"2023-12-07T10:01:06.931886+0000","last_fullsized":"2023-12-07T10:01:06.931886+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948735+0000","last_change":"2023-12-07T10:01:06.957831+0000","last_active":"2023-12-07T10:01:07.948735+0000","last_peered":"2023-12-07T10:01:07.948735+0000","last_clean":"2023-12-07T10:01:07.948735+0000","last_became_active":"2023-12-07T10:01:06.957556+0000","last_became_peered":"2023-12-07T10:01:06.957556+0000","last_unstale":"2023-12-07T10:01:07.948735+0000","last_undegraded":"2023-12-07T10:01:07.948735+0000","last_fullsized":"2023-12-07T10:01:07.948735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:12.456972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"52'3","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.969934+0000","last_change":"2023-12-07T10:01:05.926143+0000","last_active":"2023-12-07T10:01:06.969934+0000","last_peered":"2023-12-07T10:01:06.969934+0000","last_clean":"2023-12-07T10:01:06.969934+0000","last_became_active":"2023-12-07T10:01:05.925827+0000","last_became_peered":"2023-12-07T10:01:05.925827+0000","last_unstale":"2023-12-07T10:01:06.969934+0000","last_undegraded":"2023-12-07T10:01:06.969934+0000","last_fullsized":"2023-12-07T10:01:06.969934+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:35:05.706967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934868+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:01:06.934868+0000","last_peered":"2023-12-07T10:01:06.934868+0000","last_clean":"2023-12-07T10:01:06.934868+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:01:06.934868+0000","last_undegraded":"2023-12-07T10:01:06.934868+0000","last_fullsized":"2023-12-07T10:01:06.934868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939346+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:01:06.939346+0000","last_peered":"2023-12-07T10:01:06.939346+0000","last_clean":"2023-12-07T10:01:06.939346+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:01:06.939346+0000","last_undegraded":"2023-12-07T10:01:06.939346+0000","last_fullsized":"2023-12-07T10:01:06.939346+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733740+0000","last_change":"2023-12-07T10:01:06.948730+0000","last_active":"2023-12-07T10:01:08.733740+0000","last_peered":"2023-12-07T10:01:08.733740+0000","last_clean":"2023-12-07T10:01:08.733740+0000","last_became_active":"2023-12-07T10:01:06.947429+0000","last_became_peered":"2023-12-07T10:01:06.947429+0000","last_unstale":"2023-12-07T10:01:08.733740+0000","last_undegraded":"2023-12-07T10:01:08.733740+0000","last_fullsized":"2023-12-07T10:01:08.733740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:52.896843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"52'6","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.972082+0000","last_change":"2023-12-07T10:01:05.932398+0000","last_active":"2023-12-07T10:01:06.972082+0000","last_peered":"2023-12-07T10:01:06.972082+0000","last_clean":"2023-12-07T10:01:06.972082+0000","last_became_active":"2023-12-07T10:01:05.932117+0000","last_became_peered":"2023-12-07T10:01:05.932117+0000","last_unstale":"2023-12-07T10:01:06.972082+0000","last_undegraded":"2023-12-07T10:01:06.972082+0000","last_fullsized":"2023-12-07T10:01:06.972082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:15.464613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939052+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:01:06.939052+0000","last_peered":"2023-12-07T10:01:06.939052+0000","last_clean":"2023-12-07T10:01:06.939052+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:01:06.939052+0000","last_undegraded":"2023-12-07T10:01:06.939052+0000","last_fullsized":"2023-12-07T10:01:06.939052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928399+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:01:06.928399+0000","last_peered":"2023-12-07T10:01:06.928399+0000","last_clean":"2023-12-07T10:01:06.928399+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:01:06.928399+0000","last_undegraded":"2023-12-07T10:01:06.928399+0000","last_fullsized":"2023-12-07T10:01:06.928399+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733696+0000","last_change":"2023-12-07T10:01:06.943281+0000","last_active":"2023-12-07T10:01:08.733696+0000","last_peered":"2023-12-07T10:01:08.733696+0000","last_clean":"2023-12-07T10:01:08.733696+0000","last_became_active":"2023-12-07T10:01:06.942991+0000","last_became_peered":"2023-12-07T10:01:06.942991+0000","last_unstale":"2023-12-07T10:01:08.733696+0000","last_undegraded":"2023-12-07T10:01:08.733696+0000","last_fullsized":"2023-12-07T10:01:08.733696+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:25.566235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934229+0000","last_change":"2023-12-07T10:01:05.935296+0000","last_active":"2023-12-07T10:01:06.934229+0000","last_peered":"2023-12-07T10:01:06.934229+0000","last_clean":"2023-12-07T10:01:06.934229+0000","last_became_active":"2023-12-07T10:01:05.934183+0000","last_became_peered":"2023-12-07T10:01:05.934183+0000","last_unstale":"2023-12-07T10:01:06.934229+0000","last_undegraded":"2023-12-07T10:01:06.934229+0000","last_fullsized":"2023-12-07T10:01:06.934229+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:51.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935505+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:01:06.935505+0000","last_peered":"2023-12-07T10:01:06.935505+0000","last_clean":"2023-12-07T10:01:06.935505+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:01:06.935505+0000","last_undegraded":"2023-12-07T10:01:06.935505+0000","last_fullsized":"2023-12-07T10:01:06.935505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939795+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:01:06.939795+0000","last_peered":"2023-12-07T10:01:06.939795+0000","last_clean":"2023-12-07T10:01:06.939795+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:01:06.939795+0000","last_undegraded":"2023-12-07T10:01:06.939795+0000","last_fullsized":"2023-12-07T10:01:06.939795+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947545+0000","last_change":"2023-12-07T10:01:06.957042+0000","last_active":"2023-12-07T10:01:07.947545+0000","last_peered":"2023-12-07T10:01:07.947545+0000","last_clean":"2023-12-07T10:01:07.947545+0000","last_became_active":"2023-12-07T10:01:06.956729+0000","last_became_peered":"2023-12-07T10:01:06.956729+0000","last_unstale":"2023-12-07T10:01:07.947545+0000","last_undegraded":"2023-12-07T10:01:07.947545+0000","last_fullsized":"2023-12-07T10:01:07.947545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:07:53.974819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.959140+0000","last_change":"2023-12-07T10:01:05.932746+0000","last_active":"2023-12-07T10:01:06.959140+0000","last_peered":"2023-12-07T10:01:06.959140+0000","last_clean":"2023-12-07T10:01:06.959140+0000","last_became_active":"2023-12-07T10:01:05.932390+0000","last_became_peered":"2023-12-07T10:01:05.932390+0000","last_unstale":"2023-12-07T10:01:06.959140+0000","last_undegraded":"2023-12-07T10:01:06.959140+0000","last_fullsized":"2023-12-07T10:01:06.959140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:56.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939696+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:01:06.939696+0000","last_peered":"2023-12-07T10:01:06.939696+0000","last_clean":"2023-12-07T10:01:06.939696+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:01:06.939696+0000","last_undegraded":"2023-12-07T10:01:06.939696+0000","last_fullsized":"2023-12-07T10:01:06.939696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'8","reported_seq":24,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933062+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:01:06.933062+0000","last_peered":"2023-12-07T10:01:06.933062+0000","last_clean":"2023-12-07T10:01:06.933062+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:01:06.933062+0000","last_undegraded":"2023-12-07T10:01:06.933062+0000","last_fullsized":"2023-12-07T10:01:06.933062+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733488+0000","last_change":"2023-12-07T10:01:06.963984+0000","last_active":"2023-12-07T10:01:08.733488+0000","last_peered":"2023-12-07T10:01:08.733488+0000","last_clean":"2023-12-07T10:01:08.733488+0000","last_became_active":"2023-12-07T10:01:06.963668+0000","last_became_peered":"2023-12-07T10:01:06.963668+0000","last_unstale":"2023-12-07T10:01:08.733488+0000","last_undegraded":"2023-12-07T10:01:08.733488+0000","last_fullsized":"2023-12-07T10:01:08.733488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:02:46.547397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934774+0000","last_change":"2023-12-07T10:01:05.927952+0000","last_active":"2023-12-07T10:01:06.934774+0000","last_peered":"2023-12-07T10:01:06.934774+0000","last_clean":"2023-12-07T10:01:06.934774+0000","last_became_active":"2023-12-07T10:01:05.927390+0000","last_became_peered":"2023-12-07T10:01:05.927390+0000","last_unstale":"2023-12-07T10:01:06.934774+0000","last_undegraded":"2023-12-07T10:01:06.934774+0000","last_fullsized":"2023-12-07T10:01:06.934774+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:58.443670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934658+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:01:06.934658+0000","last_peered":"2023-12-07T10:01:06.934658+0000","last_clean":"2023-12-07T10:01:06.934658+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:01:06.934658+0000","last_undegraded":"2023-12-07T10:01:06.934658+0000","last_fullsized":"2023-12-07T10:01:06.934658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928291+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:01:06.928291+0000","last_peered":"2023-12-07T10:01:06.928291+0000","last_clean":"2023-12-07T10:01:06.928291+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:01:06.928291+0000","last_undegraded":"2023-12-07T10:01:06.928291+0000","last_fullsized":"2023-12-07T10:01:06.928291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732843+0000","last_change":"2023-12-07T10:01:06.950399+0000","last_active":"2023-12-07T10:01:08.732843+0000","last_peered":"2023-12-07T10:01:08.732843+0000","last_clean":"2023-12-07T10:01:08.732843+0000","last_became_active":"2023-12-07T10:01:06.950089+0000","last_became_peered":"2023-12-07T10:01:06.950089+0000","last_unstale":"2023-12-07T10:01:08.732843+0000","last_undegraded":"2023-12-07T10:01:08.732843+0000","last_fullsized":"2023-12-07T10:01:08.732843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:40.283546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"52'8","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.972450+0000","last_change":"2023-12-07T10:01:05.926480+0000","last_active":"2023-12-07T10:01:06.972450+0000","last_peered":"2023-12-07T10:01:06.972450+0000","last_clean":"2023-12-07T10:01:06.972450+0000","last_became_active":"2023-12-07T10:01:05.924899+0000","last_became_peered":"2023-12-07T10:01:05.924899+0000","last_unstale":"2023-12-07T10:01:06.972450+0000","last_undegraded":"2023-12-07T10:01:06.972450+0000","last_fullsized":"2023-12-07T10:01:06.972450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:19:02.018892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.937974+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:01:06.937974+0000","last_peered":"2023-12-07T10:01:06.937974+0000","last_clean":"2023-12-07T10:01:06.937974+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:01:06.937974+0000","last_undegraded":"2023-12-07T10:01:06.937974+0000","last_fullsized":"2023-12-07T10:01:06.937974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956233+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:01:06.956233+0000","last_peered":"2023-12-07T10:01:06.956233+0000","last_clean":"2023-12-07T10:01:06.956233+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:01:06.956233+0000","last_undegraded":"2023-12-07T10:01:06.956233+0000","last_fullsized":"2023-12-07T10:01:06.956233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.945629+0000","last_change":"2023-12-07T10:01:06.949756+0000","last_active":"2023-12-07T10:01:07.945629+0000","last_peered":"2023-12-07T10:01:07.945629+0000","last_clean":"2023-12-07T10:01:07.945629+0000","last_became_active":"2023-12-07T10:01:06.947368+0000","last_became_peered":"2023-12-07T10:01:06.947368+0000","last_unstale":"2023-12-07T10:01:07.945629+0000","last_undegraded":"2023-12-07T10:01:07.945629+0000","last_fullsized":"2023-12-07T10:01:07.945629+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:02:46.547397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.968791+0000","last_change":"2023-12-07T10:01:05.930926+0000","last_active":"2023-12-07T10:01:06.968791+0000","last_peered":"2023-12-07T10:01:06.968791+0000","last_clean":"2023-12-07T10:01:06.968791+0000","last_became_active":"2023-12-07T10:01:05.930654+0000","last_became_peered":"2023-12-07T10:01:05.930654+0000","last_unstale":"2023-12-07T10:01:06.968791+0000","last_undegraded":"2023-12-07T10:01:06.968791+0000","last_fullsized":"2023-12-07T10:01:06.968791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:21.460311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932813+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:01:06.932813+0000","last_peered":"2023-12-07T10:01:06.932813+0000","last_clean":"2023-12-07T10:01:06.932813+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:01:06.932813+0000","last_undegraded":"2023-12-07T10:01:06.932813+0000","last_fullsized":"2023-12-07T10:01:06.932813+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934964+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:01:06.934964+0000","last_peered":"2023-12-07T10:01:06.934964+0000","last_clean":"2023-12-07T10:01:06.934964+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:01:06.934964+0000","last_undegraded":"2023-12-07T10:01:06.934964+0000","last_fullsized":"2023-12-07T10:01:06.934964+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733407+0000","last_change":"2023-12-07T10:01:06.943378+0000","last_active":"2023-12-07T10:01:08.733407+0000","last_peered":"2023-12-07T10:01:08.733407+0000","last_clean":"2023-12-07T10:01:08.733407+0000","last_became_active":"2023-12-07T10:01:06.943079+0000","last_became_peered":"2023-12-07T10:01:06.943079+0000","last_unstale":"2023-12-07T10:01:08.733407+0000","last_undegraded":"2023-12-07T10:01:08.733407+0000","last_fullsized":"2023-12-07T10:01:08.733407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:58:04.852722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956005+0000","last_change":"2023-12-07T10:01:05.931634+0000","last_active":"2023-12-07T10:01:06.956005+0000","last_peered":"2023-12-07T10:01:06.956005+0000","last_clean":"2023-12-07T10:01:06.956005+0000","last_became_active":"2023-12-07T10:01:05.931335+0000","last_became_peered":"2023-12-07T10:01:05.931335+0000","last_unstale":"2023-12-07T10:01:06.956005+0000","last_undegraded":"2023-12-07T10:01:06.956005+0000","last_fullsized":"2023-12-07T10:01:06.956005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:08.810073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933252+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:01:06.933252+0000","last_peered":"2023-12-07T10:01:06.933252+0000","last_clean":"2023-12-07T10:01:06.933252+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:01:06.933252+0000","last_undegraded":"2023-12-07T10:01:06.933252+0000","last_fullsized":"2023-12-07T10:01:06.933252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":24,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932186+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:01:06.932186+0000","last_peered":"2023-12-07T10:01:06.932186+0000","last_clean":"2023-12-07T10:01:06.932186+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:01:06.932186+0000","last_undegraded":"2023-12-07T10:01:06.932186+0000","last_fullsized":"2023-12-07T10:01:06.932186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734926+0000","last_change":"2023-12-07T10:01:06.946675+0000","last_active":"2023-12-07T10:01:08.734926+0000","last_peered":"2023-12-07T10:01:08.734926+0000","last_clean":"2023-12-07T10:01:08.734926+0000","last_became_active":"2023-12-07T10:01:06.946254+0000","last_became_peered":"2023-12-07T10:01:06.946254+0000","last_unstale":"2023-12-07T10:01:08.734926+0000","last_undegraded":"2023-12-07T10:01:08.734926+0000","last_fullsized":"2023-12-07T10:01:08.734926+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:09.817923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.971146+0000","last_change":"2023-12-07T10:01:05.938970+0000","last_active":"2023-12-07T10:01:06.971146+0000","last_peered":"2023-12-07T10:01:06.971146+0000","last_clean":"2023-12-07T10:01:06.971146+0000","last_became_active":"2023-12-07T10:01:05.938656+0000","last_became_peered":"2023-12-07T10:01:05.938656+0000","last_unstale":"2023-12-07T10:01:06.971146+0000","last_undegraded":"2023-12-07T10:01:06.971146+0000","last_fullsized":"2023-12-07T10:01:06.971146+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:55.910861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.937736+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:01:06.937736+0000","last_peered":"2023-12-07T10:01:06.937736+0000","last_clean":"2023-12-07T10:01:06.937736+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:01:06.937736+0000","last_undegraded":"2023-12-07T10:01:06.937736+0000","last_fullsized":"2023-12-07T10:01:06.937736+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928969+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:01:06.928969+0000","last_peered":"2023-12-07T10:01:06.928969+0000","last_clean":"2023-12-07T10:01:06.928969+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:01:06.928969+0000","last_undegraded":"2023-12-07T10:01:06.928969+0000","last_fullsized":"2023-12-07T10:01:06.928969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734145+0000","last_change":"2023-12-07T10:01:06.948744+0000","last_active":"2023-12-07T10:01:08.734145+0000","last_peered":"2023-12-07T10:01:08.734145+0000","last_clean":"2023-12-07T10:01:08.734145+0000","last_became_active":"2023-12-07T10:01:06.946998+0000","last_became_peered":"2023-12-07T10:01:06.946998+0000","last_unstale":"2023-12-07T10:01:08.734145+0000","last_undegraded":"2023-12-07T10:01:08.734145+0000","last_fullsized":"2023-12-07T10:01:08.734145+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:22:03.843320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.938283+0000","last_change":"2023-12-07T10:01:05.937092+0000","last_active":"2023-12-07T10:01:06.938283+0000","last_peered":"2023-12-07T10:01:06.938283+0000","last_clean":"2023-12-07T10:01:06.938283+0000","last_became_active":"2023-12-07T10:01:05.936649+0000","last_became_peered":"2023-12-07T10:01:05.936649+0000","last_unstale":"2023-12-07T10:01:06.938283+0000","last_undegraded":"2023-12-07T10:01:06.938283+0000","last_fullsized":"2023-12-07T10:01:06.938283+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:20.407386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935336+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:01:06.935336+0000","last_peered":"2023-12-07T10:01:06.935336+0000","last_clean":"2023-12-07T10:01:06.935336+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:01:06.935336+0000","last_undegraded":"2023-12-07T10:01:06.935336+0000","last_fullsized":"2023-12-07T10:01:06.935336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943532+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:01:06.943532+0000","last_peered":"2023-12-07T10:01:06.943532+0000","last_clean":"2023-12-07T10:01:06.943532+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:01:06.943532+0000","last_undegraded":"2023-12-07T10:01:06.943532+0000","last_fullsized":"2023-12-07T10:01:06.943532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.950105+0000","last_change":"2023-12-07T10:01:06.948320+0000","last_active":"2023-12-07T10:01:07.950105+0000","last_peered":"2023-12-07T10:01:07.950105+0000","last_clean":"2023-12-07T10:01:07.950105+0000","last_became_active":"2023-12-07T10:01:06.948031+0000","last_became_peered":"2023-12-07T10:01:06.948031+0000","last_unstale":"2023-12-07T10:01:07.950105+0000","last_undegraded":"2023-12-07T10:01:07.950105+0000","last_fullsized":"2023-12-07T10:01:07.950105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:32.154846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.974371+0000","last_change":"2023-12-07T10:01:05.936063+0000","last_active":"2023-12-07T10:01:06.974371+0000","last_peered":"2023-12-07T10:01:06.974371+0000","last_clean":"2023-12-07T10:01:06.974371+0000","last_became_active":"2023-12-07T10:01:05.935054+0000","last_became_peered":"2023-12-07T10:01:05.935054+0000","last_unstale":"2023-12-07T10:01:06.974371+0000","last_undegraded":"2023-12-07T10:01:06.974371+0000","last_fullsized":"2023-12-07T10:01:06.974371+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:35.094189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928661+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:01:06.928661+0000","last_peered":"2023-12-07T10:01:06.928661+0000","last_clean":"2023-12-07T10:01:06.928661+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:01:06.928661+0000","last_undegraded":"2023-12-07T10:01:06.928661+0000","last_fullsized":"2023-12-07T10:01:06.928661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934673+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:01:06.934673+0000","last_peered":"2023-12-07T10:01:06.934673+0000","last_clean":"2023-12-07T10:01:06.934673+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:01:06.934673+0000","last_undegraded":"2023-12-07T10:01:06.934673+0000","last_fullsized":"2023-12-07T10:01:06.934673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947874+0000","last_change":"2023-12-07T10:01:06.963972+0000","last_active":"2023-12-07T10:01:07.947874+0000","last_peered":"2023-12-07T10:01:07.947874+0000","last_clean":"2023-12-07T10:01:07.947874+0000","last_became_active":"2023-12-07T10:01:06.961981+0000","last_became_peered":"2023-12-07T10:01:06.961981+0000","last_unstale":"2023-12-07T10:01:07.947874+0000","last_undegraded":"2023-12-07T10:01:07.947874+0000","last_fullsized":"2023-12-07T10:01:07.947874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.610873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.974569+0000","last_change":"2023-12-07T10:01:05.937326+0000","last_active":"2023-12-07T10:01:06.974569+0000","last_peered":"2023-12-07T10:01:06.974569+0000","last_clean":"2023-12-07T10:01:06.974569+0000","last_became_active":"2023-12-07T10:01:05.936996+0000","last_became_peered":"2023-12-07T10:01:05.936996+0000","last_unstale":"2023-12-07T10:01:06.974569+0000","last_undegraded":"2023-12-07T10:01:06.974569+0000","last_fullsized":"2023-12-07T10:01:06.974569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:37.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939706+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:01:06.939706+0000","last_peered":"2023-12-07T10:01:06.939706+0000","last_clean":"2023-12-07T10:01:06.939706+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:01:06.939706+0000","last_undegraded":"2023-12-07T10:01:06.939706+0000","last_fullsized":"2023-12-07T10:01:06.939706+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943842+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:01:06.943842+0000","last_peered":"2023-12-07T10:01:06.943842+0000","last_clean":"2023-12-07T10:01:06.943842+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:01:06.943842+0000","last_undegraded":"2023-12-07T10:01:06.943842+0000","last_fullsized":"2023-12-07T10:01:06.943842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941076+0000","last_change":"2023-12-07T10:01:06.962652+0000","last_active":"2023-12-07T10:01:07.941076+0000","last_peered":"2023-12-07T10:01:07.941076+0000","last_clean":"2023-12-07T10:01:07.941076+0000","last_became_active":"2023-12-07T10:01:06.962391+0000","last_became_peered":"2023-12-07T10:01:06.962391+0000","last_unstale":"2023-12-07T10:01:07.941076+0000","last_undegraded":"2023-12-07T10:01:07.941076+0000","last_fullsized":"2023-12-07T10:01:07.941076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:42:53.864129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934639+0000","last_change":"2023-12-07T10:01:05.931495+0000","last_active":"2023-12-07T10:01:06.934639+0000","last_peered":"2023-12-07T10:01:06.934639+0000","last_clean":"2023-12-07T10:01:06.934639+0000","last_became_active":"2023-12-07T10:01:05.930528+0000","last_became_peered":"2023-12-07T10:01:05.930528+0000","last_unstale":"2023-12-07T10:01:06.934639+0000","last_undegraded":"2023-12-07T10:01:06.934639+0000","last_fullsized":"2023-12-07T10:01:06.934639+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:54.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934742+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:01:06.934742+0000","last_peered":"2023-12-07T10:01:06.934742+0000","last_clean":"2023-12-07T10:01:06.934742+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:01:06.934742+0000","last_undegraded":"2023-12-07T10:01:06.934742+0000","last_fullsized":"2023-12-07T10:01:06.934742+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928476+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:01:06.928476+0000","last_peered":"2023-12-07T10:01:06.928476+0000","last_clean":"2023-12-07T10:01:06.928476+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:01:06.928476+0000","last_undegraded":"2023-12-07T10:01:06.928476+0000","last_fullsized":"2023-12-07T10:01:06.928476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941140+0000","last_change":"2023-12-07T10:01:06.965878+0000","last_active":"2023-12-07T10:01:07.941140+0000","last_peered":"2023-12-07T10:01:07.941140+0000","last_clean":"2023-12-07T10:01:07.941140+0000","last_became_active":"2023-12-07T10:01:06.964508+0000","last_became_peered":"2023-12-07T10:01:06.964508+0000","last_unstale":"2023-12-07T10:01:07.941140+0000","last_undegraded":"2023-12-07T10:01:07.941140+0000","last_fullsized":"2023-12-07T10:01:07.941140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:51.058158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.944100+0000","last_change":"2023-12-07T10:01:05.931404+0000","last_active":"2023-12-07T10:01:06.944100+0000","last_peered":"2023-12-07T10:01:06.944100+0000","last_clean":"2023-12-07T10:01:06.944100+0000","last_became_active":"2023-12-07T10:01:05.930415+0000","last_became_peered":"2023-12-07T10:01:05.930415+0000","last_unstale":"2023-12-07T10:01:06.944100+0000","last_undegraded":"2023-12-07T10:01:06.944100+0000","last_fullsized":"2023-12-07T10:01:06.944100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:13.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939721+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:01:06.939721+0000","last_peered":"2023-12-07T10:01:06.939721+0000","last_clean":"2023-12-07T10:01:06.939721+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:01:06.939721+0000","last_undegraded":"2023-12-07T10:01:06.939721+0000","last_fullsized":"2023-12-07T10:01:06.939721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935296+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:01:06.935296+0000","last_peered":"2023-12-07T10:01:06.935296+0000","last_clean":"2023-12-07T10:01:06.935296+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:01:06.935296+0000","last_undegraded":"2023-12-07T10:01:06.935296+0000","last_fullsized":"2023-12-07T10:01:06.935296+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941113+0000","last_change":"2023-12-07T10:01:06.945722+0000","last_active":"2023-12-07T10:01:07.941113+0000","last_peered":"2023-12-07T10:01:07.941113+0000","last_clean":"2023-12-07T10:01:07.941113+0000","last_became_active":"2023-12-07T10:01:06.945417+0000","last_became_peered":"2023-12-07T10:01:06.945417+0000","last_unstale":"2023-12-07T10:01:07.941113+0000","last_undegraded":"2023-12-07T10:01:07.941113+0000","last_fullsized":"2023-12-07T10:01:07.941113+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:45:23.514432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956146+0000","last_change":"2023-12-07T10:01:05.931152+0000","last_active":"2023-12-07T10:01:06.956146+0000","last_peered":"2023-12-07T10:01:06.956146+0000","last_clean":"2023-12-07T10:01:06.956146+0000","last_became_active":"2023-12-07T10:01:05.930854+0000","last_became_peered":"2023-12-07T10:01:05.930854+0000","last_unstale":"2023-12-07T10:01:06.956146+0000","last_undegraded":"2023-12-07T10:01:06.956146+0000","last_fullsized":"2023-12-07T10:01:06.956146+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:58.144283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939763+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:01:06.939763+0000","last_peered":"2023-12-07T10:01:06.939763+0000","last_clean":"2023-12-07T10:01:06.939763+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:01:06.939763+0000","last_undegraded":"2023-12-07T10:01:06.939763+0000","last_fullsized":"2023-12-07T10:01:06.939763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933596+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:01:06.933596+0000","last_peered":"2023-12-07T10:01:06.933596+0000","last_clean":"2023-12-07T10:01:06.933596+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:01:06.933596+0000","last_undegraded":"2023-12-07T10:01:06.933596+0000","last_fullsized":"2023-12-07T10:01:06.933596+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946364+0000","last_change":"2023-12-07T10:01:06.960553+0000","last_active":"2023-12-07T10:01:07.946364+0000","last_peered":"2023-12-07T10:01:07.946364+0000","last_clean":"2023-12-07T10:01:07.946364+0000","last_became_active":"2023-12-07T10:01:06.960241+0000","last_became_peered":"2023-12-07T10:01:06.960241+0000","last_unstale":"2023-12-07T10:01:07.946364+0000","last_undegraded":"2023-12-07T10:01:07.946364+0000","last_fullsized":"2023-12-07T10:01:07.946364+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:16:48.332462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934052+0000","last_change":"2023-12-07T10:01:05.928305+0000","last_active":"2023-12-07T10:01:06.934052+0000","last_peered":"2023-12-07T10:01:06.934052+0000","last_clean":"2023-12-07T10:01:06.934052+0000","last_became_active":"2023-12-07T10:01:05.927908+0000","last_became_peered":"2023-12-07T10:01:05.927908+0000","last_unstale":"2023-12-07T10:01:06.934052+0000","last_undegraded":"2023-12-07T10:01:06.934052+0000","last_fullsized":"2023-12-07T10:01:06.934052+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:03:11.922339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935957+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:01:06.935957+0000","last_peered":"2023-12-07T10:01:06.935957+0000","last_clean":"2023-12-07T10:01:06.935957+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:01:06.935957+0000","last_undegraded":"2023-12-07T10:01:06.935957+0000","last_fullsized":"2023-12-07T10:01:06.935957+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.936697+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:01:06.936697+0000","last_peered":"2023-12-07T10:01:06.936697+0000","last_clean":"2023-12-07T10:01:06.936697+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:01:06.936697+0000","last_undegraded":"2023-12-07T10:01:06.936697+0000","last_fullsized":"2023-12-07T10:01:06.936697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947205+0000","last_change":"2023-12-07T10:01:06.949763+0000","last_active":"2023-12-07T10:01:07.947205+0000","last_peered":"2023-12-07T10:01:07.947205+0000","last_clean":"2023-12-07T10:01:07.947205+0000","last_became_active":"2023-12-07T10:01:06.949460+0000","last_became_peered":"2023-12-07T10:01:06.949460+0000","last_unstale":"2023-12-07T10:01:07.947205+0000","last_undegraded":"2023-12-07T10:01:07.947205+0000","last_fullsized":"2023-12-07T10:01:07.947205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:34.437447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939975+0000","last_change":"2023-12-07T10:01:05.936727+0000","last_active":"2023-12-07T10:01:06.939975+0000","last_peered":"2023-12-07T10:01:06.939975+0000","last_clean":"2023-12-07T10:01:06.939975+0000","last_became_active":"2023-12-07T10:01:05.936408+0000","last_became_peered":"2023-12-07T10:01:05.936408+0000","last_unstale":"2023-12-07T10:01:06.939975+0000","last_undegraded":"2023-12-07T10:01:06.939975+0000","last_fullsized":"2023-12-07T10:01:06.939975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:24.558386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935426+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:01:06.935426+0000","last_peered":"2023-12-07T10:01:06.935426+0000","last_clean":"2023-12-07T10:01:06.935426+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:01:06.935426+0000","last_undegraded":"2023-12-07T10:01:06.935426+0000","last_fullsized":"2023-12-07T10:01:06.935426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"49'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943590+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:01:06.943590+0000","last_peered":"2023-12-07T10:01:06.943590+0000","last_clean":"2023-12-07T10:01:06.943590+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:01:06.943590+0000","last_undegraded":"2023-12-07T10:01:06.943590+0000","last_fullsized":"2023-12-07T10:01:06.943590+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.735052+0000","last_change":"2023-12-07T10:01:06.954130+0000","last_active":"2023-12-07T10:01:08.735052+0000","last_peered":"2023-12-07T10:01:08.735052+0000","last_clean":"2023-12-07T10:01:08.735052+0000","last_became_active":"2023-12-07T10:01:06.953819+0000","last_became_peered":"2023-12-07T10:01:06.953819+0000","last_unstale":"2023-12-07T10:01:08.735052+0000","last_undegraded":"2023-12-07T10:01:08.735052+0000","last_fullsized":"2023-12-07T10:01:08.735052+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:16:48.332462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.974278+0000","last_change":"2023-12-07T10:01:05.931789+0000","last_active":"2023-12-07T10:01:06.974278+0000","last_peered":"2023-12-07T10:01:06.974278+0000","last_clean":"2023-12-07T10:01:06.974278+0000","last_became_active":"2023-12-07T10:01:05.931437+0000","last_became_peered":"2023-12-07T10:01:05.931437+0000","last_unstale":"2023-12-07T10:01:06.974278+0000","last_undegraded":"2023-12-07T10:01:06.974278+0000","last_fullsized":"2023-12-07T10:01:06.974278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:45.273320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935544+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:01:06.935544+0000","last_peered":"2023-12-07T10:01:06.935544+0000","last_clean":"2023-12-07T10:01:06.935544+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:01:06.935544+0000","last_undegraded":"2023-12-07T10:01:06.935544+0000","last_fullsized":"2023-12-07T10:01:06.935544+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.958515+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:01:06.958515+0000","last_peered":"2023-12-07T10:01:06.958515+0000","last_clean":"2023-12-07T10:01:06.958515+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:01:06.958515+0000","last_undegraded":"2023-12-07T10:01:06.958515+0000","last_fullsized":"2023-12-07T10:01:06.958515+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733765+0000","last_change":"2023-12-07T10:01:06.951770+0000","last_active":"2023-12-07T10:01:08.733765+0000","last_peered":"2023-12-07T10:01:08.733765+0000","last_clean":"2023-12-07T10:01:08.733765+0000","last_became_active":"2023-12-07T10:01:06.951476+0000","last_became_peered":"2023-12-07T10:01:06.951476+0000","last_unstale":"2023-12-07T10:01:08.733765+0000","last_undegraded":"2023-12-07T10:01:08.733765+0000","last_fullsized":"2023-12-07T10:01:08.733765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:51.615313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.888579+0000","last_change":"2023-12-07T10:01:05.925997+0000","last_active":"2023-12-07T10:01:07.888579+0000","last_peered":"2023-12-07T10:01:07.888579+0000","last_clean":"2023-12-07T10:01:07.888579+0000","last_became_active":"2023-12-07T10:01:05.925590+0000","last_became_peered":"2023-12-07T10:01:05.925590+0000","last_unstale":"2023-12-07T10:01:07.888579+0000","last_undegraded":"2023-12-07T10:01:07.888579+0000","last_fullsized":"2023-12-07T10:01:07.888579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:31.146996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.941994+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:01:06.941994+0000","last_peered":"2023-12-07T10:01:06.941994+0000","last_clean":"2023-12-07T10:01:06.941994+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:01:06.941994+0000","last_undegraded":"2023-12-07T10:01:06.941994+0000","last_fullsized":"2023-12-07T10:01:06.941994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934019+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:01:06.934019+0000","last_peered":"2023-12-07T10:01:06.934019+0000","last_clean":"2023-12-07T10:01:06.934019+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:01:06.934019+0000","last_undegraded":"2023-12-07T10:01:06.934019+0000","last_fullsized":"2023-12-07T10:01:06.934019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732705+0000","last_change":"2023-12-07T10:01:06.947403+0000","last_active":"2023-12-07T10:01:08.732705+0000","last_peered":"2023-12-07T10:01:08.732705+0000","last_clean":"2023-12-07T10:01:08.732705+0000","last_became_active":"2023-12-07T10:01:06.947119+0000","last_became_peered":"2023-12-07T10:01:06.947119+0000","last_unstale":"2023-12-07T10:01:08.732705+0000","last_undegraded":"2023-12-07T10:01:08.732705+0000","last_fullsized":"2023-12-07T10:01:08.732705+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:03:10.053295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932133+0000","last_change":"2023-12-07T10:01:05.934504+0000","last_active":"2023-12-07T10:01:06.932133+0000","last_peered":"2023-12-07T10:01:06.932133+0000","last_clean":"2023-12-07T10:01:06.932133+0000","last_became_active":"2023-12-07T10:01:05.933884+0000","last_became_peered":"2023-12-07T10:01:05.933884+0000","last_unstale":"2023-12-07T10:01:06.932133+0000","last_undegraded":"2023-12-07T10:01:06.932133+0000","last_fullsized":"2023-12-07T10:01:06.932133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:55.910861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928027+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:01:06.928027+0000","last_peered":"2023-12-07T10:01:06.928027+0000","last_clean":"2023-12-07T10:01:06.928027+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:01:06.928027+0000","last_undegraded":"2023-12-07T10:01:06.928027+0000","last_fullsized":"2023-12-07T10:01:06.928027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935202+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:01:06.935202+0000","last_peered":"2023-12-07T10:01:06.935202+0000","last_clean":"2023-12-07T10:01:06.935202+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:01:06.935202+0000","last_undegraded":"2023-12-07T10:01:06.935202+0000","last_fullsized":"2023-12-07T10:01:06.935202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946415+0000","last_change":"2023-12-07T10:01:06.963945+0000","last_active":"2023-12-07T10:01:07.946415+0000","last_peered":"2023-12-07T10:01:07.946415+0000","last_clean":"2023-12-07T10:01:07.946415+0000","last_became_active":"2023-12-07T10:01:06.963409+0000","last_became_peered":"2023-12-07T10:01:06.963409+0000","last_unstale":"2023-12-07T10:01:07.946415+0000","last_undegraded":"2023-12-07T10:01:07.946415+0000","last_fullsized":"2023-12-07T10:01:07.946415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:43.129952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956005+0000","last_change":"2023-12-07T10:01:05.938092+0000","last_active":"2023-12-07T10:01:06.956005+0000","last_peered":"2023-12-07T10:01:06.956005+0000","last_clean":"2023-12-07T10:01:06.956005+0000","last_became_active":"2023-12-07T10:01:05.936547+0000","last_became_peered":"2023-12-07T10:01:05.936547+0000","last_unstale":"2023-12-07T10:01:06.956005+0000","last_undegraded":"2023-12-07T10:01:06.956005+0000","last_fullsized":"2023-12-07T10:01:06.956005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:40:10.271029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.938042+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:01:06.938042+0000","last_peered":"2023-12-07T10:01:06.938042+0000","last_clean":"2023-12-07T10:01:06.938042+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:01:06.938042+0000","last_undegraded":"2023-12-07T10:01:06.938042+0000","last_fullsized":"2023-12-07T10:01:06.938042+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932310+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:01:06.932310+0000","last_peered":"2023-12-07T10:01:06.932310+0000","last_clean":"2023-12-07T10:01:06.932310+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:01:06.932310+0000","last_undegraded":"2023-12-07T10:01:06.932310+0000","last_fullsized":"2023-12-07T10:01:06.932310+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734091+0000","last_change":"2023-12-07T10:01:06.950403+0000","last_active":"2023-12-07T10:01:08.734091+0000","last_peered":"2023-12-07T10:01:08.734091+0000","last_clean":"2023-12-07T10:01:08.734091+0000","last_became_active":"2023-12-07T10:01:06.950120+0000","last_became_peered":"2023-12-07T10:01:06.950120+0000","last_unstale":"2023-12-07T10:01:08.734091+0000","last_undegraded":"2023-12-07T10:01:08.734091+0000","last_fullsized":"2023-12-07T10:01:08.734091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:54.019447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933070+0000","last_change":"2023-12-07T10:01:05.928161+0000","last_active":"2023-12-07T10:01:06.933070+0000","last_peered":"2023-12-07T10:01:06.933070+0000","last_clean":"2023-12-07T10:01:06.933070+0000","last_became_active":"2023-12-07T10:01:05.927865+0000","last_became_peered":"2023-12-07T10:01:05.927865+0000","last_unstale":"2023-12-07T10:01:06.933070+0000","last_undegraded":"2023-12-07T10:01:06.933070+0000","last_fullsized":"2023-12-07T10:01:06.933070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:59.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935143+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:01:06.935143+0000","last_peered":"2023-12-07T10:01:06.935143+0000","last_clean":"2023-12-07T10:01:06.935143+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:01:06.935143+0000","last_undegraded":"2023-12-07T10:01:06.935143+0000","last_fullsized":"2023-12-07T10:01:06.935143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935408+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:01:06.935408+0000","last_peered":"2023-12-07T10:01:06.935408+0000","last_clean":"2023-12-07T10:01:06.935408+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:01:06.935408+0000","last_undegraded":"2023-12-07T10:01:06.935408+0000","last_fullsized":"2023-12-07T10:01:06.935408+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947327+0000","last_change":"2023-12-07T10:01:06.956756+0000","last_active":"2023-12-07T10:01:07.947327+0000","last_peered":"2023-12-07T10:01:07.947327+0000","last_clean":"2023-12-07T10:01:07.947327+0000","last_became_active":"2023-12-07T10:01:06.956448+0000","last_became_peered":"2023-12-07T10:01:06.956448+0000","last_unstale":"2023-12-07T10:01:07.947327+0000","last_undegraded":"2023-12-07T10:01:07.947327+0000","last_fullsized":"2023-12-07T10:01:07.947327+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:49:26.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935042+0000","last_change":"2023-12-07T10:01:05.936607+0000","last_active":"2023-12-07T10:01:06.935042+0000","last_peered":"2023-12-07T10:01:06.935042+0000","last_clean":"2023-12-07T10:01:06.935042+0000","last_became_active":"2023-12-07T10:01:05.936323+0000","last_became_peered":"2023-12-07T10:01:05.936323+0000","last_unstale":"2023-12-07T10:01:06.935042+0000","last_undegraded":"2023-12-07T10:01:06.935042+0000","last_fullsized":"2023-12-07T10:01:06.935042+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:31:28.110490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927749+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:01:06.927749+0000","last_peered":"2023-12-07T10:01:06.927749+0000","last_clean":"2023-12-07T10:01:06.927749+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:01:06.927749+0000","last_undegraded":"2023-12-07T10:01:06.927749+0000","last_fullsized":"2023-12-07T10:01:06.927749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928088+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:01:06.928088+0000","last_peered":"2023-12-07T10:01:06.928088+0000","last_clean":"2023-12-07T10:01:06.928088+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:01:06.928088+0000","last_undegraded":"2023-12-07T10:01:06.928088+0000","last_fullsized":"2023-12-07T10:01:06.928088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941177+0000","last_change":"2023-12-07T10:01:06.950835+0000","last_active":"2023-12-07T10:01:07.941177+0000","last_peered":"2023-12-07T10:01:07.941177+0000","last_clean":"2023-12-07T10:01:07.941177+0000","last_became_active":"2023-12-07T10:01:06.950591+0000","last_became_peered":"2023-12-07T10:01:06.950591+0000","last_unstale":"2023-12-07T10:01:07.941177+0000","last_undegraded":"2023-12-07T10:01:07.941177+0000","last_fullsized":"2023-12-07T10:01:07.941177+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:11.250509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.971646+0000","last_change":"2023-12-07T10:01:05.932922+0000","last_active":"2023-12-07T10:01:06.971646+0000","last_peered":"2023-12-07T10:01:06.971646+0000","last_clean":"2023-12-07T10:01:06.971646+0000","last_became_active":"2023-12-07T10:01:05.932612+0000","last_became_peered":"2023-12-07T10:01:05.932612+0000","last_unstale":"2023-12-07T10:01:06.971646+0000","last_undegraded":"2023-12-07T10:01:06.971646+0000","last_fullsized":"2023-12-07T10:01:06.971646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:13.657094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927731+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:01:06.927731+0000","last_peered":"2023-12-07T10:01:06.927731+0000","last_clean":"2023-12-07T10:01:06.927731+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:01:06.927731+0000","last_undegraded":"2023-12-07T10:01:06.927731+0000","last_fullsized":"2023-12-07T10:01:06.927731+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.957182+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:01:06.957182+0000","last_peered":"2023-12-07T10:01:06.957182+0000","last_clean":"2023-12-07T10:01:06.957182+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:01:06.957182+0000","last_undegraded":"2023-12-07T10:01:06.957182+0000","last_fullsized":"2023-12-07T10:01:06.957182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932270+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:06.932270+0000","last_peered":"2023-12-07T10:01:06.932270+0000","last_clean":"2023-12-07T10:01:06.932270+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:06.932270+0000","last_undegraded":"2023-12-07T10:01:06.932270+0000","last_fullsized":"2023-12-07T10:01:06.932270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1245184,"data_stored":866253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":275201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":275851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":278286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.878}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":275277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.38}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.62},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.75},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":276777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":1.171}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":3.6760000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":1.915}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":8.5660000000000007},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":3.714}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":2.0489999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":2.3599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":3.7519999999999998}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":1.417},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":2.3969999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":4.5110000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":277427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":869166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.877},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:15.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:15.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f405a640 1 Processor -- start 2023-12-07T10:01:15.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f405a640 1 -- start start 2023-12-07T10:01:15.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f405a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 0x7fb4ec158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f405a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec155790 con 0x7fb4ec0ca610 2023-12-07T10:01:15.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f405a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec0c4b00 con 0x7fb4ec06cd90 2023-12-07T10:01:15.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f405a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c4de0 con 0x7fb4ec0bd720 2023-12-07T10:01:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f1df6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb4ec0ca610 0x7fb4ec0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42112/0 (socket says 172.21.15.89:42112) 2023-12-07T10:01:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f1df6640 1 -- 172.21.15.89:0/3764819236 learned_addr learned my addr 172.21.15.89:0/3764819236 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:15.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f15f5640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 0x7fb4ec158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385034459 0 0) 0x7fb4ec155790 con 0x7fb4ec0ca610 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d8003530 con 0x7fb4ec0ca610 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778125952 0 0) 0x7fb4d8003530 con 0x7fb4ec0ca610 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 msgr2=0x7fb4ec158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 0x7fb4ec158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 >> v1:172.21.15.97:6789/0 conn(0x7fb4ec06cd90 legacy=0x7fb4ec0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec157e30 con 0x7fb4ec0ca610 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fb4e8001680 con 0x7fb4ec0ca610 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 >> v1:172.21.15.89:6789/0 conn(0x7fb4ec0ca610 legacy=0x7fb4ec0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d80039b0 0x7fb4d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 0x7fb4d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d8004d10 0x7fb4d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c4de0 con 0x7fb4d8004d10 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bb20 con 0x7fb4d80039b0 2023-12-07T10:01:15.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bcb0 con 0x7fb4ec0bd720 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f25f7640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d8004d10 0x7fb4d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f1df6640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d80039b0 0x7fb4d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f15f5640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 0x7fb4d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f25f7640 1 -- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 msgr2=0x7fb4d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f25f7640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4ec0bd720 0x7fb4d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f25f7640 1 -- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d80039b0 msgr2=0x7fb4d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f25f7640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4d80039b0 0x7fb4d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.700+0000 7fb4f25f7640 1 -- 172.21.15.89:0/3764819236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d8003530 con 0x7fb4d8004d10 2023-12-07T10:01:15.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f25f7640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d8004d10 0x7fb4d8005190 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4001f90 tx=0x7fb4e401efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c53be9c6af7647 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:15.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40a8bd0 con 0x7fb4d8004d10 2023-12-07T10:01:15.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40a8d30 con 0x7fb4d8004d10 2023-12-07T10:01:15.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f0df4640 1 -- 172.21.15.89:0/3764819236 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40a8ea0 con 0x7fb4d8004d10 2023-12-07T10:01:15.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f405a640 1 -- 172.21.15.89:0/3764819236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d8004d10 msgr2=0x7fb4d8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f405a640 1 --2- 172.21.15.89:0/3764819236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4d8004d10 0x7fb4d8005190 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4001f90 tx=0x7fb4e401efb0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f25f7640 1 -- 172.21.15.89:0/3764819236 reap_dead start 2023-12-07T10:01:15.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f405a640 1 -- 172.21.15.89:0/3764819236 shutdown_connections 2023-12-07T10:01:15.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f405a640 1 -- 172.21.15.89:0/3764819236 >> 172.21.15.89:0/3764819236 conn(0x7fb4ec071ea0 msgr2=0x7fb4ec0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:15.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f405a640 1 -- 172.21.15.89:0/3764819236 shutdown_connections 2023-12-07T10:01:15.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.704+0000 7fb4f405a640 1 -- 172.21.15.89:0/3764819236 wait complete. 2023-12-07T10:01:15.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 Processor -- start 2023-12-07T10:01:15.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 -- start start 2023-12-07T10:01:15.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d8004d10 0x7fb4ec0ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 0x7fb4ec14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec14e390 0x7fb4ec0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec14ecd0 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec14e810 con 0x7fb4ec14e390 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0beb60 con 0x7fb4d8004d10 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 0x7fb4ec14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 0x7fb4ec14de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41680/0 (socket says 172.21.15.89:41680) 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 -- 172.21.15.89:0/2770698243 learned_addr learned my addr 172.21.15.89:0/2770698243 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f1df6640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d8004d10 0x7fb4ec0ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f25f7640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec14e390 0x7fb4ec0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 -- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d8004d10 msgr2=0x7fb4ec0ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d8004d10 0x7fb4ec0ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 -- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec14e390 msgr2=0x7fb4ec0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec14e390 0x7fb4ec0c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 -- 172.21.15.89:0/2770698243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0be830 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f15f5640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 0x7fb4ec14de50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc011a00 tx=0x7fb4dc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:15.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00fb50 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00fcb0 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec1ea390 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc014440 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.708+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec0aeb90 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.712+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec0bed10 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.712+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb4dc0145a0 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.712+0000 7fb4e27fc640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb4d0066900 0x7fb4d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:15.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.712+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb4dc084f30 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.712+0000 7fb4f1df6640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb4d0066900 0x7fb4d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:15.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.712+0000 7fb4f1df6640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb4d0066900 0x7fb4d0068dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0ae1b0 tx=0x7fb4e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:15.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.716+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4ec0bed10 con 0x7fb4ec0be2e0 2023-12-07T10:01:15.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.860+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4ec0c9bd0 con 0x7fb4d0066900 2023-12-07T10:01:15.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.876+0000 7fb4e27fc640 1 -- 172.21.15.89:0/2770698243 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527488 (secure 0 0 0) 0x7fb4e8007750 con 0x7fb4d0066900 2023-12-07T10:01:15.885 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:15.889 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb4d0066900 msgr2=0x7fb4d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb4d0066900 0x7fb4d0068dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0ae1b0 tx=0x7fb4e8009040 comp rx=0 tx=0).stop 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 msgr2=0x7fb4ec14de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 0x7fb4ec14de50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc011a00 tx=0x7fb4dc011ec0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 shutdown_connections 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec14e390 0x7fb4ec0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4ec0be2e0 0x7fb4ec14de50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb4d0066900 0x7fb4d0068dc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 --2- 172.21.15.89:0/2770698243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb4d8004d10 0x7fb4ec0ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 >> 172.21.15.89:0/2770698243 conn(0x7fb4ec071ea0 msgr2=0x7fb4ec0c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:15.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 shutdown_connections 2023-12-07T10:01:15.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:15.880+0000 7fb4f405a640 1 -- 172.21.15.89:0/2770698243 wait complete. 2023-12-07T10:01:15.904 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-12-07T10:01:14.365786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":359,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230740,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743980,"statfs":{"total":773094113280,"available":772857835520,"internally_reserved":0,"allocated":6397952,"data_stored":3394238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002124"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941782+0000","last_change":"2023-12-07T10:01:06.954936+0000","last_active":"2023-12-07T10:01:07.941782+0000","last_peered":"2023-12-07T10:01:07.941782+0000","last_clean":"2023-12-07T10:01:07.941782+0000","last_became_active":"2023-12-07T10:01:06.954596+0000","last_became_peered":"2023-12-07T10:01:06.954596+0000","last_unstale":"2023-12-07T10:01:07.941782+0000","last_undegraded":"2023-12-07T10:01:07.941782+0000","last_fullsized":"2023-12-07T10:01:07.941782+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:06.571099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934310+0000","last_change":"2023-12-07T10:00:53.242478+0000","last_active":"2023-12-07T10:01:06.934310+0000","last_peered":"2023-12-07T10:01:06.934310+0000","last_clean":"2023-12-07T10:01:06.934310+0000","last_became_active":"2023-12-07T10:00:53.242199+0000","last_became_peered":"2023-12-07T10:00:53.242199+0000","last_unstale":"2023-12-07T10:01:06.934310+0000","last_undegraded":"2023-12-07T10:01:06.934310+0000","last_fullsized":"2023-12-07T10:01:06.934310+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:06.142765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734597+0000","last_change":"2023-12-07T10:01:06.960711+0000","last_active":"2023-12-07T10:01:08.734597+0000","last_peered":"2023-12-07T10:01:08.734597+0000","last_clean":"2023-12-07T10:01:08.734597+0000","last_became_active":"2023-12-07T10:01:06.960402+0000","last_became_peered":"2023-12-07T10:01:06.960402+0000","last_unstale":"2023-12-07T10:01:08.734597+0000","last_undegraded":"2023-12-07T10:01:08.734597+0000","last_fullsized":"2023-12-07T10:01:08.734597+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:40:11.278879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928134+0000","last_change":"2023-12-07T10:00:53.248851+0000","last_active":"2023-12-07T10:01:06.928134+0000","last_peered":"2023-12-07T10:01:06.928134+0000","last_clean":"2023-12-07T10:01:06.928134+0000","last_became_active":"2023-12-07T10:00:53.248579+0000","last_became_peered":"2023-12-07T10:00:53.248579+0000","last_unstale":"2023-12-07T10:01:06.928134+0000","last_undegraded":"2023-12-07T10:01:06.928134+0000","last_fullsized":"2023-12-07T10:01:06.928134+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:42.454761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947411+0000","last_change":"2023-12-07T10:01:06.954444+0000","last_active":"2023-12-07T10:01:07.947411+0000","last_peered":"2023-12-07T10:01:07.947411+0000","last_clean":"2023-12-07T10:01:07.947411+0000","last_became_active":"2023-12-07T10:01:06.954184+0000","last_became_peered":"2023-12-07T10:01:06.954184+0000","last_unstale":"2023-12-07T10:01:07.947411+0000","last_undegraded":"2023-12-07T10:01:07.947411+0000","last_fullsized":"2023-12-07T10:01:07.947411+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:19:05.544002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939602+0000","last_change":"2023-12-07T10:00:53.246474+0000","last_active":"2023-12-07T10:01:06.939602+0000","last_peered":"2023-12-07T10:01:06.939602+0000","last_clean":"2023-12-07T10:01:06.939602+0000","last_became_active":"2023-12-07T10:00:53.246216+0000","last_became_peered":"2023-12-07T10:00:53.246216+0000","last_unstale":"2023-12-07T10:01:06.939602+0000","last_undegraded":"2023-12-07T10:01:06.939602+0000","last_fullsized":"2023-12-07T10:01:06.939602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949189+0000","last_change":"2023-12-07T10:01:06.965982+0000","last_active":"2023-12-07T10:01:07.949189+0000","last_peered":"2023-12-07T10:01:07.949189+0000","last_clean":"2023-12-07T10:01:07.949189+0000","last_became_active":"2023-12-07T10:01:06.962736+0000","last_became_peered":"2023-12-07T10:01:06.962736+0000","last_unstale":"2023-12-07T10:01:07.949189+0000","last_undegraded":"2023-12-07T10:01:07.949189+0000","last_fullsized":"2023-12-07T10:01:07.949189+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:59.451520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932701+0000","last_change":"2023-12-07T10:00:53.241983+0000","last_active":"2023-12-07T10:01:06.932701+0000","last_peered":"2023-12-07T10:01:06.932701+0000","last_clean":"2023-12-07T10:01:06.932701+0000","last_became_active":"2023-12-07T10:00:53.241746+0000","last_became_peered":"2023-12-07T10:00:53.241746+0000","last_unstale":"2023-12-07T10:01:06.932701+0000","last_undegraded":"2023-12-07T10:01:06.932701+0000","last_fullsized":"2023-12-07T10:01:06.932701+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:02:56.977095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732955+0000","last_change":"2023-12-07T10:01:06.954857+0000","last_active":"2023-12-07T10:01:08.732955+0000","last_peered":"2023-12-07T10:01:08.732955+0000","last_clean":"2023-12-07T10:01:08.732955+0000","last_became_active":"2023-12-07T10:01:06.954577+0000","last_became_peered":"2023-12-07T10:01:06.954577+0000","last_unstale":"2023-12-07T10:01:08.732955+0000","last_undegraded":"2023-12-07T10:01:08.732955+0000","last_fullsized":"2023-12-07T10:01:08.732955+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:04.849349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933149+0000","last_change":"2023-12-07T10:00:53.241761+0000","last_active":"2023-12-07T10:01:06.933149+0000","last_peered":"2023-12-07T10:01:06.933149+0000","last_clean":"2023-12-07T10:01:06.933149+0000","last_became_active":"2023-12-07T10:00:53.241465+0000","last_became_peered":"2023-12-07T10:00:53.241465+0000","last_unstale":"2023-12-07T10:01:06.933149+0000","last_undegraded":"2023-12-07T10:01:06.933149+0000","last_fullsized":"2023-12-07T10:01:06.933149+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:13:38.707947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946144+0000","last_change":"2023-12-07T10:01:06.968860+0000","last_active":"2023-12-07T10:01:07.946144+0000","last_peered":"2023-12-07T10:01:07.946144+0000","last_clean":"2023-12-07T10:01:07.946144+0000","last_became_active":"2023-12-07T10:01:06.965982+0000","last_became_peered":"2023-12-07T10:01:06.965982+0000","last_unstale":"2023-12-07T10:01:07.946144+0000","last_undegraded":"2023-12-07T10:01:07.946144+0000","last_fullsized":"2023-12-07T10:01:07.946144+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:52.052585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939631+0000","last_change":"2023-12-07T10:00:53.252965+0000","last_active":"2023-12-07T10:01:06.939631+0000","last_peered":"2023-12-07T10:01:06.939631+0000","last_clean":"2023-12-07T10:01:06.939631+0000","last_became_active":"2023-12-07T10:00:53.252699+0000","last_became_peered":"2023-12-07T10:00:53.252699+0000","last_unstale":"2023-12-07T10:01:06.939631+0000","last_undegraded":"2023-12-07T10:01:06.939631+0000","last_fullsized":"2023-12-07T10:01:06.939631+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733041+0000","last_change":"2023-12-07T10:01:06.943288+0000","last_active":"2023-12-07T10:01:08.733041+0000","last_peered":"2023-12-07T10:01:08.733041+0000","last_clean":"2023-12-07T10:01:08.733041+0000","last_became_active":"2023-12-07T10:01:06.942994+0000","last_became_peered":"2023-12-07T10:01:06.942994+0000","last_unstale":"2023-12-07T10:01:08.733041+0000","last_undegraded":"2023-12-07T10:01:08.733041+0000","last_fullsized":"2023-12-07T10:01:08.733041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:23:14.710655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932215+0000","last_change":"2023-12-07T10:00:53.242914+0000","last_active":"2023-12-07T10:01:06.932215+0000","last_peered":"2023-12-07T10:01:06.932215+0000","last_clean":"2023-12-07T10:01:06.932215+0000","last_became_active":"2023-12-07T10:00:53.242629+0000","last_became_peered":"2023-12-07T10:00:53.242629+0000","last_unstale":"2023-12-07T10:01:06.932215+0000","last_undegraded":"2023-12-07T10:01:06.932215+0000","last_fullsized":"2023-12-07T10:01:06.932215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:04.083831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947084+0000","last_change":"2023-12-07T10:01:06.963742+0000","last_active":"2023-12-07T10:01:07.947084+0000","last_peered":"2023-12-07T10:01:07.947084+0000","last_clean":"2023-12-07T10:01:07.947084+0000","last_became_active":"2023-12-07T10:01:06.963444+0000","last_became_peered":"2023-12-07T10:01:06.963444+0000","last_unstale":"2023-12-07T10:01:07.947084+0000","last_undegraded":"2023-12-07T10:01:07.947084+0000","last_fullsized":"2023-12-07T10:01:07.947084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:12:01.230270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927627+0000","last_change":"2023-12-07T10:00:53.243793+0000","last_active":"2023-12-07T10:01:06.927627+0000","last_peered":"2023-12-07T10:01:06.927627+0000","last_clean":"2023-12-07T10:01:06.927627+0000","last_became_active":"2023-12-07T10:00:53.243387+0000","last_became_peered":"2023-12-07T10:00:53.243387+0000","last_unstale":"2023-12-07T10:01:06.927627+0000","last_undegraded":"2023-12-07T10:01:06.927627+0000","last_fullsized":"2023-12-07T10:01:06.927627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:57:51.776522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946696+0000","last_change":"2023-12-07T10:01:06.951459+0000","last_active":"2023-12-07T10:01:07.946696+0000","last_peered":"2023-12-07T10:01:07.946696+0000","last_clean":"2023-12-07T10:01:07.946696+0000","last_became_active":"2023-12-07T10:01:06.951076+0000","last_became_peered":"2023-12-07T10:01:06.951076+0000","last_unstale":"2023-12-07T10:01:07.946696+0000","last_undegraded":"2023-12-07T10:01:07.946696+0000","last_fullsized":"2023-12-07T10:01:07.946696+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:45:19.393712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934316+0000","last_change":"2023-12-07T10:00:53.246621+0000","last_active":"2023-12-07T10:01:06.934316+0000","last_peered":"2023-12-07T10:01:06.934316+0000","last_clean":"2023-12-07T10:01:06.934316+0000","last_became_active":"2023-12-07T10:00:53.246014+0000","last_became_peered":"2023-12-07T10:00:53.246014+0000","last_unstale":"2023-12-07T10:01:06.934316+0000","last_undegraded":"2023-12-07T10:01:06.934316+0000","last_fullsized":"2023-12-07T10:01:06.934316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:40.943247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733946+0000","last_change":"2023-12-07T10:01:06.946514+0000","last_active":"2023-12-07T10:01:08.733946+0000","last_peered":"2023-12-07T10:01:08.733946+0000","last_clean":"2023-12-07T10:01:08.733946+0000","last_became_active":"2023-12-07T10:01:06.945901+0000","last_became_peered":"2023-12-07T10:01:06.945901+0000","last_unstale":"2023-12-07T10:01:08.733946+0000","last_undegraded":"2023-12-07T10:01:08.733946+0000","last_fullsized":"2023-12-07T10:01:08.733946+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:52.664866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935831+0000","last_change":"2023-12-07T10:00:53.244774+0000","last_active":"2023-12-07T10:01:06.935831+0000","last_peered":"2023-12-07T10:01:06.935831+0000","last_clean":"2023-12-07T10:01:06.935831+0000","last_became_active":"2023-12-07T10:00:53.244516+0000","last_became_peered":"2023-12-07T10:00:53.244516+0000","last_unstale":"2023-12-07T10:01:06.935831+0000","last_undegraded":"2023-12-07T10:01:06.935831+0000","last_fullsized":"2023-12-07T10:01:06.935831+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:59.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734254+0000","last_change":"2023-12-07T10:01:06.959813+0000","last_active":"2023-12-07T10:01:08.734254+0000","last_peered":"2023-12-07T10:01:08.734254+0000","last_clean":"2023-12-07T10:01:08.734254+0000","last_became_active":"2023-12-07T10:01:06.956778+0000","last_became_peered":"2023-12-07T10:01:06.956778+0000","last_unstale":"2023-12-07T10:01:08.734254+0000","last_undegraded":"2023-12-07T10:01:08.734254+0000","last_fullsized":"2023-12-07T10:01:08.734254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:59.502341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935779+0000","last_change":"2023-12-07T10:00:53.241606+0000","last_active":"2023-12-07T10:01:06.935779+0000","last_peered":"2023-12-07T10:01:06.935779+0000","last_clean":"2023-12-07T10:01:06.935779+0000","last_became_active":"2023-12-07T10:00:53.241180+0000","last_became_peered":"2023-12-07T10:00:53.241180+0000","last_unstale":"2023-12-07T10:01:06.935779+0000","last_undegraded":"2023-12-07T10:01:06.935779+0000","last_fullsized":"2023-12-07T10:01:06.935779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:47.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949871+0000","last_change":"2023-12-07T10:01:06.954444+0000","last_active":"2023-12-07T10:01:07.949871+0000","last_peered":"2023-12-07T10:01:07.949871+0000","last_clean":"2023-12-07T10:01:07.949871+0000","last_became_active":"2023-12-07T10:01:06.954126+0000","last_became_peered":"2023-12-07T10:01:06.954126+0000","last_unstale":"2023-12-07T10:01:07.949871+0000","last_undegraded":"2023-12-07T10:01:07.949871+0000","last_fullsized":"2023-12-07T10:01:07.949871+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:53.591614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934114+0000","last_change":"2023-12-07T10:00:53.252094+0000","last_active":"2023-12-07T10:01:06.934114+0000","last_peered":"2023-12-07T10:01:06.934114+0000","last_clean":"2023-12-07T10:01:06.934114+0000","last_became_active":"2023-12-07T10:00:53.251298+0000","last_became_peered":"2023-12-07T10:00:53.251298+0000","last_unstale":"2023-12-07T10:01:06.934114+0000","last_undegraded":"2023-12-07T10:01:06.934114+0000","last_fullsized":"2023-12-07T10:01:06.934114+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:39.588666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732825+0000","last_change":"2023-12-07T10:01:06.945052+0000","last_active":"2023-12-07T10:01:08.732825+0000","last_peered":"2023-12-07T10:01:08.732825+0000","last_clean":"2023-12-07T10:01:08.732825+0000","last_became_active":"2023-12-07T10:01:06.944792+0000","last_became_peered":"2023-12-07T10:01:06.944792+0000","last_unstale":"2023-12-07T10:01:08.732825+0000","last_undegraded":"2023-12-07T10:01:08.732825+0000","last_fullsized":"2023-12-07T10:01:08.732825+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:07.953587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956143+0000","last_change":"2023-12-07T10:00:53.252678+0000","last_active":"2023-12-07T10:01:06.956143+0000","last_peered":"2023-12-07T10:01:06.956143+0000","last_clean":"2023-12-07T10:01:06.956143+0000","last_became_active":"2023-12-07T10:00:53.251698+0000","last_became_peered":"2023-12-07T10:00:53.251698+0000","last_unstale":"2023-12-07T10:01:06.956143+0000","last_undegraded":"2023-12-07T10:01:06.956143+0000","last_fullsized":"2023-12-07T10:01:06.956143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:57:39.955092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948002+0000","last_change":"2023-12-07T10:01:06.964360+0000","last_active":"2023-12-07T10:01:07.948002+0000","last_peered":"2023-12-07T10:01:07.948002+0000","last_clean":"2023-12-07T10:01:07.948002+0000","last_became_active":"2023-12-07T10:01:06.964095+0000","last_became_peered":"2023-12-07T10:01:06.964095+0000","last_unstale":"2023-12-07T10:01:07.948002+0000","last_undegraded":"2023-12-07T10:01:07.948002+0000","last_fullsized":"2023-12-07T10:01:07.948002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:12.456972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932224+0000","last_change":"2023-12-07T10:00:53.238320+0000","last_active":"2023-12-07T10:01:06.932224+0000","last_peered":"2023-12-07T10:01:06.932224+0000","last_clean":"2023-12-07T10:01:06.932224+0000","last_became_active":"2023-12-07T10:00:53.237998+0000","last_became_peered":"2023-12-07T10:00:53.237998+0000","last_unstale":"2023-12-07T10:01:06.932224+0000","last_undegraded":"2023-12-07T10:01:06.932224+0000","last_fullsized":"2023-12-07T10:01:06.932224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:26.825119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732816+0000","last_change":"2023-12-07T10:01:06.966654+0000","last_active":"2023-12-07T10:01:08.732816+0000","last_peered":"2023-12-07T10:01:08.732816+0000","last_clean":"2023-12-07T10:01:08.732816+0000","last_became_active":"2023-12-07T10:01:06.966372+0000","last_became_peered":"2023-12-07T10:01:06.966372+0000","last_unstale":"2023-12-07T10:01:08.732816+0000","last_undegraded":"2023-12-07T10:01:08.732816+0000","last_fullsized":"2023-12-07T10:01:08.732816+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:49:55.530961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932406+0000","last_change":"2023-12-07T10:00:53.242118+0000","last_active":"2023-12-07T10:01:06.932406+0000","last_peered":"2023-12-07T10:01:06.932406+0000","last_clean":"2023-12-07T10:01:06.932406+0000","last_became_active":"2023-12-07T10:00:53.241843+0000","last_became_peered":"2023-12-07T10:00:53.241843+0000","last_unstale":"2023-12-07T10:01:06.932406+0000","last_undegraded":"2023-12-07T10:01:06.932406+0000","last_fullsized":"2023-12-07T10:01:06.932406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:46.426142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733196+0000","last_change":"2023-12-07T10:01:06.941718+0000","last_active":"2023-12-07T10:01:08.733196+0000","last_peered":"2023-12-07T10:01:08.733196+0000","last_clean":"2023-12-07T10:01:08.733196+0000","last_became_active":"2023-12-07T10:01:06.941358+0000","last_became_peered":"2023-12-07T10:01:06.941358+0000","last_unstale":"2023-12-07T10:01:08.733196+0000","last_undegraded":"2023-12-07T10:01:08.733196+0000","last_fullsized":"2023-12-07T10:01:08.733196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:34.951918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943971+0000","last_change":"2023-12-07T10:00:53.246991+0000","last_active":"2023-12-07T10:01:06.943971+0000","last_peered":"2023-12-07T10:01:06.943971+0000","last_clean":"2023-12-07T10:01:06.943971+0000","last_became_active":"2023-12-07T10:00:53.246719+0000","last_became_peered":"2023-12-07T10:00:53.246719+0000","last_unstale":"2023-12-07T10:01:06.943971+0000","last_undegraded":"2023-12-07T10:01:06.943971+0000","last_fullsized":"2023-12-07T10:01:06.943971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948793+0000","last_change":"2023-12-07T10:01:06.964789+0000","last_active":"2023-12-07T10:01:07.948793+0000","last_peered":"2023-12-07T10:01:07.948793+0000","last_clean":"2023-12-07T10:01:07.948793+0000","last_became_active":"2023-12-07T10:01:06.961691+0000","last_became_peered":"2023-12-07T10:01:06.961691+0000","last_unstale":"2023-12-07T10:01:07.948793+0000","last_undegraded":"2023-12-07T10:01:07.948793+0000","last_fullsized":"2023-12-07T10:01:07.948793+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:55.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928879+0000","last_change":"2023-12-07T10:00:53.249701+0000","last_active":"2023-12-07T10:01:06.928879+0000","last_peered":"2023-12-07T10:01:06.928879+0000","last_clean":"2023-12-07T10:01:06.928879+0000","last_became_active":"2023-12-07T10:00:53.249407+0000","last_became_peered":"2023-12-07T10:00:53.249407+0000","last_unstale":"2023-12-07T10:01:06.928879+0000","last_undegraded":"2023-12-07T10:01:06.928879+0000","last_fullsized":"2023-12-07T10:01:06.928879+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:16:54.877387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733594+0000","last_change":"2023-12-07T10:01:06.948958+0000","last_active":"2023-12-07T10:01:08.733594+0000","last_peered":"2023-12-07T10:01:08.733594+0000","last_clean":"2023-12-07T10:01:08.733594+0000","last_became_active":"2023-12-07T10:01:06.948351+0000","last_became_peered":"2023-12-07T10:01:06.948351+0000","last_unstale":"2023-12-07T10:01:08.733594+0000","last_undegraded":"2023-12-07T10:01:08.733594+0000","last_fullsized":"2023-12-07T10:01:08.733594+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:30.942820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.937652+0000","last_change":"2023-12-07T10:00:53.248072+0000","last_active":"2023-12-07T10:01:06.937652+0000","last_peered":"2023-12-07T10:01:06.937652+0000","last_clean":"2023-12-07T10:01:06.937652+0000","last_became_active":"2023-12-07T10:00:53.247693+0000","last_became_peered":"2023-12-07T10:00:53.247693+0000","last_unstale":"2023-12-07T10:01:06.937652+0000","last_undegraded":"2023-12-07T10:01:06.937652+0000","last_fullsized":"2023-12-07T10:01:06.937652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.735010+0000","last_change":"2023-12-07T10:01:06.956874+0000","last_active":"2023-12-07T10:01:08.735010+0000","last_peered":"2023-12-07T10:01:08.735010+0000","last_clean":"2023-12-07T10:01:08.735010+0000","last_became_active":"2023-12-07T10:01:06.956489+0000","last_became_peered":"2023-12-07T10:01:06.956489+0000","last_unstale":"2023-12-07T10:01:08.735010+0000","last_undegraded":"2023-12-07T10:01:08.735010+0000","last_fullsized":"2023-12-07T10:01:08.735010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:21:39.901319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934005+0000","last_change":"2023-12-07T10:00:53.242350+0000","last_active":"2023-12-07T10:01:06.934005+0000","last_peered":"2023-12-07T10:01:06.934005+0000","last_clean":"2023-12-07T10:01:06.934005+0000","last_became_active":"2023-12-07T10:00:53.242023+0000","last_became_peered":"2023-12-07T10:00:53.242023+0000","last_unstale":"2023-12-07T10:01:06.934005+0000","last_undegraded":"2023-12-07T10:01:06.934005+0000","last_fullsized":"2023-12-07T10:01:06.934005+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:04:21.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734187+0000","last_change":"2023-12-07T10:01:06.955523+0000","last_active":"2023-12-07T10:01:08.734187+0000","last_peered":"2023-12-07T10:01:08.734187+0000","last_clean":"2023-12-07T10:01:08.734187+0000","last_became_active":"2023-12-07T10:01:06.955269+0000","last_became_peered":"2023-12-07T10:01:06.955269+0000","last_unstale":"2023-12-07T10:01:08.734187+0000","last_undegraded":"2023-12-07T10:01:08.734187+0000","last_fullsized":"2023-12-07T10:01:08.734187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:14.664943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927839+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:01:06.927839+0000","last_peered":"2023-12-07T10:01:06.927839+0000","last_clean":"2023-12-07T10:01:06.927839+0000","last_became_active":"2023-12-07T10:00:53.249984+0000","last_became_peered":"2023-12-07T10:00:53.249984+0000","last_unstale":"2023-12-07T10:01:06.927839+0000","last_undegraded":"2023-12-07T10:01:06.927839+0000","last_fullsized":"2023-12-07T10:01:06.927839+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:10.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.945608+0000","last_change":"2023-12-07T10:01:06.940462+0000","last_active":"2023-12-07T10:01:07.945608+0000","last_peered":"2023-12-07T10:01:07.945608+0000","last_clean":"2023-12-07T10:01:07.945608+0000","last_became_active":"2023-12-07T10:01:06.940160+0000","last_became_peered":"2023-12-07T10:01:06.940160+0000","last_unstale":"2023-12-07T10:01:07.945608+0000","last_undegraded":"2023-12-07T10:01:07.945608+0000","last_fullsized":"2023-12-07T10:01:07.945608+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:46:28.067287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935312+0000","last_change":"2023-12-07T10:00:53.246938+0000","last_active":"2023-12-07T10:01:06.935312+0000","last_peered":"2023-12-07T10:01:06.935312+0000","last_clean":"2023-12-07T10:01:06.935312+0000","last_became_active":"2023-12-07T10:00:53.246614+0000","last_became_peered":"2023-12-07T10:00:53.246614+0000","last_unstale":"2023-12-07T10:01:06.935312+0000","last_undegraded":"2023-12-07T10:01:06.935312+0000","last_fullsized":"2023-12-07T10:01:06.935312+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.945322+0000","last_change":"2023-12-07T10:01:06.963068+0000","last_active":"2023-12-07T10:01:07.945322+0000","last_peered":"2023-12-07T10:01:07.945322+0000","last_clean":"2023-12-07T10:01:07.945322+0000","last_became_active":"2023-12-07T10:01:06.962799+0000","last_became_peered":"2023-12-07T10:01:06.962799+0000","last_unstale":"2023-12-07T10:01:07.945322+0000","last_undegraded":"2023-12-07T10:01:07.945322+0000","last_fullsized":"2023-12-07T10:01:07.945322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:07.953587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927617+0000","last_change":"2023-12-07T10:00:53.239714+0000","last_active":"2023-12-07T10:01:06.927617+0000","last_peered":"2023-12-07T10:01:06.927617+0000","last_clean":"2023-12-07T10:01:06.927617+0000","last_became_active":"2023-12-07T10:00:53.239272+0000","last_became_peered":"2023-12-07T10:00:53.239272+0000","last_unstale":"2023-12-07T10:01:06.927617+0000","last_undegraded":"2023-12-07T10:01:06.927617+0000","last_fullsized":"2023-12-07T10:01:06.927617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:12.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949604+0000","last_change":"2023-12-07T10:01:06.948432+0000","last_active":"2023-12-07T10:01:07.949604+0000","last_peered":"2023-12-07T10:01:07.949604+0000","last_clean":"2023-12-07T10:01:07.949604+0000","last_became_active":"2023-12-07T10:01:06.948143+0000","last_became_peered":"2023-12-07T10:01:06.948143+0000","last_unstale":"2023-12-07T10:01:07.949604+0000","last_undegraded":"2023-12-07T10:01:07.949604+0000","last_fullsized":"2023-12-07T10:01:07.949604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:58.155802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933358+0000","last_change":"2023-12-07T10:00:53.241930+0000","last_active":"2023-12-07T10:01:06.933358+0000","last_peered":"2023-12-07T10:01:06.933358+0000","last_clean":"2023-12-07T10:01:06.933358+0000","last_became_active":"2023-12-07T10:00:53.241025+0000","last_became_peered":"2023-12-07T10:00:53.241025+0000","last_unstale":"2023-12-07T10:01:06.933358+0000","last_undegraded":"2023-12-07T10:01:06.933358+0000","last_fullsized":"2023-12-07T10:01:06.933358+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948733+0000","last_change":"2023-12-07T10:01:06.945211+0000","last_active":"2023-12-07T10:01:07.948733+0000","last_peered":"2023-12-07T10:01:07.948733+0000","last_clean":"2023-12-07T10:01:07.948733+0000","last_became_active":"2023-12-07T10:01:06.944919+0000","last_became_peered":"2023-12-07T10:01:06.944919+0000","last_unstale":"2023-12-07T10:01:07.948733+0000","last_undegraded":"2023-12-07T10:01:07.948733+0000","last_fullsized":"2023-12-07T10:01:07.948733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:10.038650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956521+0000","last_change":"2023-12-07T10:00:53.251024+0000","last_active":"2023-12-07T10:01:06.956521+0000","last_peered":"2023-12-07T10:01:06.956521+0000","last_clean":"2023-12-07T10:01:06.956521+0000","last_became_active":"2023-12-07T10:00:53.250740+0000","last_became_peered":"2023-12-07T10:00:53.250740+0000","last_unstale":"2023-12-07T10:01:06.956521+0000","last_undegraded":"2023-12-07T10:01:06.956521+0000","last_fullsized":"2023-12-07T10:01:06.956521+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:39.926844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941829+0000","last_change":"2023-12-07T10:01:06.937982+0000","last_active":"2023-12-07T10:01:07.941829+0000","last_peered":"2023-12-07T10:01:07.941829+0000","last_clean":"2023-12-07T10:01:07.941829+0000","last_became_active":"2023-12-07T10:01:06.937704+0000","last_became_peered":"2023-12-07T10:01:06.937704+0000","last_unstale":"2023-12-07T10:01:07.941829+0000","last_undegraded":"2023-12-07T10:01:07.941829+0000","last_fullsized":"2023-12-07T10:01:07.941829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:10.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934357+0000","last_change":"2023-12-07T10:00:53.237557+0000","last_active":"2023-12-07T10:01:06.934357+0000","last_peered":"2023-12-07T10:01:06.934357+0000","last_clean":"2023-12-07T10:01:06.934357+0000","last_became_active":"2023-12-07T10:00:53.237293+0000","last_became_peered":"2023-12-07T10:00:53.237293+0000","last_unstale":"2023-12-07T10:01:06.934357+0000","last_undegraded":"2023-12-07T10:01:06.934357+0000","last_fullsized":"2023-12-07T10:01:06.934357+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:29.463097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949571+0000","last_change":"2023-12-07T10:01:06.946503+0000","last_active":"2023-12-07T10:01:07.949571+0000","last_peered":"2023-12-07T10:01:07.949571+0000","last_clean":"2023-12-07T10:01:07.949571+0000","last_became_active":"2023-12-07T10:01:06.946245+0000","last_became_peered":"2023-12-07T10:01:06.946245+0000","last_unstale":"2023-12-07T10:01:07.949571+0000","last_undegraded":"2023-12-07T10:01:07.949571+0000","last_fullsized":"2023-12-07T10:01:07.949571+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:59.451520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935864+0000","last_change":"2023-12-07T10:00:53.252820+0000","last_active":"2023-12-07T10:01:06.935864+0000","last_peered":"2023-12-07T10:01:06.935864+0000","last_clean":"2023-12-07T10:01:06.935864+0000","last_became_active":"2023-12-07T10:00:53.252411+0000","last_became_peered":"2023-12-07T10:00:53.252411+0000","last_unstale":"2023-12-07T10:01:06.935864+0000","last_undegraded":"2023-12-07T10:01:06.935864+0000","last_fullsized":"2023-12-07T10:01:06.935864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:01.588744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949866+0000","last_change":"2023-12-07T10:01:06.954196+0000","last_active":"2023-12-07T10:01:07.949866+0000","last_peered":"2023-12-07T10:01:07.949866+0000","last_clean":"2023-12-07T10:01:07.949866+0000","last_became_active":"2023-12-07T10:01:06.953986+0000","last_became_peered":"2023-12-07T10:01:06.953986+0000","last_unstale":"2023-12-07T10:01:07.949866+0000","last_undegraded":"2023-12-07T10:01:07.949866+0000","last_fullsized":"2023-12-07T10:01:07.949866+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:08:53.051587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.941840+0000","last_change":"2023-12-07T10:00:53.249532+0000","last_active":"2023-12-07T10:01:06.941840+0000","last_peered":"2023-12-07T10:01:06.941840+0000","last_clean":"2023-12-07T10:01:06.941840+0000","last_became_active":"2023-12-07T10:00:53.249172+0000","last_became_peered":"2023-12-07T10:00:53.249172+0000","last_unstale":"2023-12-07T10:01:06.941840+0000","last_undegraded":"2023-12-07T10:01:06.941840+0000","last_fullsized":"2023-12-07T10:01:06.941840+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:59:38.931061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733708+0000","last_change":"2023-12-07T10:01:06.968010+0000","last_active":"2023-12-07T10:01:08.733708+0000","last_peered":"2023-12-07T10:01:08.733708+0000","last_clean":"2023-12-07T10:01:08.733708+0000","last_became_active":"2023-12-07T10:01:06.967720+0000","last_became_peered":"2023-12-07T10:01:06.967720+0000","last_unstale":"2023-12-07T10:01:08.733708+0000","last_undegraded":"2023-12-07T10:01:08.733708+0000","last_fullsized":"2023-12-07T10:01:08.733708+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:05.941060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933847+0000","last_change":"2023-12-07T10:00:53.242962+0000","last_active":"2023-12-07T10:01:06.933847+0000","last_peered":"2023-12-07T10:01:06.933847+0000","last_clean":"2023-12-07T10:01:06.933847+0000","last_became_active":"2023-12-07T10:00:53.242667+0000","last_became_peered":"2023-12-07T10:00:53.242667+0000","last_unstale":"2023-12-07T10:01:06.933847+0000","last_undegraded":"2023-12-07T10:01:06.933847+0000","last_fullsized":"2023-12-07T10:01:06.933847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:59.431594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733059+0000","last_change":"2023-12-07T10:01:06.946505+0000","last_active":"2023-12-07T10:01:08.733059+0000","last_peered":"2023-12-07T10:01:08.733059+0000","last_clean":"2023-12-07T10:01:08.733059+0000","last_became_active":"2023-12-07T10:01:06.946220+0000","last_became_peered":"2023-12-07T10:01:06.946220+0000","last_unstale":"2023-12-07T10:01:08.733059+0000","last_undegraded":"2023-12-07T10:01:08.733059+0000","last_fullsized":"2023-12-07T10:01:08.733059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:03:23.288655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928381+0000","last_change":"2023-12-07T10:00:53.248817+0000","last_active":"2023-12-07T10:01:06.928381+0000","last_peered":"2023-12-07T10:01:06.928381+0000","last_clean":"2023-12-07T10:01:06.928381+0000","last_became_active":"2023-12-07T10:00:53.248481+0000","last_became_peered":"2023-12-07T10:00:53.248481+0000","last_unstale":"2023-12-07T10:01:06.928381+0000","last_undegraded":"2023-12-07T10:01:06.928381+0000","last_fullsized":"2023-12-07T10:01:06.928381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:28:17.866620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946683+0000","last_change":"2023-12-07T10:01:06.956166+0000","last_active":"2023-12-07T10:01:07.946683+0000","last_peered":"2023-12-07T10:01:07.946683+0000","last_clean":"2023-12-07T10:01:07.946683+0000","last_became_active":"2023-12-07T10:01:06.955184+0000","last_became_peered":"2023-12-07T10:01:06.955184+0000","last_unstale":"2023-12-07T10:01:07.946683+0000","last_undegraded":"2023-12-07T10:01:07.946683+0000","last_fullsized":"2023-12-07T10:01:07.946683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:38.075721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933503+0000","last_change":"2023-12-07T10:00:53.246600+0000","last_active":"2023-12-07T10:01:06.933503+0000","last_peered":"2023-12-07T10:01:06.933503+0000","last_clean":"2023-12-07T10:01:06.933503+0000","last_became_active":"2023-12-07T10:00:53.246145+0000","last_became_peered":"2023-12-07T10:00:53.246145+0000","last_unstale":"2023-12-07T10:01:06.933503+0000","last_undegraded":"2023-12-07T10:01:06.933503+0000","last_fullsized":"2023-12-07T10:01:06.933503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941681+0000","last_change":"2023-12-07T10:01:06.938545+0000","last_active":"2023-12-07T10:01:07.941681+0000","last_peered":"2023-12-07T10:01:07.941681+0000","last_clean":"2023-12-07T10:01:07.941681+0000","last_became_active":"2023-12-07T10:01:06.938170+0000","last_became_peered":"2023-12-07T10:01:06.938170+0000","last_unstale":"2023-12-07T10:01:07.941681+0000","last_undegraded":"2023-12-07T10:01:07.941681+0000","last_fullsized":"2023-12-07T10:01:07.941681+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:12.983029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932039+0000","last_change":"2023-12-07T10:00:53.237062+0000","last_active":"2023-12-07T10:01:06.932039+0000","last_peered":"2023-12-07T10:01:06.932039+0000","last_clean":"2023-12-07T10:01:06.932039+0000","last_became_active":"2023-12-07T10:00:53.236580+0000","last_became_peered":"2023-12-07T10:00:53.236580+0000","last_unstale":"2023-12-07T10:01:06.932039+0000","last_undegraded":"2023-12-07T10:01:06.932039+0000","last_fullsized":"2023-12-07T10:01:06.932039+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:32.134887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733079+0000","last_change":"2023-12-07T10:01:06.950431+0000","last_active":"2023-12-07T10:01:08.733079+0000","last_peered":"2023-12-07T10:01:08.733079+0000","last_clean":"2023-12-07T10:01:08.733079+0000","last_became_active":"2023-12-07T10:01:06.950155+0000","last_became_peered":"2023-12-07T10:01:06.950155+0000","last_unstale":"2023-12-07T10:01:08.733079+0000","last_undegraded":"2023-12-07T10:01:08.733079+0000","last_fullsized":"2023-12-07T10:01:08.733079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:55.370892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.944178+0000","last_change":"2023-12-07T10:00:53.243149+0000","last_active":"2023-12-07T10:01:06.944178+0000","last_peered":"2023-12-07T10:01:06.944178+0000","last_clean":"2023-12-07T10:01:06.944178+0000","last_became_active":"2023-12-07T10:00:53.242896+0000","last_became_peered":"2023-12-07T10:00:53.242896+0000","last_unstale":"2023-12-07T10:01:06.944178+0000","last_undegraded":"2023-12-07T10:01:06.944178+0000","last_fullsized":"2023-12-07T10:01:06.944178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948748+0000","last_change":"2023-12-07T10:01:06.954105+0000","last_active":"2023-12-07T10:01:07.948748+0000","last_peered":"2023-12-07T10:01:07.948748+0000","last_clean":"2023-12-07T10:01:07.948748+0000","last_became_active":"2023-12-07T10:01:06.953848+0000","last_became_peered":"2023-12-07T10:01:06.953848+0000","last_unstale":"2023-12-07T10:01:07.948748+0000","last_undegraded":"2023-12-07T10:01:07.948748+0000","last_fullsized":"2023-12-07T10:01:07.948748+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:10.038650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.970768+0000","last_change":"2023-12-07T10:01:05.937338+0000","last_active":"2023-12-07T10:01:06.970768+0000","last_peered":"2023-12-07T10:01:06.970768+0000","last_clean":"2023-12-07T10:01:06.970768+0000","last_became_active":"2023-12-07T10:01:05.937032+0000","last_became_peered":"2023-12-07T10:01:05.937032+0000","last_unstale":"2023-12-07T10:01:06.970768+0000","last_undegraded":"2023-12-07T10:01:06.970768+0000","last_fullsized":"2023-12-07T10:01:06.970768+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:45.273320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943499+0000","last_change":"2023-12-07T10:00:53.254564+0000","last_active":"2023-12-07T10:01:06.943499+0000","last_peered":"2023-12-07T10:01:06.943499+0000","last_clean":"2023-12-07T10:01:06.943499+0000","last_became_active":"2023-12-07T10:00:53.254304+0000","last_became_peered":"2023-12-07T10:00:53.254304+0000","last_unstale":"2023-12-07T10:01:06.943499+0000","last_undegraded":"2023-12-07T10:01:06.943499+0000","last_fullsized":"2023-12-07T10:01:06.943499+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"48'4","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943205+0000","last_change":"2023-12-07T10:00:52.853157+0000","last_active":"2023-12-07T10:01:06.943205+0000","last_peered":"2023-12-07T10:01:06.943205+0000","last_clean":"2023-12-07T10:01:06.943205+0000","last_became_active":"2023-12-07T10:00:52.852899+0000","last_became_peered":"2023-12-07T10:00:52.852899+0000","last_unstale":"2023-12-07T10:01:06.943205+0000","last_undegraded":"2023-12-07T10:01:06.943205+0000","last_fullsized":"2023-12-07T10:01:06.943205+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:45.067290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947062+0000","last_change":"2023-12-07T10:01:06.949633+0000","last_active":"2023-12-07T10:01:07.947062+0000","last_peered":"2023-12-07T10:01:07.947062+0000","last_clean":"2023-12-07T10:01:07.947062+0000","last_became_active":"2023-12-07T10:01:06.949343+0000","last_became_peered":"2023-12-07T10:01:06.949343+0000","last_unstale":"2023-12-07T10:01:07.947062+0000","last_undegraded":"2023-12-07T10:01:07.947062+0000","last_fullsized":"2023-12-07T10:01:07.947062+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:04:16.747141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.968931+0000","last_change":"2023-12-07T10:01:05.932989+0000","last_active":"2023-12-07T10:01:06.968931+0000","last_peered":"2023-12-07T10:01:06.968931+0000","last_clean":"2023-12-07T10:01:06.968931+0000","last_became_active":"2023-12-07T10:01:05.932716+0000","last_became_peered":"2023-12-07T10:01:05.932716+0000","last_unstale":"2023-12-07T10:01:06.968931+0000","last_undegraded":"2023-12-07T10:01:06.968931+0000","last_fullsized":"2023-12-07T10:01:06.968931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:19:02.018892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.936618+0000","last_change":"2023-12-07T10:00:53.253583+0000","last_active":"2023-12-07T10:01:06.936618+0000","last_peered":"2023-12-07T10:01:06.936618+0000","last_clean":"2023-12-07T10:01:06.936618+0000","last_became_active":"2023-12-07T10:00:53.253235+0000","last_became_peered":"2023-12-07T10:00:53.253235+0000","last_unstale":"2023-12-07T10:01:06.936618+0000","last_undegraded":"2023-12-07T10:01:06.936618+0000","last_fullsized":"2023-12-07T10:01:06.936618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:38.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928321+0000","last_change":"2023-12-07T10:00:52.852986+0000","last_active":"2023-12-07T10:01:06.928321+0000","last_peered":"2023-12-07T10:01:06.928321+0000","last_clean":"2023-12-07T10:01:06.928321+0000","last_became_active":"2023-12-07T10:00:52.851770+0000","last_became_peered":"2023-12-07T10:00:52.851770+0000","last_unstale":"2023-12-07T10:01:06.928321+0000","last_undegraded":"2023-12-07T10:01:06.928321+0000","last_fullsized":"2023-12-07T10:01:06.928321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:44.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947952+0000","last_change":"2023-12-07T10:01:06.967317+0000","last_active":"2023-12-07T10:01:07.947952+0000","last_peered":"2023-12-07T10:01:07.947952+0000","last_clean":"2023-12-07T10:01:07.947952+0000","last_became_active":"2023-12-07T10:01:06.966980+0000","last_became_peered":"2023-12-07T10:01:06.966980+0000","last_unstale":"2023-12-07T10:01:07.947952+0000","last_undegraded":"2023-12-07T10:01:07.947952+0000","last_fullsized":"2023-12-07T10:01:07.947952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:00.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"52'4","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.971528+0000","last_change":"2023-12-07T10:01:05.933629+0000","last_active":"2023-12-07T10:01:06.971528+0000","last_peered":"2023-12-07T10:01:06.971528+0000","last_clean":"2023-12-07T10:01:06.971528+0000","last_became_active":"2023-12-07T10:01:05.933347+0000","last_became_peered":"2023-12-07T10:01:05.933347+0000","last_unstale":"2023-12-07T10:01:06.971528+0000","last_undegraded":"2023-12-07T10:01:06.971528+0000","last_fullsized":"2023-12-07T10:01:06.971528+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:04.933210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943758+0000","last_change":"2023-12-07T10:00:53.254386+0000","last_active":"2023-12-07T10:01:06.943758+0000","last_peered":"2023-12-07T10:01:06.943758+0000","last_clean":"2023-12-07T10:01:06.943758+0000","last_became_active":"2023-12-07T10:00:53.254125+0000","last_became_peered":"2023-12-07T10:00:53.254125+0000","last_unstale":"2023-12-07T10:01:06.943758+0000","last_undegraded":"2023-12-07T10:01:06.943758+0000","last_fullsized":"2023-12-07T10:01:06.943758+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.942072+0000","last_change":"2023-12-07T10:00:52.855896+0000","last_active":"2023-12-07T10:01:06.942072+0000","last_peered":"2023-12-07T10:01:06.942072+0000","last_clean":"2023-12-07T10:01:06.942072+0000","last_became_active":"2023-12-07T10:00:52.855644+0000","last_became_peered":"2023-12-07T10:00:52.855644+0000","last_unstale":"2023-12-07T10:01:06.942072+0000","last_undegraded":"2023-12-07T10:01:06.942072+0000","last_fullsized":"2023-12-07T10:01:06.942072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:00.580100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.735097+0000","last_change":"2023-12-07T10:01:06.956695+0000","last_active":"2023-12-07T10:01:08.735097+0000","last_peered":"2023-12-07T10:01:08.735097+0000","last_clean":"2023-12-07T10:01:08.735097+0000","last_became_active":"2023-12-07T10:01:06.956416+0000","last_became_peered":"2023-12-07T10:01:06.956416+0000","last_unstale":"2023-12-07T10:01:08.735097+0000","last_undegraded":"2023-12-07T10:01:08.735097+0000","last_fullsized":"2023-12-07T10:01:08.735097+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:17.160030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.967286+0000","last_change":"2023-12-07T10:01:05.930408+0000","last_active":"2023-12-07T10:01:06.967286+0000","last_peered":"2023-12-07T10:01:06.967286+0000","last_clean":"2023-12-07T10:01:06.967286+0000","last_became_active":"2023-12-07T10:01:05.930068+0000","last_became_peered":"2023-12-07T10:01:05.930068+0000","last_unstale":"2023-12-07T10:01:06.967286+0000","last_undegraded":"2023-12-07T10:01:06.967286+0000","last_fullsized":"2023-12-07T10:01:06.967286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:50.607463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.941915+0000","last_change":"2023-12-07T10:00:53.250757+0000","last_active":"2023-12-07T10:01:06.941915+0000","last_peered":"2023-12-07T10:01:06.941915+0000","last_clean":"2023-12-07T10:01:06.941915+0000","last_became_active":"2023-12-07T10:00:53.250441+0000","last_became_peered":"2023-12-07T10:00:53.250441+0000","last_unstale":"2023-12-07T10:01:06.941915+0000","last_undegraded":"2023-12-07T10:01:06.941915+0000","last_fullsized":"2023-12-07T10:01:06.941915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933919+0000","last_change":"2023-12-07T10:00:52.852173+0000","last_active":"2023-12-07T10:01:06.933919+0000","last_peered":"2023-12-07T10:01:06.933919+0000","last_clean":"2023-12-07T10:01:06.933919+0000","last_became_active":"2023-12-07T10:00:52.851848+0000","last_became_peered":"2023-12-07T10:00:52.851848+0000","last_unstale":"2023-12-07T10:01:06.933919+0000","last_undegraded":"2023-12-07T10:01:06.933919+0000","last_fullsized":"2023-12-07T10:01:06.933919+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:39.934604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732631+0000","last_change":"2023-12-07T10:01:06.946446+0000","last_active":"2023-12-07T10:01:08.732631+0000","last_peered":"2023-12-07T10:01:08.732631+0000","last_clean":"2023-12-07T10:01:08.732631+0000","last_became_active":"2023-12-07T10:01:06.946235+0000","last_became_peered":"2023-12-07T10:01:06.946235+0000","last_unstale":"2023-12-07T10:01:08.732631+0000","last_undegraded":"2023-12-07T10:01:08.732631+0000","last_fullsized":"2023-12-07T10:01:08.732631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.373269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935200+0000","last_change":"2023-12-07T10:01:05.934543+0000","last_active":"2023-12-07T10:01:06.935200+0000","last_peered":"2023-12-07T10:01:06.935200+0000","last_clean":"2023-12-07T10:01:06.935200+0000","last_became_active":"2023-12-07T10:01:05.934279+0000","last_became_peered":"2023-12-07T10:01:05.934279+0000","last_unstale":"2023-12-07T10:01:06.935200+0000","last_undegraded":"2023-12-07T10:01:06.935200+0000","last_fullsized":"2023-12-07T10:01:06.935200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:46.458492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928058+0000","last_change":"2023-12-07T10:00:53.239528+0000","last_active":"2023-12-07T10:01:06.928058+0000","last_peered":"2023-12-07T10:01:06.928058+0000","last_clean":"2023-12-07T10:01:06.928058+0000","last_became_active":"2023-12-07T10:00:53.238924+0000","last_became_peered":"2023-12-07T10:00:53.238924+0000","last_unstale":"2023-12-07T10:01:06.928058+0000","last_undegraded":"2023-12-07T10:01:06.928058+0000","last_fullsized":"2023-12-07T10:01:06.928058+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:47:51.773150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935266+0000","last_change":"2023-12-07T10:00:52.862748+0000","last_active":"2023-12-07T10:01:06.935266+0000","last_peered":"2023-12-07T10:01:06.935266+0000","last_clean":"2023-12-07T10:01:06.935266+0000","last_became_active":"2023-12-07T10:00:52.862440+0000","last_became_peered":"2023-12-07T10:00:52.862440+0000","last_unstale":"2023-12-07T10:01:06.935266+0000","last_undegraded":"2023-12-07T10:01:06.935266+0000","last_fullsized":"2023-12-07T10:01:06.935266+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:02:58.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733253+0000","last_change":"2023-12-07T10:01:06.950025+0000","last_active":"2023-12-07T10:01:08.733253+0000","last_peered":"2023-12-07T10:01:08.733253+0000","last_clean":"2023-12-07T10:01:08.733253+0000","last_became_active":"2023-12-07T10:01:06.949315+0000","last_became_peered":"2023-12-07T10:01:06.949315+0000","last_unstale":"2023-12-07T10:01:08.733253+0000","last_undegraded":"2023-12-07T10:01:08.733253+0000","last_fullsized":"2023-12-07T10:01:08.733253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:46:28.067287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.931906+0000","last_change":"2023-12-07T10:01:05.934604+0000","last_active":"2023-12-07T10:01:06.931906+0000","last_peered":"2023-12-07T10:01:06.931906+0000","last_clean":"2023-12-07T10:01:06.931906+0000","last_became_active":"2023-12-07T10:01:05.933914+0000","last_became_peered":"2023-12-07T10:01:05.933914+0000","last_unstale":"2023-12-07T10:01:06.931906+0000","last_undegraded":"2023-12-07T10:01:06.931906+0000","last_fullsized":"2023-12-07T10:01:06.931906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:49.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928172+0000","last_change":"2023-12-07T10:00:53.250358+0000","last_active":"2023-12-07T10:01:06.928172+0000","last_peered":"2023-12-07T10:01:06.928172+0000","last_clean":"2023-12-07T10:01:06.928172+0000","last_became_active":"2023-12-07T10:00:53.250075+0000","last_became_peered":"2023-12-07T10:00:53.250075+0000","last_unstale":"2023-12-07T10:01:06.928172+0000","last_undegraded":"2023-12-07T10:01:06.928172+0000","last_fullsized":"2023-12-07T10:01:06.928172+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:32:42.294692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939755+0000","last_change":"2023-12-07T10:00:52.854501+0000","last_active":"2023-12-07T10:01:06.939755+0000","last_peered":"2023-12-07T10:01:06.939755+0000","last_clean":"2023-12-07T10:01:06.939755+0000","last_became_active":"2023-12-07T10:00:52.853983+0000","last_became_peered":"2023-12-07T10:00:52.853983+0000","last_unstale":"2023-12-07T10:01:06.939755+0000","last_undegraded":"2023-12-07T10:01:06.939755+0000","last_fullsized":"2023-12-07T10:01:06.939755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:08.383318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733131+0000","last_change":"2023-12-07T10:01:06.952214+0000","last_active":"2023-12-07T10:01:08.733131+0000","last_peered":"2023-12-07T10:01:08.733131+0000","last_clean":"2023-12-07T10:01:08.733131+0000","last_became_active":"2023-12-07T10:01:06.951923+0000","last_became_peered":"2023-12-07T10:01:06.951923+0000","last_unstale":"2023-12-07T10:01:08.733131+0000","last_undegraded":"2023-12-07T10:01:08.733131+0000","last_fullsized":"2023-12-07T10:01:08.733131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:21.415236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.964618+0000","last_change":"2023-12-07T10:01:05.936746+0000","last_active":"2023-12-07T10:01:06.964618+0000","last_peered":"2023-12-07T10:01:06.964618+0000","last_clean":"2023-12-07T10:01:06.964618+0000","last_became_active":"2023-12-07T10:01:05.935754+0000","last_became_peered":"2023-12-07T10:01:05.935754+0000","last_unstale":"2023-12-07T10:01:06.964618+0000","last_undegraded":"2023-12-07T10:01:06.964618+0000","last_fullsized":"2023-12-07T10:01:06.964618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:13.665640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956620+0000","last_change":"2023-12-07T10:00:53.251197+0000","last_active":"2023-12-07T10:01:06.956620+0000","last_peered":"2023-12-07T10:01:06.956620+0000","last_clean":"2023-12-07T10:01:06.956620+0000","last_became_active":"2023-12-07T10:00:53.250925+0000","last_became_peered":"2023-12-07T10:00:53.250925+0000","last_unstale":"2023-12-07T10:01:06.956620+0000","last_undegraded":"2023-12-07T10:01:06.956620+0000","last_fullsized":"2023-12-07T10:01:06.956620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934937+0000","last_change":"2023-12-07T10:00:52.852819+0000","last_active":"2023-12-07T10:01:06.934937+0000","last_peered":"2023-12-07T10:01:06.934937+0000","last_clean":"2023-12-07T10:01:06.934937+0000","last_became_active":"2023-12-07T10:00:52.852444+0000","last_became_peered":"2023-12-07T10:00:52.852444+0000","last_unstale":"2023-12-07T10:01:06.934937+0000","last_undegraded":"2023-12-07T10:01:06.934937+0000","last_fullsized":"2023-12-07T10:01:06.934937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:21:03.075187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.949473+0000","last_change":"2023-12-07T10:01:06.955558+0000","last_active":"2023-12-07T10:01:07.949473+0000","last_peered":"2023-12-07T10:01:07.949473+0000","last_clean":"2023-12-07T10:01:07.949473+0000","last_became_active":"2023-12-07T10:01:06.950080+0000","last_became_peered":"2023-12-07T10:01:06.950080+0000","last_unstale":"2023-12-07T10:01:07.949473+0000","last_undegraded":"2023-12-07T10:01:07.949473+0000","last_fullsized":"2023-12-07T10:01:07.949473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:55.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.967960+0000","last_change":"2023-12-07T10:01:05.931730+0000","last_active":"2023-12-07T10:01:06.967960+0000","last_peered":"2023-12-07T10:01:06.967960+0000","last_clean":"2023-12-07T10:01:06.967960+0000","last_became_active":"2023-12-07T10:01:05.930867+0000","last_became_peered":"2023-12-07T10:01:05.930867+0000","last_unstale":"2023-12-07T10:01:06.967960+0000","last_undegraded":"2023-12-07T10:01:06.967960+0000","last_fullsized":"2023-12-07T10:01:06.967960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:51.657016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927656+0000","last_change":"2023-12-07T10:00:53.246799+0000","last_active":"2023-12-07T10:01:06.927656+0000","last_peered":"2023-12-07T10:01:06.927656+0000","last_clean":"2023-12-07T10:01:06.927656+0000","last_became_active":"2023-12-07T10:00:53.246147+0000","last_became_peered":"2023-12-07T10:00:53.246147+0000","last_unstale":"2023-12-07T10:01:06.927656+0000","last_undegraded":"2023-12-07T10:01:06.927656+0000","last_fullsized":"2023-12-07T10:01:06.927656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:19.078647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.931886+0000","last_change":"2023-12-07T10:00:52.855436+0000","last_active":"2023-12-07T10:01:06.931886+0000","last_peered":"2023-12-07T10:01:06.931886+0000","last_clean":"2023-12-07T10:01:06.931886+0000","last_became_active":"2023-12-07T10:00:52.855135+0000","last_became_peered":"2023-12-07T10:00:52.855135+0000","last_unstale":"2023-12-07T10:01:06.931886+0000","last_undegraded":"2023-12-07T10:01:06.931886+0000","last_fullsized":"2023-12-07T10:01:06.931886+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:26.198703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.948735+0000","last_change":"2023-12-07T10:01:06.957831+0000","last_active":"2023-12-07T10:01:07.948735+0000","last_peered":"2023-12-07T10:01:07.948735+0000","last_clean":"2023-12-07T10:01:07.948735+0000","last_became_active":"2023-12-07T10:01:06.957556+0000","last_became_peered":"2023-12-07T10:01:06.957556+0000","last_unstale":"2023-12-07T10:01:07.948735+0000","last_undegraded":"2023-12-07T10:01:07.948735+0000","last_fullsized":"2023-12-07T10:01:07.948735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:12.456972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"52'3","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.969934+0000","last_change":"2023-12-07T10:01:05.926143+0000","last_active":"2023-12-07T10:01:06.969934+0000","last_peered":"2023-12-07T10:01:06.969934+0000","last_clean":"2023-12-07T10:01:06.969934+0000","last_became_active":"2023-12-07T10:01:05.925827+0000","last_became_peered":"2023-12-07T10:01:05.925827+0000","last_unstale":"2023-12-07T10:01:06.969934+0000","last_undegraded":"2023-12-07T10:01:06.969934+0000","last_fullsized":"2023-12-07T10:01:06.969934+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:35:05.706967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934868+0000","last_change":"2023-12-07T10:00:53.243590+0000","last_active":"2023-12-07T10:01:06.934868+0000","last_peered":"2023-12-07T10:01:06.934868+0000","last_clean":"2023-12-07T10:01:06.934868+0000","last_became_active":"2023-12-07T10:00:53.243289+0000","last_became_peered":"2023-12-07T10:00:53.243289+0000","last_unstale":"2023-12-07T10:01:06.934868+0000","last_undegraded":"2023-12-07T10:01:06.934868+0000","last_fullsized":"2023-12-07T10:01:06.934868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:50.767120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939346+0000","last_change":"2023-12-07T10:00:52.861221+0000","last_active":"2023-12-07T10:01:06.939346+0000","last_peered":"2023-12-07T10:01:06.939346+0000","last_clean":"2023-12-07T10:01:06.939346+0000","last_became_active":"2023-12-07T10:00:52.860921+0000","last_became_peered":"2023-12-07T10:00:52.860921+0000","last_unstale":"2023-12-07T10:01:06.939346+0000","last_undegraded":"2023-12-07T10:01:06.939346+0000","last_fullsized":"2023-12-07T10:01:06.939346+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:38.580023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733740+0000","last_change":"2023-12-07T10:01:06.948730+0000","last_active":"2023-12-07T10:01:08.733740+0000","last_peered":"2023-12-07T10:01:08.733740+0000","last_clean":"2023-12-07T10:01:08.733740+0000","last_became_active":"2023-12-07T10:01:06.947429+0000","last_became_peered":"2023-12-07T10:01:06.947429+0000","last_unstale":"2023-12-07T10:01:08.733740+0000","last_undegraded":"2023-12-07T10:01:08.733740+0000","last_fullsized":"2023-12-07T10:01:08.733740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:52.896843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"52'6","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.972082+0000","last_change":"2023-12-07T10:01:05.932398+0000","last_active":"2023-12-07T10:01:06.972082+0000","last_peered":"2023-12-07T10:01:06.972082+0000","last_clean":"2023-12-07T10:01:06.972082+0000","last_became_active":"2023-12-07T10:01:05.932117+0000","last_became_peered":"2023-12-07T10:01:05.932117+0000","last_unstale":"2023-12-07T10:01:06.972082+0000","last_undegraded":"2023-12-07T10:01:06.972082+0000","last_fullsized":"2023-12-07T10:01:06.972082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:15.464613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939052+0000","last_change":"2023-12-07T10:00:53.249808+0000","last_active":"2023-12-07T10:01:06.939052+0000","last_peered":"2023-12-07T10:01:06.939052+0000","last_clean":"2023-12-07T10:01:06.939052+0000","last_became_active":"2023-12-07T10:00:53.249485+0000","last_became_peered":"2023-12-07T10:00:53.249485+0000","last_unstale":"2023-12-07T10:01:06.939052+0000","last_undegraded":"2023-12-07T10:01:06.939052+0000","last_fullsized":"2023-12-07T10:01:06.939052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:24.999522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928399+0000","last_change":"2023-12-07T10:00:52.862658+0000","last_active":"2023-12-07T10:01:06.928399+0000","last_peered":"2023-12-07T10:01:06.928399+0000","last_clean":"2023-12-07T10:01:06.928399+0000","last_became_active":"2023-12-07T10:00:52.862311+0000","last_became_peered":"2023-12-07T10:00:52.862311+0000","last_unstale":"2023-12-07T10:01:06.928399+0000","last_undegraded":"2023-12-07T10:01:06.928399+0000","last_fullsized":"2023-12-07T10:01:06.928399+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:39.506771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733696+0000","last_change":"2023-12-07T10:01:06.943281+0000","last_active":"2023-12-07T10:01:08.733696+0000","last_peered":"2023-12-07T10:01:08.733696+0000","last_clean":"2023-12-07T10:01:08.733696+0000","last_became_active":"2023-12-07T10:01:06.942991+0000","last_became_peered":"2023-12-07T10:01:06.942991+0000","last_unstale":"2023-12-07T10:01:08.733696+0000","last_undegraded":"2023-12-07T10:01:08.733696+0000","last_fullsized":"2023-12-07T10:01:08.733696+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:25.566235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934229+0000","last_change":"2023-12-07T10:01:05.935296+0000","last_active":"2023-12-07T10:01:06.934229+0000","last_peered":"2023-12-07T10:01:06.934229+0000","last_clean":"2023-12-07T10:01:06.934229+0000","last_became_active":"2023-12-07T10:01:05.934183+0000","last_became_peered":"2023-12-07T10:01:05.934183+0000","last_unstale":"2023-12-07T10:01:06.934229+0000","last_undegraded":"2023-12-07T10:01:06.934229+0000","last_fullsized":"2023-12-07T10:01:06.934229+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:51.044735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935505+0000","last_change":"2023-12-07T10:00:53.247852+0000","last_active":"2023-12-07T10:01:06.935505+0000","last_peered":"2023-12-07T10:01:06.935505+0000","last_clean":"2023-12-07T10:01:06.935505+0000","last_became_active":"2023-12-07T10:00:53.247649+0000","last_became_peered":"2023-12-07T10:00:53.247649+0000","last_unstale":"2023-12-07T10:01:06.935505+0000","last_undegraded":"2023-12-07T10:01:06.935505+0000","last_fullsized":"2023-12-07T10:01:06.935505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:32.009403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"48'3","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939795+0000","last_change":"2023-12-07T10:00:52.855075+0000","last_active":"2023-12-07T10:01:06.939795+0000","last_peered":"2023-12-07T10:01:06.939795+0000","last_clean":"2023-12-07T10:01:06.939795+0000","last_became_active":"2023-12-07T10:00:52.854798+0000","last_became_peered":"2023-12-07T10:00:52.854798+0000","last_unstale":"2023-12-07T10:01:06.939795+0000","last_undegraded":"2023-12-07T10:01:06.939795+0000","last_fullsized":"2023-12-07T10:01:06.939795+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947545+0000","last_change":"2023-12-07T10:01:06.957042+0000","last_active":"2023-12-07T10:01:07.947545+0000","last_peered":"2023-12-07T10:01:07.947545+0000","last_clean":"2023-12-07T10:01:07.947545+0000","last_became_active":"2023-12-07T10:01:06.956729+0000","last_became_peered":"2023-12-07T10:01:06.956729+0000","last_unstale":"2023-12-07T10:01:07.947545+0000","last_undegraded":"2023-12-07T10:01:07.947545+0000","last_fullsized":"2023-12-07T10:01:07.947545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:07:53.974819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.959140+0000","last_change":"2023-12-07T10:01:05.932746+0000","last_active":"2023-12-07T10:01:06.959140+0000","last_peered":"2023-12-07T10:01:06.959140+0000","last_clean":"2023-12-07T10:01:06.959140+0000","last_became_active":"2023-12-07T10:01:05.932390+0000","last_became_peered":"2023-12-07T10:01:05.932390+0000","last_unstale":"2023-12-07T10:01:06.959140+0000","last_undegraded":"2023-12-07T10:01:06.959140+0000","last_fullsized":"2023-12-07T10:01:06.959140+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:56.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939696+0000","last_change":"2023-12-07T10:00:53.254173+0000","last_active":"2023-12-07T10:01:06.939696+0000","last_peered":"2023-12-07T10:01:06.939696+0000","last_clean":"2023-12-07T10:01:06.939696+0000","last_became_active":"2023-12-07T10:00:53.253757+0000","last_became_peered":"2023-12-07T10:00:53.253757+0000","last_unstale":"2023-12-07T10:01:06.939696+0000","last_undegraded":"2023-12-07T10:01:06.939696+0000","last_fullsized":"2023-12-07T10:01:06.939696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:23.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'8","reported_seq":24,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933062+0000","last_change":"2023-12-07T10:00:52.859097+0000","last_active":"2023-12-07T10:01:06.933062+0000","last_peered":"2023-12-07T10:01:06.933062+0000","last_clean":"2023-12-07T10:01:06.933062+0000","last_became_active":"2023-12-07T10:00:52.858719+0000","last_became_peered":"2023-12-07T10:00:52.858719+0000","last_unstale":"2023-12-07T10:01:06.933062+0000","last_undegraded":"2023-12-07T10:01:06.933062+0000","last_fullsized":"2023-12-07T10:01:06.933062+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:20.867075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733488+0000","last_change":"2023-12-07T10:01:06.963984+0000","last_active":"2023-12-07T10:01:08.733488+0000","last_peered":"2023-12-07T10:01:08.733488+0000","last_clean":"2023-12-07T10:01:08.733488+0000","last_became_active":"2023-12-07T10:01:06.963668+0000","last_became_peered":"2023-12-07T10:01:06.963668+0000","last_unstale":"2023-12-07T10:01:08.733488+0000","last_undegraded":"2023-12-07T10:01:08.733488+0000","last_fullsized":"2023-12-07T10:01:08.733488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:02:46.547397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934774+0000","last_change":"2023-12-07T10:01:05.927952+0000","last_active":"2023-12-07T10:01:06.934774+0000","last_peered":"2023-12-07T10:01:06.934774+0000","last_clean":"2023-12-07T10:01:06.934774+0000","last_became_active":"2023-12-07T10:01:05.927390+0000","last_became_peered":"2023-12-07T10:01:05.927390+0000","last_unstale":"2023-12-07T10:01:06.934774+0000","last_undegraded":"2023-12-07T10:01:06.934774+0000","last_fullsized":"2023-12-07T10:01:06.934774+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:58.443670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934658+0000","last_change":"2023-12-07T10:00:53.242820+0000","last_active":"2023-12-07T10:01:06.934658+0000","last_peered":"2023-12-07T10:01:06.934658+0000","last_clean":"2023-12-07T10:01:06.934658+0000","last_became_active":"2023-12-07T10:00:53.242500+0000","last_became_peered":"2023-12-07T10:00:53.242500+0000","last_unstale":"2023-12-07T10:01:06.934658+0000","last_undegraded":"2023-12-07T10:01:06.934658+0000","last_fullsized":"2023-12-07T10:01:06.934658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:34.390142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928291+0000","last_change":"2023-12-07T10:00:52.862426+0000","last_active":"2023-12-07T10:01:06.928291+0000","last_peered":"2023-12-07T10:01:06.928291+0000","last_clean":"2023-12-07T10:01:06.928291+0000","last_became_active":"2023-12-07T10:00:52.862110+0000","last_became_peered":"2023-12-07T10:00:52.862110+0000","last_unstale":"2023-12-07T10:01:06.928291+0000","last_undegraded":"2023-12-07T10:01:06.928291+0000","last_fullsized":"2023-12-07T10:01:06.928291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:33:55.953807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732843+0000","last_change":"2023-12-07T10:01:06.950399+0000","last_active":"2023-12-07T10:01:08.732843+0000","last_peered":"2023-12-07T10:01:08.732843+0000","last_clean":"2023-12-07T10:01:08.732843+0000","last_became_active":"2023-12-07T10:01:06.950089+0000","last_became_peered":"2023-12-07T10:01:06.950089+0000","last_unstale":"2023-12-07T10:01:08.732843+0000","last_undegraded":"2023-12-07T10:01:08.732843+0000","last_fullsized":"2023-12-07T10:01:08.732843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:16:40.283546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"52'8","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.972450+0000","last_change":"2023-12-07T10:01:05.926480+0000","last_active":"2023-12-07T10:01:06.972450+0000","last_peered":"2023-12-07T10:01:06.972450+0000","last_clean":"2023-12-07T10:01:06.972450+0000","last_became_active":"2023-12-07T10:01:05.924899+0000","last_became_peered":"2023-12-07T10:01:05.924899+0000","last_unstale":"2023-12-07T10:01:06.972450+0000","last_undegraded":"2023-12-07T10:01:06.972450+0000","last_fullsized":"2023-12-07T10:01:06.972450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:19:02.018892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.937974+0000","last_change":"2023-12-07T10:00:53.244279+0000","last_active":"2023-12-07T10:01:06.937974+0000","last_peered":"2023-12-07T10:01:06.937974+0000","last_clean":"2023-12-07T10:01:06.937974+0000","last_became_active":"2023-12-07T10:00:53.243897+0000","last_became_peered":"2023-12-07T10:00:53.243897+0000","last_unstale":"2023-12-07T10:01:06.937974+0000","last_undegraded":"2023-12-07T10:01:06.937974+0000","last_fullsized":"2023-12-07T10:01:06.937974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956233+0000","last_change":"2023-12-07T10:00:52.856462+0000","last_active":"2023-12-07T10:01:06.956233+0000","last_peered":"2023-12-07T10:01:06.956233+0000","last_clean":"2023-12-07T10:01:06.956233+0000","last_became_active":"2023-12-07T10:00:52.856185+0000","last_became_peered":"2023-12-07T10:00:52.856185+0000","last_unstale":"2023-12-07T10:01:06.956233+0000","last_undegraded":"2023-12-07T10:01:06.956233+0000","last_fullsized":"2023-12-07T10:01:06.956233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.945629+0000","last_change":"2023-12-07T10:01:06.949756+0000","last_active":"2023-12-07T10:01:07.945629+0000","last_peered":"2023-12-07T10:01:07.945629+0000","last_clean":"2023-12-07T10:01:07.945629+0000","last_became_active":"2023-12-07T10:01:06.947368+0000","last_became_peered":"2023-12-07T10:01:06.947368+0000","last_unstale":"2023-12-07T10:01:07.945629+0000","last_undegraded":"2023-12-07T10:01:07.945629+0000","last_fullsized":"2023-12-07T10:01:07.945629+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:02:46.547397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.968791+0000","last_change":"2023-12-07T10:01:05.930926+0000","last_active":"2023-12-07T10:01:06.968791+0000","last_peered":"2023-12-07T10:01:06.968791+0000","last_clean":"2023-12-07T10:01:06.968791+0000","last_became_active":"2023-12-07T10:01:05.930654+0000","last_became_peered":"2023-12-07T10:01:05.930654+0000","last_unstale":"2023-12-07T10:01:06.968791+0000","last_undegraded":"2023-12-07T10:01:06.968791+0000","last_fullsized":"2023-12-07T10:01:06.968791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:21.460311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932813+0000","last_change":"2023-12-07T10:00:53.252664+0000","last_active":"2023-12-07T10:01:06.932813+0000","last_peered":"2023-12-07T10:01:06.932813+0000","last_clean":"2023-12-07T10:01:06.932813+0000","last_became_active":"2023-12-07T10:00:53.252375+0000","last_became_peered":"2023-12-07T10:00:53.252375+0000","last_unstale":"2023-12-07T10:01:06.932813+0000","last_undegraded":"2023-12-07T10:01:06.932813+0000","last_fullsized":"2023-12-07T10:01:06.932813+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:39.820643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934964+0000","last_change":"2023-12-07T10:00:52.852152+0000","last_active":"2023-12-07T10:01:06.934964+0000","last_peered":"2023-12-07T10:01:06.934964+0000","last_clean":"2023-12-07T10:01:06.934964+0000","last_became_active":"2023-12-07T10:00:52.851826+0000","last_became_peered":"2023-12-07T10:00:52.851826+0000","last_unstale":"2023-12-07T10:01:06.934964+0000","last_undegraded":"2023-12-07T10:01:06.934964+0000","last_fullsized":"2023-12-07T10:01:06.934964+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:55:22.054520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733407+0000","last_change":"2023-12-07T10:01:06.943378+0000","last_active":"2023-12-07T10:01:08.733407+0000","last_peered":"2023-12-07T10:01:08.733407+0000","last_clean":"2023-12-07T10:01:08.733407+0000","last_became_active":"2023-12-07T10:01:06.943079+0000","last_became_peered":"2023-12-07T10:01:06.943079+0000","last_unstale":"2023-12-07T10:01:08.733407+0000","last_undegraded":"2023-12-07T10:01:08.733407+0000","last_fullsized":"2023-12-07T10:01:08.733407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:58:04.852722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956005+0000","last_change":"2023-12-07T10:01:05.931634+0000","last_active":"2023-12-07T10:01:06.956005+0000","last_peered":"2023-12-07T10:01:06.956005+0000","last_clean":"2023-12-07T10:01:06.956005+0000","last_became_active":"2023-12-07T10:01:05.931335+0000","last_became_peered":"2023-12-07T10:01:05.931335+0000","last_unstale":"2023-12-07T10:01:06.956005+0000","last_undegraded":"2023-12-07T10:01:06.956005+0000","last_fullsized":"2023-12-07T10:01:06.956005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:08.810073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933252+0000","last_change":"2023-12-07T10:00:53.242124+0000","last_active":"2023-12-07T10:01:06.933252+0000","last_peered":"2023-12-07T10:01:06.933252+0000","last_clean":"2023-12-07T10:01:06.933252+0000","last_became_active":"2023-12-07T10:00:53.241850+0000","last_became_peered":"2023-12-07T10:00:53.241850+0000","last_unstale":"2023-12-07T10:01:06.933252+0000","last_undegraded":"2023-12-07T10:01:06.933252+0000","last_fullsized":"2023-12-07T10:01:06.933252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:43.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"48'8","reported_seq":24,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932186+0000","last_change":"2023-12-07T10:00:52.854402+0000","last_active":"2023-12-07T10:01:06.932186+0000","last_peered":"2023-12-07T10:01:06.932186+0000","last_clean":"2023-12-07T10:01:06.932186+0000","last_became_active":"2023-12-07T10:00:52.854135+0000","last_became_peered":"2023-12-07T10:00:52.854135+0000","last_unstale":"2023-12-07T10:01:06.932186+0000","last_undegraded":"2023-12-07T10:01:06.932186+0000","last_fullsized":"2023-12-07T10:01:06.932186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:29:38.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734926+0000","last_change":"2023-12-07T10:01:06.946675+0000","last_active":"2023-12-07T10:01:08.734926+0000","last_peered":"2023-12-07T10:01:08.734926+0000","last_clean":"2023-12-07T10:01:08.734926+0000","last_became_active":"2023-12-07T10:01:06.946254+0000","last_became_peered":"2023-12-07T10:01:06.946254+0000","last_unstale":"2023-12-07T10:01:08.734926+0000","last_undegraded":"2023-12-07T10:01:08.734926+0000","last_fullsized":"2023-12-07T10:01:08.734926+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:02:09.817923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.971146+0000","last_change":"2023-12-07T10:01:05.938970+0000","last_active":"2023-12-07T10:01:06.971146+0000","last_peered":"2023-12-07T10:01:06.971146+0000","last_clean":"2023-12-07T10:01:06.971146+0000","last_became_active":"2023-12-07T10:01:05.938656+0000","last_became_peered":"2023-12-07T10:01:05.938656+0000","last_unstale":"2023-12-07T10:01:06.971146+0000","last_undegraded":"2023-12-07T10:01:06.971146+0000","last_fullsized":"2023-12-07T10:01:06.971146+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:55.910861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.937736+0000","last_change":"2023-12-07T10:00:53.253183+0000","last_active":"2023-12-07T10:01:06.937736+0000","last_peered":"2023-12-07T10:01:06.937736+0000","last_clean":"2023-12-07T10:01:06.937736+0000","last_became_active":"2023-12-07T10:00:53.252721+0000","last_became_peered":"2023-12-07T10:00:53.252721+0000","last_unstale":"2023-12-07T10:01:06.937736+0000","last_undegraded":"2023-12-07T10:01:06.937736+0000","last_fullsized":"2023-12-07T10:01:06.937736+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:30.053753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928969+0000","last_change":"2023-12-07T10:00:52.861359+0000","last_active":"2023-12-07T10:01:06.928969+0000","last_peered":"2023-12-07T10:01:06.928969+0000","last_clean":"2023-12-07T10:01:06.928969+0000","last_became_active":"2023-12-07T10:00:52.860599+0000","last_became_peered":"2023-12-07T10:00:52.860599+0000","last_unstale":"2023-12-07T10:01:06.928969+0000","last_undegraded":"2023-12-07T10:01:06.928969+0000","last_fullsized":"2023-12-07T10:01:06.928969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:51:45.366677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734145+0000","last_change":"2023-12-07T10:01:06.948744+0000","last_active":"2023-12-07T10:01:08.734145+0000","last_peered":"2023-12-07T10:01:08.734145+0000","last_clean":"2023-12-07T10:01:08.734145+0000","last_became_active":"2023-12-07T10:01:06.946998+0000","last_became_peered":"2023-12-07T10:01:06.946998+0000","last_unstale":"2023-12-07T10:01:08.734145+0000","last_undegraded":"2023-12-07T10:01:08.734145+0000","last_fullsized":"2023-12-07T10:01:08.734145+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:22:03.843320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.938283+0000","last_change":"2023-12-07T10:01:05.937092+0000","last_active":"2023-12-07T10:01:06.938283+0000","last_peered":"2023-12-07T10:01:06.938283+0000","last_clean":"2023-12-07T10:01:06.938283+0000","last_became_active":"2023-12-07T10:01:05.936649+0000","last_became_peered":"2023-12-07T10:01:05.936649+0000","last_unstale":"2023-12-07T10:01:06.938283+0000","last_undegraded":"2023-12-07T10:01:06.938283+0000","last_fullsized":"2023-12-07T10:01:06.938283+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:20.407386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935336+0000","last_change":"2023-12-07T10:00:53.242532+0000","last_active":"2023-12-07T10:01:06.935336+0000","last_peered":"2023-12-07T10:01:06.935336+0000","last_clean":"2023-12-07T10:01:06.935336+0000","last_became_active":"2023-12-07T10:00:53.242253+0000","last_became_peered":"2023-12-07T10:00:53.242253+0000","last_unstale":"2023-12-07T10:01:06.935336+0000","last_undegraded":"2023-12-07T10:01:06.935336+0000","last_fullsized":"2023-12-07T10:01:06.935336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:56.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943532+0000","last_change":"2023-12-07T10:00:52.859355+0000","last_active":"2023-12-07T10:01:06.943532+0000","last_peered":"2023-12-07T10:01:06.943532+0000","last_clean":"2023-12-07T10:01:06.943532+0000","last_became_active":"2023-12-07T10:00:52.859097+0000","last_became_peered":"2023-12-07T10:00:52.859097+0000","last_unstale":"2023-12-07T10:01:06.943532+0000","last_undegraded":"2023-12-07T10:01:06.943532+0000","last_fullsized":"2023-12-07T10:01:06.943532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:57.194036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.950105+0000","last_change":"2023-12-07T10:01:06.948320+0000","last_active":"2023-12-07T10:01:07.950105+0000","last_peered":"2023-12-07T10:01:07.950105+0000","last_clean":"2023-12-07T10:01:07.950105+0000","last_became_active":"2023-12-07T10:01:06.948031+0000","last_became_peered":"2023-12-07T10:01:06.948031+0000","last_unstale":"2023-12-07T10:01:07.950105+0000","last_undegraded":"2023-12-07T10:01:07.950105+0000","last_fullsized":"2023-12-07T10:01:07.950105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:32.154846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.974371+0000","last_change":"2023-12-07T10:01:05.936063+0000","last_active":"2023-12-07T10:01:06.974371+0000","last_peered":"2023-12-07T10:01:06.974371+0000","last_clean":"2023-12-07T10:01:06.974371+0000","last_became_active":"2023-12-07T10:01:05.935054+0000","last_became_peered":"2023-12-07T10:01:05.935054+0000","last_unstale":"2023-12-07T10:01:06.974371+0000","last_undegraded":"2023-12-07T10:01:06.974371+0000","last_fullsized":"2023-12-07T10:01:06.974371+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:35.094189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928661+0000","last_change":"2023-12-07T10:00:53.246280+0000","last_active":"2023-12-07T10:01:06.928661+0000","last_peered":"2023-12-07T10:01:06.928661+0000","last_clean":"2023-12-07T10:01:06.928661+0000","last_became_active":"2023-12-07T10:00:53.245969+0000","last_became_peered":"2023-12-07T10:00:53.245969+0000","last_unstale":"2023-12-07T10:01:06.928661+0000","last_undegraded":"2023-12-07T10:01:06.928661+0000","last_fullsized":"2023-12-07T10:01:06.928661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:52.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"48'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934673+0000","last_change":"2023-12-07T10:00:52.855577+0000","last_active":"2023-12-07T10:01:06.934673+0000","last_peered":"2023-12-07T10:01:06.934673+0000","last_clean":"2023-12-07T10:01:06.934673+0000","last_became_active":"2023-12-07T10:00:52.855285+0000","last_became_peered":"2023-12-07T10:00:52.855285+0000","last_unstale":"2023-12-07T10:01:06.934673+0000","last_undegraded":"2023-12-07T10:01:06.934673+0000","last_fullsized":"2023-12-07T10:01:06.934673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:38:00.995117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947874+0000","last_change":"2023-12-07T10:01:06.963972+0000","last_active":"2023-12-07T10:01:07.947874+0000","last_peered":"2023-12-07T10:01:07.947874+0000","last_clean":"2023-12-07T10:01:07.947874+0000","last_became_active":"2023-12-07T10:01:06.961981+0000","last_became_peered":"2023-12-07T10:01:06.961981+0000","last_unstale":"2023-12-07T10:01:07.947874+0000","last_undegraded":"2023-12-07T10:01:07.947874+0000","last_fullsized":"2023-12-07T10:01:07.947874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.610873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.974569+0000","last_change":"2023-12-07T10:01:05.937326+0000","last_active":"2023-12-07T10:01:06.974569+0000","last_peered":"2023-12-07T10:01:06.974569+0000","last_clean":"2023-12-07T10:01:06.974569+0000","last_became_active":"2023-12-07T10:01:05.936996+0000","last_became_peered":"2023-12-07T10:01:05.936996+0000","last_unstale":"2023-12-07T10:01:06.974569+0000","last_undegraded":"2023-12-07T10:01:06.974569+0000","last_fullsized":"2023-12-07T10:01:06.974569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:07:37.067871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939706+0000","last_change":"2023-12-07T10:00:53.247807+0000","last_active":"2023-12-07T10:01:06.939706+0000","last_peered":"2023-12-07T10:01:06.939706+0000","last_clean":"2023-12-07T10:01:06.939706+0000","last_became_active":"2023-12-07T10:00:53.247528+0000","last_became_peered":"2023-12-07T10:00:53.247528+0000","last_unstale":"2023-12-07T10:01:06.939706+0000","last_undegraded":"2023-12-07T10:01:06.939706+0000","last_fullsized":"2023-12-07T10:01:06.939706+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:34:38.976385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943842+0000","last_change":"2023-12-07T10:00:52.856498+0000","last_active":"2023-12-07T10:01:06.943842+0000","last_peered":"2023-12-07T10:01:06.943842+0000","last_clean":"2023-12-07T10:01:06.943842+0000","last_became_active":"2023-12-07T10:00:52.856180+0000","last_became_peered":"2023-12-07T10:00:52.856180+0000","last_unstale":"2023-12-07T10:01:06.943842+0000","last_undegraded":"2023-12-07T10:01:06.943842+0000","last_fullsized":"2023-12-07T10:01:06.943842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:55:33.381499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941076+0000","last_change":"2023-12-07T10:01:06.962652+0000","last_active":"2023-12-07T10:01:07.941076+0000","last_peered":"2023-12-07T10:01:07.941076+0000","last_clean":"2023-12-07T10:01:07.941076+0000","last_became_active":"2023-12-07T10:01:06.962391+0000","last_became_peered":"2023-12-07T10:01:06.962391+0000","last_unstale":"2023-12-07T10:01:07.941076+0000","last_undegraded":"2023-12-07T10:01:07.941076+0000","last_fullsized":"2023-12-07T10:01:07.941076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:42:53.864129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934639+0000","last_change":"2023-12-07T10:01:05.931495+0000","last_active":"2023-12-07T10:01:06.934639+0000","last_peered":"2023-12-07T10:01:06.934639+0000","last_clean":"2023-12-07T10:01:06.934639+0000","last_became_active":"2023-12-07T10:01:05.930528+0000","last_became_peered":"2023-12-07T10:01:05.930528+0000","last_unstale":"2023-12-07T10:01:06.934639+0000","last_undegraded":"2023-12-07T10:01:06.934639+0000","last_fullsized":"2023-12-07T10:01:06.934639+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:54.642699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934742+0000","last_change":"2023-12-07T10:00:53.239229+0000","last_active":"2023-12-07T10:01:06.934742+0000","last_peered":"2023-12-07T10:01:06.934742+0000","last_clean":"2023-12-07T10:01:06.934742+0000","last_became_active":"2023-12-07T10:00:53.238863+0000","last_became_peered":"2023-12-07T10:00:53.238863+0000","last_unstale":"2023-12-07T10:01:06.934742+0000","last_undegraded":"2023-12-07T10:01:06.934742+0000","last_fullsized":"2023-12-07T10:01:06.934742+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:20:03.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928476+0000","last_change":"2023-12-07T10:00:52.849815+0000","last_active":"2023-12-07T10:01:06.928476+0000","last_peered":"2023-12-07T10:01:06.928476+0000","last_clean":"2023-12-07T10:01:06.928476+0000","last_became_active":"2023-12-07T10:00:52.849535+0000","last_became_peered":"2023-12-07T10:00:52.849535+0000","last_unstale":"2023-12-07T10:01:06.928476+0000","last_undegraded":"2023-12-07T10:01:06.928476+0000","last_fullsized":"2023-12-07T10:01:06.928476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:06:41.565706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941140+0000","last_change":"2023-12-07T10:01:06.965878+0000","last_active":"2023-12-07T10:01:07.941140+0000","last_peered":"2023-12-07T10:01:07.941140+0000","last_clean":"2023-12-07T10:01:07.941140+0000","last_became_active":"2023-12-07T10:01:06.964508+0000","last_became_peered":"2023-12-07T10:01:06.964508+0000","last_unstale":"2023-12-07T10:01:07.941140+0000","last_undegraded":"2023-12-07T10:01:07.941140+0000","last_fullsized":"2023-12-07T10:01:07.941140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:51.058158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.944100+0000","last_change":"2023-12-07T10:01:05.931404+0000","last_active":"2023-12-07T10:01:06.944100+0000","last_peered":"2023-12-07T10:01:06.944100+0000","last_clean":"2023-12-07T10:01:06.944100+0000","last_became_active":"2023-12-07T10:01:05.930415+0000","last_became_peered":"2023-12-07T10:01:05.930415+0000","last_unstale":"2023-12-07T10:01:06.944100+0000","last_undegraded":"2023-12-07T10:01:06.944100+0000","last_fullsized":"2023-12-07T10:01:06.944100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:13.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939721+0000","last_change":"2023-12-07T10:00:53.247164+0000","last_active":"2023-12-07T10:01:06.939721+0000","last_peered":"2023-12-07T10:01:06.939721+0000","last_clean":"2023-12-07T10:01:06.939721+0000","last_became_active":"2023-12-07T10:00:53.246886+0000","last_became_peered":"2023-12-07T10:00:53.246886+0000","last_unstale":"2023-12-07T10:01:06.939721+0000","last_undegraded":"2023-12-07T10:01:06.939721+0000","last_fullsized":"2023-12-07T10:01:06.939721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:59:44.152480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935296+0000","last_change":"2023-12-07T10:00:52.857801+0000","last_active":"2023-12-07T10:01:06.935296+0000","last_peered":"2023-12-07T10:01:06.935296+0000","last_clean":"2023-12-07T10:01:06.935296+0000","last_became_active":"2023-12-07T10:00:52.857476+0000","last_became_peered":"2023-12-07T10:00:52.857476+0000","last_unstale":"2023-12-07T10:01:06.935296+0000","last_undegraded":"2023-12-07T10:01:06.935296+0000","last_fullsized":"2023-12-07T10:01:06.935296+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:49:39.171574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941113+0000","last_change":"2023-12-07T10:01:06.945722+0000","last_active":"2023-12-07T10:01:07.941113+0000","last_peered":"2023-12-07T10:01:07.941113+0000","last_clean":"2023-12-07T10:01:07.941113+0000","last_became_active":"2023-12-07T10:01:06.945417+0000","last_became_peered":"2023-12-07T10:01:06.945417+0000","last_unstale":"2023-12-07T10:01:07.941113+0000","last_undegraded":"2023-12-07T10:01:07.941113+0000","last_fullsized":"2023-12-07T10:01:07.941113+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:45:23.514432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956146+0000","last_change":"2023-12-07T10:01:05.931152+0000","last_active":"2023-12-07T10:01:06.956146+0000","last_peered":"2023-12-07T10:01:06.956146+0000","last_clean":"2023-12-07T10:01:06.956146+0000","last_became_active":"2023-12-07T10:01:05.930854+0000","last_became_peered":"2023-12-07T10:01:05.930854+0000","last_unstale":"2023-12-07T10:01:06.956146+0000","last_undegraded":"2023-12-07T10:01:06.956146+0000","last_fullsized":"2023-12-07T10:01:06.956146+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:58.144283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939763+0000","last_change":"2023-12-07T10:00:53.251461+0000","last_active":"2023-12-07T10:01:06.939763+0000","last_peered":"2023-12-07T10:01:06.939763+0000","last_clean":"2023-12-07T10:01:06.939763+0000","last_became_active":"2023-12-07T10:00:53.250950+0000","last_became_peered":"2023-12-07T10:00:53.250950+0000","last_unstale":"2023-12-07T10:01:06.939763+0000","last_undegraded":"2023-12-07T10:01:06.939763+0000","last_fullsized":"2023-12-07T10:01:06.939763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:18:49.950542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933596+0000","last_change":"2023-12-07T10:00:52.857794+0000","last_active":"2023-12-07T10:01:06.933596+0000","last_peered":"2023-12-07T10:01:06.933596+0000","last_clean":"2023-12-07T10:01:06.933596+0000","last_became_active":"2023-12-07T10:00:52.857362+0000","last_became_peered":"2023-12-07T10:00:52.857362+0000","last_unstale":"2023-12-07T10:01:06.933596+0000","last_undegraded":"2023-12-07T10:01:06.933596+0000","last_fullsized":"2023-12-07T10:01:06.933596+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:21:49.758477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946364+0000","last_change":"2023-12-07T10:01:06.960553+0000","last_active":"2023-12-07T10:01:07.946364+0000","last_peered":"2023-12-07T10:01:07.946364+0000","last_clean":"2023-12-07T10:01:07.946364+0000","last_became_active":"2023-12-07T10:01:06.960241+0000","last_became_peered":"2023-12-07T10:01:06.960241+0000","last_unstale":"2023-12-07T10:01:07.946364+0000","last_undegraded":"2023-12-07T10:01:07.946364+0000","last_fullsized":"2023-12-07T10:01:07.946364+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:16:48.332462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934052+0000","last_change":"2023-12-07T10:01:05.928305+0000","last_active":"2023-12-07T10:01:06.934052+0000","last_peered":"2023-12-07T10:01:06.934052+0000","last_clean":"2023-12-07T10:01:06.934052+0000","last_became_active":"2023-12-07T10:01:05.927908+0000","last_became_peered":"2023-12-07T10:01:05.927908+0000","last_unstale":"2023-12-07T10:01:06.934052+0000","last_undegraded":"2023-12-07T10:01:06.934052+0000","last_fullsized":"2023-12-07T10:01:06.934052+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:03:11.922339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935957+0000","last_change":"2023-12-07T10:00:53.245136+0000","last_active":"2023-12-07T10:01:06.935957+0000","last_peered":"2023-12-07T10:01:06.935957+0000","last_clean":"2023-12-07T10:01:06.935957+0000","last_became_active":"2023-12-07T10:00:53.244085+0000","last_became_peered":"2023-12-07T10:00:53.244085+0000","last_unstale":"2023-12-07T10:01:06.935957+0000","last_undegraded":"2023-12-07T10:01:06.935957+0000","last_fullsized":"2023-12-07T10:01:06.935957+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:39:58.202680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"48'2","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.936697+0000","last_change":"2023-12-07T10:00:52.856249+0000","last_active":"2023-12-07T10:01:06.936697+0000","last_peered":"2023-12-07T10:01:06.936697+0000","last_clean":"2023-12-07T10:01:06.936697+0000","last_became_active":"2023-12-07T10:00:52.855992+0000","last_became_peered":"2023-12-07T10:00:52.855992+0000","last_unstale":"2023-12-07T10:01:06.936697+0000","last_undegraded":"2023-12-07T10:01:06.936697+0000","last_fullsized":"2023-12-07T10:01:06.936697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:11:08.970488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947205+0000","last_change":"2023-12-07T10:01:06.949763+0000","last_active":"2023-12-07T10:01:07.947205+0000","last_peered":"2023-12-07T10:01:07.947205+0000","last_clean":"2023-12-07T10:01:07.947205+0000","last_became_active":"2023-12-07T10:01:06.949460+0000","last_became_peered":"2023-12-07T10:01:06.949460+0000","last_unstale":"2023-12-07T10:01:07.947205+0000","last_undegraded":"2023-12-07T10:01:07.947205+0000","last_fullsized":"2023-12-07T10:01:07.947205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:34.437447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.939975+0000","last_change":"2023-12-07T10:01:05.936727+0000","last_active":"2023-12-07T10:01:06.939975+0000","last_peered":"2023-12-07T10:01:06.939975+0000","last_clean":"2023-12-07T10:01:06.939975+0000","last_became_active":"2023-12-07T10:01:05.936408+0000","last_became_peered":"2023-12-07T10:01:05.936408+0000","last_unstale":"2023-12-07T10:01:06.939975+0000","last_undegraded":"2023-12-07T10:01:06.939975+0000","last_fullsized":"2023-12-07T10:01:06.939975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:49:24.558386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935426+0000","last_change":"2023-12-07T10:00:53.251785+0000","last_active":"2023-12-07T10:01:06.935426+0000","last_peered":"2023-12-07T10:01:06.935426+0000","last_clean":"2023-12-07T10:01:06.935426+0000","last_became_active":"2023-12-07T10:00:53.250957+0000","last_became_peered":"2023-12-07T10:00:53.250957+0000","last_unstale":"2023-12-07T10:01:06.935426+0000","last_undegraded":"2023-12-07T10:01:06.935426+0000","last_fullsized":"2023-12-07T10:01:06.935426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:46.075934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"49'1","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.943590+0000","last_change":"2023-12-07T10:00:52.856798+0000","last_active":"2023-12-07T10:01:06.943590+0000","last_peered":"2023-12-07T10:01:06.943590+0000","last_clean":"2023-12-07T10:01:06.943590+0000","last_became_active":"2023-12-07T10:00:52.854985+0000","last_became_peered":"2023-12-07T10:00:52.854985+0000","last_unstale":"2023-12-07T10:01:06.943590+0000","last_undegraded":"2023-12-07T10:01:06.943590+0000","last_fullsized":"2023-12-07T10:01:06.943590+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:01:55.733080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.735052+0000","last_change":"2023-12-07T10:01:06.954130+0000","last_active":"2023-12-07T10:01:08.735052+0000","last_peered":"2023-12-07T10:01:08.735052+0000","last_clean":"2023-12-07T10:01:08.735052+0000","last_became_active":"2023-12-07T10:01:06.953819+0000","last_became_peered":"2023-12-07T10:01:06.953819+0000","last_unstale":"2023-12-07T10:01:08.735052+0000","last_undegraded":"2023-12-07T10:01:08.735052+0000","last_fullsized":"2023-12-07T10:01:08.735052+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:16:48.332462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.974278+0000","last_change":"2023-12-07T10:01:05.931789+0000","last_active":"2023-12-07T10:01:06.974278+0000","last_peered":"2023-12-07T10:01:06.974278+0000","last_clean":"2023-12-07T10:01:06.974278+0000","last_became_active":"2023-12-07T10:01:05.931437+0000","last_became_peered":"2023-12-07T10:01:05.931437+0000","last_unstale":"2023-12-07T10:01:06.974278+0000","last_undegraded":"2023-12-07T10:01:06.974278+0000","last_fullsized":"2023-12-07T10:01:06.974278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:45.273320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935544+0000","last_change":"2023-12-07T10:00:53.247657+0000","last_active":"2023-12-07T10:01:06.935544+0000","last_peered":"2023-12-07T10:01:06.935544+0000","last_clean":"2023-12-07T10:01:06.935544+0000","last_became_active":"2023-12-07T10:00:53.247317+0000","last_became_peered":"2023-12-07T10:00:53.247317+0000","last_unstale":"2023-12-07T10:01:06.935544+0000","last_undegraded":"2023-12-07T10:01:06.935544+0000","last_fullsized":"2023-12-07T10:01:06.935544+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:59:58.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.958515+0000","last_change":"2023-12-07T10:00:52.855388+0000","last_active":"2023-12-07T10:01:06.958515+0000","last_peered":"2023-12-07T10:01:06.958515+0000","last_clean":"2023-12-07T10:01:06.958515+0000","last_became_active":"2023-12-07T10:00:52.855006+0000","last_became_peered":"2023-12-07T10:00:52.855006+0000","last_unstale":"2023-12-07T10:01:06.958515+0000","last_undegraded":"2023-12-07T10:01:06.958515+0000","last_fullsized":"2023-12-07T10:01:06.958515+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:41:36.304621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.733765+0000","last_change":"2023-12-07T10:01:06.951770+0000","last_active":"2023-12-07T10:01:08.733765+0000","last_peered":"2023-12-07T10:01:08.733765+0000","last_clean":"2023-12-07T10:01:08.733765+0000","last_became_active":"2023-12-07T10:01:06.951476+0000","last_became_peered":"2023-12-07T10:01:06.951476+0000","last_unstale":"2023-12-07T10:01:08.733765+0000","last_undegraded":"2023-12-07T10:01:08.733765+0000","last_fullsized":"2023-12-07T10:01:08.733765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:51.615313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.888579+0000","last_change":"2023-12-07T10:01:05.925997+0000","last_active":"2023-12-07T10:01:07.888579+0000","last_peered":"2023-12-07T10:01:07.888579+0000","last_clean":"2023-12-07T10:01:07.888579+0000","last_became_active":"2023-12-07T10:01:05.925590+0000","last_became_peered":"2023-12-07T10:01:05.925590+0000","last_unstale":"2023-12-07T10:01:07.888579+0000","last_undegraded":"2023-12-07T10:01:07.888579+0000","last_fullsized":"2023-12-07T10:01:07.888579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:31.146996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.941994+0000","last_change":"2023-12-07T10:00:53.244676+0000","last_active":"2023-12-07T10:01:06.941994+0000","last_peered":"2023-12-07T10:01:06.941994+0000","last_clean":"2023-12-07T10:01:06.941994+0000","last_became_active":"2023-12-07T10:00:53.244052+0000","last_became_peered":"2023-12-07T10:00:53.244052+0000","last_unstale":"2023-12-07T10:01:06.941994+0000","last_undegraded":"2023-12-07T10:01:06.941994+0000","last_fullsized":"2023-12-07T10:01:06.941994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:48.154071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.934019+0000","last_change":"2023-12-07T10:00:52.855956+0000","last_active":"2023-12-07T10:01:06.934019+0000","last_peered":"2023-12-07T10:01:06.934019+0000","last_clean":"2023-12-07T10:01:06.934019+0000","last_became_active":"2023-12-07T10:00:52.855621+0000","last_became_peered":"2023-12-07T10:00:52.855621+0000","last_unstale":"2023-12-07T10:01:06.934019+0000","last_undegraded":"2023-12-07T10:01:06.934019+0000","last_fullsized":"2023-12-07T10:01:06.934019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:17:45.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.732705+0000","last_change":"2023-12-07T10:01:06.947403+0000","last_active":"2023-12-07T10:01:08.732705+0000","last_peered":"2023-12-07T10:01:08.732705+0000","last_clean":"2023-12-07T10:01:08.732705+0000","last_became_active":"2023-12-07T10:01:06.947119+0000","last_became_peered":"2023-12-07T10:01:06.947119+0000","last_unstale":"2023-12-07T10:01:08.732705+0000","last_undegraded":"2023-12-07T10:01:08.732705+0000","last_fullsized":"2023-12-07T10:01:08.732705+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:03:10.053295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932133+0000","last_change":"2023-12-07T10:01:05.934504+0000","last_active":"2023-12-07T10:01:06.932133+0000","last_peered":"2023-12-07T10:01:06.932133+0000","last_clean":"2023-12-07T10:01:06.932133+0000","last_became_active":"2023-12-07T10:01:05.933884+0000","last_became_peered":"2023-12-07T10:01:05.933884+0000","last_unstale":"2023-12-07T10:01:06.932133+0000","last_undegraded":"2023-12-07T10:01:06.932133+0000","last_fullsized":"2023-12-07T10:01:06.932133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:13:55.910861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928027+0000","last_change":"2023-12-07T10:00:53.243124+0000","last_active":"2023-12-07T10:01:06.928027+0000","last_peered":"2023-12-07T10:01:06.928027+0000","last_clean":"2023-12-07T10:01:06.928027+0000","last_became_active":"2023-12-07T10:00:53.242752+0000","last_became_peered":"2023-12-07T10:00:53.242752+0000","last_unstale":"2023-12-07T10:01:06.928027+0000","last_undegraded":"2023-12-07T10:01:06.928027+0000","last_fullsized":"2023-12-07T10:01:06.928027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:48:38.539114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935202+0000","last_change":"2023-12-07T10:00:52.853951+0000","last_active":"2023-12-07T10:01:06.935202+0000","last_peered":"2023-12-07T10:01:06.935202+0000","last_clean":"2023-12-07T10:01:06.935202+0000","last_became_active":"2023-12-07T10:00:52.853691+0000","last_became_peered":"2023-12-07T10:00:52.853691+0000","last_unstale":"2023-12-07T10:01:06.935202+0000","last_undegraded":"2023-12-07T10:01:06.935202+0000","last_fullsized":"2023-12-07T10:01:06.935202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:39:57.125583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.946415+0000","last_change":"2023-12-07T10:01:06.963945+0000","last_active":"2023-12-07T10:01:07.946415+0000","last_peered":"2023-12-07T10:01:07.946415+0000","last_clean":"2023-12-07T10:01:07.946415+0000","last_became_active":"2023-12-07T10:01:06.963409+0000","last_became_peered":"2023-12-07T10:01:06.963409+0000","last_unstale":"2023-12-07T10:01:07.946415+0000","last_undegraded":"2023-12-07T10:01:07.946415+0000","last_fullsized":"2023-12-07T10:01:07.946415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:04:43.129952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.956005+0000","last_change":"2023-12-07T10:01:05.938092+0000","last_active":"2023-12-07T10:01:06.956005+0000","last_peered":"2023-12-07T10:01:06.956005+0000","last_clean":"2023-12-07T10:01:06.956005+0000","last_became_active":"2023-12-07T10:01:05.936547+0000","last_became_peered":"2023-12-07T10:01:05.936547+0000","last_unstale":"2023-12-07T10:01:06.956005+0000","last_undegraded":"2023-12-07T10:01:06.956005+0000","last_fullsized":"2023-12-07T10:01:06.956005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:40:10.271029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.938042+0000","last_change":"2023-12-07T10:00:53.244839+0000","last_active":"2023-12-07T10:01:06.938042+0000","last_peered":"2023-12-07T10:01:06.938042+0000","last_clean":"2023-12-07T10:01:06.938042+0000","last_became_active":"2023-12-07T10:00:53.244566+0000","last_became_peered":"2023-12-07T10:00:53.244566+0000","last_unstale":"2023-12-07T10:01:06.938042+0000","last_undegraded":"2023-12-07T10:01:06.938042+0000","last_fullsized":"2023-12-07T10:01:06.938042+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:00:33.204970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932310+0000","last_change":"2023-12-07T10:00:52.852511+0000","last_active":"2023-12-07T10:01:06.932310+0000","last_peered":"2023-12-07T10:01:06.932310+0000","last_clean":"2023-12-07T10:01:06.932310+0000","last_became_active":"2023-12-07T10:00:52.852236+0000","last_became_peered":"2023-12-07T10:00:52.852236+0000","last_unstale":"2023-12-07T10:01:06.932310+0000","last_undegraded":"2023-12-07T10:01:06.932310+0000","last_fullsized":"2023-12-07T10:01:06.932310+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:35:46.641337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:08.734091+0000","last_change":"2023-12-07T10:01:06.950403+0000","last_active":"2023-12-07T10:01:08.734091+0000","last_peered":"2023-12-07T10:01:08.734091+0000","last_clean":"2023-12-07T10:01:08.734091+0000","last_became_active":"2023-12-07T10:01:06.950120+0000","last_became_peered":"2023-12-07T10:01:06.950120+0000","last_unstale":"2023-12-07T10:01:08.734091+0000","last_undegraded":"2023-12-07T10:01:08.734091+0000","last_fullsized":"2023-12-07T10:01:08.734091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:08:54.019447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.933070+0000","last_change":"2023-12-07T10:01:05.928161+0000","last_active":"2023-12-07T10:01:06.933070+0000","last_peered":"2023-12-07T10:01:06.933070+0000","last_clean":"2023-12-07T10:01:06.933070+0000","last_became_active":"2023-12-07T10:01:05.927865+0000","last_became_peered":"2023-12-07T10:01:05.927865+0000","last_unstale":"2023-12-07T10:01:06.933070+0000","last_undegraded":"2023-12-07T10:01:06.933070+0000","last_fullsized":"2023-12-07T10:01:06.933070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:59.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935143+0000","last_change":"2023-12-07T10:00:53.247601+0000","last_active":"2023-12-07T10:01:06.935143+0000","last_peered":"2023-12-07T10:01:06.935143+0000","last_clean":"2023-12-07T10:01:06.935143+0000","last_became_active":"2023-12-07T10:00:53.247283+0000","last_became_peered":"2023-12-07T10:00:53.247283+0000","last_unstale":"2023-12-07T10:01:06.935143+0000","last_undegraded":"2023-12-07T10:01:06.935143+0000","last_fullsized":"2023-12-07T10:01:06.935143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:47.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935408+0000","last_change":"2023-12-07T10:00:52.859487+0000","last_active":"2023-12-07T10:01:06.935408+0000","last_peered":"2023-12-07T10:01:06.935408+0000","last_clean":"2023-12-07T10:01:06.935408+0000","last_became_active":"2023-12-07T10:00:52.858516+0000","last_became_peered":"2023-12-07T10:00:52.858516+0000","last_unstale":"2023-12-07T10:01:06.935408+0000","last_undegraded":"2023-12-07T10:01:06.935408+0000","last_fullsized":"2023-12-07T10:01:06.935408+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:01:03.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.947327+0000","last_change":"2023-12-07T10:01:06.956756+0000","last_active":"2023-12-07T10:01:07.947327+0000","last_peered":"2023-12-07T10:01:07.947327+0000","last_clean":"2023-12-07T10:01:07.947327+0000","last_became_active":"2023-12-07T10:01:06.956448+0000","last_became_peered":"2023-12-07T10:01:06.956448+0000","last_unstale":"2023-12-07T10:01:07.947327+0000","last_undegraded":"2023-12-07T10:01:07.947327+0000","last_fullsized":"2023-12-07T10:01:07.947327+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:49:26.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.935042+0000","last_change":"2023-12-07T10:01:05.936607+0000","last_active":"2023-12-07T10:01:06.935042+0000","last_peered":"2023-12-07T10:01:06.935042+0000","last_clean":"2023-12-07T10:01:06.935042+0000","last_became_active":"2023-12-07T10:01:05.936323+0000","last_became_peered":"2023-12-07T10:01:05.936323+0000","last_unstale":"2023-12-07T10:01:06.935042+0000","last_undegraded":"2023-12-07T10:01:06.935042+0000","last_fullsized":"2023-12-07T10:01:06.935042+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:31:28.110490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927749+0000","last_change":"2023-12-07T10:00:53.246976+0000","last_active":"2023-12-07T10:01:06.927749+0000","last_peered":"2023-12-07T10:01:06.927749+0000","last_clean":"2023-12-07T10:01:06.927749+0000","last_became_active":"2023-12-07T10:00:53.246549+0000","last_became_peered":"2023-12-07T10:00:53.246549+0000","last_unstale":"2023-12-07T10:01:06.927749+0000","last_undegraded":"2023-12-07T10:01:06.927749+0000","last_fullsized":"2023-12-07T10:01:06.927749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:47:08.339036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.928088+0000","last_change":"2023-12-07T10:00:52.851783+0000","last_active":"2023-12-07T10:01:06.928088+0000","last_peered":"2023-12-07T10:01:06.928088+0000","last_clean":"2023-12-07T10:01:06.928088+0000","last_became_active":"2023-12-07T10:00:52.851309+0000","last_became_peered":"2023-12-07T10:00:52.851309+0000","last_unstale":"2023-12-07T10:01:06.928088+0000","last_undegraded":"2023-12-07T10:01:06.928088+0000","last_fullsized":"2023-12-07T10:01:06.928088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:11:47.145427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-07T10:01:07.941177+0000","last_change":"2023-12-07T10:01:06.950835+0000","last_active":"2023-12-07T10:01:07.941177+0000","last_peered":"2023-12-07T10:01:07.941177+0000","last_clean":"2023-12-07T10:01:07.941177+0000","last_became_active":"2023-12-07T10:01:06.950591+0000","last_became_peered":"2023-12-07T10:01:06.950591+0000","last_unstale":"2023-12-07T10:01:07.941177+0000","last_undegraded":"2023-12-07T10:01:07.941177+0000","last_fullsized":"2023-12-07T10:01:07.941177+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:05.902275+0000","last_clean_scrub_stamp":"2023-12-07T10:01:05.902275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:11.250509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.971646+0000","last_change":"2023-12-07T10:01:05.932922+0000","last_active":"2023-12-07T10:01:06.971646+0000","last_peered":"2023-12-07T10:01:06.971646+0000","last_clean":"2023-12-07T10:01:06.971646+0000","last_became_active":"2023-12-07T10:01:05.932612+0000","last_became_peered":"2023-12-07T10:01:05.932612+0000","last_unstale":"2023-12-07T10:01:06.971646+0000","last_undegraded":"2023-12-07T10:01:06.971646+0000","last_fullsized":"2023-12-07T10:01:06.971646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:04.894425+0000","last_clean_scrub_stamp":"2023-12-07T10:01:04.894425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:23:13.657094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.927731+0000","last_change":"2023-12-07T10:00:53.243607+0000","last_active":"2023-12-07T10:01:06.927731+0000","last_peered":"2023-12-07T10:01:06.927731+0000","last_clean":"2023-12-07T10:01:06.927731+0000","last_became_active":"2023-12-07T10:00:53.243047+0000","last_became_peered":"2023-12-07T10:00:53.243047+0000","last_unstale":"2023-12-07T10:01:06.927731+0000","last_undegraded":"2023-12-07T10:01:06.927731+0000","last_fullsized":"2023-12-07T10:01:06.927731+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:52.826075+0000","last_clean_scrub_stamp":"2023-12-07T10:00:52.826075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:14:01.627529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.957182+0000","last_change":"2023-12-07T10:00:52.857408+0000","last_active":"2023-12-07T10:01:06.957182+0000","last_peered":"2023-12-07T10:01:06.957182+0000","last_clean":"2023-12-07T10:01:06.957182+0000","last_became_active":"2023-12-07T10:00:52.857077+0000","last_became_peered":"2023-12-07T10:00:52.857077+0000","last_unstale":"2023-12-07T10:01:06.957182+0000","last_undegraded":"2023-12-07T10:01:06.957182+0000","last_fullsized":"2023-12-07T10:01:06.957182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:00:51.817432+0000","last_clean_scrub_stamp":"2023-12-07T10:00:51.817432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:37:53.043016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-07T10:01:06.932270+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:06.932270+0000","last_peered":"2023-12-07T10:01:06.932270+0000","last_clean":"2023-12-07T10:01:06.932270+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:06.932270+0000","last_undegraded":"2023-12-07T10:01:06.932270+0000","last_fullsized":"2023-12-07T10:01:06.932270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1245184,"data_stored":866253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":275201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":275851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":278286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.878}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":275277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.38}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.62},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.75},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":276777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":1.171}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":3.6760000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":1.915}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":8.5660000000000007},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":3.714}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":2.0489999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":2.3599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":3.7519999999999998}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":1.417},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":2.3969999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":4.5110000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":277427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.746}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":869166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.877},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:15.913 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T10:01:15.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-07T10:01:16.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febd092b640 1 Processor -- start 2023-12-07T10:01:16.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febd092b640 1 -- start start 2023-12-07T10:01:16.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febd092b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 0x7febcc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febd092b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0c0930 con 0x7febcc0c30a0 2023-12-07T10:01:16.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febd092b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0c05e0 con 0x7febcc0c4b80 2023-12-07T10:01:16.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febd092b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc154d00 con 0x7febcc0bc140 2023-12-07T10:01:16.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febc3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7febcc0c30a0 0x7febcc06b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42122/0 (socket says 172.21.15.89:42122) 2023-12-07T10:01:16.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febc3fff640 1 -- 172.21.15.89:0/842606358 learned_addr learned my addr 172.21.15.89:0/842606358 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:16.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 0x7febcc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68063185 0 0) 0x7febcc0c0930 con 0x7febcc0c30a0 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb8003530 con 0x7febcc0c30a0 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219312502 0 0) 0x7febb8003530 con 0x7febcc0c30a0 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 msgr2=0x7febcc072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 0x7febcc072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 >> v1:172.21.15.97:6789/0 conn(0x7febcc0c4b80 legacy=0x7febcc0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc1549f0 con 0x7febcc0c30a0 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7febb4001680 con 0x7febcc0c30a0 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 >> v1:172.21.15.89:6789/0 conn(0x7febcc0c30a0 legacy=0x7febcc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb80039b0 0x7febb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 0x7febb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb8004d10 0x7febb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc154d00 con 0x7febb80039b0 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb800dcd0 con 0x7febb8004d10 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb800de90 con 0x7febcc0bc140 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb80039b0 0x7febb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febc3fff640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 0x7febb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcbfff640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb8004d10 0x7febb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 -- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 msgr2=0x7febb80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bc140 0x7febb80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 -- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb8004d10 msgr2=0x7febb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb8004d10 0x7febb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.092+0000 7febcb7fe640 1 -- 172.21.15.89:0/842606358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8003530 con 0x7febb80039b0 2023-12-07T10:01:16.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febcb7fe640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb80039b0 0x7febb8003dd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7febbc009ae0 tx=0x7febbc01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935e2db8caa1452f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0a6480 con 0x7febb80039b0 2023-12-07T10:01:16.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc0a65e0 con 0x7febb80039b0 2023-12-07T10:01:16.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febcaffd640 1 -- 172.21.15.89:0/842606358 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0a6990 con 0x7febb80039b0 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febd092b640 1 -- 172.21.15.89:0/842606358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb80039b0 msgr2=0x7febb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febd092b640 1 --2- 172.21.15.89:0/842606358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb80039b0 0x7febb8003dd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7febbc009ae0 tx=0x7febbc01c990 comp rx=0 tx=0).stop 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febcbfff640 1 -- 172.21.15.89:0/842606358 reap_dead start 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febd092b640 1 -- 172.21.15.89:0/842606358 shutdown_connections 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febd092b640 1 -- 172.21.15.89:0/842606358 >> 172.21.15.89:0/842606358 conn(0x7febcc0c5a60 msgr2=0x7febcc0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febd092b640 1 -- 172.21.15.89:0/842606358 shutdown_connections 2023-12-07T10:01:16.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.096+0000 7febd092b640 1 -- 172.21.15.89:0/842606358 wait complete. 2023-12-07T10:01:16.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 Processor -- start 2023-12-07T10:01:16.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 -- start start 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb80039b0 0x7febcc0bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 0x7febcc0bf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bf840 0x7febcc14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc09a740 con 0x7febcc099c70 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc154190 con 0x7febb80039b0 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0be770 con 0x7febcc0bf840 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 0x7febcc0bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 0x7febcc0bf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41698/0 (socket says 172.21.15.89:41698) 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 -- 172.21.15.89:0/2810014513 learned_addr learned my addr 172.21.15.89:0/2810014513 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febcbfff640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bf840 0x7febcc14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febcb7fe640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb80039b0 0x7febcc0bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 -- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bf840 msgr2=0x7febcc14ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bf840 0x7febcc14ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 -- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb80039b0 msgr2=0x7febcc0bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb80039b0 0x7febcc0bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 -- 172.21.15.89:0/2810014513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc1f07b0 con 0x7febcc099c70 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc3fff640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 0x7febcc0bf300 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7febb400e7f0 tx=0x7febb400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400c870 con 0x7febcc099c70 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400c9d0 con 0x7febcc099c70 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc1f0a90 con 0x7febcc099c70 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400cd60 con 0x7febcc099c70 2023-12-07T10:01:16.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.100+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc1f1050 con 0x7febcc099c70 2023-12-07T10:01:16.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.104+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc0680c0 con 0x7febcc099c70 2023-12-07T10:01:16.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.104+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7febb4013420 con 0x7febcc099c70 2023-12-07T10:01:16.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.104+0000 7febc8ff9640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7febac066900 0x7febac068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.104+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7febb40844e0 con 0x7febcc099c70 2023-12-07T10:01:16.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.104+0000 7febcb7fe640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7febac066900 0x7febac068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.104+0000 7febcb7fe640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7febac066900 0x7febac068dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ad000 tx=0x7febbc0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.108+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7febb4051290 con 0x7febcc099c70 2023-12-07T10:01:16.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.308+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7febcc074970 con 0x7febcc099c70 2023-12-07T10:01:16.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.312+0000 7febc8ff9640 1 -- 172.21.15.89:0/2810014513 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7febb40548b0 con 0x7febcc099c70 2023-12-07T10:01:16.317 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-12-07T10:01:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA== 2023-12-07T10:01:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-12-07T10:01:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:01:16.318 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-07T10:01:16.318 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.1 2023-12-07T10:01:16.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.312+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7febac066900 msgr2=0x7febac068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.312+0000 7febd092b640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7febac066900 0x7febac068dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ad000 tx=0x7febbc0046d0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.312+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 msgr2=0x7febcc0bf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.312+0000 7febd092b640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 0x7febcc0bf300 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7febb400e7f0 tx=0x7febb400ecb0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 shutdown_connections 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7febac066900 0x7febac068dc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7febcc0bf840 0x7febcc14ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febcc099c70 0x7febcc0bf300 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 --2- 172.21.15.89:0/2810014513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febb80039b0 0x7febcc0bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 >> 172.21.15.89:0/2810014513 conn(0x7febcc0c5a60 msgr2=0x7febcc0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 shutdown_connections 2023-12-07T10:01:16.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.316+0000 7febd092b640 1 -- 172.21.15.89:0/2810014513 wait complete. 2023-12-07T10:01:16.339 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:16.339 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:16.349 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:16.349 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:16.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:16.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 Processor -- start 2023-12-07T10:01:16.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 -- start start 2023-12-07T10:01:16.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00af6b0 0x7fcfe00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcfe00cab80 0x7fcfe00c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00afa90 con 0x7fcfe00c48b0 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00c4dc0 con 0x7fcfe00cab80 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe52c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00c5080 con 0x7fcfe00af6b0 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdf7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcfe00c48b0 0x7fcfe00c7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42136/0 (socket says 172.21.15.89:42136) 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdf7fe640 1 -- 172.21.15.89:0/2994145548 learned_addr learned my addr 172.21.15.89:0/2994145548 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe4ac7640 1 --2- 172.21.15.89:0/2994145548 >> v2:172.21.15.97:3300/0 conn(0x7fcfe00cab80 0x7fcfe00c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2994145548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00af6b0 0x7fcfe00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdeffd640 1 -- 172.21.15.89:0/2994145548 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512843399 0 0) 0x7fcfe00afa90 con 0x7fcfe00c48b0 2023-12-07T10:01:16.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdeffd640 1 -- 172.21.15.89:0/2994145548 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc8003530 con 0x7fcfe00c48b0 2023-12-07T10:01:16.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdffff640 1 -- 172.21.15.89:0/2994145548 >> v2:172.21.15.97:3300/0 conn(0x7fcfe00cab80 msgr2=0x7fcfe00c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:16.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2994145548 >> v2:172.21.15.97:3300/0 conn(0x7fcfe00cab80 0x7fcfe00c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdffff640 1 -- 172.21.15.89:0/2994145548 >> v1:172.21.15.89:6789/0 conn(0x7fcfe00c48b0 legacy=0x7fcfe00c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfdffff640 1 -- 172.21.15.89:0/2994145548 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0158a30 con 0x7fcfe00af6b0 2023-12-07T10:01:16.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.536+0000 7fcfe4ac7640 1 --2- 172.21.15.89:0/2994145548 >> v2:172.21.15.97:3300/0 conn(0x7fcfe00cab80 0x7fcfe00c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:16.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2994145548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00af6b0 0x7fcfe00ca640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00097c0 tx=0x7fcfd001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580e6e0cd67dd7ae server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfdeffd640 1 -- 172.21.15.89:0/2994145548 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00ab600 con 0x7fcfe00af6b0 2023-12-07T10:01:16.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfdeffd640 1 -- 172.21.15.89:0/2994145548 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00a7050 con 0x7fcfe00af6b0 2023-12-07T10:01:16.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfdeffd640 1 -- 172.21.15.89:0/2994145548 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00ab980 con 0x7fcfe00af6b0 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2994145548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00af6b0 msgr2=0x7fcfe00ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2994145548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00af6b0 0x7fcfe00ca640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00097c0 tx=0x7fcfd001c480 comp rx=0 tx=0).stop 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2994145548 shutdown_connections 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2994145548 >> v2:172.21.15.97:3300/0 conn(0x7fcfe00cab80 0x7fcfe00c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2994145548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00af6b0 0x7fcfe00ca640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2994145548 >> 172.21.15.89:0/2994145548 conn(0x7fcfe00ac0c0 msgr2=0x7fcfe00c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2994145548 shutdown_connections 2023-12-07T10:01:16.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.540+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2994145548 wait complete. 2023-12-07T10:01:16.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 Processor -- start 2023-12-07T10:01:16.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 -- start start 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe00af6b0 0x7fcfe01ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 0x7fcfe014e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00cab80 0x7fcfe00c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01ed980 con 0x7fcfe00c48b0 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0157410 con 0x7fcfe00af6b0 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00c55b0 con 0x7fcfe00cab80 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 0x7fcfe014e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 0x7fcfe014e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41714/0 (socket says 172.21.15.89:41714) 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdf7fe640 1 -- 172.21.15.89:0/2065304586 learned_addr learned my addr 172.21.15.89:0/2065304586 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe00af6b0 0x7fcfe01ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe4ac7640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00cab80 0x7fcfe00c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 -- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00cab80 msgr2=0x7fcfe00c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00cab80 0x7fcfe00c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 -- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 msgr2=0x7fcfe014e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 0x7fcfe014e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 -- 172.21.15.89:0/2065304586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009a70 con 0x7fcfe00af6b0 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdf7fe640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 0x7fcfe014e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdffff640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe00af6b0 0x7fcfe01ed440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ab000 tx=0x7fcfd0019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00b4410 con 0x7fcfe00af6b0 2023-12-07T10:01:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00b4570 con 0x7fcfe00af6b0 2023-12-07T10:01:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00b4920 con 0x7fcfe00af6b0 2023-12-07T10:01:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd0009420 con 0x7fcfe00af6b0 2023-12-07T10:01:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.544+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00c6dd0 con 0x7fcfe00af6b0 2023-12-07T10:01:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.548+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe004e890 con 0x7fcfe00af6b0 2023-12-07T10:01:16.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.548+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcfd00b2040 con 0x7fcfe00af6b0 2023-12-07T10:01:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.548+0000 7fcfdcff9640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfcc0668d0 0x7fcfcc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.548+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcfd011e880 con 0x7fcfe00af6b0 2023-12-07T10:01:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.548+0000 7fcfdf7fe640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfcc0668d0 0x7fcfcc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.548+0000 7fcfdf7fe640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfcc0668d0 0x7fcfcc068d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00ae580 tx=0x7fcfd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.552+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfd00eb7f0 con 0x7fcfe00af6b0 2023-12-07T10:01:16.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.704+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe00ca8a0 con 0x7fcfe00af6b0 2023-12-07T10:01:16.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.704+0000 7fcfdcff9640 1 -- 172.21.15.89:0/2065304586 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7fcfd00eee10 con 0x7fcfe00af6b0 2023-12-07T10:01:16.711 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:16.711 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfcc0668d0 msgr2=0x7fcfcc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfcc0668d0 0x7fcfcc068d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00ae580 tx=0x7fcfd4009040 comp rx=0 tx=0).stop 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe00af6b0 msgr2=0x7fcfe01ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe00af6b0 0x7fcfe01ed440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ab000 tx=0x7fcfd0019220 comp rx=0 tx=0).stop 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 shutdown_connections 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfcc0668d0 0x7fcfcc068d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfe00cab80 0x7fcfe00c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00c48b0 0x7fcfe014e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 --2- 172.21.15.89:0/2065304586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe00af6b0 0x7fcfe01ed440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 >> 172.21.15.89:0/2065304586 conn(0x7fcfe00ac0c0 msgr2=0x7fcfe00c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 shutdown_connections 2023-12-07T10:01:16.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.708+0000 7fcfe52c8640 1 -- 172.21.15.89:0/2065304586 wait complete. 2023-12-07T10:01:16.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:00:50.933921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:00:52.211886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:01:04.139867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:01:05.289028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:16.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:16.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.868+0000 7faf7891c640 1 Processor -- start 2023-12-07T10:01:16.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7891c640 1 -- start start 2023-12-07T10:01:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7891c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faf7414e590 0x7faf74154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7891c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf7406b860 0x7faf7406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7891c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7406b3d0 con 0x7faf740c7d40 2023-12-07T10:01:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7891c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf741554a0 con 0x7faf7406b860 2023-12-07T10:01:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7891c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7414e970 con 0x7faf7414e590 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf7406b860 0x7faf7406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf7406b860 0x7faf7406bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41718/0 (socket says 172.21.15.89:41718) 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 -- 172.21.15.89:0/3882318241 learned_addr learned my addr 172.21.15.89:0/3882318241 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf72d9d640 1 --2- 172.21.15.89:0/3882318241 >> v2:172.21.15.97:3300/0 conn(0x7faf7414e590 0x7faf74154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 -- 172.21.15.89:0/3882318241 >> v2:172.21.15.97:3300/0 conn(0x7faf7414e590 msgr2=0x7faf74154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 --2- 172.21.15.89:0/3882318241 >> v2:172.21.15.97:3300/0 conn(0x7faf7414e590 0x7faf74154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 -- 172.21.15.89:0/3882318241 >> v1:172.21.15.97:6789/0 conn(0x7faf740c7d40 legacy=0x7faf740c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf7359e640 1 -- 172.21.15.89:0/3882318241 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740bd720 con 0x7faf7406b860 2023-12-07T10:01:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.872+0000 7faf72d9d640 1 --2- 172.21.15.89:0/3882318241 >> v2:172.21.15.97:3300/0 conn(0x7faf7414e590 0x7faf74154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7359e640 1 --2- 172.21.15.89:0/3882318241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7406b860 0x7faf7406bcf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf740c6c10 tx=0x7faf6c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5e020cae3c5f3b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf71d9b640 1 -- 172.21.15.89:0/3882318241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0a5800 con 0x7faf7406b860 2023-12-07T10:01:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf71d9b640 1 -- 172.21.15.89:0/3882318241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c0a5960 con 0x7faf7406b860 2023-12-07T10:01:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf71d9b640 1 -- 172.21.15.89:0/3882318241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0a5cf0 con 0x7faf7406b860 2023-12-07T10:01:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 -- 172.21.15.89:0/3882318241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7406b860 msgr2=0x7faf7406bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 --2- 172.21.15.89:0/3882318241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7406b860 0x7faf7406bcf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf740c6c10 tx=0x7faf6c01c940 comp rx=0 tx=0).stop 2023-12-07T10:01:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 -- 172.21.15.89:0/3882318241 shutdown_connections 2023-12-07T10:01:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 --2- 172.21.15.89:0/3882318241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7406b860 0x7faf7406bcf0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 --2- 172.21.15.89:0/3882318241 >> v2:172.21.15.97:3300/0 conn(0x7faf7414e590 0x7faf74154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 -- 172.21.15.89:0/3882318241 >> 172.21.15.89:0/3882318241 conn(0x7faf740abd70 msgr2=0x7faf740ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 -- 172.21.15.89:0/3882318241 shutdown_connections 2023-12-07T10:01:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 -- 172.21.15.89:0/3882318241 wait complete. 2023-12-07T10:01:16.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 Processor -- start 2023-12-07T10:01:16.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.876+0000 7faf7891c640 1 -- start start 2023-12-07T10:01:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf7406b860 0x7faf74146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf740c7d40 0x7faf741465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 0x7faf741ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7414ac00 con 0x7faf7414e590 2023-12-07T10:01:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7414b780 con 0x7faf740c7d40 2023-12-07T10:01:16.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf74151e10 con 0x7faf7406b860 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 0x7faf741ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 0x7faf741ecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41724/0 (socket says 172.21.15.89:41724) 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 -- 172.21.15.89:0/2812381278 learned_addr learned my addr 172.21.15.89:0/2812381278 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf72d9d640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf7406b860 0x7faf74146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7259c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf740c7d40 0x7faf741465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 -- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf7406b860 msgr2=0x7faf74146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf7406b860 0x7faf74146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 -- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf740c7d40 msgr2=0x7faf741465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf740c7d40 0x7faf741465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 -- 172.21.15.89:0/2812381278 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c009b30 con 0x7faf7414e590 2023-12-07T10:01:16.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7259c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf740c7d40 0x7faf741465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:16.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7359e640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 0x7faf741ecdf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faf6c01a570 tx=0x7faf6c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0b8880 con 0x7faf7414e590 2023-12-07T10:01:16.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c0b8a00 con 0x7faf7414e590 2023-12-07T10:01:16.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0b8db0 con 0x7faf7414e590 2023-12-07T10:01:16.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7414ae50 con 0x7faf7414e590 2023-12-07T10:01:16.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7414b410 con 0x7faf7414e590 2023-12-07T10:01:16.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7414b910 con 0x7faf7414e590 2023-12-07T10:01:16.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.880+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf6c0b6440 con 0x7faf7414e590 2023-12-07T10:01:16.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.884+0000 7faf5b7fe640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf600668d0 0x7faf60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:16.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.884+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faf6c120070 con 0x7faf7414e590 2023-12-07T10:01:16.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.884+0000 7faf72d9d640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf600668d0 0x7faf60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:16.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.884+0000 7faf72d9d640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf600668d0 0x7faf60068d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf640045f0 tx=0x7faf64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:16.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:16.888+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf6c0ecf40 con 0x7faf7414e590 2023-12-07T10:01:17.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.036+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf74074970 con 0x7faf7414e590 2023-12-07T10:01:17.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.036+0000 7faf5b7fe640 1 -- 172.21.15.89:0/2812381278 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf6c0f0560 con 0x7faf7414e590 2023-12-07T10:01:17.042 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:17.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf600668d0 msgr2=0x7faf60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf600668d0 0x7faf60068d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf640045f0 tx=0x7faf64008040 comp rx=0 tx=0).stop 2023-12-07T10:01:17.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 msgr2=0x7faf741ecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 0x7faf741ecdf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faf6c01a570 tx=0x7faf6c0196e0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 shutdown_connections 2023-12-07T10:01:17.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf7414e590 0x7faf741ecdf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf740c7d40 0x7faf741465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faf600668d0 0x7faf60068d90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 --2- 172.21.15.89:0/2812381278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf7406b860 0x7faf74146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 >> 172.21.15.89:0/2812381278 conn(0x7faf740abd70 msgr2=0x7faf740c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:17.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 shutdown_connections 2023-12-07T10:01:17.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.040+0000 7faf7891c640 1 -- 172.21.15.89:0/2812381278 wait complete. 2023-12-07T10:01:17.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:01:17.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.196+0000 7f0c6565a640 1 Processor -- start 2023-12-07T10:01:17.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.196+0000 7f0c6565a640 1 -- start start 2023-12-07T10:01:17.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c6565a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c600a8470 0x7f0c6006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c6565a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6006de00 con 0x7f0c6014eaf0 2023-12-07T10:01:17.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c6565a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c60070390 con 0x7f0c600c0370 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c6565a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6014eed0 con 0x7f0c600a8470 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0c6014eaf0 0x7f0c60151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42148/0 (socket says 172.21.15.89:42148) 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5effd640 1 -- 172.21.15.89:0/1940548086 learned_addr learned my addr 172.21.15.89:0/1940548086 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5f7fe640 1 --2- 172.21.15.89:0/1940548086 >> v2:172.21.15.89:3300/0 conn(0x7f0c600a8470 0x7f0c6006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5e7fc640 1 -- 172.21.15.89:0/1940548086 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989596416 0 0) 0x7f0c6006de00 con 0x7f0c6014eaf0 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/1940548086 >> v1:172.21.15.97:6789/0 conn(0x7f0c600c0370 legacy=0x7f0c6006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/1940548086 >> v1:172.21.15.89:6789/0 conn(0x7f0c6014eaf0 legacy=0x7f0c60151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.200+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/1940548086 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60151270 con 0x7f0c600a8470 2023-12-07T10:01:17.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c5f7fe640 1 --2- 172.21.15.89:0/1940548086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c600a8470 0x7f0c6006d820 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0c580097c0 tx=0x7f0c5801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede819e88a5d3ce0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c5e7fc640 1 -- 172.21.15.89:0/1940548086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580ad660 con 0x7f0c600a8470 2023-12-07T10:01:17.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c5e7fc640 1 -- 172.21.15.89:0/1940548086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580ad7c0 con 0x7f0c600a8470 2023-12-07T10:01:17.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c5e7fc640 1 -- 172.21.15.89:0/1940548086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580adb50 con 0x7f0c600a8470 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 -- 172.21.15.89:0/1940548086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c600a8470 msgr2=0x7f0c6006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 --2- 172.21.15.89:0/1940548086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c600a8470 0x7f0c6006d820 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0c580097c0 tx=0x7f0c5801c360 comp rx=0 tx=0).stop 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 -- 172.21.15.89:0/1940548086 shutdown_connections 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 --2- 172.21.15.89:0/1940548086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c600a8470 0x7f0c6006d820 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 -- 172.21.15.89:0/1940548086 >> 172.21.15.89:0/1940548086 conn(0x7f0c600c2a60 msgr2=0x7f0c600c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 -- 172.21.15.89:0/1940548086 shutdown_connections 2023-12-07T10:01:17.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 -- 172.21.15.89:0/1940548086 wait complete. 2023-12-07T10:01:17.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 Processor -- start 2023-12-07T10:01:17.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.204+0000 7f0c6565a640 1 -- start start 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c600a8470 0x7f0c60144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c600c0370 0x7f0c60141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 0x7f0c60141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60144660 con 0x7f0c6014eaf0 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c601438c0 con 0x7f0c600c0370 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c601f11b0 con 0x7f0c600a8470 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 0x7f0c60141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 0x7f0c60141840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41732/0 (socket says 172.21.15.89:41732) 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/383348473 learned_addr learned my addr 172.21.15.89:0/383348473 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5effd640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c600a8470 0x7f0c60144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c567fc640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c600c0370 0x7f0c60141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c600a8470 msgr2=0x7f0c60144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c600a8470 0x7f0c60144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c600c0370 msgr2=0x7f0c60141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c600c0370 0x7f0c60141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 -- 172.21.15.89:0/383348473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009420 con 0x7f0c6014eaf0 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c5f7fe640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 0x7f0c60141840 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0c58019f90 tx=0x7f0c5801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004230 con 0x7f0c6014eaf0 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58004390 con 0x7f0c6014eaf0 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580b8830 con 0x7f0c6014eaf0 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c60143b80 con 0x7f0c6014eaf0 2023-12-07T10:01:17.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c60144140 con 0x7f0c6014eaf0 2023-12-07T10:01:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6004e890 con 0x7f0c6014eaf0 2023-12-07T10:01:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.208+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c580b8990 con 0x7f0c6014eaf0 2023-12-07T10:01:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.212+0000 7f0c57fff640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c40066900 0x7f0c40068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.212+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0c5811fa70 con 0x7f0c6014eaf0 2023-12-07T10:01:17.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.212+0000 7f0c5effd640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c40066900 0x7f0c40068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.212+0000 7f0c5effd640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c40066900 0x7f0c40068dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005fd0 tx=0x7f0c50005c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.212+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c580eca60 con 0x7f0c6014eaf0 2023-12-07T10:01:17.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.368+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c60144330 con 0x7f0c6014eaf0 2023-12-07T10:01:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c57fff640 1 -- 172.21.15.89:0/383348473 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c580bc020 con 0x7f0c6014eaf0 2023-12-07T10:01:17.377 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c40066900 msgr2=0x7f0c40068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c40066900 0x7f0c40068dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005fd0 tx=0x7f0c50005c20 comp rx=0 tx=0).stop 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 msgr2=0x7f0c60141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 0x7f0c60141840 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0c58019f90 tx=0x7f0c5801aba0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 shutdown_connections 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6014eaf0 0x7f0c60141840 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c600c0370 0x7f0c60141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c40066900 0x7f0c40068dc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 --2- 172.21.15.89:0/383348473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c600a8470 0x7f0c60144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 >> 172.21.15.89:0/383348473 conn(0x7f0c600c2a60 msgr2=0x7f0c60151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:17.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 shutdown_connections 2023-12-07T10:01:17.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.372+0000 7f0c6565a640 1 -- 172.21.15.89:0/383348473 wait complete. 2023-12-07T10:01:17.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:01:17.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b50d80640 1 Processor -- start 2023-12-07T10:01:17.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b50d80640 1 -- start start 2023-12-07T10:01:17.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b50d80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7b4c0c0370 0x7f7b4c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b50d80640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c06de00 con 0x7f7b4c0a8470 2023-12-07T10:01:17.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b50d80640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c070390 con 0x7f7b4c14eaf0 2023-12-07T10:01:17.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b50d80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c14eed0 con 0x7f7b4c0c0370 2023-12-07T10:01:17.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b4ad9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7b4c0a8470 0x7f7b4c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42160/0 (socket says 172.21.15.89:42160) 2023-12-07T10:01:17.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b4ad9d640 1 -- 172.21.15.89:0/3627679864 learned_addr learned my addr 172.21.15.89:0/3627679864 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3627679864 >> v2:172.21.15.97:3300/0 conn(0x7f7b4c0c0370 0x7f7b4c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.532+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530476847 0 0) 0x7f7b4c06de00 con 0x7f7b4c0a8470 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b38003530 con 0x7f7b4c0a8470 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3000490704 0 0) 0x7f7b38003530 con 0x7f7b4c0a8470 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 >> v2:172.21.15.97:3300/0 conn(0x7f7b4c0c0370 msgr2=0x7f7b4c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 --2- 172.21.15.89:0/3627679864 >> v2:172.21.15.97:3300/0 conn(0x7f7b4c0c0370 0x7f7b4c06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 >> v1:172.21.15.97:6789/0 conn(0x7f7b4c14eaf0 legacy=0x7f7b4c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c151270 con 0x7f7b4c0a8470 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f7b44001680 con 0x7f7b4c0a8470 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 >> v1:172.21.15.89:6789/0 conn(0x7f7b4c0a8470 legacy=0x7f7b4c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b38003980 0x7f7b38003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b380051e0 0x7f7b3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c14eed0 con 0x7f7b380047d0 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3800c130 con 0x7f7b380051e0 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3800c2f0 con 0x7f7b38003980 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b4a59c640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b38003980 0x7f7b38003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b4ad9d640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b380051e0 0x7f7b3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b41d9b640 1 -- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b38003980 msgr2=0x7f7b38003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b38003980 0x7f7b38003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b41d9b640 1 -- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b380051e0 msgr2=0x7f7b3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:17.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b380051e0 0x7f7b3800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b41d9b640 1 -- 172.21.15.89:0/3627679864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38003530 con 0x7f7b380047d0 2023-12-07T10:01:17.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.536+0000 7f7b4ad9d640 1 -- 172.21.15.89:0/3627679864 reap_dead start 2023-12-07T10:01:17.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b38004c50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009ab0 tx=0x7f7b3401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66e8abc4cf5584f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340a55d0 con 0x7f7b380047d0 2023-12-07T10:01:17.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b340a5730 con 0x7f7b380047d0 2023-12-07T10:01:17.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b49d9b640 1 -- 172.21.15.89:0/3627679864 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340a5ae0 con 0x7f7b380047d0 2023-12-07T10:01:17.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- 172.21.15.89:0/3627679864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 msgr2=0x7f7b38004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b38004c50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009ab0 tx=0x7f7b3401ca00 comp rx=0 tx=0).stop 2023-12-07T10:01:17.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- 172.21.15.89:0/3627679864 shutdown_connections 2023-12-07T10:01:17.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3627679864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b38004c50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- 172.21.15.89:0/3627679864 >> 172.21.15.89:0/3627679864 conn(0x7f7b4c0c2a60 msgr2=0x7f7b4c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:17.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- 172.21.15.89:0/3627679864 shutdown_connections 2023-12-07T10:01:17.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- 172.21.15.89:0/3627679864 wait complete. 2023-12-07T10:01:17.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 Processor -- start 2023-12-07T10:01:17.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- start start 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b4c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b4c14e050 0x7f7b4c0c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b4c143cb0 0x7f7b4c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1ed9a0 con 0x7f7b380047d0 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1eded0 con 0x7f7b4c14e050 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.540+0000 7f7b50d80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1edbf0 con 0x7f7b4c143cb0 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b4c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b4c1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41746/0 (socket says 172.21.15.89:41746) 2023-12-07T10:01:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 -- 172.21.15.89:0/3083213218 learned_addr learned my addr 172.21.15.89:0/3083213218 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b4c14e050 0x7f7b4c0c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4ad9d640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b4c143cb0 0x7f7b4c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 -- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b4c143cb0 msgr2=0x7f7b4c152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b4c143cb0 0x7f7b4c152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 -- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b4c14e050 msgr2=0x7f7b4c0c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b4c14e050 0x7f7b4c0c2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 -- 172.21.15.89:0/3083213218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0c3c80 con 0x7f7b380047d0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b4a59c640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b4c1544f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00fb40 tx=0x7f7b3c00ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c003b90 con 0x7f7b380047d0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c003d10 con 0x7f7b380047d0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c0c3f60 con 0x7f7b380047d0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00dad0 con 0x7f7b380047d0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c152b80 con 0x7f7b380047d0 2023-12-07T10:01:17.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c04e890 con 0x7f7b380047d0 2023-12-07T10:01:17.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7b3c00dc30 con 0x7f7b380047d0 2023-12-07T10:01:17.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b437fe640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7b2c066900 0x7f7b2c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.544+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7b3c084a20 con 0x7f7b380047d0 2023-12-07T10:01:17.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.548+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7b2c066900 0x7f7b2c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.548+0000 7f7b41d9b640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7b2c066900 0x7f7b2c068dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b340af000 tx=0x7f7b340046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.552+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b3c0518f0 con 0x7f7b380047d0 2023-12-07T10:01:17.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b4c0abd70 con 0x7f7b380047d0 2023-12-07T10:01:17.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b437fe640 1 -- 172.21.15.89:0/3083213218 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b3c054f10 con 0x7f7b380047d0 2023-12-07T10:01:17.705 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7b2c066900 msgr2=0x7f7b2c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7b2c066900 0x7f7b2c068dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b340af000 tx=0x7f7b340046d0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 msgr2=0x7f7b4c1544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b4c1544f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00fb40 tx=0x7f7b3c00ff40 comp rx=0 tx=0).stop 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 shutdown_connections 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7b2c066900 0x7f7b2c068dc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7b4c143cb0 0x7f7b4c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b4c14e050 0x7f7b4c0c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 --2- 172.21.15.89:0/3083213218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b380047d0 0x7f7b4c1544f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 >> 172.21.15.89:0/3083213218 conn(0x7f7b4c0c2a60 msgr2=0x7f7b4c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:17.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 shutdown_connections 2023-12-07T10:01:17.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.700+0000 7f7b50d80640 1 -- 172.21.15.89:0/3083213218 wait complete. 2023-12-07T10:01:17.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:01:17.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 Processor -- start 2023-12-07T10:01:17.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 -- start start 2023-12-07T10:01:17.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f32e4154000 0x7f32e41543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32e406df30 0x7f32e40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e4154920 con 0x7f32e40700f0 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e40a8710 con 0x7f32e406df30 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e9b1c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e4071be0 con 0x7f32e4154000 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32e406df30 0x7f32e40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f32e40700f0 0x7f32e4070f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42170/0 (socket says 172.21.15.89:42170) 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.860+0000 7f32e2ffd640 1 -- 172.21.15.89:0/65422113 learned_addr learned my addr 172.21.15.89:0/65422113 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e37fe640 1 --2- 172.21.15.89:0/65422113 >> v2:172.21.15.97:3300/0 conn(0x7f32e4154000 0x7f32e41543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e3fff640 1 -- 172.21.15.89:0/65422113 >> v2:172.21.15.97:3300/0 conn(0x7f32e4154000 msgr2=0x7f32e41543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e3fff640 1 --2- 172.21.15.89:0/65422113 >> v2:172.21.15.97:3300/0 conn(0x7f32e4154000 0x7f32e41543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e3fff640 1 -- 172.21.15.89:0/65422113 >> v1:172.21.15.89:6789/0 conn(0x7f32e40700f0 legacy=0x7f32e4070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e3fff640 1 -- 172.21.15.89:0/65422113 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4154b90 con 0x7f32e406df30 2023-12-07T10:01:17.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e3fff640 1 --2- 172.21.15.89:0/65422113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e40716a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f32e40c3a30 tx=0x7f32dc01d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0939298ceb011aa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e27fc640 1 -- 172.21.15.89:0/65422113 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0a6930 con 0x7f32e406df30 2023-12-07T10:01:17.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e27fc640 1 -- 172.21.15.89:0/65422113 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc0a6a90 con 0x7f32e406df30 2023-12-07T10:01:17.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e27fc640 1 -- 172.21.15.89:0/65422113 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0a6e20 con 0x7f32e406df30 2023-12-07T10:01:17.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e9b1c640 1 -- 172.21.15.89:0/65422113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 msgr2=0x7f32e40716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/65422113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e40716a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f32e40c3a30 tx=0x7f32dc01d900 comp rx=0 tx=0).stop 2023-12-07T10:01:17.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e9b1c640 1 -- 172.21.15.89:0/65422113 shutdown_connections 2023-12-07T10:01:17.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/65422113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e40716a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/65422113 >> v2:172.21.15.97:3300/0 conn(0x7f32e4154000 0x7f32e41543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.864+0000 7f32e9b1c640 1 -- 172.21.15.89:0/65422113 >> 172.21.15.89:0/65422113 conn(0x7f32e40c2a60 msgr2=0x7f32e40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:17.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- 172.21.15.89:0/65422113 shutdown_connections 2023-12-07T10:01:17.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- 172.21.15.89:0/65422113 wait complete. 2023-12-07T10:01:17.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 Processor -- start 2023-12-07T10:01:17.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- start start 2023-12-07T10:01:17.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e4146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32e40700f0 0x7f32e41427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32e4154000 0x7f32e4142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e414e150 con 0x7f32e406df30 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4143250 con 0x7f32e40700f0 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e415a780 con 0x7f32e4154000 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e4146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e4146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41756/0 (socket says 172.21.15.89:41756) 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 -- 172.21.15.89:0/2086488616 learned_addr learned my addr 172.21.15.89:0/2086488616 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 -- 172.21.15.89:0/2086488616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32e4154000 msgr2=0x7f32e4142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32e4154000 0x7f32e4142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 -- 172.21.15.89:0/2086488616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32e40700f0 msgr2=0x7f32e41427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32e40700f0 0x7f32e41427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 -- 172.21.15.89:0/2086488616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc009a70 con 0x7f32e406df30 2023-12-07T10:01:17.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e37fe640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e4146090 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f32d400d5f0 tx=0x7f32d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40125f0 con 0x7f32e406df30 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4012750 con 0x7f32e406df30 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e415aa60 con 0x7f32e406df30 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.868+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4012ae0 con 0x7f32e406df30 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e414da60 con 0x7f32e406df30 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e404e890 con 0x7f32e406df30 2023-12-07T10:01:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f32d4012c40 con 0x7f32e406df30 2023-12-07T10:01:17.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32cbfff640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f32d00668d0 0x7f32d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:17.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f32d4084cb0 con 0x7f32e406df30 2023-12-07T10:01:17.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32e2ffd640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f32d00668d0 0x7f32d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:17.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.872+0000 7f32e2ffd640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f32d00668d0 0x7f32d0068d90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f32e414d7e0 tx=0x7f32d8007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:17.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:17.876+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32d4051b80 con 0x7f32e406df30 2023-12-07T10:01:18.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.028+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32e40c25f0 con 0x7f32e406df30 2023-12-07T10:01:18.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.028+0000 7f32cbfff640 1 -- 172.21.15.89:0/2086488616 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v53) v1 ==== 105+0+11 (secure 0 0 0) 0x7f32d4007380 con 0x7f32e406df30 2023-12-07T10:01:18.034 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.028+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f32d00668d0 msgr2=0x7f32d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.028+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f32d00668d0 0x7f32d0068d90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f32e414d7e0 tx=0x7f32d8007a50 comp rx=0 tx=0).stop 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.028+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 msgr2=0x7f32e4146090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.028+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e4146090 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f32d400d5f0 tx=0x7f32d400dab0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 shutdown_connections 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f32d00668d0 0x7f32d0068d90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f32e4154000 0x7f32e4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f32e40700f0 0x7f32e41427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 --2- 172.21.15.89:0/2086488616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32e406df30 0x7f32e4146090 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 >> 172.21.15.89:0/2086488616 conn(0x7f32e40c2a60 msgr2=0x7f32e41e2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:18.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 shutdown_connections 2023-12-07T10:01:18.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.032+0000 7f32e9b1c640 1 -- 172.21.15.89:0/2086488616 wait complete. 2023-12-07T10:01:18.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:01:18.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 Processor -- start 2023-12-07T10:01:18.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 -- start start 2023-12-07T10:01:18.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd40c7f20 0x7fabd406be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd406cf70 con 0x7fabd40c8430 2023-12-07T10:01:18.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd4152160 con 0x7fabd40c7f20 2023-12-07T10:01:18.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.188+0000 7fabd99d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40c6a30 con 0x7fabd4151d80 2023-12-07T10:01:18.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd40c7f20 0x7fabd406be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd40c7f20 0x7fabd406be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41758/0 (socket says 172.21.15.89:41758) 2023-12-07T10:01:18.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 -- 172.21.15.89:0/3326911883 learned_addr learned my addr 172.21.15.89:0/3326911883 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:18.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd2ffd640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 -- 172.21.15.89:0/3326911883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 msgr2=0x7fabd40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:18.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd40c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 -- 172.21.15.89:0/3326911883 >> v1:172.21.15.97:6789/0 conn(0x7fabd40c8430 legacy=0x7fabd406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:18.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 -- 172.21.15.89:0/3326911883 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40c72d0 con 0x7fabd40c7f20 2023-12-07T10:01:18.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd2ffd640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:18.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd37fe640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c7f20 0x7fabd406be30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009870 tx=0x7fabcc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723e3a925df7a347 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:18.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd27fc640 1 -- 172.21.15.89:0/3326911883 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0ab600 con 0x7fabd40c7f20 2023-12-07T10:01:18.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd27fc640 1 -- 172.21.15.89:0/3326911883 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc0ab760 con 0x7fabd40c7f20 2023-12-07T10:01:18.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.192+0000 7fabd27fc640 1 -- 172.21.15.89:0/3326911883 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0abaf0 con 0x7fabd40c7f20 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- 172.21.15.89:0/3326911883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c7f20 msgr2=0x7fabd406be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c7f20 0x7fabd406be30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009870 tx=0x7fabcc01c440 comp rx=0 tx=0).stop 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- 172.21.15.89:0/3326911883 shutdown_connections 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c7f20 0x7fabd406be30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 --2- 172.21.15.89:0/3326911883 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- 172.21.15.89:0/3326911883 >> 172.21.15.89:0/3326911883 conn(0x7fabd40abd00 msgr2=0x7fabd40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- 172.21.15.89:0/3326911883 shutdown_connections 2023-12-07T10:01:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- 172.21.15.89:0/3326911883 wait complete. 2023-12-07T10:01:18.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 Processor -- start 2023-12-07T10:01:18.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- start start 2023-12-07T10:01:18.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd40c7f20 0x7fabd41f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 0x7fabd41f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd41432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd414c6d0 con 0x7fabd40c8430 2023-12-07T10:01:18.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41f0f70 con 0x7fabd40c7f20 2023-12-07T10:01:18.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd99d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41531d0 con 0x7fabd4151d80 2023-12-07T10:01:18.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 0x7fabd41f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 0x7fabd41f0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41760/0 (socket says 172.21.15.89:41760) 2023-12-07T10:01:18.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabca7fc640 1 -- 172.21.15.89:0/2580063780 learned_addr learned my addr 172.21.15.89:0/2580063780 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:18.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd2ffd640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd40c7f20 0x7fabd41f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.196+0000 7fabd37fe640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd41432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabca7fc640 1 -- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 msgr2=0x7fabd41432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabca7fc640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd41432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabca7fc640 1 -- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd40c7f20 msgr2=0x7fabd41f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabca7fc640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd40c7f20 0x7fabd41f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabca7fc640 1 -- 172.21.15.89:0/2580063780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0094d0 con 0x7fabd40c8430 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabca7fc640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 0x7fabd41f0a30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00c450 tx=0x7fabbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc012830 con 0x7fabd40c8430 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc0129b0 con 0x7fabd40c8430 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc012d60 con 0x7fabd40c8430 2023-12-07T10:01:18.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd4153810 con 0x7fabd40c8430 2023-12-07T10:01:18.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd4153dd0 con 0x7fabd40c8430 2023-12-07T10:01:18.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd404e890 con 0x7fabd40c8430 2023-12-07T10:01:18.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabbc01c460 con 0x7fabd40c8430 2023-12-07T10:01:18.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.200+0000 7fabd0ff9640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabb40668d0 0x7fabb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.204+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fabbc084470 con 0x7fabd40c8430 2023-12-07T10:01:18.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.204+0000 7fabd2ffd640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabb40668d0 0x7fabb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.204+0000 7fabd2ffd640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabb40668d0 0x7fabb4068d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fabd414eca0 tx=0x7fabc4007810 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:18.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.204+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabbc0513f0 con 0x7fabd40c8430 2023-12-07T10:01:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.352+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fabd4153ff0 con 0x7fabd40c8430 2023-12-07T10:01:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd0ff9640 1 -- 172.21.15.89:0/2580063780 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v53) v1 ==== 101+0+11 (secure 0 0 0) 0x7fabbc054a10 con 0x7fabd40c8430 2023-12-07T10:01:18.359 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabb40668d0 msgr2=0x7fabb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabb40668d0 0x7fabb4068d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fabd414eca0 tx=0x7fabc4007810 comp rx=0 tx=0).stop 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 msgr2=0x7fabd41f0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 0x7fabd41f0a30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00c450 tx=0x7fabbc00c910 comp rx=0 tx=0).stop 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 shutdown_connections 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabb40668d0 0x7fabb4068d90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabd4151d80 0x7fabd41432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd40c8430 0x7fabd41f0a30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 --2- 172.21.15.89:0/2580063780 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd40c7f20 0x7fabd41f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 >> 172.21.15.89:0/2580063780 conn(0x7fabd40abd00 msgr2=0x7fabd40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 shutdown_connections 2023-12-07T10:01:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.356+0000 7fabd99d1640 1 -- 172.21.15.89:0/2580063780 wait complete. 2023-12-07T10:01:18.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:01:18.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 Processor -- start 2023-12-07T10:01:18.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 -- start start 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f775c0c4a10 0x7f775c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f775c157e70 0x7f775c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0c5da0 con 0x7f775c152080 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c0c6940 con 0x7f775c157e70 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f776252a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c0c51d0 con 0x7f775c0c4a10 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f775bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f775c152080 0x7f775c0c6230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42178/0 (socket says 172.21.15.89:42178) 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f775bfff640 1 -- 172.21.15.89:0/3461962671 learned_addr learned my addr 172.21.15.89:0/3461962671 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f7760ac7640 1 --2- 172.21.15.89:0/3461962671 >> v2:172.21.15.89:3300/0 conn(0x7f775c157e70 0x7f775c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f775b7fe640 1 --2- 172.21.15.89:0/3461962671 >> v2:172.21.15.97:3300/0 conn(0x7f775c0c4a10 0x7f775c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f775affd640 1 -- 172.21.15.89:0/3461962671 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108854128 0 0) 0x7f775c0c5da0 con 0x7f775c152080 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f775affd640 1 -- 172.21.15.89:0/3461962671 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7744003530 con 0x7f775c152080 2023-12-07T10:01:18.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f7760ac7640 1 -- 172.21.15.89:0/3461962671 >> v2:172.21.15.97:3300/0 conn(0x7f775c0c4a10 msgr2=0x7f775c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:18.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f7760ac7640 1 --2- 172.21.15.89:0/3461962671 >> v2:172.21.15.97:3300/0 conn(0x7f775c0c4a10 0x7f775c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f7760ac7640 1 -- 172.21.15.89:0/3461962671 >> v1:172.21.15.89:6789/0 conn(0x7f775c152080 legacy=0x7f775c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.516+0000 7f7760ac7640 1 -- 172.21.15.89:0/3461962671 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0c5470 con 0x7f775c157e70 2023-12-07T10:01:18.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f7760ac7640 1 --2- 172.21.15.89:0/3461962671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c06b110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f775c066f40 tx=0x7f775401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aa50e092a0ab8f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:18.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f775affd640 1 -- 172.21.15.89:0/3461962671 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540a5910 con 0x7f775c157e70 2023-12-07T10:01:18.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f775affd640 1 -- 172.21.15.89:0/3461962671 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540a5a70 con 0x7f775c157e70 2023-12-07T10:01:18.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f775affd640 1 -- 172.21.15.89:0/3461962671 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540a5e00 con 0x7f775c157e70 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 -- 172.21.15.89:0/3461962671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 msgr2=0x7f775c06b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 --2- 172.21.15.89:0/3461962671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c06b110 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f775c066f40 tx=0x7f775401c850 comp rx=0 tx=0).stop 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 -- 172.21.15.89:0/3461962671 shutdown_connections 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 --2- 172.21.15.89:0/3461962671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c06b110 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 --2- 172.21.15.89:0/3461962671 >> v2:172.21.15.97:3300/0 conn(0x7f775c0c4a10 0x7f775c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 -- 172.21.15.89:0/3461962671 >> 172.21.15.89:0/3461962671 conn(0x7f775c0ca090 msgr2=0x7f775c0ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 -- 172.21.15.89:0/3461962671 shutdown_connections 2023-12-07T10:01:18.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.520+0000 7f776252a640 1 -- 172.21.15.89:0/3461962671 wait complete. 2023-12-07T10:01:18.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 Processor -- start 2023-12-07T10:01:18.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 -- start start 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f775c0c4a10 0x7f775c1f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f775c152080 0x7f775c146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c1ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c14b680 con 0x7f775c157e70 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c1f0370 con 0x7f775c152080 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c1f0930 con 0x7f775c0c4a10 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c1ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c1ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41778/0 (socket says 172.21.15.89:41778) 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 -- 172.21.15.89:0/1915726338 learned_addr learned my addr 172.21.15.89:0/1915726338 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f775b7fe640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f775c152080 0x7f775c146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f775bfff640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f775c0c4a10 0x7f775c1f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 -- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f775c0c4a10 msgr2=0x7f775c1f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f775c0c4a10 0x7f775c1f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 -- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f775c152080 msgr2=0x7f775c146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f775c152080 0x7f775c146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 -- 172.21.15.89:0/1915726338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7754009a70 con 0x7f775c157e70 2023-12-07T10:01:18.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7760ac7640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c1ece00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f775401a480 tx=0x7f77540195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540ad850 con 0x7f775c157e70 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540ad9b0 con 0x7f775c157e70 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540add60 con 0x7f775c157e70 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c155e50 con 0x7f775c157e70 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.524+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c1f05c0 con 0x7f775c157e70 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.528+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c04e890 con 0x7f775c157e70 2023-12-07T10:01:18.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.528+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f77540b4050 con 0x7f775c157e70 2023-12-07T10:01:18.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.528+0000 7f7758ff9640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77480668d0 0x7f7748068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.528+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f775411f510 con 0x7f775c157e70 2023-12-07T10:01:18.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.528+0000 7f775bfff640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77480668d0 0x7f7748068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.528+0000 7f775bfff640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77480668d0 0x7f7748068d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f774c0011f0 tx=0x7f774c007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:18.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.532+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77540ec490 con 0x7f775c157e70 2023-12-07T10:01:18.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.692+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f775c1f0a70 con 0x7f775c157e70 2023-12-07T10:01:18.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f7758ff9640 1 -- 172.21.15.89:0/1915726338 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77540b2080 con 0x7f775c157e70 2023-12-07T10:01:18.700 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77480668d0 msgr2=0x7f7748068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77480668d0 0x7f7748068d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f774c0011f0 tx=0x7f774c007d40 comp rx=0 tx=0).stop 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 msgr2=0x7f775c1ece00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c1ece00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f775401a480 tx=0x7f77540195f0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 shutdown_connections 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f775c157e70 0x7f775c1ece00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f775c152080 0x7f775c146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f77480668d0 0x7f7748068d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 --2- 172.21.15.89:0/1915726338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f775c0c4a10 0x7f775c1f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:18.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 >> 172.21.15.89:0/1915726338 conn(0x7f775c0ca090 msgr2=0x7f775c0a9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:18.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 shutdown_connections 2023-12-07T10:01:18.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.696+0000 7f776252a640 1 -- 172.21.15.89:0/1915726338 wait complete. 2023-12-07T10:01:18.721 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T10:01:18.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:18.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:18.751 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:01:18.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:18.752 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:01:18.806 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:18.806 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:18.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:01:18.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:01:18.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee445d1640 1 Processor -- start 2023-12-07T10:01:18.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee445d1640 1 -- start start 2023-12-07T10:01:18.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee445d1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee3c0ca610 0x7fee3c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:18.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee445d1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c155790 con 0x7fee3c06cd90 2023-12-07T10:01:18.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee445d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0c4b00 con 0x7fee3c0bd720 2023-12-07T10:01:18.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee445d1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c0c4de0 con 0x7fee3c0ca610 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee4236d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee3c0ca610 0x7fee3c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee42b6e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fee3c06cd90 0x7fee3c0c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42194/0 (socket says 172.21.15.89:42194) 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee42b6e640 1 -- 172.21.15.89:0/2282485840 learned_addr learned my addr 172.21.15.89:0/2282485840 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee4236d640 1 -- 172.21.15.89:0/2282485840 >> v1:172.21.15.97:6789/0 conn(0x7fee3c0bd720 legacy=0x7fee3c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee4236d640 1 -- 172.21.15.89:0/2282485840 >> v1:172.21.15.89:6789/0 conn(0x7fee3c06cd90 legacy=0x7fee3c0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee4236d640 1 -- 172.21.15.89:0/2282485840 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c157e30 con 0x7fee3c0ca610 2023-12-07T10:01:18.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.992+0000 7fee4136b640 1 -- 172.21.15.89:0/2282485840 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340082036 0 0) 0x7fee3c155790 con 0x7fee3c06cd90 2023-12-07T10:01:19.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee4236d640 1 --2- 172.21.15.89:0/2282485840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ca610 0x7fee3c0c94c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fee380097c0 tx=0x7fee3801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cecaf589a3fd2a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee4136b640 1 -- 172.21.15.89:0/2282485840 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0c52d0 con 0x7fee3c0ca610 2023-12-07T10:01:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee4136b640 1 -- 172.21.15.89:0/2282485840 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee380a4770 con 0x7fee3c0ca610 2023-12-07T10:01:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee4136b640 1 -- 172.21.15.89:0/2282485840 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380a4b00 con 0x7fee3c0ca610 2023-12-07T10:01:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 -- 172.21.15.89:0/2282485840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ca610 msgr2=0x7fee3c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 --2- 172.21.15.89:0/2282485840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ca610 0x7fee3c0c94c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fee380097c0 tx=0x7fee3801c040 comp rx=0 tx=0).stop 2023-12-07T10:01:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 -- 172.21.15.89:0/2282485840 shutdown_connections 2023-12-07T10:01:19.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 --2- 172.21.15.89:0/2282485840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ca610 0x7fee3c0c94c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 -- 172.21.15.89:0/2282485840 >> 172.21.15.89:0/2282485840 conn(0x7fee3c071ea0 msgr2=0x7fee3c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:19.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 -- 172.21.15.89:0/2282485840 shutdown_connections 2023-12-07T10:01:19.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 -- 172.21.15.89:0/2282485840 wait complete. 2023-12-07T10:01:19.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 Processor -- start 2023-12-07T10:01:19.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:18.996+0000 7fee445d1640 1 -- start start 2023-12-07T10:01:19.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 0x7fee3c0c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:19.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3c0bd720 0x7fee3c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:19.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee3c0ca610 0x7fee3c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1eed60 con 0x7fee3c06cd90 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1423b0 con 0x7fee3c0ca610 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1ee150 con 0x7fee3c0bd720 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 0x7fee3c0c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 0x7fee3c0c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41788/0 (socket says 172.21.15.89:41788) 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 -- 172.21.15.89:0/2062285570 learned_addr learned my addr 172.21.15.89:0/2062285570 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee42b6e640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee3c0ca610 0x7fee3c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee41b6c640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3c0bd720 0x7fee3c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 -- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3c0bd720 msgr2=0x7fee3c14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3c0bd720 0x7fee3c14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 -- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee3c0ca610 msgr2=0x7fee3c14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee3c0ca610 0x7fee3c14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 -- 172.21.15.89:0/2062285570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38009420 con 0x7fee3c06cd90 2023-12-07T10:01:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee42b6e640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee3c0ca610 0x7fee3c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee41b6c640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3c0bd720 0x7fee3c14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee4236d640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 0x7fee3c0c3dd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fee38018f70 tx=0x7fee38019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380ac850 con 0x7fee3c06cd90 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee380ac9b0 con 0x7fee3c06cd90 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c1ee430 con 0x7fee3c06cd90 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380acd20 con 0x7fee3c06cd90 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c1ee9f0 con 0x7fee3c06cd90 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.000+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c04e890 con 0x7fee3c06cd90 2023-12-07T10:01:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.004+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee380b3040 con 0x7fee3c06cd90 2023-12-07T10:01:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.004+0000 7fee32ffd640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee20066900 0x7fee20068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.004+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fee3c0cac00 con 0x7fee3c06cd90 2023-12-07T10:01:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.004+0000 7fee41b6c640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee20066900 0x7fee20068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.004+0000 7fee41b6c640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee20066900 0x7fee20068dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee3c14a6c0 tx=0x7fee2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.008+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee3814f280 con 0x7fee3c06cd90 2023-12-07T10:01:19.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee3c06cb70 con 0x7fee3c06cd90 2023-12-07T10:01:19.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee32ffd640 1 -- 172.21.15.89:0/2062285570 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7fee380b10b0 con 0x7fee3c06cd90 2023-12-07T10:01:19.197 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:01:19.197 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:01:19.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee20066900 msgr2=0x7fee20068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:19.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee20066900 0x7fee20068dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee3c14a6c0 tx=0x7fee2c009040 comp rx=0 tx=0).stop 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 msgr2=0x7fee3c0c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 0x7fee3c0c3dd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fee38018f70 tx=0x7fee38019100 comp rx=0 tx=0).stop 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 shutdown_connections 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee3c0ca610 0x7fee3c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fee20066900 0x7fee20068dc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fee3c0bd720 0x7fee3c14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 --2- 172.21.15.89:0/2062285570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c06cd90 0x7fee3c0c3dd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 >> 172.21.15.89:0/2062285570 conn(0x7fee3c071ea0 msgr2=0x7fee3c158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 shutdown_connections 2023-12-07T10:01:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:19.192+0000 7fee445d1640 1 -- 172.21.15.89:0/2062285570 wait complete. 2023-12-07T10:01:19.217 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-07T10:01:19.217 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:01:19.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:01:19.217 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T10:01:19.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:19.217 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-07T10:01:19.218 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:01:19.218 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:01:19.218 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:01:19.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.218 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:01:19.228 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42297sec preferred_lft 42297sec 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.229 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:01:19.230 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:19.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.231 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:01:19.293 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:01:19.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.295 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:19.348 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:19.349 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:01:19.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.349 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:01:19.349 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:01:19.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:01:19.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:01:19.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:01:19.349 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:01:19.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.447 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:01:19.457 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:01:19.457 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:01:19.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:01:19.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:19.525 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:19.577 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:01:19.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:19.577 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:19.628 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-07T10:01:19.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:19.727 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:19.727 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:19.739 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:19.740 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:19.740 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:01:19.740 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs2=/ 2023-12-07T10:01:19.740 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:01:19.743 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:01:19.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.743 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:19.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:19.764 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:01:19.825 INFO:teuthology.orchestra.run.smithi097.stdout:client6213 2023-12-07T10:01:19.826 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:19.826 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:19.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-07T10:01:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c12957640 1 Processor -- start 2023-12-07T10:01:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c12957640 1 -- start start 2023-12-07T10:01:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c12957640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c0700f0 0x7f6c0c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c12957640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c071be0 con 0x7f6c0c154000 2023-12-07T10:01:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c12957640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c154b90 con 0x7f6c0c06df30 2023-12-07T10:01:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c12957640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0a8710 con 0x7f6c0c0700f0 2023-12-07T10:01:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6c0c154000 0x7f6c0c1543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36102/0 (socket says 172.21.15.89:36102) 2023-12-07T10:01:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0bfff640 1 -- 172.21.15.89:0/750786401 learned_addr learned my addr 172.21.15.89:0/750786401 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:20.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0b7fe640 1 --2- 172.21.15.89:0/750786401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c0700f0 0x7f6c0c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144756498 0 0) 0x7f6c0c071be0 con 0x7f6c0c154000 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf4003530 con 0x7f6c0c154000 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406069258 0 0) 0x7f6c0c154b90 con 0x7f6c0c06df30 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c0c071be0 con 0x7f6c0c06df30 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/750786401 >> v1:172.21.15.97:6789/0 conn(0x7f6c0c06df30 legacy=0x7f6c0c0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/750786401 >> v1:172.21.15.89:6789/0 conn(0x7f6c0c154000 legacy=0x7f6c0c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.020+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/750786401 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0abd70 con 0x7f6c0c0700f0 2023-12-07T10:01:20.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c0b7fe640 1 --2- 172.21.15.89:0/750786401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c0700f0 0x7f6c0c070f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c000097f0 tx=0x7f6c0001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6053f52ccee8ee4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000ab600 con 0x7f6c0c0700f0 2023-12-07T10:01:20.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c000a7050 con 0x7f6c0c0700f0 2023-12-07T10:01:20.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c0affd640 1 -- 172.21.15.89:0/750786401 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000ab980 con 0x7f6c0c0700f0 2023-12-07T10:01:20.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 -- 172.21.15.89:0/750786401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c0700f0 msgr2=0x7f6c0c070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 --2- 172.21.15.89:0/750786401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c0700f0 0x7f6c0c070f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c000097f0 tx=0x7f6c0001c3a0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 -- 172.21.15.89:0/750786401 shutdown_connections 2023-12-07T10:01:20.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 --2- 172.21.15.89:0/750786401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c0700f0 0x7f6c0c070f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 -- 172.21.15.89:0/750786401 >> 172.21.15.89:0/750786401 conn(0x7f6c0c0c2a60 msgr2=0x7f6c0c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:20.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 -- 172.21.15.89:0/750786401 shutdown_connections 2023-12-07T10:01:20.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.024+0000 7f6c12957640 1 -- 172.21.15.89:0/750786401 wait complete. 2023-12-07T10:01:20.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 Processor -- start 2023-12-07T10:01:20.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- start start 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c06df30 0x7f6c0c14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 0x7f6c0c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c0c154000 0x7f6c0c148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c147da0 con 0x7f6c0c0700f0 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c148290 con 0x7f6c0c154000 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c1eb940 con 0x7f6c0c06df30 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 0x7f6c0c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 0x7f6c0c15e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40434/0 (socket says 172.21.15.89:40434) 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/1967189024 learned_addr learned my addr 172.21.15.89:0/1967189024 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c10ef4640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c0c154000 0x7f6c0c148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0bfff640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c06df30 0x7f6c0c14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c06df30 msgr2=0x7f6c0c14b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c06df30 0x7f6c0c14b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c0c154000 msgr2=0x7f6c0c148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c0c154000 0x7f6c0c148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 -- 172.21.15.89:0/1967189024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009420 con 0x7f6c0c0700f0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0bfff640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c06df30 0x7f6c0c14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c0b7fe640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 0x7f6c0c15e8d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6c000097f0 tx=0x7f6c00019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000b4400 con 0x7f6c0c0700f0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c000b4580 con 0x7f6c0c0700f0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c14a320 con 0x7f6c0c0700f0 2023-12-07T10:01:20.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000b4930 con 0x7f6c0c0700f0 2023-12-07T10:01:20.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c14a8e0 con 0x7f6c0c0700f0 2023-12-07T10:01:20.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.028+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c0678c0 con 0x7f6c0c0700f0 2023-12-07T10:01:20.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.032+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c000b2040 con 0x7f6c0c0700f0 2023-12-07T10:01:20.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.032+0000 7f6c08ff9640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6bf80668d0 0x7f6bf8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.032+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c0011e510 con 0x7f6c0c0700f0 2023-12-07T10:01:20.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.032+0000 7f6c0bfff640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6bf80668d0 0x7f6bf8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.032+0000 7f6c0bfff640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6bf80668d0 0x7f6bf8068d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc000f70 tx=0x7f6bfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.036+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c000eb350 con 0x7f6c0c0700f0 2023-12-07T10:01:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.240+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f6c0c0c01f0 con 0x7f6c0c0700f0 2023-12-07T10:01:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.240+0000 7f6c08ff9640 1 -- 172.21.15.89:0/1967189024 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f6c000ee970 con 0x7f6c0c0700f0 2023-12-07T10:01:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:added key for client.testuser 2023-12-07T10:01:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6bf80668d0 msgr2=0x7f6bf8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6bf80668d0 0x7f6bf8068d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc000f70 tx=0x7f6bfc009040 comp rx=0 tx=0).stop 2023-12-07T10:01:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 msgr2=0x7f6c0c15e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 0x7f6c0c15e8d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6c000097f0 tx=0x7f6c00019140 comp rx=0 tx=0).stop 2023-12-07T10:01:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 shutdown_connections 2023-12-07T10:01:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c0c154000 0x7f6c0c148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c0c0700f0 0x7f6c0c15e8d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6bf80668d0 0x7f6bf8068d90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 --2- 172.21.15.89:0/1967189024 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c0c06df30 0x7f6c0c14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 >> 172.21.15.89:0/1967189024 conn(0x7f6c0c0c2a60 msgr2=0x7f6c0c150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 shutdown_connections 2023-12-07T10:01:20.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.244+0000 7f6c12957640 1 -- 172.21.15.89:0/1967189024 wait complete. 2023-12-07T10:01:20.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-07T10:01:20.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 Processor -- start 2023-12-07T10:01:20.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 -- start start 2023-12-07T10:01:20.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc80c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4fc806b5b0 0x7f4fc806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80c2290 con 0x7f4fc814e4d0 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc80c2e30 con 0x7f4fc806b5b0 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcfd55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8073c00 con 0x7f4fc80c2a50 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcd2f0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4fc814e4d0 0x7f4fc80734f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36108/0 (socket says 172.21.15.89:36108) 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcd2f0640 1 -- 172.21.15.89:0/2336464801 learned_addr learned my addr 172.21.15.89:0/2336464801 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fce2f2640 1 --2- 172.21.15.89:0/2336464801 >> v2:172.21.15.97:3300/0 conn(0x7f4fc806b5b0 0x7f4fc806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcdaf1640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc80c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fccaef640 1 -- 172.21.15.89:0/2336464801 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657627498 0 0) 0x7f4fc80c2290 con 0x7f4fc814e4d0 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fccaef640 1 -- 172.21.15.89:0/2336464801 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb4003530 con 0x7f4fc814e4d0 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fce2f2640 1 -- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 msgr2=0x7f4fc80c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fce2f2640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc80c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fce2f2640 1 -- 172.21.15.89:0/2336464801 >> v1:172.21.15.89:6789/0 conn(0x7f4fc814e4d0 legacy=0x7f4fc80734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fce2f2640 1 -- 172.21.15.89:0/2336464801 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80c3010 con 0x7f4fc806b5b0 2023-12-07T10:01:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.404+0000 7f4fcdaf1640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc80c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:20.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fce2f2640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc806ba10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009dc0 tx=0x7f4fc001c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2738d5556e6bfe server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fccaef640 1 -- 172.21.15.89:0/2336464801 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00a5960 con 0x7f4fc806b5b0 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fccaef640 1 -- 172.21.15.89:0/2336464801 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00a5ac0 con 0x7f4fc806b5b0 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fccaef640 1 -- 172.21.15.89:0/2336464801 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00a5e50 con 0x7f4fc806b5b0 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 -- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 msgr2=0x7f4fc806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc806ba10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009dc0 tx=0x7f4fc001c880 comp rx=0 tx=0).stop 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 -- 172.21.15.89:0/2336464801 shutdown_connections 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc806ba10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/2336464801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc80c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 -- 172.21.15.89:0/2336464801 >> 172.21.15.89:0/2336464801 conn(0x7f4fc80c3240 msgr2=0x7f4fc80c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:20.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 -- 172.21.15.89:0/2336464801 shutdown_connections 2023-12-07T10:01:20.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.408+0000 7f4fcfd55640 1 -- 172.21.15.89:0/2336464801 wait complete. 2023-12-07T10:01:20.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 Processor -- start 2023-12-07T10:01:20.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- start start 2023-12-07T10:01:20.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc80a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc81f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 0x7f4fc814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80a8130 con 0x7f4fc814e4d0 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81f16c0 con 0x7f4fc806b5b0 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8146150 con 0x7f4fc80c2a50 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 0x7f4fc814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 0x7f4fc814d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40448/0 (socket says 172.21.15.89:40448) 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 -- 172.21.15.89:0/1310336655 learned_addr learned my addr 172.21.15.89:0/1310336655 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcdaf1640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc80a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcd2f0640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc81f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 -- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 msgr2=0x7f4fc81f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc81f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 -- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 msgr2=0x7f4fc80a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc80a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 -- 172.21.15.89:0/1310336655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4009420 con 0x7f4fc814e4d0 2023-12-07T10:01:20.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fce2f2640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 0x7f4fc814d1a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4fc001cd60 tx=0x7f4fc0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00aecb0 con 0x7f4fc814e4d0 2023-12-07T10:01:20.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00aee30 con 0x7f4fc814e4d0 2023-12-07T10:01:20.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc0009a70 con 0x7f4fc814e4d0 2023-12-07T10:01:20.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00b7650 con 0x7f4fc814e4d0 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc81f12e0 con 0x7f4fc814e4d0 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.412+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc804e890 con 0x7f4fc814e4d0 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.416+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4fc00b4050 con 0x7f4fc814e4d0 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.416+0000 7f4fbe7fc640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4fac0668d0 0x7f4fac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.416+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4fc011f760 con 0x7f4fc814e4d0 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.416+0000 7f4fcdaf1640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4fac0668d0 0x7f4fac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.416+0000 7f4fcdaf1640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4fac0668d0 0x7f4fac068d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4fc81ee3f0 tx=0x7f4fc4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.420+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fc00ec780 con 0x7f4fc814e4d0 2023-12-07T10:01:20.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.616+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f4fc80c1f40 con 0x7f4fc814e4d0 2023-12-07T10:01:20.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fbe7fc640 1 -- 172.21.15.89:0/1310336655 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7f4fc0009450 con 0x7f4fc814e4d0 2023-12-07T10:01:20.624 INFO:teuthology.orchestra.run.smithi089.stdout:[client.testuser] 2023-12-07T10:01:20.624 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDwl3FlKpd3DhAA8+9gxttS6SPzQ9IT9iSWow== 2023-12-07T10:01:20.624 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-07T10:01:20.625 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-07T10:01:20.625 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-07T10:01:20.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4fac0668d0 msgr2=0x7f4fac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4fac0668d0 0x7f4fac068d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4fc81ee3f0 tx=0x7f4fc4009190 comp rx=0 tx=0).stop 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 msgr2=0x7f4fc814d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 0x7f4fc814d1a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4fc001cd60 tx=0x7f4fc0019620 comp rx=0 tx=0).stop 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 shutdown_connections 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fc814e4d0 0x7f4fc814d1a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4fac0668d0 0x7f4fac068d90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4fc80c2a50 0x7f4fc81f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 --2- 172.21.15.89:0/1310336655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fc806b5b0 0x7f4fc80a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 >> 172.21.15.89:0/1310336655 conn(0x7f4fc80c3240 msgr2=0x7f4fc8147d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:20.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 shutdown_connections 2023-12-07T10:01:20.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.620+0000 7f4fcfd55640 1 -- 172.21.15.89:0/1310336655 wait complete. 2023-12-07T10:01:20.645 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:01:20.654 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.6Ml7hgFrAU 2023-12-07T10:01:20.654 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:20.654 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/tmp/tmp.6Ml7hgFrAU 2023-12-07T10:01:20.703 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:20.703 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:20.757 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:20.757 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:20.808 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:20.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 Processor -- start 2023-12-07T10:01:20.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 -- start start 2023-12-07T10:01:20.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6140c93c0 0x7fb61415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6141559f0 con 0x7fb6140bd5e0 2023-12-07T10:01:20.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb614157930 con 0x7fb6140c93c0 2023-12-07T10:01:20.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb618cad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb614151f20 con 0x7fb61406b100 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6140c93c0 0x7fb61415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6140c93c0 0x7fb61415ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40456/0 (socket says 172.21.15.89:40456) 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 -- 172.21.15.89:0/1647164453 learned_addr learned my addr 172.21.15.89:0/1647164453 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb6137fe640 1 --2- 172.21.15.89:0/1647164453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 -- 172.21.15.89:0/1647164453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 msgr2=0x7fb61406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 --2- 172.21.15.89:0/1647164453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61406b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 -- 172.21.15.89:0/1647164453 >> v1:172.21.15.97:6789/0 conn(0x7fb6140bd5e0 legacy=0x7fb6140c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.984+0000 7fb613fff640 1 -- 172.21.15.89:0/1647164453 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140aff20 con 0x7fb6140c93c0 2023-12-07T10:01:20.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb613fff640 1 --2- 172.21.15.89:0/1647164453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb61415ee80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009e50 tx=0x7fb60c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bb3b488d76fc70 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb6127fc640 1 -- 172.21.15.89:0/1647164453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0a56e0 con 0x7fb6140c93c0 2023-12-07T10:01:20.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb6127fc640 1 -- 172.21.15.89:0/1647164453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c0a5840 con 0x7fb6140c93c0 2023-12-07T10:01:20.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb6127fc640 1 -- 172.21.15.89:0/1647164453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0a5bd0 con 0x7fb6140c93c0 2023-12-07T10:01:20.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 -- 172.21.15.89:0/1647164453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 msgr2=0x7fb61415ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 --2- 172.21.15.89:0/1647164453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb61415ee80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009e50 tx=0x7fb60c01ca10 comp rx=0 tx=0).stop 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 -- 172.21.15.89:0/1647164453 shutdown_connections 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 --2- 172.21.15.89:0/1647164453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb61415ee80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 --2- 172.21.15.89:0/1647164453 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61406b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 -- 172.21.15.89:0/1647164453 >> 172.21.15.89:0/1647164453 conn(0x7fb6140ca550 msgr2=0x7fb6140abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 -- 172.21.15.89:0/1647164453 shutdown_connections 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 -- 172.21.15.89:0/1647164453 wait complete. 2023-12-07T10:01:20.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 Processor -- start 2023-12-07T10:01:20.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.988+0000 7fb618cad640 1 -- start start 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb6140bd5e0 0x7fb614148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb614148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140ac840 con 0x7fb6140c93c0 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb614148cc0 con 0x7fb6140bd5e0 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141eda70 con 0x7fb61406b100 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb614148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb6137fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb614148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40462/0 (socket says 172.21.15.89:40462) 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb6137fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61414afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:37166/0 (socket says 172.21.15.89:37166) 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 -- 172.21.15.89:0/3519287954 learned_addr learned my addr 172.21.15.89:0/3519287954 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb612ffd640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb6140bd5e0 0x7fb614148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 -- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 msgr2=0x7fb61414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 -- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb6140bd5e0 msgr2=0x7fb614148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:20.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb6140bd5e0 0x7fb614148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:20.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 -- 172.21.15.89:0/3519287954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009b30 con 0x7fb6140c93c0 2023-12-07T10:01:20.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb613fff640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb614148780 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb60c01a640 tx=0x7fb60c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0be070 con 0x7fb6140c93c0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c009510 con 0x7fb6140c93c0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61414a240 con 0x7fb6140c93c0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0b8660 con 0x7fb6140c93c0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61414a800 con 0x7fb6140c93c0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.992+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6140ac9b0 con 0x7fb6140c93c0 2023-12-07T10:01:20.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.996+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb60c0b87c0 con 0x7fb6140c93c0 2023-12-07T10:01:21.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.996+0000 7fb5fbfff640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6000668d0 0x7fb600068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.996+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb60c11ee80 con 0x7fb6140c93c0 2023-12-07T10:01:21.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.996+0000 7fb6137fe640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6000668d0 0x7fb600068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:20.996+0000 7fb6137fe640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6000668d0 0x7fb600068d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb604009b60 tx=0x7fb604009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.000+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb60c0ebd70 con 0x7fb6140c93c0 2023-12-07T10:01:21.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.148+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb61404e890 con 0x7fb6140c93c0 2023-12-07T10:01:21.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb5fbfff640 1 -- 172.21.15.89:0/3519287954 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7fb60c0ef390 con 0x7fb6140c93c0 2023-12-07T10:01:21.156 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:21.156 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6000668d0 msgr2=0x7fb600068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6000668d0 0x7fb600068d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb604009b60 tx=0x7fb604009190 comp rx=0 tx=0).stop 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 msgr2=0x7fb614148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb614148780 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb60c01a640 tx=0x7fb60c0197b0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 shutdown_connections 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6140c93c0 0x7fb614148780 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb6140bd5e0 0x7fb614148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb6000668d0 0x7fb600068d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 --2- 172.21.15.89:0/3519287954 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb61406b100 0x7fb61414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 >> 172.21.15.89:0/3519287954 conn(0x7fb6140ca550 msgr2=0x7fb6140663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:21.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 shutdown_connections 2023-12-07T10:01:21.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.152+0000 7fb618cad640 1 -- 172.21.15.89:0/3519287954 wait complete. 2023-12-07T10:01:21.177 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:00:50.933921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:00:52.211886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:01:04.139867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:01:05.289028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:21.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 Processor -- start 2023-12-07T10:01:21.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 -- start start 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f821c151d80 0x7f821c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f821c06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c06cf70 con 0x7f821c0c8430 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c152160 con 0x7f821c151d80 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.312+0000 7f8222817640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c6a30 con 0x7f821c0c7f20 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f821c0c8430 0x7f821c06b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36116/0 (socket says 172.21.15.89:36116) 2023-12-07T10:01:21.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 -- 172.21.15.89:0/1553326576 learned_addr learned my addr 172.21.15.89:0/1553326576 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821bfff640 1 --2- 172.21.15.89:0/1553326576 >> v2:172.21.15.97:3300/0 conn(0x7f821c151d80 0x7f821c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f8220db4640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f821c06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629056046 0 0) 0x7f821c06cf70 con 0x7f821c0c8430 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8204003530 con 0x7f821c0c8430 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802256322 0 0) 0x7f8204003530 con 0x7f821c0c8430 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 msgr2=0x7f821c06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f821c06be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 >> v2:172.21.15.97:3300/0 conn(0x7f821c151d80 msgr2=0x7f821c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 --2- 172.21.15.89:0/1553326576 >> v2:172.21.15.97:3300/0 conn(0x7f821c151d80 0x7f821c0c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0c72d0 con 0x7f821c0c8430 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f8210001680 con 0x7f821c0c8430 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f8220db4640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f821c06be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821bfff640 1 --2- 172.21.15.89:0/1553326576 >> v2:172.21.15.97:3300/0 conn(0x7f821c151d80 0x7f821c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 >> v1:172.21.15.89:6789/0 conn(0x7f821c0c8430 legacy=0x7f821c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8204003980 0x7f8204003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f8204004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f8204005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c152160 con 0x7f82040047d0 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c6a30 con 0x7f8204003980 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820400b990 con 0x7f821c0c7f20 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f8204004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821bfff640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8204003980 0x7f8204003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f8220db4640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f8204005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 -- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 msgr2=0x7f8204005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f8204005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 -- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8204003980 msgr2=0x7f8204003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8204003980 0x7f8204003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821b7fe640 1 -- 172.21.15.89:0/1553326576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009a70 con 0x7f82040047d0 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f8220db4640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c0c7f20 0x7f8204005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:21.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.316+0000 7f821bfff640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8204003980 0x7f8204003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:21.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f8204004c50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f821000c110 tx=0x7f821001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75478e8704a00891 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100058e0 con 0x7f82040047d0 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210005a60 con 0x7f82040047d0 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f821affd640 1 -- 172.21.15.89:0/1553326576 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210005e10 con 0x7f82040047d0 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 -- 172.21.15.89:0/1553326576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 msgr2=0x7f8204004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 --2- 172.21.15.89:0/1553326576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f8204004c50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f821000c110 tx=0x7f821001cb70 comp rx=0 tx=0).stop 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8220db4640 1 -- 172.21.15.89:0/1553326576 reap_dead start 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 -- 172.21.15.89:0/1553326576 shutdown_connections 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 -- 172.21.15.89:0/1553326576 >> 172.21.15.89:0/1553326576 conn(0x7f821c0abd00 msgr2=0x7f821c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 -- 172.21.15.89:0/1553326576 shutdown_connections 2023-12-07T10:01:21.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 -- 172.21.15.89:0/1553326576 wait complete. 2023-12-07T10:01:21.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 Processor -- start 2023-12-07T10:01:21.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.320+0000 7f8222817640 1 -- start start 2023-12-07T10:01:21.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f821c1eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c15b810 0x7f821c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f821c15ada0 0x7f821c1ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c158570 con 0x7f82040047d0 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c1edf40 con 0x7f821c15ada0 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15b220 con 0x7f821c15b810 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f821c1eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f821c1eda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40476/0 (socket says 172.21.15.89:40476) 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 -- 172.21.15.89:0/1137291426 learned_addr learned my addr 172.21.15.89:0/1137291426 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c15b810 0x7f821c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8220db4640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f821c15ada0 0x7f821c1ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 -- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c15b810 msgr2=0x7f821c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c15b810 0x7f821c15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 -- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f821c15ada0 msgr2=0x7f821c1ef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f821c15ada0 0x7f821c1ef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 -- 172.21.15.89:0/1137291426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0aab20 con 0x7f82040047d0 2023-12-07T10:01:21.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f821bfff640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f821c1eda00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f820c011cc0 tx=0x7f820c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011ed0 con 0x7f82040047d0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00fed0 con 0x7f82040047d0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c014640 con 0x7f82040047d0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0aae00 con 0x7f82040047d0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0ab3c0 con 0x7f82040047d0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c04e890 con 0x7f82040047d0 2023-12-07T10:01:21.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.324+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f820c0147a0 con 0x7f82040047d0 2023-12-07T10:01:21.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.328+0000 7f8218ff9640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8208066900 0x7f8208068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.328+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f820c0852b0 con 0x7f82040047d0 2023-12-07T10:01:21.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.328+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8208066900 0x7f8208068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.328+0000 7f821b7fe640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8208066900 0x7f8208068dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82100aa000 tx=0x7f82100019b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.332+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f820c0520f0 con 0x7f82040047d0 2023-12-07T10:01:21.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f821c0c79d0 con 0x7f82040047d0 2023-12-07T10:01:21.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8218ff9640 1 -- 172.21.15.89:0/1137291426 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f820c055710 con 0x7f82040047d0 2023-12-07T10:01:21.489 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:21.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8208066900 msgr2=0x7f8208068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8208066900 0x7f8208068dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82100aa000 tx=0x7f82100019b0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 msgr2=0x7f821c1eda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f821c1eda00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f820c011cc0 tx=0x7f820c00f610 comp rx=0 tx=0).stop 2023-12-07T10:01:21.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 shutdown_connections 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f821c15ada0 0x7f821c1ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8208066900 0x7f8208068dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f821c15b810 0x7f821c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 --2- 172.21.15.89:0/1137291426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82040047d0 0x7f821c1eda00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.484+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 >> 172.21.15.89:0/1137291426 conn(0x7f821c0abd00 msgr2=0x7f821c150990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.488+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 shutdown_connections 2023-12-07T10:01:21.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.488+0000 7f8222817640 1 -- 172.21.15.89:0/1137291426 wait complete. 2023-12-07T10:01:21.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:01:21.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.644+0000 7f0e9b356640 1 Processor -- start 2023-12-07T10:01:21.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.644+0000 7f0e9b356640 1 -- start start 2023-12-07T10:01:21.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9b356640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940bc140 0x7f0e94072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9b356640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e940c30a0 0x7f0e9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9b356640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e9406bee0 0x7f0e940c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9b356640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940c0930 con 0x7f0e9406bee0 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9b356640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940c05e0 con 0x7f0e940c30a0 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9b356640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94154d00 con 0x7f0e940bc140 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e9406bee0 0x7f0e940c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e9406bee0 0x7f0e940c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40490/0 (socket says 172.21.15.89:40490) 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 -- 172.21.15.89:0/127949947 learned_addr learned my addr 172.21.15.89:0/127949947 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e99b53640 1 --2- 172.21.15.89:0/127949947 >> v2:172.21.15.97:3300/0 conn(0x7f0e940c30a0 0x7f0e9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 -- 172.21.15.89:0/127949947 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940bc140 msgr2=0x7f0e94072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9a354640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940bc140 0x7f0e94072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940bc140 0x7f0e94072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 -- 172.21.15.89:0/127949947 >> v2:172.21.15.97:3300/0 conn(0x7f0e940c30a0 msgr2=0x7f0e9406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 --2- 172.21.15.89:0/127949947 >> v2:172.21.15.97:3300/0 conn(0x7f0e940c30a0 0x7f0e9406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9ab55640 1 -- 172.21.15.89:0/127949947 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e941549f0 con 0x7f0e9406bee0 2023-12-07T10:01:21.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e99b53640 1 --2- 172.21.15.89:0/127949947 >> v2:172.21.15.97:3300/0 conn(0x7f0e940c30a0 0x7f0e9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:21.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.648+0000 7f0e9a354640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940bc140 0x7f0e94072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:21.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9ab55640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e940c4b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0e940c6830 tx=0x7f0e8c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95337257f4647a06 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e99352640 1 -- 172.21.15.89:0/127949947 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0a55c0 con 0x7f0e9406bee0 2023-12-07T10:01:21.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e99352640 1 -- 172.21.15.89:0/127949947 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0a5720 con 0x7f0e9406bee0 2023-12-07T10:01:21.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e99352640 1 -- 172.21.15.89:0/127949947 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0a5ab0 con 0x7f0e9406bee0 2023-12-07T10:01:21.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- 172.21.15.89:0/127949947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 msgr2=0x7f0e940c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e940c4b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0e940c6830 tx=0x7f0e8c01c940 comp rx=0 tx=0).stop 2023-12-07T10:01:21.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- 172.21.15.89:0/127949947 shutdown_connections 2023-12-07T10:01:21.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e940c4b80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- 172.21.15.89:0/127949947 >> v2:172.21.15.97:3300/0 conn(0x7f0e940c30a0 0x7f0e9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- 172.21.15.89:0/127949947 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940bc140 0x7f0e94072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- 172.21.15.89:0/127949947 >> 172.21.15.89:0/127949947 conn(0x7f0e940c5a60 msgr2=0x7f0e940c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:21.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- 172.21.15.89:0/127949947 shutdown_connections 2023-12-07T10:01:21.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- 172.21.15.89:0/127949947 wait complete. 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 Processor -- start 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- start start 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e94154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e940bc140 0x7f0e941ef070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940c30a0 0x7f0e941ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940bf4c0 con 0x7f0e9406bee0 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e941eebe0 con 0x7f0e940bc140 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9b356640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e941ee340 con 0x7f0e940c30a0 2023-12-07T10:01:21.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9a354640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e94154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9a354640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e94154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40498/0 (socket says 172.21.15.89:40498) 2023-12-07T10:01:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9a354640 1 -- 172.21.15.89:0/894559625 learned_addr learned my addr 172.21.15.89:0/894559625 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e99b53640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e940bc140 0x7f0e941ef070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.652+0000 7f0e9ab55640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940c30a0 0x7f0e941ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9a354640 1 -- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940c30a0 msgr2=0x7f0e941ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9a354640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940c30a0 0x7f0e941ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9a354640 1 -- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e940bc140 msgr2=0x7f0e941ef070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9a354640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e940bc140 0x7f0e941ef070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9a354640 1 -- 172.21.15.89:0/894559625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009b30 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9a354640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e94154130 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c7c0 tx=0x7f0e9000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90007a30 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90007b90 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000ce70 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e941f11c0 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e941ee870 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e940680c0 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e900113f0 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e8affd640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0e78066900 0x7f0e78068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e90084720 con 0x7f0e9406bee0 2023-12-07T10:01:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.656+0000 7f0e99b53640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0e78066900 0x7f0e78068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.660+0000 7f0e99b53640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0e78066900 0x7f0e78068dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0e94150b90 tx=0x7f0e84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.660+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e90051740 con 0x7f0e9406bee0 2023-12-07T10:01:21.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.808+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e94074970 con 0x7f0e9406bee0 2023-12-07T10:01:21.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e8affd640 1 -- 172.21.15.89:0/894559625 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e90054d60 con 0x7f0e9406bee0 2023-12-07T10:01:21.816 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:21.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0e78066900 msgr2=0x7f0e78068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0e78066900 0x7f0e78068dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0e94150b90 tx=0x7f0e84008040 comp rx=0 tx=0).stop 2023-12-07T10:01:21.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 msgr2=0x7f0e94154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e94154130 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c7c0 tx=0x7f0e9000cc80 comp rx=0 tx=0).stop 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 shutdown_connections 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0e78066900 0x7f0e78068dc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e940c30a0 0x7f0e941ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e940bc140 0x7f0e941ef070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 --2- 172.21.15.89:0/894559625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9406bee0 0x7f0e94154130 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 >> 172.21.15.89:0/894559625 conn(0x7f0e940c5a60 msgr2=0x7f0e940c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 shutdown_connections 2023-12-07T10:01:21.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.812+0000 7f0e9b356640 1 -- 172.21.15.89:0/894559625 wait complete. 2023-12-07T10:01:21.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:01:21.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.972+0000 7f6081165640 1 Processor -- start 2023-12-07T10:01:21.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f6081165640 1 -- start start 2023-12-07T10:01:21.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f6081165640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f607c14eaf0 0x7f607c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f6081165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c0c0370 0x7f607c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f6081165640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c06de00 con 0x7f607c151f90 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f6081165640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c070390 con 0x7f607c14eaf0 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f6081165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c14eed0 con 0x7f607c0c0370 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f607c14eaf0 0x7f607c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f607c14eaf0 0x7f607c151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40500/0 (socket says 172.21.15.89:40500) 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 -- 172.21.15.89:0/938882544 learned_addr learned my addr 172.21.15.89:0/938882544 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607b59e640 1 --2- 172.21.15.89:0/938882544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c0c0370 0x7f607c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 -- 172.21.15.89:0/938882544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c0c0370 msgr2=0x7f607c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 --2- 172.21.15.89:0/938882544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c0c0370 0x7f607c06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 -- 172.21.15.89:0/938882544 >> v1:172.21.15.97:6789/0 conn(0x7f607c151f90 legacy=0x7f607c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.976+0000 7f607ad9d640 1 -- 172.21.15.89:0/938882544 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c151270 con 0x7f607c14eaf0 2023-12-07T10:01:21.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f607ad9d640 1 --2- 172.21.15.89:0/938882544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c151a50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f606c009870 tx=0x7f606c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9833978e65b28e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f607a59c640 1 -- 172.21.15.89:0/938882544 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0ab5f0 con 0x7f607c14eaf0 2023-12-07T10:01:21.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f607a59c640 1 -- 172.21.15.89:0/938882544 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0ab750 con 0x7f607c14eaf0 2023-12-07T10:01:21.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f607a59c640 1 -- 172.21.15.89:0/938882544 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0abae0 con 0x7f607c14eaf0 2023-12-07T10:01:21.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 -- 172.21.15.89:0/938882544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 msgr2=0x7f607c151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 --2- 172.21.15.89:0/938882544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c151a50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f606c009870 tx=0x7f606c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 -- 172.21.15.89:0/938882544 shutdown_connections 2023-12-07T10:01:21.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 --2- 172.21.15.89:0/938882544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c0c0370 0x7f607c06d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 --2- 172.21.15.89:0/938882544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c151a50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 -- 172.21.15.89:0/938882544 >> 172.21.15.89:0/938882544 conn(0x7f607c0c2a60 msgr2=0x7f607c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:21.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 -- 172.21.15.89:0/938882544 shutdown_connections 2023-12-07T10:01:21.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 -- 172.21.15.89:0/938882544 wait complete. 2023-12-07T10:01:21.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 Processor -- start 2023-12-07T10:01:21.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.980+0000 7f6081165640 1 -- start start 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607c0c0370 0x7f607c13f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c144a70 0x7f607c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0c2890 con 0x7f607c14eaf0 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0c1e40 con 0x7f607c0c0370 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0c2340 con 0x7f607c144a70 2023-12-07T10:01:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f607ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607c0c0370 0x7f607c13f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c0c1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40504/0 (socket says 172.21.15.89:40504) 2023-12-07T10:01:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 -- 172.21.15.89:0/1137218950 learned_addr learned my addr 172.21.15.89:0/1137218950 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f607b59e640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c144a70 0x7f607c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 -- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c144a70 msgr2=0x7f607c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c144a70 0x7f607c149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 -- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607c0c0370 msgr2=0x7f607c13f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:21.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607c0c0370 0x7f607c13f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:21.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 -- 172.21.15.89:0/1137218950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c0094d0 con 0x7f607c14eaf0 2023-12-07T10:01:21.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6073fff640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c0c1900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f606400c420 tx=0x7f606400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640052d0 con 0x7f607c14eaf0 2023-12-07T10:01:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064005430 con 0x7f607c14eaf0 2023-12-07T10:01:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c148f40 con 0x7f607c14eaf0 2023-12-07T10:01:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064003840 con 0x7f607c14eaf0 2023-12-07T10:01:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c0c0860 con 0x7f607c14eaf0 2023-12-07T10:01:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c04e890 con 0x7f607c14eaf0 2023-12-07T10:01:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.984+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60640039a0 con 0x7f607c14eaf0 2023-12-07T10:01:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.988+0000 7f60737fe640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f605c0668d0 0x7f605c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.988+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6064083bc0 con 0x7f607c14eaf0 2023-12-07T10:01:21.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.988+0000 7f607ad9d640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f605c0668d0 0x7f605c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:21.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.988+0000 7f607ad9d640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f605c0668d0 0x7f605c068d90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f606c0af000 tx=0x7f606c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:21.992+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6064050b40 con 0x7f607c14eaf0 2023-12-07T10:01:22.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.140+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f607c1490d0 con 0x7f607c14eaf0 2023-12-07T10:01:22.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.140+0000 7f60737fe640 1 -- 172.21.15.89:0/1137218950 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60640170a0 con 0x7f607c14eaf0 2023-12-07T10:01:22.147 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:22.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f605c0668d0 msgr2=0x7f605c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f605c0668d0 0x7f605c068d90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f606c0af000 tx=0x7f606c0b6040 comp rx=0 tx=0).stop 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 msgr2=0x7f607c0c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c0c1900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f606400c420 tx=0x7f606400c8e0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 shutdown_connections 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f605c0668d0 0x7f605c068d90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607c144a70 0x7f607c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607c14eaf0 0x7f607c0c1900 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 --2- 172.21.15.89:0/1137218950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607c0c0370 0x7f607c13f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 >> 172.21.15.89:0/1137218950 conn(0x7f607c0c2a60 msgr2=0x7f607c0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 shutdown_connections 2023-12-07T10:01:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.144+0000 7f6081165640 1 -- 172.21.15.89:0/1137218950 wait complete. 2023-12-07T10:01:22.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:01:22.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 Processor -- start 2023-12-07T10:01:22.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 -- start start 2023-12-07T10:01:22.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10000c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f10000c2a60 0x7f100006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1000073710 con 0x7f100006b810 2023-12-07T10:01:22.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10001589f0 con 0x7f10000c2a60 2023-12-07T10:01:22.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f10085d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10001586e0 con 0x7f100006f0d0 2023-12-07T10:01:22.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1005b6c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10000c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1006b6e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f10000c2a60 0x7f100006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f100636d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f100006b810 0x7f10000bfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:45686/0 (socket says 172.21.15.89:45686) 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f100636d640 1 -- 172.21.15.89:0/4104553085 learned_addr learned my addr 172.21.15.89:0/4104553085 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f100536b640 1 -- 172.21.15.89:0/4104553085 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925255203 0 0) 0x7f1000073710 con 0x7f100006b810 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1005b6c640 1 -- 172.21.15.89:0/4104553085 >> v2:172.21.15.97:3300/0 conn(0x7f10000c2a60 msgr2=0x7f100006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1005b6c640 1 --2- 172.21.15.89:0/4104553085 >> v2:172.21.15.97:3300/0 conn(0x7f10000c2a60 0x7f100006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1005b6c640 1 -- 172.21.15.89:0/4104553085 >> v1:172.21.15.97:6789/0 conn(0x7f100006b810 legacy=0x7f10000bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1005b6c640 1 -- 172.21.15.89:0/4104553085 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000a6010 con 0x7f100006f0d0 2023-12-07T10:01:22.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.304+0000 7f1006b6e640 1 --2- 172.21.15.89:0/4104553085 >> v2:172.21.15.97:3300/0 conn(0x7f10000c2a60 0x7f100006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:22.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f1005b6c640 1 --2- 172.21.15.89:0/4104553085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10000c1140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097c0 tx=0x7f0ff001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99749207026e33f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f100536b640 1 -- 172.21.15.89:0/4104553085 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ab600 con 0x7f100006f0d0 2023-12-07T10:01:22.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f100536b640 1 -- 172.21.15.89:0/4104553085 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00a7050 con 0x7f100006f0d0 2023-12-07T10:01:22.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f100536b640 1 -- 172.21.15.89:0/4104553085 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ab980 con 0x7f100006f0d0 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 -- 172.21.15.89:0/4104553085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 msgr2=0x7f10000c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 --2- 172.21.15.89:0/4104553085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10000c1140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097c0 tx=0x7f0ff001c480 comp rx=0 tx=0).stop 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 -- 172.21.15.89:0/4104553085 shutdown_connections 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 --2- 172.21.15.89:0/4104553085 >> v2:172.21.15.97:3300/0 conn(0x7f10000c2a60 0x7f100006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 --2- 172.21.15.89:0/4104553085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10000c1140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 -- 172.21.15.89:0/4104553085 >> 172.21.15.89:0/4104553085 conn(0x7f10000c3240 msgr2=0x7f10000c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 -- 172.21.15.89:0/4104553085 shutdown_connections 2023-12-07T10:01:22.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.308+0000 7f10085d1640 1 -- 172.21.15.89:0/4104553085 wait complete. 2023-12-07T10:01:22.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 Processor -- start 2023-12-07T10:01:22.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 -- start start 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f100006b810 0x7f1000150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10001525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 0x7f100014e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10001f11c0 con 0x7f10000c2a60 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000154ec0 con 0x7f100006b810 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000ab7e0 con 0x7f100006f0d0 2023-12-07T10:01:22.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 0x7f100014e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 0x7f100014e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40516/0 (socket says 172.21.15.89:40516) 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 -- 172.21.15.89:0/4131678600 learned_addr learned my addr 172.21.15.89:0/4131678600 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f100636d640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f100006b810 0x7f1000150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1005b6c640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10001525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 -- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 msgr2=0x7f10001525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10001525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 -- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f100006b810 msgr2=0x7f1000150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f100006b810 0x7f1000150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 -- 172.21.15.89:0/4131678600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8009a70 con 0x7f10000c2a60 2023-12-07T10:01:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f1006b6e640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 0x7f100014e130 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009f00 tx=0x7f0ff800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8009d70 con 0x7f10000c2a60 2023-12-07T10:01:22.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff800f040 con 0x7f10000c2a60 2023-12-07T10:01:22.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8003bc0 con 0x7f10000c2a60 2023-12-07T10:01:22.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff0009420 con 0x7f10000c2a60 2023-12-07T10:01:22.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.312+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10000aa9e0 con 0x7f10000c2a60 2023-12-07T10:01:22.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.316+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10000aa840 con 0x7f10000c2a60 2023-12-07T10:01:22.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.316+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ff8014480 con 0x7f10000c2a60 2023-12-07T10:01:22.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.316+0000 7f0ff6ffd640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fe40668d0 0x7f0fe4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.316+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ff8085330 con 0x7f10000c2a60 2023-12-07T10:01:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.316+0000 7f100636d640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fe40668d0 0x7f0fe4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.316+0000 7f100636d640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fe40668d0 0x7f0fe4068d90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000f70 tx=0x7f0ffc007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.320+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10000aa840 con 0x7f10000c2a60 2023-12-07T10:01:22.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.472+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10000aa840 con 0x7f10000c2a60 2023-12-07T10:01:22.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.472+0000 7f0ff6ffd640 1 -- 172.21.15.89:0/4131678600 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v53) v1 ==== 105+0+11 (secure 0 0 0) 0x7f10000aa840 con 0x7f10000c2a60 2023-12-07T10:01:22.478 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:22.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.472+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fe40668d0 msgr2=0x7f0fe4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.472+0000 7f10085d1640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fe40668d0 0x7f0fe4068d90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000f70 tx=0x7f0ffc007df0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.472+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 msgr2=0x7f100014e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.472+0000 7f10085d1640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 0x7f100014e130 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009f00 tx=0x7f0ff800c490 comp rx=0 tx=0).stop 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 shutdown_connections 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10000c2a60 0x7f100014e130 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0fe40668d0 0x7f0fe4068d90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f100006f0d0 0x7f10001525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 --2- 172.21.15.89:0/4131678600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f100006b810 0x7f1000150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 >> 172.21.15.89:0/4131678600 conn(0x7f10000c3240 msgr2=0x7f1000071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 shutdown_connections 2023-12-07T10:01:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.476+0000 7f10085d1640 1 -- 172.21.15.89:0/4131678600 wait complete. 2023-12-07T10:01:22.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:01:22.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.632+0000 7f8046965640 1 Processor -- start 2023-12-07T10:01:22.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.632+0000 7f8046965640 1 -- start start 2023-12-07T10:01:22.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f8046965640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8040151d80 0x7f80400c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f8046965640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804006cf70 con 0x7f80400c7f20 2023-12-07T10:01:22.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f8046965640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8040152160 con 0x7f80400c8430 2023-12-07T10:01:22.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f8046965640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80400c6a30 con 0x7f8040151d80 2023-12-07T10:01:22.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f8044f02640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f80400c7f20 0x7f804006be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36124/0 (socket says 172.21.15.89:36124) 2023-12-07T10:01:22.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f8044f02640 1 -- 172.21.15.89:0/572694120 learned_addr learned my addr 172.21.15.89:0/572694120 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:22.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f803ffff640 1 --2- 172.21.15.89:0/572694120 >> v2:172.21.15.97:3300/0 conn(0x7f8040151d80 0x7f80400c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f803effd640 1 -- 172.21.15.89:0/572694120 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160330597 0 0) 0x7f804006cf70 con 0x7f80400c7f20 2023-12-07T10:01:22.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f803effd640 1 -- 172.21.15.89:0/572694120 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028003530 con 0x7f80400c7f20 2023-12-07T10:01:22.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f803ffff640 1 -- 172.21.15.89:0/572694120 >> v1:172.21.15.97:6789/0 conn(0x7f80400c8430 legacy=0x7f804006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f803ffff640 1 -- 172.21.15.89:0/572694120 >> v1:172.21.15.89:6789/0 conn(0x7f80400c7f20 legacy=0x7f804006be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.636+0000 7f803ffff640 1 -- 172.21.15.89:0/572694120 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400c72d0 con 0x7f8040151d80 2023-12-07T10:01:22.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f803ffff640 1 --2- 172.21.15.89:0/572694120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8040151d80 0x7f80400c49a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f80300097c0 tx=0x7f803001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3668cb695a97996 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f803effd640 1 -- 172.21.15.89:0/572694120 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300ab600 con 0x7f8040151d80 2023-12-07T10:01:22.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f803effd640 1 -- 172.21.15.89:0/572694120 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80300a7050 con 0x7f8040151d80 2023-12-07T10:01:22.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f803effd640 1 -- 172.21.15.89:0/572694120 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300ab980 con 0x7f8040151d80 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 -- 172.21.15.89:0/572694120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8040151d80 msgr2=0x7f80400c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 --2- 172.21.15.89:0/572694120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8040151d80 0x7f80400c49a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f80300097c0 tx=0x7f803001c330 comp rx=0 tx=0).stop 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 -- 172.21.15.89:0/572694120 shutdown_connections 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 --2- 172.21.15.89:0/572694120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8040151d80 0x7f80400c49a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 -- 172.21.15.89:0/572694120 >> 172.21.15.89:0/572694120 conn(0x7f80400abd00 msgr2=0x7f80400ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 -- 172.21.15.89:0/572694120 shutdown_connections 2023-12-07T10:01:22.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 -- 172.21.15.89:0/572694120 wait complete. 2023-12-07T10:01:22.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.640+0000 7f8046965640 1 Processor -- start 2023-12-07T10:01:22.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- start start 2023-12-07T10:01:22.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80400c7f20 0x7f8040158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 0x7f8040153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8040151d80 0x7f80401ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400c2e00 con 0x7f80400c8430 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400c30e0 con 0x7f80400c7f20 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8040155a90 con 0x7f8040151d80 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 0x7f8040153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 0x7f8040153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40532/0 (socket says 172.21.15.89:40532) 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 -- 172.21.15.89:0/657550261 learned_addr learned my addr 172.21.15.89:0/657550261 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803ffff640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80400c7f20 0x7f8040158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8044f02640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8040151d80 0x7f80401ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 -- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8040151d80 msgr2=0x7f80401ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8040151d80 0x7f80401ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 -- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80400c7f20 msgr2=0x7f8040158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80400c7f20 0x7f8040158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 -- 172.21.15.89:0/657550261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030009420 con 0x7f80400c8430 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8044f02640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8040151d80 0x7f80401ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803f7fe640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 0x7f8040153d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f803400c3c0 tx=0x7f803400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340052d0 con 0x7f80400c8430 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034005430 con 0x7f80400c8430 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034003840 con 0x7f80400c8430 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8040155d70 con 0x7f80400c8430 2023-12-07T10:01:22.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80401542c0 con 0x7f80400c8430 2023-12-07T10:01:22.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.644+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804004e890 con 0x7f80400c8430 2023-12-07T10:01:22.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.648+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f80340039a0 con 0x7f80400c8430 2023-12-07T10:01:22.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.648+0000 7f803cff9640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f802c0668d0 0x7f802c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.648+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8034083aa0 con 0x7f80400c8430 2023-12-07T10:01:22.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.648+0000 7f803ffff640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f802c0668d0 0x7f802c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.648+0000 7f803ffff640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f802c0668d0 0x7f802c068d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f80300ad000 tx=0x7f8030008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.652+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8034050a20 con 0x7f80400c8430 2023-12-07T10:01:22.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8040152160 con 0x7f80400c8430 2023-12-07T10:01:22.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f803cff9640 1 -- 172.21.15.89:0/657550261 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v53) v1 ==== 101+0+11 (secure 0 0 0) 0x7f8040152160 con 0x7f80400c8430 2023-12-07T10:01:22.808 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:22.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f802c0668d0 msgr2=0x7f802c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f802c0668d0 0x7f802c068d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f80300ad000 tx=0x7f8030008040 comp rx=0 tx=0).stop 2023-12-07T10:01:22.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 msgr2=0x7f8040153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 0x7f8040153d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f803400c3c0 tx=0x7f803400c880 comp rx=0 tx=0).stop 2023-12-07T10:01:22.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 shutdown_connections 2023-12-07T10:01:22.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f802c0668d0 0x7f802c068d90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8040151d80 0x7f80401ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80400c8430 0x7f8040153d80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 --2- 172.21.15.89:0/657550261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80400c7f20 0x7f8040158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 >> 172.21.15.89:0/657550261 conn(0x7f80400abd00 msgr2=0x7f8040150bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:22.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 shutdown_connections 2023-12-07T10:01:22.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.804+0000 7f8046965640 1 -- 172.21.15.89:0/657550261 wait complete. 2023-12-07T10:01:22.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:01:22.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 Processor -- start 2023-12-07T10:01:22.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 -- start start 2023-12-07T10:01:22.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb5406b100 0x7ffb5406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb540bd5e0 0x7ffb540c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb541559f0 con 0x7ffb540c91f0 2023-12-07T10:01:22.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb54157930 con 0x7ffb5406b100 2023-12-07T10:01:22.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb59f7d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb54151f20 con 0x7ffb540bd5e0 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb5406b100 0x7ffb5406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb5406b100 0x7ffb5406b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40544/0 (socket says 172.21.15.89:40544) 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 -- 172.21.15.89:0/2067747067 learned_addr learned my addr 172.21.15.89:0/2067747067 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb53fff640 1 --2- 172.21.15.89:0/2067747067 >> v2:172.21.15.97:3300/0 conn(0x7ffb540bd5e0 0x7ffb540c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 -- 172.21.15.89:0/2067747067 >> v2:172.21.15.97:3300/0 conn(0x7ffb540bd5e0 msgr2=0x7ffb540c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 --2- 172.21.15.89:0/2067747067 >> v2:172.21.15.97:3300/0 conn(0x7ffb540bd5e0 0x7ffb540c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 -- 172.21.15.89:0/2067747067 >> v1:172.21.15.97:6789/0 conn(0x7ffb540c91f0 legacy=0x7ffb54157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.968+0000 7ffb58f7b640 1 -- 172.21.15.89:0/2067747067 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540aff20 con 0x7ffb5406b100 2023-12-07T10:01:22.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb58f7b640 1 --2- 172.21.15.89:0/2067747067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb5406b100 0x7ffb5406b4e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ffb5408b780 tx=0x7ffb4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb041ce26a2d305 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb537fe640 1 -- 172.21.15.89:0/2067747067 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480ac640 con 0x7ffb5406b100 2023-12-07T10:01:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb537fe640 1 -- 172.21.15.89:0/2067747067 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480ac7a0 con 0x7ffb5406b100 2023-12-07T10:01:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb537fe640 1 -- 172.21.15.89:0/2067747067 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480acb30 con 0x7ffb5406b100 2023-12-07T10:01:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 -- 172.21.15.89:0/2067747067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb5406b100 msgr2=0x7ffb5406b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/2067747067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb5406b100 0x7ffb5406b4e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ffb5408b780 tx=0x7ffb4801c500 comp rx=0 tx=0).stop 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 -- 172.21.15.89:0/2067747067 shutdown_connections 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/2067747067 >> v2:172.21.15.97:3300/0 conn(0x7ffb540bd5e0 0x7ffb540c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/2067747067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb5406b100 0x7ffb5406b4e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 -- 172.21.15.89:0/2067747067 >> 172.21.15.89:0/2067747067 conn(0x7ffb540ca550 msgr2=0x7ffb540abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 -- 172.21.15.89:0/2067747067 shutdown_connections 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 -- 172.21.15.89:0/2067747067 wait complete. 2023-12-07T10:01:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 Processor -- start 2023-12-07T10:01:22.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.972+0000 7ffb59f7d640 1 -- start start 2023-12-07T10:01:22.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb5406b100 0x7ffb54148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 0x7ffb5414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb540c91f0 0x7ffb540ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb541f1380 con 0x7ffb540bd5e0 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb541486c0 con 0x7ffb5406b100 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54150640 con 0x7ffb540c91f0 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 0x7ffb5414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 0x7ffb5414a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40558/0 (socket says 172.21.15.89:40558) 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 -- 172.21.15.89:0/3246037480 learned_addr learned my addr 172.21.15.89:0/3246037480 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb5977c640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb540c91f0 0x7ffb540ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb58f7b640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb5406b100 0x7ffb54148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 -- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb540c91f0 msgr2=0x7ffb540ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb540c91f0 0x7ffb540ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 -- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb5406b100 msgr2=0x7ffb54148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb5406b100 0x7ffb54148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 -- 172.21.15.89:0/3246037480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480094d0 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb53fff640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 0x7ffb5414a3e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d7d0 tx=0x7ffb4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000b6c0 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000b820 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000bbd0 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54150920 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb540ac8e0 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.976+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540acaa0 con 0x7ffb540bd5e0 2023-12-07T10:01:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.980+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb4000bd30 con 0x7ffb540bd5e0 2023-12-07T10:01:22.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.980+0000 7ffb517fa640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb38066900 0x7ffb38068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:22.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.980+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffb40084bf0 con 0x7ffb540bd5e0 2023-12-07T10:01:22.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.980+0000 7ffb58f7b640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb38066900 0x7ffb38068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.980+0000 7ffb58f7b640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb38066900 0x7ffb38068dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb480ae000 tx=0x7ffb480a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:22.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:22.984+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb40051ae0 con 0x7ffb540bd5e0 2023-12-07T10:01:23.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb5404e890 con 0x7ffb540bd5e0 2023-12-07T10:01:23.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb517fa640 1 -- 172.21.15.89:0/3246037480 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffb40055100 con 0x7ffb540bd5e0 2023-12-07T10:01:23.149 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb38066900 msgr2=0x7ffb38068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb38066900 0x7ffb38068dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb480ae000 tx=0x7ffb480a6070 comp rx=0 tx=0).stop 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 msgr2=0x7ffb5414a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 0x7ffb5414a3e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d7d0 tx=0x7ffb4000dc90 comp rx=0 tx=0).stop 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 shutdown_connections 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb38066900 0x7ffb38068dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb540c91f0 0x7ffb540ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb540bd5e0 0x7ffb5414a3e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 --2- 172.21.15.89:0/3246037480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb5406b100 0x7ffb54148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 >> 172.21.15.89:0/3246037480 conn(0x7ffb540ca550 msgr2=0x7ffb54154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:23.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 shutdown_connections 2023-12-07T10:01:23.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.144+0000 7ffb59f7d640 1 -- 172.21.15.89:0/3246037480 wait complete. 2023-12-07T10:01:23.170 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T10:01:23.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:23.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:23.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:01:23.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:23.198 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T10:01:23.252 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:23.252 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:23.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:01:23.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:01:23.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 Processor -- start 2023-12-07T10:01:23.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 -- start start 2023-12-07T10:01:23.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac814e9d0 0x7f0ac8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:23.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0ac80a8470 0x7f0ac806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:23.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac806d320 con 0x7f0ac8070b80 2023-12-07T10:01:23.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac80721b0 con 0x7f0ac80a8470 2023-12-07T10:01:23.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0acd32a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80c2830 con 0x7f0ac814e9d0 2023-12-07T10:01:23.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac814e9d0 0x7f0ac8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:23.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0ac80a8470 0x7f0ac806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:23.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0abe7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0ac8070b80 0x7f0ac80c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:45720/0 (socket says 172.21.15.89:45720) 2023-12-07T10:01:23.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0abe7fc640 1 -- 172.21.15.89:0/447843243 learned_addr learned my addr 172.21.15.89:0/447843243 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:23.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac77fe640 1 -- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac814e9d0 msgr2=0x7f0ac8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:23.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac77fe640 1 --2- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac814e9d0 0x7f0ac8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac77fe640 1 -- 172.21.15.89:0/447843243 >> v1:172.21.15.97:6789/0 conn(0x7f0ac8070b80 legacy=0x7f0ac80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac77fe640 1 -- 172.21.15.89:0/447843243 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8072450 con 0x7f0ac80a8470 2023-12-07T10:01:23.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.488+0000 7f0ac6ffd640 1 --2- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac814e9d0 0x7f0ac8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:23.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0ac77fe640 1 --2- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac80a8470 0x7f0ac806d7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00097c0 tx=0x7f0ac001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8d18f06a8f1497 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:23.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0ac67fc640 1 -- 172.21.15.89:0/447843243 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00ab600 con 0x7f0ac80a8470 2023-12-07T10:01:23.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0ac67fc640 1 -- 172.21.15.89:0/447843243 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac00a7050 con 0x7f0ac80a8470 2023-12-07T10:01:23.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0ac67fc640 1 -- 172.21.15.89:0/447843243 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00ab980 con 0x7f0ac80a8470 2023-12-07T10:01:23.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 -- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac80a8470 msgr2=0x7f0ac806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 --2- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac80a8470 0x7f0ac806d7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00097c0 tx=0x7f0ac001c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 -- 172.21.15.89:0/447843243 shutdown_connections 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 --2- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac80a8470 0x7f0ac806d7b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 --2- 172.21.15.89:0/447843243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac814e9d0 0x7f0ac8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 -- 172.21.15.89:0/447843243 >> 172.21.15.89:0/447843243 conn(0x7f0ac80c2ad0 msgr2=0x7f0ac80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 -- 172.21.15.89:0/447843243 shutdown_connections 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.492+0000 7f0acd32a640 1 -- 172.21.15.89:0/447843243 wait complete. 2023-12-07T10:01:23.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 Processor -- start 2023-12-07T10:01:23.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 -- start start 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac8070b80 0x7f0ac80ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 0x7f0ac815e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac814e9d0 0x7f0ac813ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81f04c0 con 0x7f0ac80a8470 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81f07a0 con 0x7f0ac814e9d0 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0acd32a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81f0a80 con 0x7f0ac8070b80 2023-12-07T10:01:23.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 0x7f0ac815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 0x7f0ac815e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40564/0 (socket says 172.21.15.89:40564) 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 -- 172.21.15.89:0/3094186161 learned_addr learned my addr 172.21.15.89:0/3094186161 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0ac77fe640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac814e9d0 0x7f0ac813ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0ac6ffd640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac8070b80 0x7f0ac80ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 -- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac8070b80 msgr2=0x7f0ac80ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac8070b80 0x7f0ac80ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 -- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac814e9d0 msgr2=0x7f0ac813ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac814e9d0 0x7f0ac813ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 -- 172.21.15.89:0/3094186161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009420 con 0x7f0ac80a8470 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0ac6ffd640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac8070b80 0x7f0ac80ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.496+0000 7f0abe7fc640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 0x7f0ac815e240 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000cbc0 tx=0x7f0ab000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000ad40 con 0x7f0ac80a8470 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab0012400 con 0x7f0ac80a8470 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000aea0 con 0x7f0ac80a8470 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac0009420 con 0x7f0ac80a8470 2023-12-07T10:01:23.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac81f1040 con 0x7f0ac80a8470 2023-12-07T10:01:23.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac804e890 con 0x7f0ac80a8470 2023-12-07T10:01:23.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ab00127b0 con 0x7f0ac80a8470 2023-12-07T10:01:23.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0abffff640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0aa80668d0 0x7f0aa8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:23.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ab0084640 con 0x7f0ac80a8470 2023-12-07T10:01:23.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.500+0000 7f0ac6ffd640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0aa80668d0 0x7f0aa8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:23.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.504+0000 7f0ac6ffd640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0aa80668d0 0x7f0aa8068d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80a88c0 tx=0x7f0ab8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:23.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.504+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ab0051600 con 0x7f0ac80a8470 2023-12-07T10:01:23.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.684+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ac80700a0 con 0x7f0ac80a8470 2023-12-07T10:01:23.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.684+0000 7f0abffff640 1 -- 172.21.15.89:0/3094186161 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f0ab0054c20 con 0x7f0ac80a8470 2023-12-07T10:01:23.691 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:01:23.692 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0aa80668d0 msgr2=0x7f0aa8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0aa80668d0 0x7f0aa8068d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80a88c0 tx=0x7f0ab8008040 comp rx=0 tx=0).stop 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 msgr2=0x7f0ac815e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 0x7f0ac815e240 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000cbc0 tx=0x7f0ab000a430 comp rx=0 tx=0).stop 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 shutdown_connections 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0ac814e9d0 0x7f0ac813ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac80a8470 0x7f0ac815e240 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0aa80668d0 0x7f0aa8068d90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 --2- 172.21.15.89:0/3094186161 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0ac8070b80 0x7f0ac80ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 >> 172.21.15.89:0/3094186161 conn(0x7f0ac80c2ad0 msgr2=0x7f0ac81427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:23.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 shutdown_connections 2023-12-07T10:01:23.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:23.688+0000 7f0acd32a640 1 -- 172.21.15.89:0/3094186161 wait complete. 2023-12-07T10:01:23.711 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-07T10:01:23.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:01:23.712 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T10:01:23.712 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-07T10:01:23.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:23.712 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-07T10:01:23.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:01:23.712 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.6Ml7hgFrAU 2023-12-07T10:01:23.712 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:01:23.721 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.sGyFbpw7qY 2023-12-07T10:01:23.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /tmp/tmp.6Ml7hgFrAU /tmp/tmp.sGyFbpw7qY 2023-12-07T10:01:23.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.sGyFbpw7qY 2023-12-07T10:01:23.907 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.sGyFbpw7qY is 245B 2023-12-07T10:01:23.926 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.sGyFbpw7qY 2023-12-07T10:01:23.934 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDwl3FlKpd3DhAA8+9gxttS6SPzQ9IT9iSWow== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-07T10:01:23.934 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:01:23.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:23.935 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T10:01:23.988 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:01:23.988 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:01:23.988 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:01:23.988 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:23.989 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42275sec preferred_lft 42275sec 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.990 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:01:23.991 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:01:23.991 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:01:23.991 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:01:23.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:23.991 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:01:24.049 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T10:01:24.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:24.051 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T10:01:24.109 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T10:01:24.109 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:01:24.109 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:01:24.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:24.110 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T10:01:24.110 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T10:01:24.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:01:24.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:01:24.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:01:24.111 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T10:01:24.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:24.201 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:01:24.210 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:01:24.211 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:01:24.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:24.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T10:01:24.279 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:24.279 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:24.336 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:01:24.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:01:24.447 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:01:24.456 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:24.456 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/tmp/tmp.6Ml7hgFrAU of=/dev/stdout 2023-12-07T10:01:24.507 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-07T10:01:24.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:24.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDwl3FlKpd3DhAA8+9gxttS6SPzQ9IT9iSWow==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:24.601 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,secret=AQDwl3FlKpd3DhAA8+9gxttS6SPzQ9IT9iSWow==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:24.601 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:24.601 INFO:teuthology.orchestra.run.smithi089.stdout:keyring.get_secret failed 2023-12-07T10:01:24.611 INFO:teuthology.orchestra.run.smithi089.stderr:mount.ceph: kernel BUG! 2023-12-07T10:01:24.611 INFO:teuthology.orchestra.run.smithi089.stderr:mount error 13 = Permission denied 2023-12-07T10:01:24.612 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,secret=AQDwl3FlKpd3DhAA8+9gxttS6SPzQ9IT9iSWow==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:01:24.612 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:01:24.612 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:01:24.612 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: testuser@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs2=/ 2023-12-07T10:01:24.612 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:01:24.616 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-07T10:01:24.616 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-07T10:01:24.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T10:01:24.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:01:24.706 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:01:24.799 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T10:01:24.799 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:24.799 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:24.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:01:24.809 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:24.809 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:24.818 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:24.818 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:24.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:25.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063f59e640 1 Processor -- start 2023-12-07T10:01:25.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063f59e640 1 -- start start 2023-12-07T10:01:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f06400c6940 0x7f06400c8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06400c71b0 con 0x7f0640154fe0 2023-12-07T10:01:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063f59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06401521b0 con 0x7f06400c6d20 2023-12-07T10:01:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063f59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400c4c60 con 0x7f06400c6940 2023-12-07T10:01:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063ed9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0640154fe0 0x7f064015f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36132/0 (socket says 172.21.15.89:36132) 2023-12-07T10:01:25.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063ed9d640 1 -- 172.21.15.89:0/20297623 learned_addr learned my addr 172.21.15.89:0/20297623 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063e59c640 1 --2- 172.21.15.89:0/20297623 >> v2:172.21.15.97:3300/0 conn(0x7f06400c6940 0x7f06400c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452262484 0 0) 0x7f06380014a0 con 0x7f0640154fe0 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0628003530 con 0x7f0640154fe0 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896804010 0 0) 0x7f06401521b0 con 0x7f06400c6d20 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06380014a0 con 0x7f06400c6d20 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2375723493 0 0) 0x7f0628003530 con 0x7f0640154fe0 2023-12-07T10:01:25.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 >> v2:172.21.15.97:3300/0 conn(0x7f06400c6940 msgr2=0x7f06400c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 --2- 172.21.15.89:0/20297623 >> v2:172.21.15.97:3300/0 conn(0x7f06400c6940 0x7f06400c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 >> v1:172.21.15.97:6789/0 conn(0x7f06400c6d20 legacy=0x7f0640158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400c4f40 con 0x7f0640154fe0 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f0638001b90 con 0x7f0640154fe0 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063e59c640 1 --2- 172.21.15.89:0/20297623 >> v2:172.21.15.97:3300/0 conn(0x7f06400c6940 0x7f06400c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 >> v1:172.21.15.89:6789/0 conn(0x7f0640154fe0 legacy=0x7f064015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0628003b10 0x7f0628003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06280047d0 0x7f0628004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0628005190 0x7f062800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400c4c60 con 0x7f0628005190 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062800c0c0 con 0x7f06280047d0 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.004+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062800c280 con 0x7f0628003b10 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0628005190 0x7f062800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063dd9b640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06280047d0 0x7f0628004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063e59c640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0628003b10 0x7f0628003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 -- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0628003b10 msgr2=0x7f0628003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:25.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0628003b10 0x7f0628003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 -- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06280047d0 msgr2=0x7f0628004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:25.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06280047d0 0x7f0628004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 -- 172.21.15.89:0/20297623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0628003530 con 0x7f0628005190 2023-12-07T10:01:25.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 -- 172.21.15.89:0/20297623 reap_dead start 2023-12-07T10:01:25.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063ed9d640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0628005190 0x7f062800b990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f063800a7a0 tx=0x7f063801d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af987818478a01e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380ac620 con 0x7f0628005190 2023-12-07T10:01:25.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380a8070 con 0x7f0628005190 2023-12-07T10:01:25.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063d59a640 1 -- 172.21.15.89:0/20297623 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380ac9e0 con 0x7f0628005190 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.008+0000 7f063f59e640 1 -- 172.21.15.89:0/20297623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0628005190 msgr2=0x7f062800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0628005190 0x7f062800b990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f063800a7a0 tx=0x7f063801d0a0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- 172.21.15.89:0/20297623 shutdown_connections 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 --2- 172.21.15.89:0/20297623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0628005190 0x7f062800b990 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- 172.21.15.89:0/20297623 >> 172.21.15.89:0/20297623 conn(0x7f06400ca140 msgr2=0x7f06400ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- 172.21.15.89:0/20297623 shutdown_connections 2023-12-07T10:01:25.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- 172.21.15.89:0/20297623 wait complete. 2023-12-07T10:01:25.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 Processor -- start 2023-12-07T10:01:25.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- start start 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0628005190 0x7f064014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06400c1040 0x7f0640158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 0x7f0640158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400abcd0 con 0x7f06400c0af0 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400aaf10 con 0x7f0628005190 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063f59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400c2770 con 0x7f06400c1040 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 0x7f0640158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0628005190 0x7f064014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 0x7f0640158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40580/0 (socket says 172.21.15.89:40580) 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063ed9d640 1 -- 172.21.15.89:0/3125657460 learned_addr learned my addr 172.21.15.89:0/3125657460 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063dd9b640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06400c1040 0x7f0640158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063e59c640 1 -- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06400c1040 msgr2=0x7f0640158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063e59c640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06400c1040 0x7f0640158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063e59c640 1 -- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 msgr2=0x7f0640158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063e59c640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 0x7f0640158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063e59c640 1 -- 172.21.15.89:0/3125657460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06401ee890 con 0x7f0628005190 2023-12-07T10:01:25.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.012+0000 7f063ed9d640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 0x7f0640158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f063e59c640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0628005190 0x7f064014dbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0630011980 tx=0x7f0630011d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000faf0 con 0x7f0628005190 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06400abf20 con 0x7f0628005190 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000fc50 con 0x7f0628005190 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630004020 con 0x7f0628005190 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06400c15c0 con 0x7f0628005190 2023-12-07T10:01:25.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06400c1780 con 0x7f0628005190 2023-12-07T10:01:25.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0630004180 con 0x7f0628005190 2023-12-07T10:01:25.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.016+0000 7f062effd640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0620066900 0x7f0620068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.020+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f06300851a0 con 0x7f0628005190 2023-12-07T10:01:25.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.020+0000 7f063dd9b640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0620066900 0x7f0620068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.020+0000 7f063dd9b640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0620066900 0x7f0620068dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06401538c0 tx=0x7f0634009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.020+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0630052000 con 0x7f0628005190 2023-12-07T10:01:25.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.176+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f064004e890 con 0x7f0628005190 2023-12-07T10:01:25.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.176+0000 7f062effd640 1 -- 172.21.15.89:0/3125657460 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7f0630022090 con 0x7f0628005190 2023-12-07T10:01:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:25.183 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0620066900 msgr2=0x7f0620068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0620066900 0x7f0620068dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06401538c0 tx=0x7f0634009040 comp rx=0 tx=0).stop 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0628005190 msgr2=0x7f064014dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0628005190 0x7f064014dbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0630011980 tx=0x7f0630011d80 comp rx=0 tx=0).stop 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 shutdown_connections 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c0af0 0x7f0640158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0620066900 0x7f0620068dc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06400c1040 0x7f0640158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 --2- 172.21.15.89:0/3125657460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0628005190 0x7f064014dbe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 >> 172.21.15.89:0/3125657460 conn(0x7f06400ca140 msgr2=0x7f0640150760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:25.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 shutdown_connections 2023-12-07T10:01:25.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.180+0000 7f063f59e640 1 -- 172.21.15.89:0/3125657460 wait complete. 2023-12-07T10:01:25.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:00:50.933921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:00:52.211886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:01:04.139867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:01:05.289028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:25.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:25.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.340+0000 7f9e9466b640 1 Processor -- start 2023-12-07T10:01:25.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e9466b640 1 -- start start 2023-12-07T10:01:25.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e9466b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e8c14eaf0 0x7f9e8c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e9466b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c151f90 0x7f9e8c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e9466b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c06de00 con 0x7f9e8c0c0370 2023-12-07T10:01:25.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e9466b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c070390 con 0x7f9e8c14eaf0 2023-12-07T10:01:25.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e9466b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c14eed0 con 0x7f9e8c151f90 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92407640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e8c14eaf0 0x7f9e8c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e91c06640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c151f90 0x7f9e8c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92c08640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9e8c0c0370 0x7f9e8c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:45734/0 (socket says 172.21.15.89:45734) 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92c08640 1 -- 172.21.15.89:0/3614501614 learned_addr learned my addr 172.21.15.89:0/3614501614 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92407640 1 -- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c151f90 msgr2=0x7f9e8c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92407640 1 --2- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c151f90 0x7f9e8c06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92407640 1 -- 172.21.15.89:0/3614501614 >> v1:172.21.15.97:6789/0 conn(0x7f9e8c0c0370 legacy=0x7f9e8c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e91405640 1 -- 172.21.15.89:0/3614501614 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186282950 0 0) 0x7f9e8c06de00 con 0x7f9e8c0c0370 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e92407640 1 -- 172.21.15.89:0/3614501614 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c151270 con 0x7f9e8c14eaf0 2023-12-07T10:01:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.344+0000 7f9e91c06640 1 --2- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c151f90 0x7f9e8c06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e92407640 1 --2- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c151a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e880097c0 tx=0x7f9e8801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e0d126f6036c335 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e91405640 1 -- 172.21.15.89:0/3614501614 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880ab600 con 0x7f9e8c14eaf0 2023-12-07T10:01:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e91405640 1 -- 172.21.15.89:0/3614501614 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e880a7050 con 0x7f9e8c14eaf0 2023-12-07T10:01:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e91405640 1 -- 172.21.15.89:0/3614501614 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880ab980 con 0x7f9e8c14eaf0 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 -- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c14eaf0 msgr2=0x7f9e8c151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 --2- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c151a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e880097c0 tx=0x7f9e8801c330 comp rx=0 tx=0).stop 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 -- 172.21.15.89:0/3614501614 shutdown_connections 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 --2- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c151f90 0x7f9e8c06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 --2- 172.21.15.89:0/3614501614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c151a50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 -- 172.21.15.89:0/3614501614 >> 172.21.15.89:0/3614501614 conn(0x7f9e8c0c2a60 msgr2=0x7f9e8c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 -- 172.21.15.89:0/3614501614 shutdown_connections 2023-12-07T10:01:25.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.348+0000 7f9e9466b640 1 -- 172.21.15.89:0/3614501614 wait complete. 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 Processor -- start 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- start start 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c0c0370 0x7f9e8c1ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c141b20 0x7f9e8c141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c0e30 con 0x7f9e8c14eaf0 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c1c90 con 0x7f9e8c0c0370 2023-12-07T10:01:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c1080 con 0x7f9e8c141b20 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e91c06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c0c0370 0x7f9e8c1ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e91c06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c0c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40590/0 (socket says 172.21.15.89:40590) 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e91c06640 1 -- 172.21.15.89:0/712321124 learned_addr learned my addr 172.21.15.89:0/712321124 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92c08640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c141b20 0x7f9e8c141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 -- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c141b20 msgr2=0x7f9e8c141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c141b20 0x7f9e8c141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 -- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8c14eaf0 msgr2=0x7f9e8c0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 -- 172.21.15.89:0/712321124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c009420 con 0x7f9e8c0c0370 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e92407640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c0c0370 0x7f9e8c1ee890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e880ab000 tx=0x7f9e880190d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88004030 con 0x7f9e8c0c0370 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88004190 con 0x7f9e8c0c0370 2023-12-07T10:01:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88004500 con 0x7f9e8c0c0370 2023-12-07T10:01:25.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e88009420 con 0x7f9e8c0c0370 2023-12-07T10:01:25.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c0c1640 con 0x7f9e8c0c0370 2023-12-07T10:01:25.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.352+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c04e890 con 0x7f9e8c0c0370 2023-12-07T10:01:25.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.356+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e880b2040 con 0x7f9e8c0c0370 2023-12-07T10:01:25.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.356+0000 7f9e82ffd640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e700668d0 0x7f9e70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.356+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e8811ee00 con 0x7f9e8c0c0370 2023-12-07T10:01:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.356+0000 7f9e91c06640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e700668d0 0x7f9e70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.356+0000 7f9e91c06640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e700668d0 0x7f9e70068d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0c2950 tx=0x7f9e7c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.360+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e880ebd70 con 0x7f9e8c0c0370 2023-12-07T10:01:25.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.512+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e8c150960 con 0x7f9e8c0c0370 2023-12-07T10:01:25.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.512+0000 7f9e82ffd640 1 -- 172.21.15.89:0/712321124 <== mon.1 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e880b00a0 con 0x7f9e8c0c0370 2023-12-07T10:01:25.519 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e700668d0 msgr2=0x7f9e70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e700668d0 0x7f9e70068d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0c2950 tx=0x7f9e7c009190 comp rx=0 tx=0).stop 2023-12-07T10:01:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c0c0370 msgr2=0x7f9e8c1ee890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c0c0370 0x7f9e8c1ee890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e880ab000 tx=0x7f9e880190d0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 shutdown_connections 2023-12-07T10:01:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9e700668d0 0x7f9e70068d90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9e8c141b20 0x7f9e8c141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e8c14eaf0 0x7f9e8c0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 --2- 172.21.15.89:0/712321124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e8c0c0370 0x7f9e8c1ee890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 >> 172.21.15.89:0/712321124 conn(0x7f9e8c0c2a60 msgr2=0x7f9e8c14ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 shutdown_connections 2023-12-07T10:01:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.516+0000 7f9e9466b640 1 -- 172.21.15.89:0/712321124 wait complete. 2023-12-07T10:01:25.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:01:25.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 Processor -- start 2023-12-07T10:01:25.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 -- start start 2023-12-07T10:01:25.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7490158a10 0x7f74900c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490151bf0 0x7f7490152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7490158580 con 0x7f74900c6220 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7490158e60 con 0x7f7490158a10 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74957b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7490157f50 con 0x7f7490151bf0 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74867fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7490158a10 0x7f74900c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f748effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f74900c6220 0x7f74900c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36148/0 (socket says 172.21.15.89:36148) 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f748effd640 1 -- 172.21.15.89:0/581397028 learned_addr learned my addr 172.21.15.89:0/581397028 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f748f7fe640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490151bf0 0x7f7490152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74867fc640 1 -- 172.21.15.89:0/581397028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490151bf0 msgr2=0x7f7490152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74867fc640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490151bf0 0x7f7490152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74867fc640 1 -- 172.21.15.89:0/581397028 >> v1:172.21.15.89:6789/0 conn(0x7f74900c6220 legacy=0x7f74900c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f74867fc640 1 -- 172.21.15.89:0/581397028 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900c1f60 con 0x7f7490158a10 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f748e7fc640 1 -- 172.21.15.89:0/581397028 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595895432 0 0) 0x7f7490158580 con 0x7f74900c6220 2023-12-07T10:01:25.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.676+0000 7f748f7fe640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490151bf0 0x7f7490152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:25.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74867fc640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490158a10 0x7f74900c28c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7478009de0 tx=0x7f747801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bb9e6eb2526b63 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f748e7fc640 1 -- 172.21.15.89:0/581397028 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780a5a20 con 0x7f7490158a10 2023-12-07T10:01:25.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f748e7fc640 1 -- 172.21.15.89:0/581397028 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74780a5b80 con 0x7f7490158a10 2023-12-07T10:01:25.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f748e7fc640 1 -- 172.21.15.89:0/581397028 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780ad440 con 0x7f7490158a10 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 -- 172.21.15.89:0/581397028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490158a10 msgr2=0x7f74900c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490158a10 0x7f74900c28c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7478009de0 tx=0x7f747801c960 comp rx=0 tx=0).stop 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 -- 172.21.15.89:0/581397028 shutdown_connections 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490151bf0 0x7f7490152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 --2- 172.21.15.89:0/581397028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490158a10 0x7f74900c28c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 -- 172.21.15.89:0/581397028 >> 172.21.15.89:0/581397028 conn(0x7f749006a5a0 msgr2=0x7f749006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 -- 172.21.15.89:0/581397028 shutdown_connections 2023-12-07T10:01:25.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 -- 172.21.15.89:0/581397028 wait complete. 2023-12-07T10:01:25.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.680+0000 7f74957b8640 1 Processor -- start 2023-12-07T10:01:25.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- start start 2023-12-07T10:01:25.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74900c6220 0x7f74901487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 0x7f749006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490158a10 0x7f749014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749006d7e0 con 0x7f7490151bf0 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749006be80 con 0x7f74900c6220 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74901429d0 con 0x7f7490158a10 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 0x7f749006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 0x7f749006d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40618/0 (socket says 172.21.15.89:40618) 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 -- 172.21.15.89:0/4100769141 learned_addr learned my addr 172.21.15.89:0/4100769141 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f748effd640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74900c6220 0x7f74901487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f748f7fe640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490158a10 0x7f749014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 -- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490158a10 msgr2=0x7f749014ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490158a10 0x7f749014ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 -- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74900c6220 msgr2=0x7f74901487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74900c6220 0x7f74901487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 -- 172.21.15.89:0/4100769141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7478009a70 con 0x7f7490151bf0 2023-12-07T10:01:25.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74867fc640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 0x7f749006d2a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f747801ce40 tx=0x7f7478019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780aee90 con 0x7f7490151bf0 2023-12-07T10:01:25.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74780b7410 con 0x7f7490151bf0 2023-12-07T10:01:25.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780b7780 con 0x7f7490151bf0 2023-12-07T10:01:25.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749014cf20 con 0x7f7490151bf0 2023-12-07T10:01:25.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7490142be0 con 0x7f7490151bf0 2023-12-07T10:01:25.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.684+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749004e890 con 0x7f7490151bf0 2023-12-07T10:01:25.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.688+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f74780b4050 con 0x7f7490151bf0 2023-12-07T10:01:25.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.688+0000 7f7487fff640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7470066900 0x7f7470068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:25.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.688+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f747811f8a0 con 0x7f7490151bf0 2023-12-07T10:01:25.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.688+0000 7f748effd640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7470066900 0x7f7470068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:25.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.688+0000 7f748effd640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7470066900 0x7f7470068dc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7480000f70 tx=0x7f7480007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:25.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.692+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74780ec820 con 0x7f7490151bf0 2023-12-07T10:01:25.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.840+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f749006d000 con 0x7f7490151bf0 2023-12-07T10:01:25.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.840+0000 7f7487fff640 1 -- 172.21.15.89:0/4100769141 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74780efe40 con 0x7f7490151bf0 2023-12-07T10:01:25.846 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7470066900 msgr2=0x7f7470068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7470066900 0x7f7470068dc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7480000f70 tx=0x7f7480007df0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 msgr2=0x7f749006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 0x7f749006d2a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f747801ce40 tx=0x7f7478019700 comp rx=0 tx=0).stop 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 shutdown_connections 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7470066900 0x7f7470068dc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7490158a10 0x7f749014ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7490151bf0 0x7f749006d2a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 --2- 172.21.15.89:0/4100769141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74900c6220 0x7f74901487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:25.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 >> 172.21.15.89:0/4100769141 conn(0x7f749006a5a0 msgr2=0x7f7490066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:25.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 shutdown_connections 2023-12-07T10:01:25.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:25.844+0000 7f74957b8640 1 -- 172.21.15.89:0/4100769141 wait complete. 2023-12-07T10:01:25.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:01:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.000+0000 7f5582a74640 1 Processor -- start 2023-12-07T10:01:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.000+0000 7f5582a74640 1 -- start start 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5582a74640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f557c14fab0 0x7f557c1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5582a74640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c152a00 0x7f557c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5582a74640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c156360 con 0x7f557c06d600 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5582a74640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c152e90 con 0x7f557c14fab0 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5582a74640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c06da90 con 0x7f557c152a00 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581a72640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f557c14fab0 0x7f557c1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581271640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f557c06d600 0x7f557c0a4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36158/0 (socket says 172.21.15.89:36158) 2023-12-07T10:01:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581271640 1 -- 172.21.15.89:0/1387771375 learned_addr learned my addr 172.21.15.89:0/1387771375 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:26.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581a72640 1 -- 172.21.15.89:0/1387771375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c152a00 msgr2=0x7f557c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:26.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581a72640 1 --2- 172.21.15.89:0/1387771375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c152a00 0x7f557c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581a72640 1 -- 172.21.15.89:0/1387771375 >> v1:172.21.15.89:6789/0 conn(0x7f557c06d600 legacy=0x7f557c0a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581a72640 1 -- 172.21.15.89:0/1387771375 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c155a30 con 0x7f557c14fab0 2023-12-07T10:01:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.004+0000 7f5581a72640 1 --2- 172.21.15.89:0/1387771375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1524c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f55780097c0 tx=0x7f557801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c6455282cbf581 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5580a70640 1 -- 172.21.15.89:0/1387771375 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780ab600 con 0x7f557c14fab0 2023-12-07T10:01:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5580a70640 1 -- 172.21.15.89:0/1387771375 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55780a7050 con 0x7f557c14fab0 2023-12-07T10:01:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5580a70640 1 -- 172.21.15.89:0/1387771375 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780ab980 con 0x7f557c14fab0 2023-12-07T10:01:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- 172.21.15.89:0/1387771375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 msgr2=0x7f557c1524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 --2- 172.21.15.89:0/1387771375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1524c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f55780097c0 tx=0x7f557801c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- 172.21.15.89:0/1387771375 shutdown_connections 2023-12-07T10:01:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 --2- 172.21.15.89:0/1387771375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c152a00 0x7f557c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 --2- 172.21.15.89:0/1387771375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1524c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- 172.21.15.89:0/1387771375 >> 172.21.15.89:0/1387771375 conn(0x7f557c0c5a60 msgr2=0x7f557c0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- 172.21.15.89:0/1387771375 shutdown_connections 2023-12-07T10:01:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- 172.21.15.89:0/1387771375 wait complete. 2023-12-07T10:01:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 Processor -- start 2023-12-07T10:01:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- start start 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c0bf6c0 0x7f557c14c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c14c790 0x7f557c0a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1ef3d0 con 0x7f557c14fab0 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0bd500 con 0x7f557c14c790 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5582a74640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0bd7e0 con 0x7f557c0bf6c0 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5581a72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5581a72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1eee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40634/0 (socket says 172.21.15.89:40634) 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.008+0000 7f5581a72640 1 -- 172.21.15.89:0/905881834 learned_addr learned my addr 172.21.15.89:0/905881834 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581a72640 1 -- 172.21.15.89:0/905881834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c0bf6c0 msgr2=0x7f557c14c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581a72640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c0bf6c0 0x7f557c14c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581a72640 1 -- 172.21.15.89:0/905881834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c14c790 msgr2=0x7f557c0a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581a72640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c14c790 0x7f557c0a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581a72640 1 -- 172.21.15.89:0/905881834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578009420 con 0x7f557c14fab0 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581a72640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1eee90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f557801a020 tx=0x7f557801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780b7450 con 0x7f557c14fab0 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55780b75d0 con 0x7f557c14fab0 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780b7980 con 0x7f557c14fab0 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0bdac0 con 0x7f557c14fab0 2023-12-07T10:01:26.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c0a5780 con 0x7f557c14fab0 2023-12-07T10:01:26.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c0680c0 con 0x7f557c14fab0 2023-12-07T10:01:26.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f55780b7ae0 con 0x7f557c14fab0 2023-12-07T10:01:26.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f55727fc640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55600668d0 0x7f5560068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f557811f220 con 0x7f557c14fab0 2023-12-07T10:01:26.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.012+0000 7f5581271640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55600668d0 0x7f5560068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.016+0000 7f5581271640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55600668d0 0x7f5560068d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f557c0abf40 tx=0x7f556c007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.016+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55780ec210 con 0x7f557c14fab0 2023-12-07T10:01:26.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.164+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f557c074970 con 0x7f557c14fab0 2023-12-07T10:01:26.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.164+0000 7f55727fc640 1 -- 172.21.15.89:0/905881834 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55780ef830 con 0x7f557c14fab0 2023-12-07T10:01:26.171 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55600668d0 msgr2=0x7f5560068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55600668d0 0x7f5560068d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f557c0abf40 tx=0x7f556c007a50 comp rx=0 tx=0).stop 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 msgr2=0x7f557c1eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1eee90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f557801a020 tx=0x7f557801ac30 comp rx=0 tx=0).stop 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 shutdown_connections 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c14c790 0x7f557c0a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f55600668d0 0x7f5560068d90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f557c0bf6c0 0x7f557c14c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 --2- 172.21.15.89:0/905881834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f557c14fab0 0x7f557c1eee90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 >> 172.21.15.89:0/905881834 conn(0x7f557c0c5a60 msgr2=0x7f557c070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 shutdown_connections 2023-12-07T10:01:26.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.168+0000 7f5582a74640 1 -- 172.21.15.89:0/905881834 wait complete. 2023-12-07T10:01:26.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:01:26.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 Processor -- start 2023-12-07T10:01:26.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 -- start start 2023-12-07T10:01:26.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb6c14ea40 0x7fdb6c1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 0x7fdb6c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0c64b0 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c0a5f70 con 0x7fdb6c14ea40 2023-12-07T10:01:26.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb71cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c155460 con 0x7fdb6c073950 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 0x7fdb6c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb6b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb6c14ea40 0x7fdb6c1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 0x7fdb6c06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:37304/0 (socket says 172.21.15.89:37304) 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 -- 172.21.15.89:0/2543364228 learned_addr learned my addr 172.21.15.89:0/2543364228 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 -- 172.21.15.89:0/2543364228 >> v2:172.21.15.97:3300/0 conn(0x7fdb6c14ea40 msgr2=0x7fdb6c1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 --2- 172.21.15.89:0/2543364228 >> v2:172.21.15.97:3300/0 conn(0x7fdb6c14ea40 0x7fdb6c1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 -- 172.21.15.89:0/2543364228 >> v1:172.21.15.97:6789/0 conn(0x7fdb6c06b5b0 legacy=0x7fdb6c151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb63fff640 1 -- 172.21.15.89:0/2543364228 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c152df0 con 0x7fdb6c073950 2023-12-07T10:01:26.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.328+0000 7fdb6affd640 1 -- 172.21.15.89:0/2543364228 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830811405 0 0) 0x7fdb6c0c64b0 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb63fff640 1 --2- 172.21.15.89:0/2543364228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 0x7fdb6c06d710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009870 tx=0x7fdb5401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2de8899743d8212 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb6affd640 1 -- 172.21.15.89:0/2543364228 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c152340 con 0x7fdb6c073950 2023-12-07T10:01:26.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb6affd640 1 -- 172.21.15.89:0/2543364228 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540a7050 con 0x7fdb6c073950 2023-12-07T10:01:26.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb6affd640 1 -- 172.21.15.89:0/2543364228 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540ab820 con 0x7fdb6c073950 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 -- 172.21.15.89:0/2543364228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 msgr2=0x7fdb6c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/2543364228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 0x7fdb6c06d710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009870 tx=0x7fdb5401c420 comp rx=0 tx=0).stop 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 -- 172.21.15.89:0/2543364228 shutdown_connections 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/2543364228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c073950 0x7fdb6c06d710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/2543364228 >> v2:172.21.15.97:3300/0 conn(0x7fdb6c14ea40 0x7fdb6c1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 -- 172.21.15.89:0/2543364228 >> 172.21.15.89:0/2543364228 conn(0x7fdb6c0c3240 msgr2=0x7fdb6c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 -- 172.21.15.89:0/2543364228 shutdown_connections 2023-12-07T10:01:26.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.332+0000 7fdb71cfe640 1 -- 172.21.15.89:0/2543364228 wait complete. 2023-12-07T10:01:26.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 Processor -- start 2023-12-07T10:01:26.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- start start 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 0x7fdb6c0bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb6c073950 0x7fdb6c0c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c14ea40 0x7fdb6c14cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0bdff0 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c1ee0f0 con 0x7fdb6c073950 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c1ee990 con 0x7fdb6c14ea40 2023-12-07T10:01:26.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 0x7fdb6c0bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 0x7fdb6c0bfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40644/0 (socket says 172.21.15.89:40644) 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 -- 172.21.15.89:0/861589187 learned_addr learned my addr 172.21.15.89:0/861589187 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6bfff640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c14ea40 0x7fdb6c14cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb63fff640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb6c073950 0x7fdb6c0c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 -- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c14ea40 msgr2=0x7fdb6c14cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c14ea40 0x7fdb6c14cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 -- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb6c073950 msgr2=0x7fdb6c0c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb6c073950 0x7fdb6c0c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 -- 172.21.15.89:0/861589187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540094d0 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb6b7fe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 0x7fdb6c0bfae0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00e960 tx=0x7fdb5c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c009690 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00ca00 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c0a7270 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00cd70 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c0ab500 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.336+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c04e890 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.340+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdb5c013470 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.340+0000 7fdb68ff9640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdb4c0668d0 0x7fdb4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.340+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdb5c084890 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.340+0000 7fdb63fff640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdb4c0668d0 0x7fdb4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.340+0000 7fdb63fff640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdb4c0668d0 0x7fdb4c068d90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ad000 tx=0x7fdb54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.344+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb5c0518b0 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.496+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb6c073730 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.496+0000 7fdb68ff9640 1 -- 172.21.15.89:0/861589187 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v53) v1 ==== 105+0+11 (secure 0 0 0) 0x7fdb5c054ed0 con 0x7fdb6c06b5b0 2023-12-07T10:01:26.502 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:26.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.496+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdb4c0668d0 msgr2=0x7fdb4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.496+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdb4c0668d0 0x7fdb4c068d90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ad000 tx=0x7fdb54008040 comp rx=0 tx=0).stop 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.496+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 msgr2=0x7fdb6c0bfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.496+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 0x7fdb6c0bfae0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00e960 tx=0x7fdb5c00ee20 comp rx=0 tx=0).stop 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 shutdown_connections 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdb4c0668d0 0x7fdb4c068d90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdb6c14ea40 0x7fdb6c14cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb6c073950 0x7fdb6c0c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 --2- 172.21.15.89:0/861589187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb6c06b5b0 0x7fdb6c0bfae0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 >> 172.21.15.89:0/861589187 conn(0x7fdb6c0c3240 msgr2=0x7fdb6c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 shutdown_connections 2023-12-07T10:01:26.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.500+0000 7fdb71cfe640 1 -- 172.21.15.89:0/861589187 wait complete. 2023-12-07T10:01:26.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:01:26.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 Processor -- start 2023-12-07T10:01:26.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 -- start start 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c14eaf0 0x7fd80c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd80c0c0370 0x7fd80c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c06de00 con 0x7fd80c151f90 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c070390 con 0x7fd80c0c0370 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.656+0000 7fd81478d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c14eed0 con 0x7fd80c14eaf0 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd80c0c0370 0x7fd80c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd80c0c0370 0x7fd80c06d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40656/0 (socket says 172.21.15.89:40656) 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 -- 172.21.15.89:0/2247519862 learned_addr learned my addr 172.21.15.89:0/2247519862 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812529640 1 --2- 172.21.15.89:0/2247519862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c14eaf0 0x7fd80c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 -- 172.21.15.89:0/2247519862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c14eaf0 msgr2=0x7fd80c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 --2- 172.21.15.89:0/2247519862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c14eaf0 0x7fd80c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 -- 172.21.15.89:0/2247519862 >> v1:172.21.15.97:6789/0 conn(0x7fd80c151f90 legacy=0x7fd80c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 -- 172.21.15.89:0/2247519862 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c151270 con 0x7fd80c0c0370 2023-12-07T10:01:26.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd812d2a640 1 --2- 172.21.15.89:0/2247519862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c0c0370 0x7fd80c06d820 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd804009e50 tx=0x7fd80401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79be5a839991a45 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd811527640 1 -- 172.21.15.89:0/2247519862 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040a5780 con 0x7fd80c0c0370 2023-12-07T10:01:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd811527640 1 -- 172.21.15.89:0/2247519862 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040a58e0 con 0x7fd80c0c0370 2023-12-07T10:01:26.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.660+0000 7fd811527640 1 -- 172.21.15.89:0/2247519862 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040a5c70 con 0x7fd80c0c0370 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- 172.21.15.89:0/2247519862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c0c0370 msgr2=0x7fd80c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 --2- 172.21.15.89:0/2247519862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c0c0370 0x7fd80c06d820 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd804009e50 tx=0x7fd80401c8c0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- 172.21.15.89:0/2247519862 shutdown_connections 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 --2- 172.21.15.89:0/2247519862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c0c0370 0x7fd80c06d820 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 --2- 172.21.15.89:0/2247519862 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c14eaf0 0x7fd80c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- 172.21.15.89:0/2247519862 >> 172.21.15.89:0/2247519862 conn(0x7fd80c0c2a60 msgr2=0x7fd80c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- 172.21.15.89:0/2247519862 shutdown_connections 2023-12-07T10:01:26.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- 172.21.15.89:0/2247519862 wait complete. 2023-12-07T10:01:26.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 Processor -- start 2023-12-07T10:01:26.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- start start 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c0c0370 0x7fd80c0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 0x7fd80c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80c14a660 0x7fd80c0ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0c4640 con 0x7fd80c14eaf0 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0aba10 con 0x7fd80c14a660 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd81478d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1eb0d0 con 0x7fd80c0c0370 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 0x7fd80c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 0x7fd80c0aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40660/0 (socket says 172.21.15.89:40660) 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 -- 172.21.15.89:0/2575757707 learned_addr learned my addr 172.21.15.89:0/2575757707 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd812529640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c0c0370 0x7fd80c0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd812d2a640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80c14a660 0x7fd80c0ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 -- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c0c0370 msgr2=0x7fd80c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c0c0370 0x7fd80c0c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 -- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80c14a660 msgr2=0x7fd80c0ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80c14a660 0x7fd80c0ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 -- 172.21.15.89:0/2575757707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804009b30 con 0x7fd80c14eaf0 2023-12-07T10:01:26.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd812d2a640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80c14a660 0x7fd80c0ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:26.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.664+0000 7fd811d28640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 0x7fd80c0aaf90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c3c0 tx=0x7fd7fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0052d0 con 0x7fd80c14eaf0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc005430 con 0x7fd80c14eaf0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc003840 con 0x7fd80c14eaf0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c1f1350 con 0x7fd80c14eaf0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c1f0ab0 con 0x7fd80c14eaf0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c1f14e0 con 0x7fd80c14eaf0 2023-12-07T10:01:26.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd7fc0039a0 con 0x7fd80c14eaf0 2023-12-07T10:01:26.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd802ffd640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7f0066900 0x7fd7f0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd7fc083c50 con 0x7fd80c14eaf0 2023-12-07T10:01:26.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd812529640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7f0066900 0x7fd7f0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.668+0000 7fd812529640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7f0066900 0x7fd7f0068dc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd808009ac0 tx=0x7fd808009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.672+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7fc050bd0 con 0x7fd80c14eaf0 2023-12-07T10:01:26.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd80c04e890 con 0x7fd80c14eaf0 2023-12-07T10:01:26.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd802ffd640 1 -- 172.21.15.89:0/2575757707 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v53) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd7fc017020 con 0x7fd80c14eaf0 2023-12-07T10:01:26.828 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:26.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7f0066900 msgr2=0x7fd7f0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7f0066900 0x7fd7f0068dc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd808009ac0 tx=0x7fd808009190 comp rx=0 tx=0).stop 2023-12-07T10:01:26.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 msgr2=0x7fd80c0aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 0x7fd80c0aaf90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c3c0 tx=0x7fd7fc00c880 comp rx=0 tx=0).stop 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 shutdown_connections 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd80c14a660 0x7fd80c0ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd80c14eaf0 0x7fd80c0aaf90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd7f0066900 0x7fd7f0068dc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 --2- 172.21.15.89:0/2575757707 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd80c0c0370 0x7fd80c0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 >> 172.21.15.89:0/2575757707 conn(0x7fd80c0c2a60 msgr2=0x7fd80c144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 shutdown_connections 2023-12-07T10:01:26.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.824+0000 7fd81478d640 1 -- 172.21.15.89:0/2575757707 wait complete. 2023-12-07T10:01:26.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:01:26.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 Processor -- start 2023-12-07T10:01:26.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 -- start start 2023-12-07T10:01:26.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a814e9d0 0x7f31a8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31a80a8470 0x7f31a806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a806d320 con 0x7f31a8070b80 2023-12-07T10:01:26.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a80721b0 con 0x7f31a80a8470 2023-12-07T10:01:26.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31ae246640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c2830 con 0x7f31a814e9d0 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31a80a8470 0x7f31a806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31a80a8470 0x7f31a806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40672/0 (socket says 172.21.15.89:40672) 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 -- 172.21.15.89:0/2742181165 learned_addr learned my addr 172.21.15.89:0/2742181165 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a77fe640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a814e9d0 0x7f31a8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 -- 172.21.15.89:0/2742181165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a814e9d0 msgr2=0x7f31a8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a814e9d0 0x7f31a8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 -- 172.21.15.89:0/2742181165 >> v1:172.21.15.97:6789/0 conn(0x7f31a8070b80 legacy=0x7f31a80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a7fff640 1 -- 172.21.15.89:0/2742181165 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8072450 con 0x7f31a80a8470 2023-12-07T10:01:26.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.984+0000 7f31a77fe640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a814e9d0 0x7f31a8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:26.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31a7fff640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a806d7b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d150 tx=0x7f31a001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c714aa719f34b601 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:26.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31a67fc640 1 -- 172.21.15.89:0/2742181165 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000b2d0 con 0x7f31a80a8470 2023-12-07T10:01:26.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31a67fc640 1 -- 172.21.15.89:0/2742181165 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000b430 con 0x7f31a80a8470 2023-12-07T10:01:26.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31a67fc640 1 -- 172.21.15.89:0/2742181165 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00a7a80 con 0x7f31a80a8470 2023-12-07T10:01:26.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 -- 172.21.15.89:0/2742181165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 msgr2=0x7f31a806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:26.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a806d7b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d150 tx=0x7f31a001eb80 comp rx=0 tx=0).stop 2023-12-07T10:01:26.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 -- 172.21.15.89:0/2742181165 shutdown_connections 2023-12-07T10:01:26.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a806d7b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 --2- 172.21.15.89:0/2742181165 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a814e9d0 0x7f31a8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:26.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 -- 172.21.15.89:0/2742181165 >> 172.21.15.89:0/2742181165 conn(0x7f31a80c2ad0 msgr2=0x7f31a80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:26.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 -- 172.21.15.89:0/2742181165 shutdown_connections 2023-12-07T10:01:26.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 -- 172.21.15.89:0/2742181165 wait complete. 2023-12-07T10:01:26.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.988+0000 7f31ae246640 1 Processor -- start 2023-12-07T10:01:26.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- start start 2023-12-07T10:01:26.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a8070b80 0x7f31a80c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a81edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31a814e9d0 0x7f31a81f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:26.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81557b0 con 0x7f31a80a8470 2023-12-07T10:01:26.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81551f0 con 0x7f31a814e9d0 2023-12-07T10:01:26.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81554d0 con 0x7f31a8070b80 2023-12-07T10:01:26.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a81edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a81edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40676/0 (socket says 172.21.15.89:40676) 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 -- 172.21.15.89:0/875613521 learned_addr learned my addr 172.21.15.89:0/875613521 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a7fff640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31a814e9d0 0x7f31a81f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a77fe640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a8070b80 0x7f31a80c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 -- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a8070b80 msgr2=0x7f31a80c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a8070b80 0x7f31a80c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 -- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31a814e9d0 msgr2=0x7f31a81f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31a814e9d0 0x7f31a81f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 -- 172.21.15.89:0/875613521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a000bd40 con 0x7f31a80a8470 2023-12-07T10:01:27.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31a6ffd640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a81edc80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f319c00c4d0 tx=0x7f319c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c0052d0 con 0x7f31a80a8470 2023-12-07T10:01:27.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c005430 con 0x7f31a80a8470 2023-12-07T10:01:27.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c012830 con 0x7f31a80a8470 2023-12-07T10:01:27.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a81ed480 con 0x7f31a80a8470 2023-12-07T10:01:27.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a80c53b0 con 0x7f31a80a8470 2023-12-07T10:01:27.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.992+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a81ed9a0 con 0x7f31a80a8470 2023-12-07T10:01:27.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.996+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f319c012990 con 0x7f31a80a8470 2023-12-07T10:01:27.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.996+0000 7f318ffff640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f31940668d0 0x7f3194068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.996+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f319c084200 con 0x7f31a80a8470 2023-12-07T10:01:27.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.996+0000 7f31a77fe640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f31940668d0 0x7f3194068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:26.996+0000 7f31a77fe640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f31940668d0 0x7f3194068d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f31980045f0 tx=0x7f3198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.000+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31a81ed9a0 con 0x7f31a80a8470 2023-12-07T10:01:27.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.160+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31a81ed9a0 con 0x7f31a80a8470 2023-12-07T10:01:27.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f318ffff640 1 -- 172.21.15.89:0/875613521 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31a81ed9a0 con 0x7f31a80a8470 2023-12-07T10:01:27.167 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f31940668d0 msgr2=0x7f3194068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f31940668d0 0x7f3194068d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f31980045f0 tx=0x7f3198008040 comp rx=0 tx=0).stop 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 msgr2=0x7f31a81edc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a81edc80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f319c00c4d0 tx=0x7f319c00c990 comp rx=0 tx=0).stop 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 shutdown_connections 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31a814e9d0 0x7f31a81f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31a80a8470 0x7f31a81edc80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f31940668d0 0x7f3194068d90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 --2- 172.21.15.89:0/875613521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f31a8070b80 0x7f31a80c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 >> 172.21.15.89:0/875613521 conn(0x7f31a80c2ad0 msgr2=0x7f31a814dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 shutdown_connections 2023-12-07T10:01:27.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.164+0000 7f31ae246640 1 -- 172.21.15.89:0/875613521 wait complete. 2023-12-07T10:01:27.189 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T10:01:27.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:27.189 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:01:27.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:01:27.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:01:27.221 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:01:27.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:27.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 Processor -- start 2023-12-07T10:01:27.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 -- start start 2023-12-07T10:01:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0000ca610 0x7fd0000c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd0000bd720 0x7fd0000c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd000155790 con 0x7fd00006cd90 2023-12-07T10:01:27.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000c4b00 con 0x7fd0000ca610 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd007c17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000c4de0 con 0x7fd0000bd720 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0000ca610 0x7fd0000c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0000ca610 0x7fd0000c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40680/0 (socket says 172.21.15.89:40680) 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 -- 172.21.15.89:0/655770907 learned_addr learned my addr 172.21.15.89:0/655770907 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0051b2640 1 --2- 172.21.15.89:0/655770907 >> v2:172.21.15.97:3300/0 conn(0x7fd0000bd720 0x7fd0000c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 -- 172.21.15.89:0/655770907 >> v2:172.21.15.97:3300/0 conn(0x7fd0000bd720 msgr2=0x7fd0000c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 --2- 172.21.15.89:0/655770907 >> v2:172.21.15.97:3300/0 conn(0x7fd0000bd720 0x7fd0000c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 -- 172.21.15.89:0/655770907 >> v1:172.21.15.97:6789/0 conn(0x7fd00006cd90 legacy=0x7fd000158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.412+0000 7fd0059b3640 1 -- 172.21.15.89:0/655770907 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000157e30 con 0x7fd0000ca610 2023-12-07T10:01:27.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd0059b3640 1 --2- 172.21.15.89:0/655770907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000ca610 0x7fd0000c94c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd0000ca380 tx=0x7fcffc01c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc2268ca9d9aae9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd0049b1640 1 -- 172.21.15.89:0/655770907 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000c52d0 con 0x7fd0000ca610 2023-12-07T10:01:27.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd0049b1640 1 -- 172.21.15.89:0/655770907 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc0a4900 con 0x7fd0000ca610 2023-12-07T10:01:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd0049b1640 1 -- 172.21.15.89:0/655770907 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0a4c90 con 0x7fd0000ca610 2023-12-07T10:01:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 -- 172.21.15.89:0/655770907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000ca610 msgr2=0x7fd0000c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 --2- 172.21.15.89:0/655770907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000ca610 0x7fd0000c94c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd0000ca380 tx=0x7fcffc01c0c0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 -- 172.21.15.89:0/655770907 shutdown_connections 2023-12-07T10:01:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 --2- 172.21.15.89:0/655770907 >> v2:172.21.15.97:3300/0 conn(0x7fd0000bd720 0x7fd0000c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 --2- 172.21.15.89:0/655770907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000ca610 0x7fd0000c94c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 -- 172.21.15.89:0/655770907 >> 172.21.15.89:0/655770907 conn(0x7fd000071ea0 msgr2=0x7fd0000722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 -- 172.21.15.89:0/655770907 shutdown_connections 2023-12-07T10:01:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.416+0000 7fd007c17640 1 -- 172.21.15.89:0/655770907 wait complete. 2023-12-07T10:01:27.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 Processor -- start 2023-12-07T10:01:27.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- start start 2023-12-07T10:01:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd00006cd90 0x7fd0000c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 0x7fd000147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd0000ca610 0x7fd000147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000149b60 con 0x7fd0000bd720 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000067590 con 0x7fd00006cd90 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0001f27d0 con 0x7fd0000ca610 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 0x7fd000147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 0x7fd000147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40682/0 (socket says 172.21.15.89:40682) 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 -- 172.21.15.89:0/4061728379 learned_addr learned my addr 172.21.15.89:0/4061728379 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0059b3640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd00006cd90 0x7fd0000c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0061b4640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd0000ca610 0x7fd000147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 -- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd0000ca610 msgr2=0x7fd000147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd0000ca610 0x7fd000147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 -- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd00006cd90 msgr2=0x7fd0000c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd00006cd90 0x7fd0000c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 -- 172.21.15.89:0/4061728379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0094d0 con 0x7fd0000bd720 2023-12-07T10:01:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0061b4640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd0000ca610 0x7fd000147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd0051b2640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 0x7fd000147560 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcff000d830 tx=0x7fcff000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000b6c0 con 0x7fd0000bd720 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000b860 con 0x7fd0000bd720 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000bc10 con 0x7fd0000bd720 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0001f2340 con 0x7fd0000bd720 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0001f1cf0 con 0x7fd0000bd720 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.420+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0001f24d0 con 0x7fd0000bd720 2023-12-07T10:01:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.424+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcff001e460 con 0x7fd0000bd720 2023-12-07T10:01:27.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.424+0000 7fcff67fc640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfe40668d0 0x7fcfe4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.424+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcff0084e60 con 0x7fd0000bd720 2023-12-07T10:01:27.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.424+0000 7fd0059b3640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfe40668d0 0x7fcfe4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.424+0000 7fd0059b3640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfe40668d0 0x7fcfe4068d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0ae000 tx=0x7fcffc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.428+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcff0051dd0 con 0x7fd0000bd720 2023-12-07T10:01:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0000af6b0 con 0x7fd0000bd720 2023-12-07T10:01:27.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fcff67fc640 1 -- 172.21.15.89:0/4061728379 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7fd0000af6b0 con 0x7fd0000bd720 2023-12-07T10:01:27.614 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:27.614 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:27.614 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 37 2023-12-07T10:01:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfe40668d0 msgr2=0x7fcfe4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfe40668d0 0x7fcfe4068d90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0ae000 tx=0x7fcffc008040 comp rx=0 tx=0).stop 2023-12-07T10:01:27.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 msgr2=0x7fd000147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 0x7fd000147560 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcff000d830 tx=0x7fcff000dcf0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 shutdown_connections 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.608+0000 7fd007c17640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcfe40668d0 0x7fcfe4068d90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.612+0000 7fd007c17640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd0000ca610 0x7fd000147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.612+0000 7fd007c17640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0000bd720 0x7fd000147560 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.612+0000 7fd007c17640 1 --2- 172.21.15.89:0/4061728379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd00006cd90 0x7fd0000c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.612+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 >> 172.21.15.89:0/4061728379 conn(0x7fd000071ea0 msgr2=0x7fd000072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.612+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 shutdown_connections 2023-12-07T10:01:27.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.612+0000 7fd007c17640 1 -- 172.21.15.89:0/4061728379 wait complete. 2023-12-07T10:01:27.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 Processor -- start 2023-12-07T10:01:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 -- start start 2023-12-07T10:01:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71000ca610 0x7f71000c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f710006cd90 0x7f7100158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7100155790 con 0x7f71000ca610 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000c4b00 con 0x7f710006cd90 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f710771d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c4de0 con 0x7f71000bd720 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71000ca610 0x7f71000c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71000ca610 0x7f71000c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40694/0 (socket says 172.21.15.89:40694) 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 -- 172.21.15.89:0/1524068201 learned_addr learned my addr 172.21.15.89:0/1524068201 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f7104cb8640 1 --2- 172.21.15.89:0/1524068201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f7105cba640 1 --2- 172.21.15.89:0/1524068201 >> v2:172.21.15.97:3300/0 conn(0x7f710006cd90 0x7f7100158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 -- 172.21.15.89:0/1524068201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 msgr2=0x7f71000c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 --2- 172.21.15.89:0/1524068201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 -- 172.21.15.89:0/1524068201 >> v2:172.21.15.97:3300/0 conn(0x7f710006cd90 msgr2=0x7f7100158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 --2- 172.21.15.89:0/1524068201 >> v2:172.21.15.97:3300/0 conn(0x7f710006cd90 0x7f7100158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.768+0000 7f71054b9640 1 -- 172.21.15.89:0/1524068201 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100157e30 con 0x7f71000ca610 2023-12-07T10:01:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f71054b9640 1 --2- 172.21.15.89:0/1524068201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000ca610 0x7f71000c94c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7100152370 tx=0x7f70fc01c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b842567937359a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f70f7fff640 1 -- 172.21.15.89:0/1524068201 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71000c52d0 con 0x7f71000ca610 2023-12-07T10:01:27.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f70f7fff640 1 -- 172.21.15.89:0/1524068201 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc0a4880 con 0x7f71000ca610 2023-12-07T10:01:27.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f70f7fff640 1 -- 172.21.15.89:0/1524068201 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0a4c10 con 0x7f71000ca610 2023-12-07T10:01:27.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 -- 172.21.15.89:0/1524068201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000ca610 msgr2=0x7f71000c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 --2- 172.21.15.89:0/1524068201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000ca610 0x7f71000c94c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7100152370 tx=0x7f70fc01c0c0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 -- 172.21.15.89:0/1524068201 shutdown_connections 2023-12-07T10:01:27.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 --2- 172.21.15.89:0/1524068201 >> v2:172.21.15.97:3300/0 conn(0x7f710006cd90 0x7f7100158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 --2- 172.21.15.89:0/1524068201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 --2- 172.21.15.89:0/1524068201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000ca610 0x7f71000c94c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 -- 172.21.15.89:0/1524068201 >> 172.21.15.89:0/1524068201 conn(0x7f7100071ea0 msgr2=0x7f71000722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 -- 172.21.15.89:0/1524068201 shutdown_connections 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.772+0000 7f710771d640 1 -- 172.21.15.89:0/1524068201 wait complete. 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 Processor -- start 2023-12-07T10:01:27.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- start start 2023-12-07T10:01:27.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 0x7f71001538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71000ca610 0x7f71000a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000ab6f0 con 0x7f710006cd90 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c3e10 con 0x7f71000ca610 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c40f0 con 0x7f71000bd720 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 0x7f71001538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 0x7f71001538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40704/0 (socket says 172.21.15.89:40704) 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 -- 172.21.15.89:0/1322341665 learned_addr learned my addr 172.21.15.89:0/1322341665 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f7105cba640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71000ca610 0x7f71000a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f7104cb8640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 -- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 msgr2=0x7f71000ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 -- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71000ca610 msgr2=0x7f71000a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71000ca610 0x7f71000a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 -- 172.21.15.89:0/1322341665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0094d0 con 0x7f710006cd90 2023-12-07T10:01:27.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f71054b9640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 0x7f71001538c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0af040 tx=0x7f70fc019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0b7670 con 0x7f710006cd90 2023-12-07T10:01:27.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc0b77f0 con 0x7f710006cd90 2023-12-07T10:01:27.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71000ab310 con 0x7f710006cd90 2023-12-07T10:01:27.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0b7ba0 con 0x7f710006cd90 2023-12-07T10:01:27.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000c43d0 con 0x7f710006cd90 2023-12-07T10:01:27.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.776+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710004e890 con 0x7f710006cd90 2023-12-07T10:01:27.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.780+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f70fc0b3070 con 0x7f710006cd90 2023-12-07T10:01:27.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.780+0000 7f70f5ffb640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70e40668d0 0x7f70e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:27.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.780+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f71000cac00 con 0x7f710006cd90 2023-12-07T10:01:27.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.780+0000 7f7104cb8640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70e40668d0 0x7f70e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:27.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.780+0000 7f7104cb8640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70e40668d0 0x7f70e4068d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71000c5b90 tx=0x7f70f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:27.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.784+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70fc0eb1e0 con 0x7f710006cd90 2023-12-07T10:01:27.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.936+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f710006cb70 con 0x7f710006cd90 2023-12-07T10:01:27.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.936+0000 7f70f5ffb640 1 -- 172.21.15.89:0/1322341665 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7f70fc0ee800 con 0x7f710006cd90 2023-12-07T10:01:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:27.941 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:27.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.936+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70e40668d0 msgr2=0x7f70e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.936+0000 7f710771d640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70e40668d0 0x7f70e4068d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71000c5b90 tx=0x7f70f0008040 comp rx=0 tx=0).stop 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.936+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 msgr2=0x7f71001538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.936+0000 7f710771d640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 0x7f71001538c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0af040 tx=0x7f70fc019180 comp rx=0 tx=0).stop 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 shutdown_connections 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71000ca610 0x7f71000a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f70e40668d0 0x7f70e4068d90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71000bd720 0x7f71000ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 --2- 172.21.15.89:0/1322341665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f710006cd90 0x7f71001538c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 >> 172.21.15.89:0/1322341665 conn(0x7f7100071ea0 msgr2=0x7f71000ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 shutdown_connections 2023-12-07T10:01:27.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:27.940+0000 7f710771d640 1 -- 172.21.15.89:0/1322341665 wait complete. 2023-12-07T10:01:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:00:50.933921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:00:52.211886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:01:04.139867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:01:05.289028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:27.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:28.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 Processor -- start 2023-12-07T10:01:28.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 -- start start 2023-12-07T10:01:28.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 0x7f674c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f674c0c7f20 0x7f674c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674c06cf70 con 0x7f674c151d80 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c152160 con 0x7f674c0c7f20 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f6751279640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0c6a30 con 0x7f674c0c8430 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f674c151d80 0x7f674c0c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36160/0 (socket says 172.21.15.89:36160) 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674affd640 1 -- 172.21.15.89:0/398312420 learned_addr learned my addr 172.21.15.89:0/398312420 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 --2- 172.21.15.89:0/398312420 >> v2:172.21.15.97:3300/0 conn(0x7f674c0c7f20 0x7f674c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f67427fc640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 0x7f674c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030063785 0 0) 0x7f674c06cf70 con 0x7f674c151d80 2023-12-07T10:01:28.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6738003530 con 0x7f674c151d80 2023-12-07T10:01:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402876020 0 0) 0x7f6738003530 con 0x7f674c151d80 2023-12-07T10:01:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 msgr2=0x7f674c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 0x7f674c06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 >> v2:172.21.15.97:3300/0 conn(0x7f674c0c7f20 msgr2=0x7f674c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 --2- 172.21.15.89:0/398312420 >> v2:172.21.15.97:3300/0 conn(0x7f674c0c7f20 0x7f674c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0c72d0 con 0x7f674c151d80 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f673c001680 con 0x7f674c151d80 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 >> v1:172.21.15.89:6789/0 conn(0x7f674c151d80 legacy=0x7f674c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6738003980 0x7f6738003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 0x7f67380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f6738005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c152160 con 0x7f6738004d10 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0c6a30 con 0x7f6738003980 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673800b9c0 con 0x7f674c0c8430 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 --2- 172.21.15.89:0/398312420 >> v2:172.21.15.97:3300/0 conn(0x7f674c0c7f20 0x7f674c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f6738005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674affd640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6738003980 0x7f6738003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f67427fc640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 0x7f67380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 -- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 msgr2=0x7f67380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:28.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c0c8430 0x7f67380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 -- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6738003980 msgr2=0x7f6738003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:28.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6738003980 0x7f6738003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.100+0000 7f674b7fe640 1 -- 172.21.15.89:0/398312420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738003530 con 0x7f6738004d10 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f674b7fe640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f6738005190 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6744009c90 tx=0x7f674401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed32b24581f7d81 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744004020 con 0x7f6738004d10 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6744004180 con 0x7f6738004d10 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f674a7fc640 1 -- 172.21.15.89:0/398312420 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67440a5910 con 0x7f6738004d10 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f6751279640 1 -- 172.21.15.89:0/398312420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 msgr2=0x7f6738005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f6751279640 1 --2- 172.21.15.89:0/398312420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f6738005190 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6744009c90 tx=0x7f674401cc50 comp rx=0 tx=0).stop 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f674b7fe640 1 -- 172.21.15.89:0/398312420 reap_dead start 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f6751279640 1 -- 172.21.15.89:0/398312420 shutdown_connections 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f6751279640 1 -- 172.21.15.89:0/398312420 >> 172.21.15.89:0/398312420 conn(0x7f674c0abd00 msgr2=0x7f674c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f6751279640 1 -- 172.21.15.89:0/398312420 shutdown_connections 2023-12-07T10:01:28.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.104+0000 7f6751279640 1 -- 172.21.15.89:0/398312420 wait complete. 2023-12-07T10:01:28.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 Processor -- start 2023-12-07T10:01:28.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 -- start start 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f674c1edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c153660 0x7f674c0aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f674c1eac70 0x7f674c0acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0ae8e0 con 0x7f6738004d10 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c1ee460 con 0x7f674c1eac70 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c153dd0 con 0x7f674c153660 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f674c1edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f674c1edf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40722/0 (socket says 172.21.15.89:40722) 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 -- 172.21.15.89:0/3360427908 learned_addr learned my addr 172.21.15.89:0/3360427908 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f67427fc640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c153660 0x7f674c0aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674b7fe640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f674c1eac70 0x7f674c0acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 -- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c153660 msgr2=0x7f674c0aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c153660 0x7f674c0aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 -- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f674c1eac70 msgr2=0x7f674c0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f674c1eac70 0x7f674c0acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 -- 172.21.15.89:0/3360427908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c153af0 con 0x7f6738004d10 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f674affd640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f674c1edf20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f673c001060 tx=0x7f673c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c014810 con 0x7f6738004d10 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c014970 con 0x7f6738004d10 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c014d00 con 0x7f6738004d10 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c1ea190 con 0x7f6738004d10 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.108+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c1ea750 con 0x7f6738004d10 2023-12-07T10:01:28.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.112+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c1e9ff0 con 0x7f6738004d10 2023-12-07T10:01:28.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.112+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f673c016480 con 0x7f6738004d10 2023-12-07T10:01:28.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.112+0000 7f6743fff640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f672c0668d0 0x7f672c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.112+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f673c087cd0 con 0x7f6738004d10 2023-12-07T10:01:28.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.112+0000 7f67427fc640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f672c0668d0 0x7f672c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.112+0000 7f67427fc640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f672c0668d0 0x7f672c068d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f674c158da0 tx=0x7f673400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.116+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f674c1e9ff0 con 0x7f6738004d10 2023-12-07T10:01:28.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f674c1e9ff0 con 0x7f6738004d10 2023-12-07T10:01:28.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6743fff640 1 -- 172.21.15.89:0/3360427908 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f674c1e9ff0 con 0x7f6738004d10 2023-12-07T10:01:28.273 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f672c0668d0 msgr2=0x7f672c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f672c0668d0 0x7f672c068d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f674c158da0 tx=0x7f673400b040 comp rx=0 tx=0).stop 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 msgr2=0x7f674c1edf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f674c1edf20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f673c001060 tx=0x7f673c005870 comp rx=0 tx=0).stop 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 shutdown_connections 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f674c1eac70 0x7f674c0acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f672c0668d0 0x7f672c068d90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f674c153660 0x7f674c0aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 --2- 172.21.15.89:0/3360427908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6738004d10 0x7f674c1edf20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 >> 172.21.15.89:0/3360427908 conn(0x7f674c0abd00 msgr2=0x7f674c0c0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 shutdown_connections 2023-12-07T10:01:28.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.268+0000 7f6751279640 1 -- 172.21.15.89:0/3360427908 wait complete. 2023-12-07T10:01:28.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:01:28.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab28f1d640 1 Processor -- start 2023-12-07T10:01:28.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab28f1d640 1 -- start start 2023-12-07T10:01:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab28f1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab24072330 0x7fab240c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab28f1d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab241522c0 con 0x7fab240c1ae0 2023-12-07T10:01:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab28f1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab24155040 con 0x7fab24151ee0 2023-12-07T10:01:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab28f1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab240c1610 con 0x7fab24072330 2023-12-07T10:01:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab19d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fab240c1ae0 0x7fab240c09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36176/0 (socket says 172.21.15.89:36176) 2023-12-07T10:01:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab19d9b640 1 -- 172.21.15.89:0/581028685 learned_addr learned my addr 172.21.15.89:0/581028685 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:28.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab22d9d640 1 --2- 172.21.15.89:0/581028685 >> v2:172.21.15.97:3300/0 conn(0x7fab24072330 0x7fab240c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836657718 0 0) 0x7fab241522c0 con 0x7fab240c1ae0 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab10003530 con 0x7fab240c1ae0 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274474011 0 0) 0x7fab24155040 con 0x7fab24151ee0 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab241522c0 con 0x7fab24151ee0 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab22d9d640 1 -- 172.21.15.89:0/581028685 >> v1:172.21.15.97:6789/0 conn(0x7fab24151ee0 legacy=0x7fab2406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3482451103 0 0) 0x7fab10003530 con 0x7fab240c1ae0 2023-12-07T10:01:28.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab22d9d640 1 -- 172.21.15.89:0/581028685 >> v1:172.21.15.89:6789/0 conn(0x7fab240c1ae0 legacy=0x7fab240c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.432+0000 7fab22d9d640 1 -- 172.21.15.89:0/581028685 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab241555c0 con 0x7fab24072330 2023-12-07T10:01:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab22d9d640 1 --2- 172.21.15.89:0/581028685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab24072330 0x7fab240c10d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009d90 tx=0x7fab1c01c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f49767622dd50b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c001680 con 0x7fab24072330 2023-12-07T10:01:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c0a5620 con 0x7fab24072330 2023-12-07T10:01:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab21d9b640 1 -- 172.21.15.89:0/581028685 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0a59b0 con 0x7fab24072330 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 -- 172.21.15.89:0/581028685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab24072330 msgr2=0x7fab240c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 --2- 172.21.15.89:0/581028685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab24072330 0x7fab240c10d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009d90 tx=0x7fab1c01c7e0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 -- 172.21.15.89:0/581028685 shutdown_connections 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 --2- 172.21.15.89:0/581028685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab24072330 0x7fab240c10d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 -- 172.21.15.89:0/581028685 >> 172.21.15.89:0/581028685 conn(0x7fab240c3b70 msgr2=0x7fab240c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 -- 172.21.15.89:0/581028685 shutdown_connections 2023-12-07T10:01:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.436+0000 7fab28f1d640 1 -- 172.21.15.89:0/581028685 wait complete. 2023-12-07T10:01:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 Processor -- start 2023-12-07T10:01:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 -- start start 2023-12-07T10:01:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab24072330 0x7fab240ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab240c1ae0 0x7fab240ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 0x7fab240ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2406aab0 con 0x7fab24151ee0 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240abaa0 con 0x7fab240c1ae0 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab241edcc0 con 0x7fab24072330 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 0x7fab240ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 0x7fab240ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40736/0 (socket says 172.21.15.89:40736) 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 -- 172.21.15.89:0/333948665 learned_addr learned my addr 172.21.15.89:0/333948665 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab19d9b640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab240c1ae0 0x7fab240ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab2259c640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab24072330 0x7fab240ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 -- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab24072330 msgr2=0x7fab240ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab24072330 0x7fab240ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 -- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab240c1ae0 msgr2=0x7fab240ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab240c1ae0 0x7fab240ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 -- 172.21.15.89:0/333948665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c009a70 con 0x7fab24151ee0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab22d9d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 0x7fab240ab560 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0b0040 tx=0x7fab1c019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c003ba0 con 0x7fab24151ee0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c003d00 con 0x7fab24151ee0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab24156090 con 0x7fab24151ee0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c004240 con 0x7fab24151ee0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.440+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab24156650 con 0x7fab24151ee0 2023-12-07T10:01:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.444+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2404e890 con 0x7fab24151ee0 2023-12-07T10:01:28.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.444+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fab1c0043a0 con 0x7fab24151ee0 2023-12-07T10:01:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.444+0000 7fab1b7fe640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab040668d0 0x7fab04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.444+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fab1c11f4b0 con 0x7fab24151ee0 2023-12-07T10:01:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.444+0000 7fab2259c640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab040668d0 0x7fab04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.444+0000 7fab2259c640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab040668d0 0x7fab04068d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fab140011f0 tx=0x7fab14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.448+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab1c0ec420 con 0x7fab24151ee0 2023-12-07T10:01:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.596+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab2406eeb0 con 0x7fab24151ee0 2023-12-07T10:01:28.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab1b7fe640 1 -- 172.21.15.89:0/333948665 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab1c009450 con 0x7fab24151ee0 2023-12-07T10:01:28.604 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab040668d0 msgr2=0x7fab04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab040668d0 0x7fab04068d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fab140011f0 tx=0x7fab14009040 comp rx=0 tx=0).stop 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 msgr2=0x7fab240ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 0x7fab240ab560 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0b0040 tx=0x7fab1c019580 comp rx=0 tx=0).stop 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 shutdown_connections 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab24151ee0 0x7fab240ab560 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab240c1ae0 0x7fab240ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab040668d0 0x7fab04068d90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 --2- 172.21.15.89:0/333948665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab24072330 0x7fab240ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 >> 172.21.15.89:0/333948665 conn(0x7fab240c3b70 msgr2=0x7fab240c08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 shutdown_connections 2023-12-07T10:01:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.600+0000 7fab28f1d640 1 -- 172.21.15.89:0/333948665 wait complete. 2023-12-07T10:01:28.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:01:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 Processor -- start 2023-12-07T10:01:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 -- start start 2023-12-07T10:01:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe0c06b810 0x7fbe0c156300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbe0c156840 0x7fbe0c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c155c40 con 0x7fbe0c0c17b0 2023-12-07T10:01:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c073590 con 0x7fbe0c156840 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe14217640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c60c0 con 0x7fbe0c06b810 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe127b4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbe0c156840 0x7fbe0c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe117b2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbe0c0c17b0 0x7fbe0c0719e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36178/0 (socket says 172.21.15.89:36178) 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe117b2640 1 -- 172.21.15.89:0/3861149122 learned_addr learned my addr 172.21.15.89:0/3861149122 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe11fb3640 1 --2- 172.21.15.89:0/3861149122 >> v2:172.21.15.97:3300/0 conn(0x7fbe0c06b810 0x7fbe0c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe127b4640 1 -- 172.21.15.89:0/3861149122 >> v2:172.21.15.97:3300/0 conn(0x7fbe0c06b810 msgr2=0x7fbe0c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe127b4640 1 --2- 172.21.15.89:0/3861149122 >> v2:172.21.15.97:3300/0 conn(0x7fbe0c06b810 0x7fbe0c156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe127b4640 1 -- 172.21.15.89:0/3861149122 >> v1:172.21.15.89:6789/0 conn(0x7fbe0c0c17b0 legacy=0x7fbe0c0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe10fb1640 1 -- 172.21.15.89:0/3861149122 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261272479 0 0) 0x7fbe0c155c40 con 0x7fbe0c0c17b0 2023-12-07T10:01:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.760+0000 7fbe127b4640 1 -- 172.21.15.89:0/3861149122 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c073800 con 0x7fbe0c156840 2023-12-07T10:01:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe127b4640 1 --2- 172.21.15.89:0/3861149122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c0720f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0aca60 tx=0x7fbe0401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be13c50d0fb4dda server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe10fb1640 1 -- 172.21.15.89:0/3861149122 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040a57d0 con 0x7fbe0c156840 2023-12-07T10:01:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe10fb1640 1 -- 172.21.15.89:0/3861149122 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040a5930 con 0x7fbe0c156840 2023-12-07T10:01:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe10fb1640 1 -- 172.21.15.89:0/3861149122 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040a5cc0 con 0x7fbe0c156840 2023-12-07T10:01:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 -- 172.21.15.89:0/3861149122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 msgr2=0x7fbe0c0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 --2- 172.21.15.89:0/3861149122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c0720f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0aca60 tx=0x7fbe0401c910 comp rx=0 tx=0).stop 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 -- 172.21.15.89:0/3861149122 shutdown_connections 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 --2- 172.21.15.89:0/3861149122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c0720f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 --2- 172.21.15.89:0/3861149122 >> v2:172.21.15.97:3300/0 conn(0x7fbe0c06b810 0x7fbe0c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 -- 172.21.15.89:0/3861149122 >> 172.21.15.89:0/3861149122 conn(0x7fbe0c0c3240 msgr2=0x7fbe0c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 -- 172.21.15.89:0/3861149122 shutdown_connections 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.764+0000 7fbe14217640 1 -- 172.21.15.89:0/3861149122 wait complete. 2023-12-07T10:01:28.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 Processor -- start 2023-12-07T10:01:28.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- start start 2023-12-07T10:01:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c06b810 0x7fbe0c1eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c0c17b0 0x7fbe0c0a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1525b0 con 0x7fbe0c156840 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1532e0 con 0x7fbe0c06b810 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1ef110 con 0x7fbe0c0c17b0 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40762/0 (socket says 172.21.15.89:40762) 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 -- 172.21.15.89:0/2324956865 learned_addr learned my addr 172.21.15.89:0/2324956865 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe11fb3640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c06b810 0x7fbe0c1eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe117b2640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c0c17b0 0x7fbe0c0a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 -- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c0c17b0 msgr2=0x7fbe0c0a6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c0c17b0 0x7fbe0c0a6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 -- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c06b810 msgr2=0x7fbe0c1eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c06b810 0x7fbe0c1eac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 -- 172.21.15.89:0/2324956865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04009a70 con 0x7fbe0c156840 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe127b4640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c149700 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbe040b0040 tx=0x7fbe040196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b9650 con 0x7fbe0c156840 2023-12-07T10:01:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040b97b0 con 0x7fbe0c156840 2023-12-07T10:01:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b9b40 con 0x7fbe0c156840 2023-12-07T10:01:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c1ee590 con 0x7fbe0c156840 2023-12-07T10:01:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c1eeb50 con 0x7fbe0c156840 2023-12-07T10:01:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.768+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c04e890 con 0x7fbe0c156840 2023-12-07T10:01:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.772+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbe040b9ca0 con 0x7fbe0c156840 2023-12-07T10:01:28.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.772+0000 7fbe027fc640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbdf00668d0 0x7fbdf0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:28.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.772+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbe0411fb80 con 0x7fbe0c156840 2023-12-07T10:01:28.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.772+0000 7fbe11fb3640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbdf00668d0 0x7fbdf0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:28.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.772+0000 7fbe11fb3640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbdf00668d0 0x7fbdf0068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0c2a30 tx=0x7fbe08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.776+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe040ec9d0 con 0x7fbe0c156840 2023-12-07T10:01:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.924+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe0c0c0e20 con 0x7fbe0c156840 2023-12-07T10:01:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe027fc640 1 -- 172.21.15.89:0/2324956865 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe040efff0 con 0x7fbe0c156840 2023-12-07T10:01:28.931 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbdf00668d0 msgr2=0x7fbdf0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbdf00668d0 0x7fbdf0068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0c2a30 tx=0x7fbe08008040 comp rx=0 tx=0).stop 2023-12-07T10:01:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 msgr2=0x7fbe0c149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c149700 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbe040b0040 tx=0x7fbe040196b0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 shutdown_connections 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe0c156840 0x7fbe0c149700 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbdf00668d0 0x7fbdf0068d90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe0c0c17b0 0x7fbe0c0a6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 --2- 172.21.15.89:0/2324956865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe0c06b810 0x7fbe0c1eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 >> 172.21.15.89:0/2324956865 conn(0x7fbe0c0c3240 msgr2=0x7fbe0c0718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 shutdown_connections 2023-12-07T10:01:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:28.928+0000 7fbe14217640 1 -- 172.21.15.89:0/2324956865 wait complete. 2023-12-07T10:01:28.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:01:29.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 Processor -- start 2023-12-07T10:01:29.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 -- start start 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16080a86d0 0x7f16080a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f160814fd00 0x7f16080aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1608152d90 con 0x7f1608156600 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1608152480 con 0x7f16080a86d0 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f1610679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16080a9760 con 0x7f160814fd00 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f160e415640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16080a86d0 0x7f16080a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f160e415640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16080a86d0 0x7f16080a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40772/0 (socket says 172.21.15.89:40772) 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f160e415640 1 -- 172.21.15.89:0/3051222526 learned_addr learned my addr 172.21.15.89:0/3051222526 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.088+0000 7f160ec16640 1 --2- 172.21.15.89:0/3051222526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f160814fd00 0x7f16080aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160e415640 1 -- 172.21.15.89:0/3051222526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f160814fd00 msgr2=0x7f16080aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160e415640 1 --2- 172.21.15.89:0/3051222526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f160814fd00 0x7f16080aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160e415640 1 -- 172.21.15.89:0/3051222526 >> v1:172.21.15.97:6789/0 conn(0x7f1608156600 legacy=0x7f160814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160e415640 1 -- 172.21.15.89:0/3051222526 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608152740 con 0x7f16080a86d0 2023-12-07T10:01:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160e415640 1 --2- 172.21.15.89:0/3051222526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16080a86d0 0x7f16080a8f30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f16040098a0 tx=0x7f160401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a86ae7396352cfd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160d413640 1 -- 172.21.15.89:0/3051222526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16040ab610 con 0x7f16080a86d0 2023-12-07T10:01:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160d413640 1 -- 172.21.15.89:0/3051222526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16040ab770 con 0x7f16080a86d0 2023-12-07T10:01:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f160d413640 1 -- 172.21.15.89:0/3051222526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16040abb00 con 0x7f16080a86d0 2023-12-07T10:01:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f1610679640 1 -- 172.21.15.89:0/3051222526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16080a86d0 msgr2=0x7f16080a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.092+0000 7f1610679640 1 --2- 172.21.15.89:0/3051222526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16080a86d0 0x7f16080a8f30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f16040098a0 tx=0x7f160401c520 comp rx=0 tx=0).stop 2023-12-07T10:01:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- 172.21.15.89:0/3051222526 shutdown_connections 2023-12-07T10:01:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 --2- 172.21.15.89:0/3051222526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f160814fd00 0x7f16080aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 --2- 172.21.15.89:0/3051222526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16080a86d0 0x7f16080a8f30 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- 172.21.15.89:0/3051222526 >> 172.21.15.89:0/3051222526 conn(0x7f16080c2a60 msgr2=0x7f16080c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- 172.21.15.89:0/3051222526 shutdown_connections 2023-12-07T10:01:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- 172.21.15.89:0/3051222526 wait complete. 2023-12-07T10:01:29.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 Processor -- start 2023-12-07T10:01:29.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- start start 2023-12-07T10:01:29.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16080a86d0 0x7f1608147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 0x7f1608154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1608156600 0x7f1608071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080708a0 con 0x7f160814fd00 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080710b0 con 0x7f16080a86d0 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f1610679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608147820 con 0x7f1608156600 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 0x7f1608154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 0x7f1608154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40788/0 (socket says 172.21.15.89:40788) 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 -- 172.21.15.89:0/2820378785 learned_addr learned my addr 172.21.15.89:0/2820378785 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160e415640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16080a86d0 0x7f1608147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160ec16640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1608156600 0x7f1608071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 -- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1608156600 msgr2=0x7f1608071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1608156600 0x7f1608071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 -- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16080a86d0 msgr2=0x7f1608147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16080a86d0 0x7f1608147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 -- 172.21.15.89:0/2820378785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040094d0 con 0x7f160814fd00 2023-12-07T10:01:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f160dc14640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 0x7f1608154970 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c390 tx=0x7f15f800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.096+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f80052d0 con 0x7f160814fd00 2023-12-07T10:01:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8005430 con 0x7f160814fd00 2023-12-07T10:01:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16081533a0 con 0x7f160814fd00 2023-12-07T10:01:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003820 con 0x7f160814fd00 2023-12-07T10:01:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1608070dd0 con 0x7f160814fd00 2023-12-07T10:01:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1608153200 con 0x7f160814fd00 2023-12-07T10:01:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15f8003980 con 0x7f160814fd00 2023-12-07T10:01:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f15feffd640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15ec066900 0x7f15ec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15f8083c20 con 0x7f160814fd00 2023-12-07T10:01:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f160e415640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15ec066900 0x7f15ec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.100+0000 7f160e415640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15ec066900 0x7f15ec068dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f16040af000 tx=0x7f16040b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.104+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1608153200 con 0x7f160814fd00 2023-12-07T10:01:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1608153200 con 0x7f160814fd00 2023-12-07T10:01:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f15feffd640 1 -- 172.21.15.89:0/2820378785 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v53) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1608153200 con 0x7f160814fd00 2023-12-07T10:01:29.264 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15ec066900 msgr2=0x7f15ec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15ec066900 0x7f15ec068dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f16040af000 tx=0x7f16040b6040 comp rx=0 tx=0).stop 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 msgr2=0x7f1608154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 0x7f1608154970 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c390 tx=0x7f15f800c850 comp rx=0 tx=0).stop 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 shutdown_connections 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f15ec066900 0x7f15ec068dc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1608156600 0x7f1608071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f160814fd00 0x7f1608154970 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 --2- 172.21.15.89:0/2820378785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16080a86d0 0x7f1608147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 >> 172.21.15.89:0/2820378785 conn(0x7f16080c2a60 msgr2=0x7f160814f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 shutdown_connections 2023-12-07T10:01:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.260+0000 7f1610679640 1 -- 172.21.15.89:0/2820378785 wait complete. 2023-12-07T10:01:29.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:01:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 Processor -- start 2023-12-07T10:01:29.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 -- start start 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3510070760 0x7f35100701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3510158ff0 0x7f3510159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3510071020 con 0x7f35101561d0 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3510071300 con 0x7f3510070760 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.420+0000 7f351729c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35100715e0 con 0x7f3510158ff0 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3510070760 0x7f35100701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3510070760 0x7f35100701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40794/0 (socket says 172.21.15.89:40794) 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 -- 172.21.15.89:0/419039526 learned_addr learned my addr 172.21.15.89:0/419039526 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3515839640 1 --2- 172.21.15.89:0/419039526 >> v2:172.21.15.97:3300/0 conn(0x7f3510158ff0 0x7f3510159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 -- 172.21.15.89:0/419039526 >> v2:172.21.15.97:3300/0 conn(0x7f3510158ff0 msgr2=0x7f3510159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:29.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 --2- 172.21.15.89:0/419039526 >> v2:172.21.15.97:3300/0 conn(0x7f3510158ff0 0x7f3510159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 -- 172.21.15.89:0/419039526 >> v1:172.21.15.97:6789/0 conn(0x7f35101561d0 legacy=0x7f351006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 -- 172.21.15.89:0/419039526 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100718c0 con 0x7f3510070760 2023-12-07T10:01:29.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3514837640 1 --2- 172.21.15.89:0/419039526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510070760 0x7f35100701f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f35100728c0 tx=0x7f350001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720aad9c6def01f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3507fff640 1 -- 172.21.15.89:0/419039526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000ad680 con 0x7f3510070760 2023-12-07T10:01:29.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3507fff640 1 -- 172.21.15.89:0/419039526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35000ad7e0 con 0x7f3510070760 2023-12-07T10:01:29.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.424+0000 7f3507fff640 1 -- 172.21.15.89:0/419039526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000adb70 con 0x7f3510070760 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- 172.21.15.89:0/419039526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510070760 msgr2=0x7f35100701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 --2- 172.21.15.89:0/419039526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510070760 0x7f35100701f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f35100728c0 tx=0x7f350001c470 comp rx=0 tx=0).stop 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- 172.21.15.89:0/419039526 shutdown_connections 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 --2- 172.21.15.89:0/419039526 >> v2:172.21.15.97:3300/0 conn(0x7f3510158ff0 0x7f3510159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 --2- 172.21.15.89:0/419039526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510070760 0x7f35100701f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- 172.21.15.89:0/419039526 >> 172.21.15.89:0/419039526 conn(0x7f35100c2a60 msgr2=0x7f35100c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- 172.21.15.89:0/419039526 shutdown_connections 2023-12-07T10:01:29.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- 172.21.15.89:0/419039526 wait complete. 2023-12-07T10:01:29.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 Processor -- start 2023-12-07T10:01:29.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- start start 2023-12-07T10:01:29.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3510070760 0x7f35100c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 0x7f3510148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3510158ff0 0x7f3510149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101527b0 con 0x7f35101561d0 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510157120 con 0x7f3510070760 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f351729c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35101f1fc0 con 0x7f3510158ff0 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 0x7f3510148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 0x7f3510148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40802/0 (socket says 172.21.15.89:40802) 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 -- 172.21.15.89:0/1121098286 learned_addr learned my addr 172.21.15.89:0/1121098286 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3515038640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3510070760 0x7f35100c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3515839640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3510158ff0 0x7f3510149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 -- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3510158ff0 msgr2=0x7f3510149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3510158ff0 0x7f3510149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 -- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3510070760 msgr2=0x7f35100c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3510070760 0x7f35100c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.428+0000 7f3514837640 1 -- 172.21.15.89:0/1121098286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000094d0 con 0x7f35101561d0 2023-12-07T10:01:29.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3514837640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 0x7f3510148d30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3500019080 tx=0x7f350001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000adde0 con 0x7f35101561d0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35000b6460 con 0x7f35101561d0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000b6810 con 0x7f35101561d0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35101f1160 con 0x7f35101561d0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35101f1690 con 0x7f35101561d0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351004e890 con 0x7f35101561d0 2023-12-07T10:01:29.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f35000b4070 con 0x7f35101561d0 2023-12-07T10:01:29.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3505ffb640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34f40668d0 0x7f34f4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f350011dfe0 con 0x7f35101561d0 2023-12-07T10:01:29.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.432+0000 7f3515038640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34f40668d0 0x7f34f4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.436+0000 7f3515038640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34f40668d0 0x7f34f4068d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f35100c5c60 tx=0x7f350c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.436+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35000eafa0 con 0x7f35101561d0 2023-12-07T10:01:29.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.584+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f351015ce00 con 0x7f35101561d0 2023-12-07T10:01:29.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.584+0000 7f3505ffb640 1 -- 172.21.15.89:0/1121098286 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v53) v1 ==== 101+0+11 (secure 0 0 0) 0x7f35000b2020 con 0x7f35101561d0 2023-12-07T10:01:29.591 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34f40668d0 msgr2=0x7f34f4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34f40668d0 0x7f34f4068d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f35100c5c60 tx=0x7f350c009040 comp rx=0 tx=0).stop 2023-12-07T10:01:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 msgr2=0x7f3510148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 0x7f3510148d30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3500019080 tx=0x7f350001acb0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 shutdown_connections 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f34f40668d0 0x7f34f4068d90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3510158ff0 0x7f3510149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35101561d0 0x7f3510148d30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 --2- 172.21.15.89:0/1121098286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3510070760 0x7f35100c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 >> 172.21.15.89:0/1121098286 conn(0x7f35100c2a60 msgr2=0x7f351014c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 shutdown_connections 2023-12-07T10:01:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.588+0000 7f351729c640 1 -- 172.21.15.89:0/1121098286 wait complete. 2023-12-07T10:01:29.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:29.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f9546b640 1 Processor -- start 2023-12-07T10:01:29.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f9546b640 1 -- start start 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f9546b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f9006cd90 0x7f5f90160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f9546b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f90155790 con 0x7f5f900ca610 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f9546b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900c4b00 con 0x7f5f900bd720 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f9546b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c4de0 con 0x7f5f9006cd90 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5f900ca610 0x7f5f900c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49332/0 (socket says 172.21.15.89:49332) 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8effd640 1 -- 172.21.15.89:0/2846807911 learned_addr learned my addr 172.21.15.89:0/2846807911 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8f7fe640 1 --2- 172.21.15.89:0/2846807911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f9006cd90 0x7f5f90160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889472348 0 0) 0x7f5f90155790 con 0x7f5f900ca610 2023-12-07T10:01:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f7c003530 con 0x7f5f900ca610 2023-12-07T10:01:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744018419 0 0) 0x7f5f900c4b00 con 0x7f5f900bd720 2023-12-07T10:01:29.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f90155790 con 0x7f5f900bd720 2023-12-07T10:01:29.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8f7fe640 1 -- 172.21.15.89:0/2846807911 >> v1:172.21.15.97:6789/0 conn(0x7f5f900bd720 legacy=0x7f5f90158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8f7fe640 1 -- 172.21.15.89:0/2846807911 >> v1:172.21.15.89:6789/0 conn(0x7f5f900ca610 legacy=0x7f5f900c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.744+0000 7f5f8f7fe640 1 -- 172.21.15.89:0/2846807911 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90157e30 con 0x7f5f9006cd90 2023-12-07T10:01:29.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f8f7fe640 1 --2- 172.21.15.89:0/2846807911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f9006cd90 0x7f5f90160130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f880097f0 tx=0x7f5f8801c080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7439aac89b11b6eb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900c52d0 con 0x7f5f9006cd90 2023-12-07T10:01:29.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f880a48c0 con 0x7f5f9006cd90 2023-12-07T10:01:29.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f8e7fc640 1 -- 172.21.15.89:0/2846807911 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880a4c50 con 0x7f5f9006cd90 2023-12-07T10:01:29.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 -- 172.21.15.89:0/2846807911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f9006cd90 msgr2=0x7f5f90160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 --2- 172.21.15.89:0/2846807911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f9006cd90 0x7f5f90160130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f880097f0 tx=0x7f5f8801c080 comp rx=0 tx=0).stop 2023-12-07T10:01:29.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 -- 172.21.15.89:0/2846807911 shutdown_connections 2023-12-07T10:01:29.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 --2- 172.21.15.89:0/2846807911 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f9006cd90 0x7f5f90160130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 -- 172.21.15.89:0/2846807911 >> 172.21.15.89:0/2846807911 conn(0x7f5f90071ea0 msgr2=0x7f5f900722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:29.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 -- 172.21.15.89:0/2846807911 shutdown_connections 2023-12-07T10:01:29.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.748+0000 7f5f9546b640 1 -- 172.21.15.89:0/2846807911 wait complete. 2023-12-07T10:01:29.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 Processor -- start 2023-12-07T10:01:29.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 -- start start 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 0x7f5f900ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f900bd720 0x7f5f900c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f900ca610 0x7f5f900aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90149c50 con 0x7f5f9006cd90 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900aeba0 con 0x7f5f900ca610 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90149970 con 0x7f5f900bd720 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 0x7f5f900ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 0x7f5f900ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36552/0 (socket says 172.21.15.89:36552) 2023-12-07T10:01:29.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 -- 172.21.15.89:0/1613319881 learned_addr learned my addr 172.21.15.89:0/1613319881 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8f7fe640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f900ca610 0x7f5f900aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f867fc640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f900bd720 0x7f5f900c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 -- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f900bd720 msgr2=0x7f5f900c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f900bd720 0x7f5f900c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 -- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f900ca610 msgr2=0x7f5f900aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f900ca610 0x7f5f900aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 -- 172.21.15.89:0/1613319881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88009420 con 0x7f5f9006cd90 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f8effd640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 0x7f5f900ae660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c420 tx=0x7f5f8000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80005cf0 con 0x7f5f9006cd90 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80005e50 con 0x7f5f9006cd90 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f900ac640 con 0x7f5f9006cd90 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80007310 con 0x7f5f9006cd90 2023-12-07T10:01:29.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.752+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f900ae140 con 0x7f5f9006cd90 2023-12-07T10:01:29.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.756+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f900ac880 con 0x7f5f9006cd90 2023-12-07T10:01:29.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.756+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5f80007470 con 0x7f5f9006cd90 2023-12-07T10:01:29.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.756+0000 7f5f87fff640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5f700668d0 0x7f5f70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:29.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.756+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5f80083dd0 con 0x7f5f9006cd90 2023-12-07T10:01:29.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.756+0000 7f5f867fc640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5f700668d0 0x7f5f70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:29.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.756+0000 7f5f867fc640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5f700668d0 0x7f5f70068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5f78007fd0 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:29.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.760+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f900ac880 con 0x7f5f9006cd90 2023-12-07T10:01:29.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.944+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f900ac880 con 0x7f5f9006cd90 2023-12-07T10:01:29.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.944+0000 7f5f87fff640 1 -- 172.21.15.89:0/1613319881 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f5f900ac880 con 0x7f5f9006cd90 2023-12-07T10:01:29.950 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:29.950 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 37 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5f700668d0 msgr2=0x7f5f70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5f700668d0 0x7f5f70068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5f78007fd0 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 msgr2=0x7f5f900ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 0x7f5f900ae660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c420 tx=0x7f5f8000c8e0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 shutdown_connections 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f900ca610 0x7f5f900aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5f700668d0 0x7f5f70068d90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5f900bd720 0x7f5f900c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 --2- 172.21.15.89:0/1613319881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f9006cd90 0x7f5f900ae660 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:29.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 >> 172.21.15.89:0/1613319881 conn(0x7f5f90071ea0 msgr2=0x7f5f90155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:29.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 shutdown_connections 2023-12-07T10:01:29.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:29.948+0000 7f5f9546b640 1 -- 172.21.15.89:0/1613319881 wait complete. 2023-12-07T10:01:29.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:30.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1712d3e640 1 Processor -- start 2023-12-07T10:01:30.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1712d3e640 1 -- start start 2023-12-07T10:01:30.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1712d3e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f170c0ca610 0x7f170c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1712d3e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c155790 con 0x7f170c06cd90 2023-12-07T10:01:30.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1712d3e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c0c4b00 con 0x7f170c0bd720 2023-12-07T10:01:30.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1712d3e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c0c4de0 con 0x7f170c0ca610 2023-12-07T10:01:30.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f17112db640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f170c06cd90 0x7f170c0c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49346/0 (socket says 172.21.15.89:49346) 2023-12-07T10:01:30.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f17112db640 1 -- 172.21.15.89:0/2740458320 learned_addr learned my addr 172.21.15.89:0/2740458320 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:30.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 --2- 172.21.15.89:0/2740458320 >> v2:172.21.15.97:3300/0 conn(0x7f170c0ca610 0x7f170c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459472204 0 0) 0x7f170c155790 con 0x7f170c06cd90 2023-12-07T10:01:30.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16fc003530 con 0x7f170c06cd90 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 536166666 0 0) 0x7f16fc003530 con 0x7f170c06cd90 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 >> v2:172.21.15.97:3300/0 conn(0x7f170c0ca610 msgr2=0x7f170c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 --2- 172.21.15.89:0/2740458320 >> v2:172.21.15.97:3300/0 conn(0x7f170c0ca610 0x7f170c0c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 >> v1:172.21.15.97:6789/0 conn(0x7f170c0bd720 legacy=0x7f170c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c157e30 con 0x7f170c06cd90 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f1704001a00 con 0x7f170c06cd90 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 >> v1:172.21.15.89:6789/0 conn(0x7f170c06cd90 legacy=0x7f170c0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16fc0039d0 0x7f16fc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0047d0 0x7f16fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16fc0052b0 0x7f16fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c4de0 con 0x7f16fc0039d0 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc00c1b0 con 0x7f16fc0047d0 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc00c370 con 0x7f16fc0052b0 2023-12-07T10:01:30.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16fc0039d0 0x7f16fc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f17112db640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16fc0052b0 0x7f16fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 -- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16fc0052b0 msgr2=0x7f16fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f16fc0052b0 0x7f16fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 -- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0047d0 msgr2=0x7f16fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170bfff640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0047d0 0x7f16fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0047d0 0x7f16fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f1710ada640 1 -- 172.21.15.89:0/2740458320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc003530 con 0x7f16fc0039d0 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f17112db640 1 -- 172.21.15.89:0/2740458320 reap_dead start 2023-12-07T10:01:30.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.104+0000 7f170bfff640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0047d0 0x7f16fc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:30.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1710ada640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16fc0039d0 0x7f16fc003df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1700009ae0 tx=0x7f170001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194b9200fb92686 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c0c52d0 con 0x7f16fc0039d0 2023-12-07T10:01:30.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17000a4bb0 con 0x7f16fc0039d0 2023-12-07T10:01:30.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f170b7fe640 1 -- 172.21.15.89:0/2740458320 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000ac440 con 0x7f16fc0039d0 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 -- 172.21.15.89:0/2740458320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16fc0039d0 msgr2=0x7f16fc003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16fc0039d0 0x7f16fc003df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1700009ae0 tx=0x7f170001c750 comp rx=0 tx=0).stop 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 -- 172.21.15.89:0/2740458320 shutdown_connections 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2740458320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16fc0039d0 0x7f16fc003df0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 -- 172.21.15.89:0/2740458320 >> 172.21.15.89:0/2740458320 conn(0x7f170c071ea0 msgr2=0x7f170c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 -- 172.21.15.89:0/2740458320 shutdown_connections 2023-12-07T10:01:30.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.108+0000 7f1712d3e640 1 -- 172.21.15.89:0/2740458320 wait complete. 2023-12-07T10:01:30.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 Processor -- start 2023-12-07T10:01:30.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 -- start start 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039d0 0x7f170c0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c1ee8e0 0x7f170c0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 0x7f170c1f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1edbc0 con 0x7f170c1f11e0 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1ee450 con 0x7f16fc0039d0 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0ae5b0 con 0x7f170c1ee8e0 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 0x7f170c1f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 0x7f170c1f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36562/0 (socket says 172.21.15.89:36562) 2023-12-07T10:01:30.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 -- 172.21.15.89:0/2280460216 learned_addr learned my addr 172.21.15.89:0/2280460216 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1710ada640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039d0 0x7f170c0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f170bfff640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c1ee8e0 0x7f170c0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 -- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c1ee8e0 msgr2=0x7f170c0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c1ee8e0 0x7f170c0c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 -- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039d0 msgr2=0x7f170c0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039d0 0x7f170c0adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 -- 172.21.15.89:0/2280460216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c1ede00 con 0x7f170c1f11e0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f170bfff640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c1ee8e0 0x7f170c0c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17112db640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 0x7f170c1f1660 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f170c0c5d10 tx=0x7f1704007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170400eaa0 con 0x7f170c1f11e0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170400ec20 con 0x7f170c1f11e0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704013420 con 0x7f170c1f11e0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.112+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c1ee0e0 con 0x7f170c1f11e0 2023-12-07T10:01:30.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.116+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c0c8dd0 con 0x7f170c1f11e0 2023-12-07T10:01:30.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.116+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c04e890 con 0x7f170c1f11e0 2023-12-07T10:01:30.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.116+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1704013580 con 0x7f170c1f11e0 2023-12-07T10:01:30.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.116+0000 7f17097fa640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f16f0066900 0x7f16f0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.116+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1704084b40 con 0x7f170c1f11e0 2023-12-07T10:01:30.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.116+0000 7f1710ada640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f16f0066900 0x7f16f0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.120+0000 7f1710ada640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f16f0066900 0x7f16f0068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17000ae000 tx=0x7f17000046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.120+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1704055490 con 0x7f170c1f11e0 2023-12-07T10:01:30.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.272+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f170c072690 con 0x7f170c1f11e0 2023-12-07T10:01:30.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.272+0000 7f17097fa640 1 -- 172.21.15.89:0/2280460216 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7f1704055020 con 0x7f170c1f11e0 2023-12-07T10:01:30.281 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:30.281 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:30.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f16f0066900 msgr2=0x7f16f0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f16f0066900 0x7f16f0068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17000ae000 tx=0x7f17000046d0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 msgr2=0x7f170c1f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 0x7f170c1f1660 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f170c0c5d10 tx=0x7f1704007bc0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 shutdown_connections 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c1f11e0 0x7f170c1f1660 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f16f0066900 0x7f16f0068dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f170c1ee8e0 0x7f170c0c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 --2- 172.21.15.89:0/2280460216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc0039d0 0x7f170c0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 >> 172.21.15.89:0/2280460216 conn(0x7f170c071ea0 msgr2=0x7f170c0c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 shutdown_connections 2023-12-07T10:01:30.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.276+0000 7f1712d3e640 1 -- 172.21.15.89:0/2280460216 wait complete. 2023-12-07T10:01:30.301 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-07T10:01:30.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:30.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba55eaa640 1 Processor -- start 2023-12-07T10:01:30.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba55eaa640 1 -- start start 2023-12-07T10:01:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba55eaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba50156500 0x7fba5006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba55eaa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5006dec0 con 0x7fba5014fcc0 2023-12-07T10:01:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba55eaa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba50156980 con 0x7fba500c19e0 2023-12-07T10:01:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba55eaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba500aa340 con 0x7fba50156500 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba4f7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fba5014fcc0 0x7fba500aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49352/0 (socket says 172.21.15.89:49352) 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba4f7fe640 1 -- 172.21.15.89:0/2279550264 learned_addr learned my addr 172.21.15.89:0/2279550264 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.436+0000 7fba4effd640 1 --2- 172.21.15.89:0/2279550264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba50156500 0x7fba5006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4e7fc640 1 -- 172.21.15.89:0/2279550264 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538304890 0 0) 0x7fba5006dec0 con 0x7fba5014fcc0 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4e7fc640 1 -- 172.21.15.89:0/2279550264 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba38003530 con 0x7fba5014fcc0 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4effd640 1 -- 172.21.15.89:0/2279550264 >> v1:172.21.15.97:6789/0 conn(0x7fba500c19e0 legacy=0x7fba500c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4e7fc640 1 -- 172.21.15.89:0/2279550264 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201524964 0 0) 0x7fba480014a0 con 0x7fba500c19e0 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4effd640 1 -- 172.21.15.89:0/2279550264 >> v1:172.21.15.89:6789/0 conn(0x7fba5014fcc0 legacy=0x7fba500aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4effd640 1 -- 172.21.15.89:0/2279550264 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500ab580 con 0x7fba50156500 2023-12-07T10:01:30.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4effd640 1 --2- 172.21.15.89:0/2279550264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba50156500 0x7fba5006d980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba440097f0 tx=0x7fba4401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a61b58b8032c08 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4e7fc640 1 -- 172.21.15.89:0/2279550264 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440aa5f0 con 0x7fba50156500 2023-12-07T10:01:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4e7fc640 1 -- 172.21.15.89:0/2279550264 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba440aa750 con 0x7fba50156500 2023-12-07T10:01:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.440+0000 7fba4e7fc640 1 -- 172.21.15.89:0/2279550264 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440aaac0 con 0x7fba50156500 2023-12-07T10:01:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- 172.21.15.89:0/2279550264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba50156500 msgr2=0x7fba5006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 --2- 172.21.15.89:0/2279550264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba50156500 0x7fba5006d980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba440097f0 tx=0x7fba4401c490 comp rx=0 tx=0).stop 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- 172.21.15.89:0/2279550264 shutdown_connections 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 --2- 172.21.15.89:0/2279550264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba50156500 0x7fba5006d980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- 172.21.15.89:0/2279550264 >> 172.21.15.89:0/2279550264 conn(0x7fba500c2ad0 msgr2=0x7fba500c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- 172.21.15.89:0/2279550264 shutdown_connections 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- 172.21.15.89:0/2279550264 wait complete. 2023-12-07T10:01:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 Processor -- start 2023-12-07T10:01:30.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- start start 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba500c19e0 0x7fba5014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba50156500 0x7fba5015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 0x7fba501ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50151890 con 0x7fba5015d5c0 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba500c4610 con 0x7fba50156500 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba55eaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba50152850 con 0x7fba500c19e0 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 0x7fba501ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 0x7fba501ecfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36576/0 (socket says 172.21.15.89:36576) 2023-12-07T10:01:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 -- 172.21.15.89:0/3055175785 learned_addr learned my addr 172.21.15.89:0/3055175785 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4f7fe640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba500c19e0 0x7fba5014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4effd640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba50156500 0x7fba5015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 -- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba500c19e0 msgr2=0x7fba5014ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba500c19e0 0x7fba5014ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 -- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba50156500 msgr2=0x7fba5015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba50156500 0x7fba5015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 -- 172.21.15.89:0/3055175785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009420 con 0x7fba5015d5c0 2023-12-07T10:01:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.444+0000 7fba4ffff640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 0x7fba501ecfd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fba4800c7b0 tx=0x7fba4800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48003db0 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48005070 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba501f0c90 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48005420 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba500c4b40 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5004e890 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fba48005580 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba37fff640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fba3c0668d0 0x7fba3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fba48084440 con 0x7fba5015d5c0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba4f7fe640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fba3c0668d0 0x7fba3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.448+0000 7fba4f7fe640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fba3c0668d0 0x7fba3c068d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fba40005890 tx=0x7fba40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.452+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba48051310 con 0x7fba5015d5c0 2023-12-07T10:01:30.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba50156980 con 0x7fba5015d5c0 2023-12-07T10:01:30.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba37fff640 1 -- 172.21.15.89:0/3055175785 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7fba50156980 con 0x7fba5015d5c0 2023-12-07T10:01:30.640 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:30.641 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:30.641 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 37 2023-12-07T10:01:30.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fba3c0668d0 msgr2=0x7fba3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fba3c0668d0 0x7fba3c068d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fba40005890 tx=0x7fba40009040 comp rx=0 tx=0).stop 2023-12-07T10:01:30.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 msgr2=0x7fba501ecfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 0x7fba501ecfd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fba4800c7b0 tx=0x7fba4800cc70 comp rx=0 tx=0).stop 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 shutdown_connections 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba5015d5c0 0x7fba501ecfd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba50156500 0x7fba5015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fba3c0668d0 0x7fba3c068d90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 --2- 172.21.15.89:0/3055175785 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fba500c19e0 0x7fba5014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 >> 172.21.15.89:0/3055175785 conn(0x7fba500c2ad0 msgr2=0x7fba500bfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 shutdown_connections 2023-12-07T10:01:30.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.636+0000 7fba55eaa640 1 -- 172.21.15.89:0/3055175785 wait complete. 2023-12-07T10:01:30.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.792+0000 7f104d654640 1 Processor -- start 2023-12-07T10:01:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.792+0000 7f104d654640 1 -- start start 2023-12-07T10:01:30.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f104d654640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10481555d0 0x7f10480c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f104d654640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1048158010 0x7f10481584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f104d654640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10480c70a0 con 0x7f10480a6e50 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f104d654640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10480c7380 con 0x7f10481555d0 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f104d654640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104806c470 con 0x7f1048158010 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10481555d0 0x7f10480c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10481555d0 0x7f10480c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36592/0 (socket says 172.21.15.89:36592) 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 -- 172.21.15.89:0/211610928 learned_addr learned my addr 172.21.15.89:0/211610928 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f10477fe640 1 --2- 172.21.15.89:0/211610928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1048158010 0x7f10481584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 -- 172.21.15.89:0/211610928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1048158010 msgr2=0x7f10481584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 --2- 172.21.15.89:0/211610928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1048158010 0x7f10481584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 -- 172.21.15.89:0/211610928 >> v1:172.21.15.97:6789/0 conn(0x7f10480a6e50 legacy=0x7f10480c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.796+0000 7f1046ffd640 1 -- 172.21.15.89:0/211610928 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104806c750 con 0x7f10481555d0 2023-12-07T10:01:30.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f1046ffd640 1 --2- 172.21.15.89:0/211610928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10481555d0 0x7f10480c78e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1038009870 tx=0x7f103801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff0b3eec7aab5df server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f10467fc640 1 -- 172.21.15.89:0/211610928 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380ad640 con 0x7f10481555d0 2023-12-07T10:01:30.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f10467fc640 1 -- 172.21.15.89:0/211610928 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10380ad7a0 con 0x7f10481555d0 2023-12-07T10:01:30.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f10467fc640 1 -- 172.21.15.89:0/211610928 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380adb30 con 0x7f10481555d0 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 -- 172.21.15.89:0/211610928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10481555d0 msgr2=0x7f10480c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 --2- 172.21.15.89:0/211610928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10481555d0 0x7f10480c78e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1038009870 tx=0x7f103801c540 comp rx=0 tx=0).stop 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 -- 172.21.15.89:0/211610928 shutdown_connections 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 --2- 172.21.15.89:0/211610928 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1048158010 0x7f10481584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 --2- 172.21.15.89:0/211610928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10481555d0 0x7f10480c78e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 -- 172.21.15.89:0/211610928 >> 172.21.15.89:0/211610928 conn(0x7f10480c4960 msgr2=0x7f10480c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:30.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 -- 172.21.15.89:0/211610928 shutdown_connections 2023-12-07T10:01:30.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 -- 172.21.15.89:0/211610928 wait complete. 2023-12-07T10:01:30.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 Processor -- start 2023-12-07T10:01:30.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.800+0000 7f104d654640 1 -- start start 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10480a6e50 0x7f104806e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10481555d0 0x7f104814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 0x7f1048070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104814dc70 con 0x7f1048158010 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104814d2a0 con 0x7f10481555d0 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104806f900 con 0x7f10480a6e50 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 0x7f1048070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 0x7f1048070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36596/0 (socket says 172.21.15.89:36596) 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 -- 172.21.15.89:0/1355023705 learned_addr learned my addr 172.21.15.89:0/1355023705 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:30.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f103ffff640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10481555d0 0x7f104814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f1046ffd640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10480a6e50 0x7f104806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 -- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10480a6e50 msgr2=0x7f104806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10480a6e50 0x7f104806e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 -- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10481555d0 msgr2=0x7f104814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:30.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10481555d0 0x7f104814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:30.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 -- 172.21.15.89:0/1355023705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380094d0 con 0x7f1048158010 2023-12-07T10:01:30.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f10477fe640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 0x7f1048070010 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f104000efc0 tx=0x7f104000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040009ba0 con 0x7f1048158010 2023-12-07T10:01:30.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000f040 con 0x7f1048158010 2023-12-07T10:01:30.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10481ed9c0 con 0x7f1048158010 2023-12-07T10:01:30.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10400146c0 con 0x7f1048158010 2023-12-07T10:01:30.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10481edc60 con 0x7f1048158010 2023-12-07T10:01:30.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104814d410 con 0x7f1048158010 2023-12-07T10:01:30.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.804+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1040014820 con 0x7f1048158010 2023-12-07T10:01:30.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.808+0000 7f103f7fe640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1028066900 0x7f1028068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:30.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.808+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1040085450 con 0x7f1048158010 2023-12-07T10:01:30.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.808+0000 7f1046ffd640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1028066900 0x7f1028068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:30.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.808+0000 7f1046ffd640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1028066900 0x7f1028068dc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f10380af000 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:30.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.812+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10400523d0 con 0x7f1048158010 2023-12-07T10:01:31.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.996+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f104804e890 con 0x7f1048158010 2023-12-07T10:01:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:30.996+0000 7f103f7fe640 1 -- 172.21.15.89:0/1355023705 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6126 (secure 0 0 0) 0x7f10400559f0 con 0x7f1048158010 2023-12-07T10:01:31.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:31.002 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:00:53.212873+0000","modified":"2023-12-07T10:00:56.223970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/416367230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":416367230},{"type":"v1","addr":"172.21.15.89:6837","nonce":416367230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 37 2023-12-07T10:01:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1028066900 msgr2=0x7f1028068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1028066900 0x7f1028068dc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f10380af000 tx=0x7f1038008040 comp rx=0 tx=0).stop 2023-12-07T10:01:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 msgr2=0x7f1048070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 0x7f1048070010 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f104000efc0 tx=0x7f104000c490 comp rx=0 tx=0).stop 2023-12-07T10:01:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 shutdown_connections 2023-12-07T10:01:31.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1048158010 0x7f1048070010 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10481555d0 0x7f104814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1028066900 0x7f1028068dc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 --2- 172.21.15.89:0/1355023705 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f10480a6e50 0x7f104806e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 >> 172.21.15.89:0/1355023705 conn(0x7f10480c4960 msgr2=0x7f1048066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 shutdown_connections 2023-12-07T10:01:31.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.000+0000 7f104d654640 1 -- 172.21.15.89:0/1355023705 wait complete. 2023-12-07T10:01:31.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:31.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.156+0000 7efd22fd1640 1 Processor -- start 2023-12-07T10:01:31.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.156+0000 7efd22fd1640 1 -- start start 2023-12-07T10:01:31.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd22fd1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd1c14fcc0 0x7efd1c156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd22fd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd22fd1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c0ab580 con 0x7efd1c06d980 2023-12-07T10:01:31.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd22fd1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0aa340 con 0x7efd1c14fcc0 2023-12-07T10:01:31.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd22fd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c152fe0 con 0x7efd1c0c19e0 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd2156e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd13fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efd1c06d980 0x7efd1c0aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:34762/0 (socket says 172.21.15.89:34762) 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd13fff640 1 -- 172.21.15.89:0/2614391278 learned_addr learned my addr 172.21.15.89:0/2614391278 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd20d6d640 1 --2- 172.21.15.89:0/2614391278 >> v2:172.21.15.97:3300/0 conn(0x7efd1c14fcc0 0x7efd1c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd137fe640 1 -- 172.21.15.89:0/2614391278 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944052145 0 0) 0x7efd1c0ab580 con 0x7efd1c06d980 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd2156e640 1 -- 172.21.15.89:0/2614391278 >> v2:172.21.15.97:3300/0 conn(0x7efd1c14fcc0 msgr2=0x7efd1c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd2156e640 1 --2- 172.21.15.89:0/2614391278 >> v2:172.21.15.97:3300/0 conn(0x7efd1c14fcc0 0x7efd1c156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd2156e640 1 -- 172.21.15.89:0/2614391278 >> v1:172.21.15.97:6789/0 conn(0x7efd1c06d980 legacy=0x7efd1c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.160+0000 7efd2156e640 1 -- 172.21.15.89:0/2614391278 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c1532c0 con 0x7efd1c0c19e0 2023-12-07T10:01:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd2156e640 1 --2- 172.21.15.89:0/2614391278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c1e70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd14009d90 tx=0x7efd1401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de3393869f6d424 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd137fe640 1 -- 172.21.15.89:0/2614391278 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140a58f0 con 0x7efd1c0c19e0 2023-12-07T10:01:31.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd137fe640 1 -- 172.21.15.89:0/2614391278 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd140a5a50 con 0x7efd1c0c19e0 2023-12-07T10:01:31.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd137fe640 1 -- 172.21.15.89:0/2614391278 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140a5de0 con 0x7efd1c0c19e0 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 -- 172.21.15.89:0/2614391278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 msgr2=0x7efd1c0c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 --2- 172.21.15.89:0/2614391278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c1e70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd14009d90 tx=0x7efd1401c920 comp rx=0 tx=0).stop 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 -- 172.21.15.89:0/2614391278 shutdown_connections 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 --2- 172.21.15.89:0/2614391278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c1e70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 --2- 172.21.15.89:0/2614391278 >> v2:172.21.15.97:3300/0 conn(0x7efd1c14fcc0 0x7efd1c156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 -- 172.21.15.89:0/2614391278 >> 172.21.15.89:0/2614391278 conn(0x7efd1c0c2ad0 msgr2=0x7efd1c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 -- 172.21.15.89:0/2614391278 shutdown_connections 2023-12-07T10:01:31.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 -- 172.21.15.89:0/2614391278 wait complete. 2023-12-07T10:01:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 Processor -- start 2023-12-07T10:01:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.164+0000 7efd22fd1640 1 -- start start 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd1c06d980 0x7efd1c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 0x7efd1c1f0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0be150 con 0x7efd1c14ef30 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0bb6e0 con 0x7efd1c06d980 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c150800 con 0x7efd1c0c19e0 2023-12-07T10:01:31.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 0x7efd1c1f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 0x7efd1c1f0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36610/0 (socket says 172.21.15.89:36610) 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 -- 172.21.15.89:0/861187037 learned_addr learned my addr 172.21.15.89:0/861187037 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd13fff640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd20d6d640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd1c06d980 0x7efd1c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 -- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 msgr2=0x7efd1c0c0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 -- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd1c06d980 msgr2=0x7efd1c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd1c06d980 0x7efd1c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 -- 172.21.15.89:0/861187037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14009a70 con 0x7efd1c14ef30 2023-12-07T10:01:31.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd13fff640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd2156e640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 0x7efd1c1f0220 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7efd1401ce00 tx=0x7efd140196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14003ba0 con 0x7efd1c14ef30 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14003d00 con 0x7efd1c14ef30 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c152020 con 0x7efd1c14ef30 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140ad850 con 0x7efd1c14ef30 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c1f0de0 con 0x7efd1c14ef30 2023-12-07T10:01:31.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1c06dd80 con 0x7efd1c14ef30 2023-12-07T10:01:31.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.168+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd140b4070 con 0x7efd1c14ef30 2023-12-07T10:01:31.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.172+0000 7efd117fa640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efd080668d0 0x7efd08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.172+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efd1411f480 con 0x7efd1c14ef30 2023-12-07T10:01:31.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.172+0000 7efd20d6d640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efd080668d0 0x7efd08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.172+0000 7efd20d6d640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efd080668d0 0x7efd08068d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efd18009ac0 tx=0x7efd18009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.176+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd140ec350 con 0x7efd1c14ef30 2023-12-07T10:01:31.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.328+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd1c04e890 con 0x7efd1c14ef30 2023-12-07T10:01:31.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.328+0000 7efd117fa640 1 -- 172.21.15.89:0/861187037 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20220 (secure 0 0 0) 0x7efd140ef970 con 0x7efd1c14ef30 2023-12-07T10:01:31.334 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:31.334 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:07.935968+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:00:50.933921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-07T10:00:52.211886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efd080668d0 msgr2=0x7efd08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efd080668d0 0x7efd08068d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efd18009ac0 tx=0x7efd18009190 comp rx=0 tx=0).stop 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 msgr2=0x7efd1c1f0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 0x7efd1c1f0220 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7efd1401ce00 tx=0x7efd140196c0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 shutdown_connections 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd1c14ef30 0x7efd1c1f0220 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7efd080668d0 0x7efd08068d90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd1c0c19e0 0x7efd1c0c0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 --2- 172.21.15.89:0/861187037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd1c06d980 0x7efd1c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 >> 172.21.15.89:0/861187037 conn(0x7efd1c0c2ad0 msgr2=0x7efd1c153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:31.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 shutdown_connections 2023-12-07T10:01:31.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.332+0000 7efd22fd1640 1 -- 172.21.15.89:0/861187037 wait complete. 2023-12-07T10:01:31.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-07T10:01:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.488+0000 7f9a42b65640 1 Processor -- start 2023-12-07T10:01:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a42b65640 1 -- start start 2023-12-07T10:01:31.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a42b65640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 0x7f9a3c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a42b65640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c06d320 con 0x7f9a3c14e9d0 2023-12-07T10:01:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a42b65640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0721b0 con 0x7f9a3c0a8470 2023-12-07T10:01:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a42b65640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c2830 con 0x7f9a3c070b80 2023-12-07T10:01:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a40901640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9a3c14e9d0 0x7f9a3c0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49358/0 (socket says 172.21.15.89:49358) 2023-12-07T10:01:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a40901640 1 -- 172.21.15.89:0/207516814 learned_addr learned my addr 172.21.15.89:0/207516814 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:31.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a33fff640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 0x7f9a3c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483248714 0 0) 0x7f9a3c06d320 con 0x7f9a3c14e9d0 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24003530 con 0x7f9a3c14e9d0 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133423949 0 0) 0x7f9a24003530 con 0x7f9a3c14e9d0 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 msgr2=0x7f9a3c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 0x7f9a3c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 >> v1:172.21.15.97:6789/0 conn(0x7f9a3c0a8470 legacy=0x7f9a3c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c072450 con 0x7f9a3c14e9d0 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f9a38001680 con 0x7f9a3c14e9d0 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 >> v1:172.21.15.89:6789/0 conn(0x7f9a3c14e9d0 legacy=0x7f9a3c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240039b0 0x7f9a24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 0x7f9a240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24004d10 0x7f9a24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c2830 con 0x7f9a24004d10 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2400dc50 con 0x7f9a240039b0 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2400de10 con 0x7f9a3c070b80 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a41102640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24004d10 0x7f9a24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a40901640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240039b0 0x7f9a24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a33fff640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 0x7f9a240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a41102640 1 -- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 msgr2=0x7f9a240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a41102640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c070b80 0x7f9a240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a41102640 1 -- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240039b0 msgr2=0x7f9a24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a41102640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a240039b0 0x7f9a24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.492+0000 7f9a41102640 1 -- 172.21.15.89:0/207516814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24003530 con 0x7f9a24004d10 2023-12-07T10:01:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a41102640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24004d10 0x7f9a24005190 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0a8920 tx=0x7f9a3401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908d4cf5973c3f48 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a9670 con 0x7f9a24004d10 2023-12-07T10:01:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340a97f0 con 0x7f9a24004d10 2023-12-07T10:01:31.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a337fe640 1 -- 172.21.15.89:0/207516814 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a9ba0 con 0x7f9a24004d10 2023-12-07T10:01:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a42b65640 1 -- 172.21.15.89:0/207516814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24004d10 msgr2=0x7f9a24005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a42b65640 1 --2- 172.21.15.89:0/207516814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a24004d10 0x7f9a24005190 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0a8920 tx=0x7f9a3401c8a0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a41102640 1 -- 172.21.15.89:0/207516814 reap_dead start 2023-12-07T10:01:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a42b65640 1 -- 172.21.15.89:0/207516814 shutdown_connections 2023-12-07T10:01:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a42b65640 1 -- 172.21.15.89:0/207516814 >> 172.21.15.89:0/207516814 conn(0x7f9a3c0c2ad0 msgr2=0x7f9a3c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:31.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a42b65640 1 -- 172.21.15.89:0/207516814 shutdown_connections 2023-12-07T10:01:31.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.496+0000 7f9a42b65640 1 -- 172.21.15.89:0/207516814 wait complete. 2023-12-07T10:01:31.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 Processor -- start 2023-12-07T10:01:31.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 -- start start 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a24004d10 0x7f9a3c0aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 0x7f9a3c146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c0a9e60 0x7f9a3c1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c14c5e0 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0ac1c0 con 0x7f9a24004d10 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c4cd0 con 0x7f9a3c0a9e60 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 0x7f9a3c146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 0x7f9a3c146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36634/0 (socket says 172.21.15.89:36634) 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 -- 172.21.15.89:0/2894274226 learned_addr learned my addr 172.21.15.89:0/2894274226 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a40901640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a24004d10 0x7f9a3c0aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a41102640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c0a9e60 0x7f9a3c1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 -- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c0a9e60 msgr2=0x7f9a3c1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c0a9e60 0x7f9a3c1473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 -- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a24004d10 msgr2=0x7f9a3c0aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a24004d10 0x7f9a3c0aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 -- 172.21.15.89:0/2894274226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0c4fb0 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a40901640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a24004d10 0x7f9a3c0aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a33fff640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 0x7f9a3c146e60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c011970 tx=0x7f9a2c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c004240 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c0043a0 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c14c200 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00fb00 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.500+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c0aae80 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.504+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c067a40 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.504+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9a2c00fc60 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.504+0000 7f9a317fa640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a28066900 0x7f9a28068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.504+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9a2c084e90 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.504+0000 7f9a40901640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a28066900 0x7f9a28068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.504+0000 7f9a40901640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a28066900 0x7f9a28068dc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9a38001ec0 tx=0x7f9a38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.508+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a2c051d60 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.688+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9a3c06e230 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.695 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T10:01:31.692+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T10:01:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.692+0000 7f9a317fa640 1 -- 172.21.15.89:0/2894274226 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9a2c023090 con 0x7f9a3c0c3bc0 2023-12-07T10:01:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T10:01:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a28066900 msgr2=0x7f9a28068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a28066900 0x7f9a28068dc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9a38001ec0 tx=0x7f9a38009040 comp rx=0 tx=0).stop 2023-12-07T10:01:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 msgr2=0x7f9a3c146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 0x7f9a3c146e60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c011970 tx=0x7f9a2c011e30 comp rx=0 tx=0).stop 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 shutdown_connections 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9a28066900 0x7f9a28068dc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a3c0a9e60 0x7f9a3c1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3c0c3bc0 0x7f9a3c146e60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 --2- 172.21.15.89:0/2894274226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a24004d10 0x7f9a3c0aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 >> 172.21.15.89:0/2894274226 conn(0x7f9a3c0c2ad0 msgr2=0x7f9a3c14b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 shutdown_connections 2023-12-07T10:01:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.696+0000 7f9a42b65640 1 -- 172.21.15.89:0/2894274226 wait complete. 2023-12-07T10:01:31.708 INFO:tasks.ceph.mds.c.smithi089.stderr: -2863> 2023-12-07T10:00:59.812+0000 7f0b772f7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:01:31.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-07T10:01:31.756 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-12-07T10:01:31.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 Processor -- start 2023-12-07T10:01:31.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 -- start start 2023-12-07T10:01:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6aac154000 0x7f6aac1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac154920 con 0x7f6aac06df30 2023-12-07T10:01:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac0a8710 con 0x7f6aac154000 2023-12-07T10:01:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6ab2101640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac071be0 con 0x7f6aac0700f0 2023-12-07T10:01:31.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aabfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6aac06df30 0x7f6aac0714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49362/0 (socket says 172.21.15.89:49362) 2023-12-07T10:01:31.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aabfff640 1 -- 172.21.15.89:0/210133090 learned_addr learned my addr 172.21.15.89:0/210133090 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:31.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aab7fe640 1 --2- 172.21.15.89:0/210133090 >> v2:172.21.15.97:3300/0 conn(0x7f6aac154000 0x7f6aac1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aaaffd640 1 --2- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aaa7fc640 1 -- 172.21.15.89:0/210133090 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748627399 0 0) 0x7f6aac154920 con 0x7f6aac06df30 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aaa7fc640 1 -- 172.21.15.89:0/210133090 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a94003530 con 0x7f6aac06df30 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aab7fe640 1 -- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 msgr2=0x7f6aac070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aab7fe640 1 --2- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aab7fe640 1 -- 172.21.15.89:0/210133090 >> v1:172.21.15.89:6789/0 conn(0x7f6aac06df30 legacy=0x7f6aac0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aaa7fc640 1 -- 172.21.15.89:0/210133090 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540310324 0 0) 0x7f6a94003530 con 0x7f6aac06df30 2023-12-07T10:01:31.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.860+0000 7f6aab7fe640 1 -- 172.21.15.89:0/210133090 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac154b90 con 0x7f6aac154000 2023-12-07T10:01:31.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6aab7fe640 1 --2- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 0x7f6aac1543e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0097c0 tx=0x7f6a9c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe9a08586afcac8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6aaa7fc640 1 -- 172.21.15.89:0/210133090 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0ab600 con 0x7f6aac154000 2023-12-07T10:01:31.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6aaa7fc640 1 -- 172.21.15.89:0/210133090 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c0a7050 con 0x7f6aac154000 2023-12-07T10:01:31.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6aaa7fc640 1 -- 172.21.15.89:0/210133090 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0ab980 con 0x7f6aac154000 2023-12-07T10:01:31.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 -- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 msgr2=0x7f6aac1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 --2- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 0x7f6aac1543e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0097c0 tx=0x7f6a9c01c360 comp rx=0 tx=0).stop 2023-12-07T10:01:31.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 -- 172.21.15.89:0/210133090 shutdown_connections 2023-12-07T10:01:31.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 --2- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 --2- 172.21.15.89:0/210133090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 0x7f6aac1543e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 -- 172.21.15.89:0/210133090 >> 172.21.15.89:0/210133090 conn(0x7f6aac0c2a60 msgr2=0x7f6aac0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:31.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 -- 172.21.15.89:0/210133090 shutdown_connections 2023-12-07T10:01:31.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.864+0000 7f6ab2101640 1 -- 172.21.15.89:0/210133090 wait complete. 2023-12-07T10:01:31.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 Processor -- start 2023-12-07T10:01:31.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- start start 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 0x7f6aac14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 0x7f6aac150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac14f840 con 0x7f6aac06df30 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac1f04b0 con 0x7f6aac154000 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac1ed400 con 0x7f6aac0700f0 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 0x7f6aac14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 0x7f6aac14eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36652/0 (socket says 172.21.15.89:36652) 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 -- 172.21.15.89:0/800667841 learned_addr learned my addr 172.21.15.89:0/800667841 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 -- 172.21.15.89:0/800667841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 msgr2=0x7f6aac0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 -- 172.21.15.89:0/800667841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 msgr2=0x7f6aac150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:31.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 0x7f6aac150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 -- 172.21.15.89:0/800667841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009420 con 0x7f6aac06df30 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6aab7fe640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 0x7f6aac14eae0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ae040 tx=0x7f6a9c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0abea0 con 0x7f6aac06df30 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c0b7450 con 0x7f6aac06df30 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac1ed6e0 con 0x7f6aac06df30 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0b7800 con 0x7f6aac06df30 2023-12-07T10:01:31.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac1edca0 con 0x7f6aac06df30 2023-12-07T10:01:31.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.868+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aac1ede90 con 0x7f6aac06df30 2023-12-07T10:01:31.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.872+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6a9c0b7960 con 0x7f6aac06df30 2023-12-07T10:01:31.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.872+0000 7f6a93fff640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6a980668d0 0x7f6a98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:31.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.872+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f6a9c11ed00 con 0x7f6aac06df30 2023-12-07T10:01:31.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.872+0000 7f6aaaffd640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6a980668d0 0x7f6a98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:31.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.872+0000 7f6aaaffd640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6a980668d0 0x7f6a98068d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0006aa0 tx=0x7f6aa0006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:31.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:31.876+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a9c0ebc00 con 0x7f6aac06df30 2023-12-07T10:01:32.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.056+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6aac1f0620 con 0x7f6aac06df30 2023-12-07T10:01:32.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6a93fff640 1 -- 172.21.15.89:0/800667841 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a9c0bb0a0 con 0x7f6aac06df30 2023-12-07T10:01:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6a980668d0 msgr2=0x7f6a98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6a980668d0 0x7f6a98068d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0006aa0 tx=0x7f6aa0006a30 comp rx=0 tx=0).stop 2023-12-07T10:01:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 msgr2=0x7f6aac14eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 0x7f6aac14eae0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ae040 tx=0x7f6a9c01aba0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 shutdown_connections 2023-12-07T10:01:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aac154000 0x7f6aac150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6a980668d0 0x7f6a98068d90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6aac0700f0 0x7f6aac0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 --2- 172.21.15.89:0/800667841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac06df30 0x7f6aac14eae0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 >> 172.21.15.89:0/800667841 conn(0x7f6aac0c2a60 msgr2=0x7f6aac14cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 shutdown_connections 2023-12-07T10:01:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.696+0000 7f6ab2101640 1 -- 172.21.15.89:0/800667841 wait complete. 2023-12-07T10:01:32.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-07T10:01:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 Processor -- start 2023-12-07T10:01:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 -- start start 2023-12-07T10:01:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c0c1410 0x7f656c154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f656c0bf860 0x7f656c155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c154840 con 0x7f656c072800 2023-12-07T10:01:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c0c2840 con 0x7f656c0bf860 2023-12-07T10:01:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f6571957640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c072be0 con 0x7f656c0c1410 2023-12-07T10:01:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.904+0000 7f656b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f656c0bf860 0x7f656c155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f656c0bf860 0x7f656c155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36654/0 (socket says 172.21.15.89:36654) 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 -- 172.21.15.89:0/3562704960 learned_addr learned my addr 172.21.15.89:0/3562704960 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f65627fc640 1 --2- 172.21.15.89:0/3562704960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c0c1410 0x7f656c154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656affd640 1 --1- 172.21.15.89:0/3562704960 >> v1:172.21.15.97:6789/0 conn(0x7f656c072800 0x7f656c0c1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:34790/0 (socket says 172.21.15.89:34790) 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 -- 172.21.15.89:0/3562704960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c0c1410 msgr2=0x7f656c154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 --2- 172.21.15.89:0/3562704960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c0c1410 0x7f656c154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 -- 172.21.15.89:0/3562704960 >> v1:172.21.15.97:6789/0 conn(0x7f656c072800 legacy=0x7f656c0c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 -- 172.21.15.89:0/3562704960 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0bfd60 con 0x7f656c0bf860 2023-12-07T10:01:32.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656b7fe640 1 --2- 172.21.15.89:0/3562704960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c155210 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6564009870 tx=0x7f656401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7f1045360f5a0f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:32.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656a7fc640 1 -- 172.21.15.89:0/3562704960 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65640ab680 con 0x7f656c0bf860 2023-12-07T10:01:32.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656a7fc640 1 -- 172.21.15.89:0/3562704960 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65640ab7e0 con 0x7f656c0bf860 2023-12-07T10:01:32.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.908+0000 7f656a7fc640 1 -- 172.21.15.89:0/3562704960 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65640abb70 con 0x7f656c0bf860 2023-12-07T10:01:32.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- 172.21.15.89:0/3562704960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 msgr2=0x7f656c155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 --2- 172.21.15.89:0/3562704960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c155210 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6564009870 tx=0x7f656401c480 comp rx=0 tx=0).stop 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- 172.21.15.89:0/3562704960 shutdown_connections 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 --2- 172.21.15.89:0/3562704960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c155210 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 --2- 172.21.15.89:0/3562704960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c0c1410 0x7f656c154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- 172.21.15.89:0/3562704960 >> 172.21.15.89:0/3562704960 conn(0x7f656c0c6830 msgr2=0x7f656c0c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- 172.21.15.89:0/3562704960 shutdown_connections 2023-12-07T10:01:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- 172.21.15.89:0/3562704960 wait complete. 2023-12-07T10:01:32.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 Processor -- start 2023-12-07T10:01:32.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- start start 2023-12-07T10:01:32.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c072800 0x7f656c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:32.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:32.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f656c0c1410 0x7f656c14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:32.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0a9b40 con 0x7f656c0bf860 2023-12-07T10:01:32.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c1ed5c0 con 0x7f656c0c1410 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f6571957640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0a96b0 con 0x7f656c072800 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c14b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36666/0 (socket says 172.21.15.89:36666) 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 -- 172.21.15.89:0/1975313446 learned_addr learned my addr 172.21.15.89:0/1975313446 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f656affd640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c072800 0x7f656c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f656b7fe640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f656c0c1410 0x7f656c14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 -- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c072800 msgr2=0x7f656c14c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c072800 0x7f656c14c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 -- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f656c0c1410 msgr2=0x7f656c14bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f656c0c1410 0x7f656c14bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:32.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.912+0000 7f65627fc640 1 -- 172.21.15.89:0/1975313446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640094d0 con 0x7f656c0bf860 2023-12-07T10:01:32.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f65627fc640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c14b6a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f655400e840 tx=0x7f655400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:32.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554009510 con 0x7f656c0bf860 2023-12-07T10:01:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400ee90 con 0x7f656c0bf860 2023-12-07T10:01:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c1edad0 con 0x7f656c0bf860 2023-12-07T10:01:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400cb80 con 0x7f656c0bf860 2023-12-07T10:01:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c0a9340 con 0x7f656c0bf860 2023-12-07T10:01:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c0a9820 con 0x7f656c0bf860 2023-12-07T10:01:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f655400cce0 con 0x7f656c0bf860 2023-12-07T10:01:32.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6568ff9640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f654c0668d0 0x7f654c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:32.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f6554084920 con 0x7f656c0bf860 2023-12-07T10:01:32.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.916+0000 7f656affd640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f654c0668d0 0x7f654c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:32.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.920+0000 7f656affd640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f654c0668d0 0x7f654c068d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f655c005fd0 tx=0x7f655c005ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:32.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:32.920+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65540517a0 con 0x7f656c0bf860 2023-12-07T10:01:33.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.076+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f656c04e890 con 0x7f656c0bf860 2023-12-07T10:01:33.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6568ff9640 1 -- 172.21.15.89:0/1975313446 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6554054dc0 con 0x7f656c0bf860 2023-12-07T10:01:33.703 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f654c0668d0 msgr2=0x7f654c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f654c0668d0 0x7f654c068d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f655c005fd0 tx=0x7f655c005ba0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 msgr2=0x7f656c14b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c14b6a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f655400e840 tx=0x7f655400ec40 comp rx=0 tx=0).stop 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 shutdown_connections 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f656c0c1410 0x7f656c14bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f656c0bf860 0x7f656c14b6a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f654c0668d0 0x7f654c068d90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 --2- 172.21.15.89:0/1975313446 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f656c072800 0x7f656c14c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 >> 172.21.15.89:0/1975313446 conn(0x7f656c0c6830 msgr2=0x7f656c154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:33.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 shutdown_connections 2023-12-07T10:01:33.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.700+0000 7f6571957640 1 -- 172.21.15.89:0/1975313446 wait complete. 2023-12-07T10:01:33.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-07T10:01:33.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 Processor -- start 2023-12-07T10:01:33.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 -- start start 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ac8154ea0 0x7f1ac8155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ac806b0c0 0x7f1ac814e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac8070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac81557c0 con 0x7f1ac8154ea0 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac81559d0 con 0x7f1ac806b0c0 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1acdfdf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac806d910 con 0x7f1ac814edc0 2023-12-07T10:01:33.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1ac77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ac8154ea0 0x7f1ac8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1ac77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ac8154ea0 0x7f1ac8155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36668/0 (socket says 172.21.15.89:36668) 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.876+0000 7f1ac77fe640 1 -- 172.21.15.89:0/2153467061 learned_addr learned my addr 172.21.15.89:0/2153467061 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac7fff640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1abffff640 1 --2- 172.21.15.89:0/2153467061 >> v2:172.21.15.97:3300/0 conn(0x7f1ac806b0c0 0x7f1ac814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac77fe640 1 -- 172.21.15.89:0/2153467061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 msgr2=0x7f1ac8070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac8070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac77fe640 1 -- 172.21.15.89:0/2153467061 >> v2:172.21.15.97:3300/0 conn(0x7f1ac806b0c0 msgr2=0x7f1ac814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:33.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2153467061 >> v2:172.21.15.97:3300/0 conn(0x7f1ac806b0c0 0x7f1ac814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac77fe640 1 -- 172.21.15.89:0/2153467061 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80c1230 con 0x7f1ac8154ea0 2023-12-07T10:01:33.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac7fff640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac8070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:33.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac8155280 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1ac806e3e0 tx=0x7f1ab801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624cb367a9fb7f7e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:33.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac6ffd640 1 -- 172.21.15.89:0/2153467061 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80ab600 con 0x7f1ac8154ea0 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac6ffd640 1 -- 172.21.15.89:0/2153467061 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab80a7050 con 0x7f1ac8154ea0 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.880+0000 7f1ac6ffd640 1 -- 172.21.15.89:0/2153467061 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80ab980 con 0x7f1ac8154ea0 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2153467061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 msgr2=0x7f1ac8155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac8155280 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1ac806e3e0 tx=0x7f1ab801c3b0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2153467061 shutdown_connections 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac8070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2153467061 >> v2:172.21.15.97:3300/0 conn(0x7f1ac806b0c0 0x7f1ac814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2153467061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac8155280 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2153467061 >> 172.21.15.89:0/2153467061 conn(0x7f1ac806a5a0 msgr2=0x7f1ac806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:33.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2153467061 shutdown_connections 2023-12-07T10:01:33.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2153467061 wait complete. 2023-12-07T10:01:33.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 Processor -- start 2023-12-07T10:01:33.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- start start 2023-12-07T10:01:33.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ac806b0c0 0x7f1ac814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac8151430 con 0x7f1ac8154ea0 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81ee330 con 0x7f1ac806b0c0 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1acdfdf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80c4560 con 0x7f1ac814edc0 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac814f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36680/0 (socket says 172.21.15.89:36680) 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 -- 172.21.15.89:0/2521272550 learned_addr learned my addr 172.21.15.89:0/2521272550 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ac806b0c0 0x7f1ac814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1abffff640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 -- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 msgr2=0x7f1ac814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 -- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ac806b0c0 msgr2=0x7f1ac814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ac806b0c0 0x7f1ac814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 -- 172.21.15.89:0/2521272550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80094d0 con 0x7f1ac8154ea0 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ac806b0c0 0x7f1ac814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.884+0000 7f1ac7fff640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac814f9b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000cef0 tx=0x7f1ac000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000d840 con 0x7f1ac8154ea0 2023-12-07T10:01:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac000d9c0 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000dd70 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac81ee5d0 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac80c4040 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac80a98e0 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1ac001e3b0 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac4ff9640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1aa80668d0 0x7f1aa8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f1ac0084f90 con 0x7f1ac8154ea0 2023-12-07T10:01:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1aa80668d0 0x7f1aa8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:33.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.888+0000 7f1ac77fe640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1aa80668d0 0x7f1aa8068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80ad000 tx=0x7f1ab8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:33.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:33.892+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ac00b6280 con 0x7f1ac8154ea0 2023-12-07T10:01:34.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.044+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1ac806dd80 con 0x7f1ac8154ea0 2023-12-07T10:01:34.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.700+0000 7f1ac4ff9640 1 -- 172.21.15.89:0/2521272550 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1ac806dd80 con 0x7f1ac8154ea0 2023-12-07T10:01:34.706 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2023-12-07T10:01:34.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1aa80668d0 msgr2=0x7f1aa8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:34.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1aa80668d0 0x7f1aa8068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80ad000 tx=0x7f1ab8008040 comp rx=0 tx=0).stop 2023-12-07T10:01:34.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 msgr2=0x7f1ac814f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:34.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac814f9b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000cef0 tx=0x7f1ac000a710 comp rx=0 tx=0).stop 2023-12-07T10:01:34.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 shutdown_connections 2023-12-07T10:01:34.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ac8154ea0 0x7f1ac814f9b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1aa80668d0 0x7f1aa8068d90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ac814edc0 0x7f1ac814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 --2- 172.21.15.89:0/2521272550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ac806b0c0 0x7f1ac814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 >> 172.21.15.89:0/2521272550 conn(0x7f1ac806a5a0 msgr2=0x7f1ac806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:34.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 shutdown_connections 2023-12-07T10:01:34.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.704+0000 7f1acdfdf640 1 -- 172.21.15.89:0/2521272550 wait complete. 2023-12-07T10:01:34.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:34.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.876+0000 7f7a7e18d640 1 Processor -- start 2023-12-07T10:01:34.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.876+0000 7f7a7e18d640 1 -- start start 2023-12-07T10:01:34.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a7e18d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7a780aacd0 0x7f7a78154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:34.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a7e18d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:34.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a7e18d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a78072780 con 0x7f7a780700a0 2023-12-07T10:01:34.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a7e18d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a780ac160 con 0x7f7a780aacd0 2023-12-07T10:01:34.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a7e18d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780abe80 con 0x7f7a780ab7a0 2023-12-07T10:01:34.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a77fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:34.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7a780aacd0 0x7f7a78154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:34.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7a780aacd0 0x7f7a78154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:34158/0 (socket says 172.21.15.89:34158) 2023-12-07T10:01:34.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 -- 172.21.15.89:0/3342846460 learned_addr learned my addr 172.21.15.89:0/3342846460 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:34.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 -- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 msgr2=0x7f7a781546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:34.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 --2- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 -- 172.21.15.89:0/3342846460 >> v1:172.21.15.97:6789/0 conn(0x7f7a780700a0 legacy=0x7f7a7806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:34.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.880+0000 7f7a777fe640 1 -- 172.21.15.89:0/3342846460 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78154cf0 con 0x7f7a780aacd0 2023-12-07T10:01:34.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a777fe640 1 --2- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a78154160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009870 tx=0x7f7a6801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51a18cf3c3d4f4dd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:34.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a767fc640 1 -- 172.21.15.89:0/3342846460 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680ab600 con 0x7f7a780aacd0 2023-12-07T10:01:34.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a767fc640 1 -- 172.21.15.89:0/3342846460 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680a7050 con 0x7f7a780aacd0 2023-12-07T10:01:34.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a767fc640 1 -- 172.21.15.89:0/3342846460 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680ab980 con 0x7f7a780aacd0 2023-12-07T10:01:34.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 -- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 msgr2=0x7f7a78154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a78154160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009870 tx=0x7f7a6801c480 comp rx=0 tx=0).stop 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 -- 172.21.15.89:0/3342846460 shutdown_connections 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/3342846460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a78154160 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 -- 172.21.15.89:0/3342846460 >> 172.21.15.89:0/3342846460 conn(0x7f7a780c2ad0 msgr2=0x7f7a780c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 -- 172.21.15.89:0/3342846460 shutdown_connections 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 -- 172.21.15.89:0/3342846460 wait complete. 2023-12-07T10:01:34.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.884+0000 7f7a7e18d640 1 Processor -- start 2023-12-07T10:01:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- start start 2023-12-07T10:01:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 0x7f7a7814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a781ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781ed280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7814a8a0 con 0x7f7a780700a0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781ec8b0 con 0x7f7a780aacd0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7814c750 con 0x7f7a780ab7a0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 0x7f7a7814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 0x7f7a7814d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36688/0 (socket says 172.21.15.89:36688) 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 -- 172.21.15.89:0/416703293 learned_addr learned my addr 172.21.15.89:0/416703293 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a77fff640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a76ffd640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a781ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 -- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 msgr2=0x7f7a781ed280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781ed280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 -- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 msgr2=0x7f7a781ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a781ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 -- 172.21.15.89:0/416703293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680094d0 con 0x7f7a780700a0 2023-12-07T10:01:34.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a777fe640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 0x7f7a7814d950 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7a6801a0b0 tx=0x7f7a68019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680b5400 con 0x7f7a780700a0 2023-12-07T10:01:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680b5560 con 0x7f7a780700a0 2023-12-07T10:01:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7814ca30 con 0x7f7a780700a0 2023-12-07T10:01:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680b58f0 con 0x7f7a780700a0 2023-12-07T10:01:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a781ec540 con 0x7f7a780700a0 2023-12-07T10:01:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.888+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a780c2350 con 0x7f7a780700a0 2023-12-07T10:01:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.892+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7a680b5a50 con 0x7f7a780700a0 2023-12-07T10:01:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.892+0000 7f7a5ffff640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7a640668d0 0x7f7a64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.892+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7a6811dc50 con 0x7f7a780700a0 2023-12-07T10:01:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.892+0000 7f7a76ffd640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7a640668d0 0x7f7a64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.892+0000 7f7a76ffd640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7a640668d0 0x7f7a64068d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7a781e8e70 tx=0x7f7a6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:34.896+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a680eaee0 con 0x7f7a780700a0 2023-12-07T10:01:35.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.048+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a7804e890 con 0x7f7a780700a0 2023-12-07T10:01:35.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.052+0000 7f7a5ffff640 1 -- 172.21.15.89:0/416703293 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16639 (secure 0 0 0) 0x7f7a680ee500 con 0x7f7a780700a0 2023-12-07T10:01:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:35.058 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":56,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:34.701550+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6837/416367230":"2023-12-08T10:01:31.693467+0000","172.21.15.89:6835/416367230":"2023-12-08T10:01:31.693467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:35.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7a640668d0 msgr2=0x7f7a64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7a640668d0 0x7f7a64068d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7a781e8e70 tx=0x7f7a6c009040 comp rx=0 tx=0).stop 2023-12-07T10:01:35.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 msgr2=0x7f7a7814d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 0x7f7a7814d950 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7a6801a0b0 tx=0x7f7a68019220 comp rx=0 tx=0).stop 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 shutdown_connections 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7a640668d0 0x7f7a64068d90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7a780ab7a0 0x7f7a781ed280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a780aacd0 0x7f7a781ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 --2- 172.21.15.89:0/416703293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a780700a0 0x7f7a7814d950 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 >> 172.21.15.89:0/416703293 conn(0x7f7a780c2ad0 msgr2=0x7f7a780c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:35.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 shutdown_connections 2023-12-07T10:01:35.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.056+0000 7f7a7e18d640 1 -- 172.21.15.89:0/416703293 wait complete. 2023-12-07T10:01:35.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:01:04.139867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:01:05.289028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:35.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:35.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.220+0000 7f6c448fe640 1 Processor -- start 2023-12-07T10:01:35.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.220+0000 7f6c448fe640 1 -- start start 2023-12-07T10:01:35.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c448fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c400a86d0 0x7f6c400a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c448fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c40156600 0x7f6c4014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c448fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c40152d90 con 0x7f6c4014fb30 2023-12-07T10:01:35.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c448fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4014ffa0 con 0x7f6c40156600 2023-12-07T10:01:35.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c448fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c40152480 con 0x7f6c400a86d0 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c35d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c40156600 0x7f6c4014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c3ed9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6c4014fb30 0x7f6c400aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49370/0 (socket says 172.21.15.89:49370) 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c3ed9d640 1 -- 172.21.15.89:0/1081581306 learned_addr learned my addr 172.21.15.89:0/1081581306 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c3e59c640 1 --2- 172.21.15.89:0/1081581306 >> v2:172.21.15.97:3300/0 conn(0x7f6c400a86d0 0x7f6c400a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c35d9b640 1 -- 172.21.15.89:0/1081581306 >> v2:172.21.15.97:3300/0 conn(0x7f6c400a86d0 msgr2=0x7f6c400a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c35d9b640 1 --2- 172.21.15.89:0/1081581306 >> v2:172.21.15.97:3300/0 conn(0x7f6c400a86d0 0x7f6c400a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c35d9b640 1 -- 172.21.15.89:0/1081581306 >> v1:172.21.15.89:6789/0 conn(0x7f6c4014fb30 legacy=0x7f6c400aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c35d9b640 1 -- 172.21.15.89:0/1081581306 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400a9760 con 0x7f6c40156600 2023-12-07T10:01:35.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.224+0000 7f6c3dd9b640 1 -- 172.21.15.89:0/1081581306 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777390808 0 0) 0x7f6c40152d90 con 0x7f6c4014fb30 2023-12-07T10:01:35.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c35d9b640 1 --2- 172.21.15.89:0/1081581306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014f5f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097c0 tx=0x7f6c2801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3566a842f7c9b3b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c3dd9b640 1 -- 172.21.15.89:0/1081581306 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280ab600 con 0x7f6c40156600 2023-12-07T10:01:35.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c3dd9b640 1 -- 172.21.15.89:0/1081581306 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c280a7050 con 0x7f6c40156600 2023-12-07T10:01:35.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c3dd9b640 1 -- 172.21.15.89:0/1081581306 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280ab980 con 0x7f6c40156600 2023-12-07T10:01:35.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 -- 172.21.15.89:0/1081581306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 msgr2=0x7f6c4014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 --2- 172.21.15.89:0/1081581306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014f5f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097c0 tx=0x7f6c2801c440 comp rx=0 tx=0).stop 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 -- 172.21.15.89:0/1081581306 shutdown_connections 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 --2- 172.21.15.89:0/1081581306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014f5f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 --2- 172.21.15.89:0/1081581306 >> v2:172.21.15.97:3300/0 conn(0x7f6c400a86d0 0x7f6c400a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 -- 172.21.15.89:0/1081581306 >> 172.21.15.89:0/1081581306 conn(0x7f6c400c2a60 msgr2=0x7f6c400c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 -- 172.21.15.89:0/1081581306 shutdown_connections 2023-12-07T10:01:35.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 -- 172.21.15.89:0/1081581306 wait complete. 2023-12-07T10:01:35.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 Processor -- start 2023-12-07T10:01:35.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.228+0000 7f6c448fe640 1 -- start start 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c400a86d0 0x7f6c401ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4014fb30 0x7f6c401487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40149a10 con 0x7f6c40156600 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c401464f0 con 0x7f6c4014fb30 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c401467d0 con 0x7f6c400a86d0 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36714/0 (socket says 172.21.15.89:36714) 2023-12-07T10:01:35.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 -- 172.21.15.89:0/2957913141 learned_addr learned my addr 172.21.15.89:0/2957913141 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3e59c640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c400a86d0 0x7f6c401ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c35d9b640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4014fb30 0x7f6c401487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 -- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c400a86d0 msgr2=0x7f6c401ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c400a86d0 0x7f6c401ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 -- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4014fb30 msgr2=0x7f6c401487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4014fb30 0x7f6c401487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 -- 172.21.15.89:0/2957913141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28009420 con 0x7f6c40156600 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c3ed9d640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014a830 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6c38001570 tx=0x7f6c3800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800a640 con 0x7f6c40156600 2023-12-07T10:01:35.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3800a7c0 con 0x7f6c40156600 2023-12-07T10:01:35.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c40146ab0 con 0x7f6c40156600 2023-12-07T10:01:35.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800ab70 con 0x7f6c40156600 2023-12-07T10:01:35.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c40147070 con 0x7f6c40156600 2023-12-07T10:01:35.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c40147260 con 0x7f6c40156600 2023-12-07T10:01:35.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.232+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c3800acd0 con 0x7f6c40156600 2023-12-07T10:01:35.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.236+0000 7f6c377fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c20066900 0x7f6c20068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.236+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6c38083bd0 con 0x7f6c40156600 2023-12-07T10:01:35.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.236+0000 7f6c3e59c640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c20066900 0x7f6c20068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.236+0000 7f6c3e59c640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c20066900 0x7f6c20068dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6c300079c0 tx=0x7f6c30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.240+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c38050e50 con 0x7f6c40156600 2023-12-07T10:01:35.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.392+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c4004e890 con 0x7f6c40156600 2023-12-07T10:01:35.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.392+0000 7f6c377fe640 1 -- 172.21.15.89:0/2957913141 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c38018020 con 0x7f6c40156600 2023-12-07T10:01:35.398 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c20066900 msgr2=0x7f6c20068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c20066900 0x7f6c20068dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6c300079c0 tx=0x7f6c30008040 comp rx=0 tx=0).stop 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 msgr2=0x7f6c4014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014a830 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6c38001570 tx=0x7f6c3800cca0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 shutdown_connections 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c40156600 0x7f6c4014a830 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c4014fb30 0x7f6c401487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c20066900 0x7f6c20068dc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 --2- 172.21.15.89:0/2957913141 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c400a86d0 0x7f6c401ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 >> 172.21.15.89:0/2957913141 conn(0x7f6c400c2a60 msgr2=0x7f6c4006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 shutdown_connections 2023-12-07T10:01:35.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.396+0000 7f6c448fe640 1 -- 172.21.15.89:0/2957913141 wait complete. 2023-12-07T10:01:35.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:01:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.552+0000 7f65c5679640 1 Processor -- start 2023-12-07T10:01:35.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.552+0000 7f65c5679640 1 -- start start 2023-12-07T10:01:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65c5679640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65c0158a10 0x7f65c00c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65c5679640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65c0151bf0 0x7f65c0152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65c5679640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0158580 con 0x7f65c00c6220 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65c5679640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c0158e60 con 0x7f65c0158a10 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65c5679640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c0157f50 con 0x7f65c0151bf0 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65beffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f65c00c6220 0x7f65c00c13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49386/0 (socket says 172.21.15.89:49386) 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65beffd640 1 -- 172.21.15.89:0/1307236524 learned_addr learned my addr 172.21.15.89:0/1307236524 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65b67fc640 1 --2- 172.21.15.89:0/1307236524 >> v2:172.21.15.89:3300/0 conn(0x7f65c0158a10 0x7f65c00c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65bf7fe640 1 --2- 172.21.15.89:0/1307236524 >> v2:172.21.15.97:3300/0 conn(0x7f65c0151bf0 0x7f65c0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65b67fc640 1 -- 172.21.15.89:0/1307236524 >> v2:172.21.15.97:3300/0 conn(0x7f65c0151bf0 msgr2=0x7f65c0152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:35.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65b67fc640 1 --2- 172.21.15.89:0/1307236524 >> v2:172.21.15.97:3300/0 conn(0x7f65c0151bf0 0x7f65c0152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65b67fc640 1 -- 172.21.15.89:0/1307236524 >> v1:172.21.15.89:6789/0 conn(0x7f65c00c6220 legacy=0x7f65c00c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65be7fc640 1 -- 172.21.15.89:0/1307236524 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449534976 0 0) 0x7f65c0158580 con 0x7f65c00c6220 2023-12-07T10:01:35.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65b67fc640 1 -- 172.21.15.89:0/1307236524 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00c1f60 con 0x7f65c0158a10 2023-12-07T10:01:35.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.556+0000 7f65b67fc640 1 --2- 172.21.15.89:0/1307236524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c00c28c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f65c006d950 tx=0x7f65a801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1c6782e92fbc6b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65be7fc640 1 -- 172.21.15.89:0/1307236524 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80ab610 con 0x7f65c0158a10 2023-12-07T10:01:35.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65be7fc640 1 -- 172.21.15.89:0/1307236524 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a80ab770 con 0x7f65c0158a10 2023-12-07T10:01:35.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65be7fc640 1 -- 172.21.15.89:0/1307236524 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80abb00 con 0x7f65c0158a10 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- 172.21.15.89:0/1307236524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 msgr2=0x7f65c00c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 --2- 172.21.15.89:0/1307236524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c00c28c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f65c006d950 tx=0x7f65a801c410 comp rx=0 tx=0).stop 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- 172.21.15.89:0/1307236524 shutdown_connections 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 --2- 172.21.15.89:0/1307236524 >> v2:172.21.15.97:3300/0 conn(0x7f65c0151bf0 0x7f65c0152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 --2- 172.21.15.89:0/1307236524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c00c28c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- 172.21.15.89:0/1307236524 >> 172.21.15.89:0/1307236524 conn(0x7f65c006a5a0 msgr2=0x7f65c006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- 172.21.15.89:0/1307236524 shutdown_connections 2023-12-07T10:01:35.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- 172.21.15.89:0/1307236524 wait complete. 2023-12-07T10:01:35.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 Processor -- start 2023-12-07T10:01:35.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- start start 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65c00c6220 0x7f65c00aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65c0151bf0 0x7f65c014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c0144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00aaab0 con 0x7f65c0158a10 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c014e490 con 0x7f65c0151bf0 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65c5679640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0157d70 con 0x7f65c00c6220 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65bf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c0144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65bf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c0144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36740/0 (socket says 172.21.15.89:36740) 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65bf7fe640 1 -- 172.21.15.89:0/2890689226 learned_addr learned my addr 172.21.15.89:0/2890689226 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65beffd640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65c00c6220 0x7f65c00aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.560+0000 7f65b67fc640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65c0151bf0 0x7f65c014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65bf7fe640 1 -- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65c00c6220 msgr2=0x7f65c00aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65bf7fe640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65c00c6220 0x7f65c00aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65bf7fe640 1 -- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65c0151bf0 msgr2=0x7f65c014df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65bf7fe640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65c0151bf0 0x7f65c014df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65bf7fe640 1 -- 172.21.15.89:0/2890689226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80093b0 con 0x7f65c0158a10 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65beffd640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65c00c6220 0x7f65c00aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65b67fc640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65c0151bf0 0x7f65c014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65bf7fe640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c0144ba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f65b800e930 tx=0x7f65b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b80096b0 con 0x7f65c0158a10 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b800c9a0 con 0x7f65c0158a10 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c0157a90 con 0x7f65c0158a10 2023-12-07T10:01:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800cd30 con 0x7f65c0158a10 2023-12-07T10:01:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c01ed7e0 con 0x7f65c0158a10 2023-12-07T10:01:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c004e890 con 0x7f65c0158a10 2023-12-07T10:01:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f65b8013470 con 0x7f65c0158a10 2023-12-07T10:01:35.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.564+0000 7f65b7fff640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65a00668d0 0x7f65a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.568+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f65b8084700 con 0x7f65c0158a10 2023-12-07T10:01:35.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.568+0000 7f65beffd640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65a00668d0 0x7f65a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.568+0000 7f65beffd640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65a00668d0 0x7f65a0068d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65b00012f0 tx=0x7f65b0005b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.572+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65b8051990 con 0x7f65c0158a10 2023-12-07T10:01:35.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65c006f2e0 con 0x7f65c0158a10 2023-12-07T10:01:35.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65b7fff640 1 -- 172.21.15.89:0/2890689226 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7f65b8054fb0 con 0x7f65c0158a10 2023-12-07T10:01:35.725 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:01:35.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65a00668d0 msgr2=0x7f65a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65a00668d0 0x7f65a0068d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65b00012f0 tx=0x7f65b0005b80 comp rx=0 tx=0).stop 2023-12-07T10:01:35.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 msgr2=0x7f65c0144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c0144ba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f65b800e930 tx=0x7f65b800edf0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 shutdown_connections 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65c0158a10 0x7f65c0144ba0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65c0151bf0 0x7f65c014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f65a00668d0 0x7f65a0068d90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.720+0000 7f65c5679640 1 --2- 172.21.15.89:0/2890689226 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65c00c6220 0x7f65c00aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.724+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 >> 172.21.15.89:0/2890689226 conn(0x7f65c006a5a0 msgr2=0x7f65c0150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.724+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 shutdown_connections 2023-12-07T10:01:35.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.724+0000 7f65c5679640 1 -- 172.21.15.89:0/2890689226 wait complete. 2023-12-07T10:01:35.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:01:35.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 Processor -- start 2023-12-07T10:01:35.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 -- start start 2023-12-07T10:01:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc2e0151d80 0x7fc2e00c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2e00c8430 0x7fc2e006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e006cf70 con 0x7fc2e00c8430 2023-12-07T10:01:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e0152160 con 0x7fc2e0151d80 2023-12-07T10:01:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.880+0000 7fc2e5757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00c6a30 con 0x7fc2e00c7f20 2023-12-07T10:01:35.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2e00c8430 0x7fc2e006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2e00c8430 0x7fc2e006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36742/0 (socket says 172.21.15.89:36742) 2023-12-07T10:01:35.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 -- 172.21.15.89:0/3546307071 learned_addr learned my addr 172.21.15.89:0/3546307071 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:35.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 -- 172.21.15.89:0/3546307071 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 msgr2=0x7fc2e006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:35.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 --2- 172.21.15.89:0/3546307071 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 -- 172.21.15.89:0/3546307071 >> v2:172.21.15.97:3300/0 conn(0x7fc2e0151d80 msgr2=0x7fc2e00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:35.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 --2- 172.21.15.89:0/3546307071 >> v2:172.21.15.97:3300/0 conn(0x7fc2e0151d80 0x7fc2e00c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 -- 172.21.15.89:0/3546307071 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00c72d0 con 0x7fc2e00c8430 2023-12-07T10:01:35.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2d67fc640 1 --2- 172.21.15.89:0/3546307071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e006b720 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc2e008b3e0 tx=0x7fc2d001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d440f7c11992caff server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.884+0000 7fc2de7fc640 1 -- 172.21.15.89:0/3546307071 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00ab600 con 0x7fc2e00c8430 2023-12-07T10:01:35.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2de7fc640 1 -- 172.21.15.89:0/3546307071 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d00ab760 con 0x7fc2e00c8430 2023-12-07T10:01:35.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2de7fc640 1 -- 172.21.15.89:0/3546307071 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00abaf0 con 0x7fc2e00c8430 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- 172.21.15.89:0/3546307071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 msgr2=0x7fc2e006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- 172.21.15.89:0/3546307071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e006b720 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc2e008b3e0 tx=0x7fc2d001c440 comp rx=0 tx=0).stop 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- 172.21.15.89:0/3546307071 shutdown_connections 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- 172.21.15.89:0/3546307071 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- 172.21.15.89:0/3546307071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e006b720 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- 172.21.15.89:0/3546307071 >> v2:172.21.15.97:3300/0 conn(0x7fc2e0151d80 0x7fc2e00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- 172.21.15.89:0/3546307071 >> 172.21.15.89:0/3546307071 conn(0x7fc2e00abd00 msgr2=0x7fc2e00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- 172.21.15.89:0/3546307071 shutdown_connections 2023-12-07T10:01:35.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- 172.21.15.89:0/3546307071 wait complete. 2023-12-07T10:01:35.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 Processor -- start 2023-12-07T10:01:35.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- start start 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e00ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2e0151d80 0x7fc2e014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01edfd0 con 0x7fc2e00c8430 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01ee270 con 0x7fc2e0151d80 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2e5757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00af1e0 con 0x7fc2e00c7f20 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2d67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2d67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36752/0 (socket says 172.21.15.89:36752) 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2d67fc640 1 -- 172.21.15.89:0/1447019655 learned_addr learned my addr 172.21.15.89:0/1447019655 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2deffd640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e00ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.888+0000 7fc2df7fe640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2e0151d80 0x7fc2e014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d67fc640 1 -- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 msgr2=0x7fc2e00ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d67fc640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e00ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d67fc640 1 -- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2e0151d80 msgr2=0x7fc2e014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d67fc640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2e0151d80 0x7fc2e014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d67fc640 1 -- 172.21.15.89:0/1447019655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00094d0 con 0x7fc2e00c8430 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d67fc640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e014e730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc2d001aaf0 tx=0x7fc2d001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00b4800 con 0x7fc2e00c8430 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d00b4960 con 0x7fc2e00c8430 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00b4cd0 con 0x7fc2e00c8430 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e00af4c0 con 0x7fc2e00c8430 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00adbb0 con 0x7fc2e00c8430 2023-12-07T10:01:35.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e00af320 con 0x7fc2e00c8430 2023-12-07T10:01:35.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc2d00b3380 con 0x7fc2e00c8430 2023-12-07T10:01:35.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d7fff640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2c00668d0 0x7fc2c0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:35.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc2d011ec80 con 0x7fc2e00c8430 2023-12-07T10:01:35.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.892+0000 7fc2deffd640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2c00668d0 0x7fc2c0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:35.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.896+0000 7fc2deffd640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2c00668d0 0x7fc2c0068d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00c0560 tx=0x7fc2c8006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:35.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:35.896+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2e00af320 con 0x7fc2e00c8430 2023-12-07T10:01:36.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fc2e00af320 con 0x7fc2e00c8430 2023-12-07T10:01:36.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2d7fff640 1 -- 172.21.15.89:0/1447019655 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7fc2e00af320 con 0x7fc2e00c8430 2023-12-07T10:01:36.052 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2c00668d0 msgr2=0x7fc2c0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2c00668d0 0x7fc2c0068d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00c0560 tx=0x7fc2c8006f90 comp rx=0 tx=0).stop 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 msgr2=0x7fc2e014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e014e730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc2d001aaf0 tx=0x7fc2d001ac80 comp rx=0 tx=0).stop 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 shutdown_connections 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2e0151d80 0x7fc2e014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e00c8430 0x7fc2e014e730 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2c00668d0 0x7fc2c0068d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 --2- 172.21.15.89:0/1447019655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2e00c7f20 0x7fc2e00ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 >> 172.21.15.89:0/1447019655 conn(0x7fc2e00abd00 msgr2=0x7fc2e00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:36.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 shutdown_connections 2023-12-07T10:01:36.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.048+0000 7fc2e5757640 1 -- 172.21.15.89:0/1447019655 wait complete. 2023-12-07T10:01:36.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:36.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.204+0000 7f0c4466b640 1 Processor -- start 2023-12-07T10:01:36.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.204+0000 7f0c4466b640 1 -- start start 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c4466b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c3c0aacd0 0x7f0c3c154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c4466b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0700a0 0x7f0c3c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c4466b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0c3c0ab7a0 0x7f0c3c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c4466b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c072780 con 0x7f0c3c0aacd0 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c4466b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ac160 con 0x7f0c3c0ab7a0 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c4466b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0abe80 con 0x7f0c3c0700a0 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c3c0aacd0 0x7f0c3c154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c3c0aacd0 0x7f0c3c154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36756/0 (socket says 172.21.15.89:36756) 2023-12-07T10:01:36.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 -- 172.21.15.89:0/2543166508 learned_addr learned my addr 172.21.15.89:0/2543166508 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c41c06640 1 --2- 172.21.15.89:0/2543166508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0700a0 0x7f0c3c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42c08640 1 --2- 172.21.15.89:0/2543166508 >> v2:172.21.15.97:3300/0 conn(0x7f0c3c0ab7a0 0x7f0c3c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 -- 172.21.15.89:0/2543166508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0700a0 msgr2=0x7f0c3c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 --2- 172.21.15.89:0/2543166508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0700a0 0x7f0c3c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 -- 172.21.15.89:0/2543166508 >> v2:172.21.15.97:3300/0 conn(0x7f0c3c0ab7a0 msgr2=0x7f0c3c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 --2- 172.21.15.89:0/2543166508 >> v2:172.21.15.97:3300/0 conn(0x7f0c3c0ab7a0 0x7f0c3c06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.208+0000 7f0c42407640 1 -- 172.21.15.89:0/2543166508 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c154cf0 con 0x7f0c3c0aacd0 2023-12-07T10:01:36.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c42407640 1 --2- 172.21.15.89:0/2543166508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0aacd0 0x7f0c3c154160 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0c03e0 tx=0x7f0c3801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e9dfb80f3b68c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c41405640 1 -- 172.21.15.89:0/2543166508 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380ad680 con 0x7f0c3c0aacd0 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c41405640 1 -- 172.21.15.89:0/2543166508 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380ad7e0 con 0x7f0c3c0aacd0 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c41405640 1 -- 172.21.15.89:0/2543166508 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380adb70 con 0x7f0c3c0aacd0 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- 172.21.15.89:0/2543166508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0aacd0 msgr2=0x7f0c3c154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- 172.21.15.89:0/2543166508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0aacd0 0x7f0c3c154160 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0c03e0 tx=0x7f0c3801c440 comp rx=0 tx=0).stop 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- 172.21.15.89:0/2543166508 shutdown_connections 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- 172.21.15.89:0/2543166508 >> v2:172.21.15.97:3300/0 conn(0x7f0c3c0ab7a0 0x7f0c3c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- 172.21.15.89:0/2543166508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0700a0 0x7f0c3c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- 172.21.15.89:0/2543166508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0aacd0 0x7f0c3c154160 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- 172.21.15.89:0/2543166508 >> 172.21.15.89:0/2543166508 conn(0x7f0c3c0c2ad0 msgr2=0x7f0c3c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- 172.21.15.89:0/2543166508 shutdown_connections 2023-12-07T10:01:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- 172.21.15.89:0/2543166508 wait complete. 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 Processor -- start 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- start start 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 0x7f0c3c1ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0aacd0 0x7f0c3c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c3c0ab7a0 0x7f0c3c14d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0a9af0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1ed240 con 0x7f0c3c0ab7a0 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.212+0000 7f0c4466b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0a9d00 con 0x7f0c3c0aacd0 2023-12-07T10:01:36.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 0x7f0c3c1ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 0x7f0c3c1ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36764/0 (socket says 172.21.15.89:36764) 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 -- 172.21.15.89:0/727734355 learned_addr learned my addr 172.21.15.89:0/727734355 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c41c06640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0aacd0 0x7f0c3c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42c08640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c3c0ab7a0 0x7f0c3c14d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 -- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0aacd0 msgr2=0x7f0c3c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0aacd0 0x7f0c3c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 -- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c3c0ab7a0 msgr2=0x7f0c3c14d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c3c0ab7a0 0x7f0c3c14d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 -- 172.21.15.89:0/727734355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380094d0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c41c06640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0aacd0 0x7f0c3c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c42407640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 0x7f0c3c1ed6d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0c3801aaf0 tx=0x7f0c3801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380ade60 con 0x7f0c3c0700a0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380b8420 con 0x7f0c3c0700a0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380b8790 con 0x7f0c3c0700a0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c1f0bd0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c1ecbf0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c04e890 con 0x7f0c3c0700a0 2023-12-07T10:01:36.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c380b4040 con 0x7f0c3c0700a0 2023-12-07T10:01:36.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c32ffd640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c20066900 0x7f0c20068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.216+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f0c3811e9c0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.220+0000 7f0c41c06640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c20066900 0x7f0c20068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.220+0000 7f0c41c06640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c20066900 0x7f0c20068dc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c150ff0 tx=0x7f0c2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.220+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c380ebb90 con 0x7f0c3c0700a0 2023-12-07T10:01:36.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c3c0705b0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c32ffd640 1 -- 172.21.15.89:0/727734355 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4914 (secure 0 0 0) 0x7f0c380ef1b0 con 0x7f0c3c0700a0 2023-12-07T10:01:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:36.408 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6390,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2462425024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2462425024},{"type":"v1","addr":"172.21.15.89:6837","nonce":2462425024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:36.409 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 39 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c20066900 msgr2=0x7f0c20068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c20066900 0x7f0c20068dc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c150ff0 tx=0x7f0c2c008040 comp rx=0 tx=0).stop 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 msgr2=0x7f0c3c1ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 0x7f0c3c1ed6d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0c3801aaf0 tx=0x7f0c3801ac80 comp rx=0 tx=0).stop 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 shutdown_connections 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c3c0ab7a0 0x7f0c3c14d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0c20066900 0x7f0c20068dc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0c3c0aacd0 0x7f0c3c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 --2- 172.21.15.89:0/727734355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c0700a0 0x7f0c3c1ed6d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 >> 172.21.15.89:0/727734355 conn(0x7f0c3c0c2ad0 msgr2=0x7f0c3c0bf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 shutdown_connections 2023-12-07T10:01:36.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.404+0000 7f0c4466b640 1 -- 172.21.15.89:0/727734355 wait complete. 2023-12-07T10:01:36.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:36.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.560+0000 7ff9597b8640 1 Processor -- start 2023-12-07T10:01:36.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.560+0000 7ff9597b8640 1 -- start start 2023-12-07T10:01:36.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9597b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff95414b420 0x7ff954071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9597b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 0x7ff95406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9597b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff954152320 con 0x7ff95406dc80 2023-12-07T10:01:36.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9597b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff954151e30 con 0x7ff95414b420 2023-12-07T10:01:36.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9597b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff954152040 con 0x7ff9540c0b90 2023-12-07T10:01:36.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 0x7ff95406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9537fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff95406dc80 0x7ff95406ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:34814/0 (socket says 172.21.15.89:34814) 2023-12-07T10:01:36.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9537fe640 1 -- 172.21.15.89:0/3331500473 learned_addr learned my addr 172.21.15.89:0/3331500473 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 0x7ff95406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:49034/0 (socket says 172.21.15.89:49034) 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff952ffd640 1 --2- 172.21.15.89:0/3331500473 >> v2:172.21.15.97:3300/0 conn(0x7ff95414b420 0x7ff954071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff94bfff640 1 -- 172.21.15.89:0/3331500473 >> v2:172.21.15.97:3300/0 conn(0x7ff95414b420 msgr2=0x7ff954071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff94bfff640 1 --2- 172.21.15.89:0/3331500473 >> v2:172.21.15.97:3300/0 conn(0x7ff95414b420 0x7ff954071ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff94bfff640 1 -- 172.21.15.89:0/3331500473 >> v1:172.21.15.97:6789/0 conn(0x7ff95406dc80 legacy=0x7ff95406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff94bfff640 1 -- 172.21.15.89:0/3331500473 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95406bf80 con 0x7ff9540c0b90 2023-12-07T10:01:36.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.564+0000 7ff9527fc640 1 -- 172.21.15.89:0/3331500473 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817802298 0 0) 0x7ff954152320 con 0x7ff95406dc80 2023-12-07T10:01:36.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff94bfff640 1 --2- 172.21.15.89:0/3331500473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 0x7ff95406d740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0097c0 tx=0x7ff93c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8847104041ddc9d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9527fc640 1 -- 172.21.15.89:0/3331500473 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0ab600 con 0x7ff9540c0b90 2023-12-07T10:01:36.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9527fc640 1 -- 172.21.15.89:0/3331500473 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c0a7050 con 0x7ff9540c0b90 2023-12-07T10:01:36.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9527fc640 1 -- 172.21.15.89:0/3331500473 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0ab980 con 0x7ff9540c0b90 2023-12-07T10:01:36.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 -- 172.21.15.89:0/3331500473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 msgr2=0x7ff95406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 --2- 172.21.15.89:0/3331500473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 0x7ff95406d740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0097c0 tx=0x7ff93c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 -- 172.21.15.89:0/3331500473 shutdown_connections 2023-12-07T10:01:36.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 --2- 172.21.15.89:0/3331500473 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9540c0b90 0x7ff95406d740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 --2- 172.21.15.89:0/3331500473 >> v2:172.21.15.97:3300/0 conn(0x7ff95414b420 0x7ff954071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 -- 172.21.15.89:0/3331500473 >> 172.21.15.89:0/3331500473 conn(0x7ff95406af50 msgr2=0x7ff9540c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:36.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 -- 172.21.15.89:0/3331500473 shutdown_connections 2023-12-07T10:01:36.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 -- 172.21.15.89:0/3331500473 wait complete. 2023-12-07T10:01:36.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 Processor -- start 2023-12-07T10:01:36.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.568+0000 7ff9597b8640 1 -- start start 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 0x7ff9540c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9540c0b90 0x7ff954149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95414b420 0x7ff9540a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c4a20 con 0x7ff95406dc80 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541ed8c0 con 0x7ff9540c0b90 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541edba0 con 0x7ff95414b420 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 0x7ff9540c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 0x7ff9540c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36776/0 (socket says 172.21.15.89:36776) 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 -- 172.21.15.89:0/10379526 learned_addr learned my addr 172.21.15.89:0/10379526 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff94bfff640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9540c0b90 0x7ff954149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9537fe640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95414b420 0x7ff9540a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 -- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95414b420 msgr2=0x7ff9540a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95414b420 0x7ff9540a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 -- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9540c0b90 msgr2=0x7ff954149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9540c0b90 0x7ff954149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 -- 172.21.15.89:0/10379526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009420 con 0x7ff95406dc80 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff94bfff640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9540c0b90 0x7ff954149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9537fe640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95414b420 0x7ff9540a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff952ffd640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 0x7ff9540c44e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff94400e870 tx=0x7ff94400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944009510 con 0x7ff95406dc80 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400eec0 con 0x7ff95406dc80 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400cb40 con 0x7ff95406dc80 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9540a94c0 con 0x7ff95406dc80 2023-12-07T10:01:36.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff954149f40 con 0x7ff95406dc80 2023-12-07T10:01:36.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9541eddc0 con 0x7ff95406dc80 2023-12-07T10:01:36.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.572+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff94400cca0 con 0x7ff95406dc80 2023-12-07T10:01:36.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.576+0000 7ff94b7fe640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9340668d0 0x7ff934068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.576+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff944084560 con 0x7ff95406dc80 2023-12-07T10:01:36.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.576+0000 7ff94bfff640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9340668d0 0x7ff934068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.576+0000 7ff94bfff640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9340668d0 0x7ff934068d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0ad000 tx=0x7ff93c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.580+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9440517b0 con 0x7ff95406dc80 2023-12-07T10:01:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.728+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff95404e890 con 0x7ff95406dc80 2023-12-07T10:01:36.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff94b7fe640 1 -- 172.21.15.89:0/10379526 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16639 (secure 0 0 0) 0x7ff944054dd0 con 0x7ff95406dc80 2023-12-07T10:01:36.736 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:36.737 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":56,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:34.701550+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6837/416367230":"2023-12-08T10:01:31.693467+0000","172.21.15.89:6835/416367230":"2023-12-08T10:01:31.693467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:36.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9340668d0 msgr2=0x7ff934068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9340668d0 0x7ff934068d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0ad000 tx=0x7ff93c0a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 msgr2=0x7ff9540c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 0x7ff9540c44e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff94400e870 tx=0x7ff94400ec70 comp rx=0 tx=0).stop 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 shutdown_connections 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9340668d0 0x7ff934068d90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff95414b420 0x7ff9540a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9540c0b90 0x7ff954149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 --2- 172.21.15.89:0/10379526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95406dc80 0x7ff9540c44e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 >> 172.21.15.89:0/10379526 conn(0x7ff95406af50 msgr2=0x7ff954144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 shutdown_connections 2023-12-07T10:01:36.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.732+0000 7ff9597b8640 1 -- 172.21.15.89:0/10379526 wait complete. 2023-12-07T10:01:36.757 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-07T10:01:36.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:36.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 Processor -- start 2023-12-07T10:01:36.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 -- start start 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2540ca610 0x7fa2540c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa2540bd720 0x7fa2540c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa254155790 con 0x7fa25406cd90 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540c4b00 con 0x7fa2540ca610 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa258d72640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540c4de0 con 0x7fa2540bd720 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa252d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa25406cd90 0x7fa254158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49396/0 (socket says 172.21.15.89:49396) 2023-12-07T10:01:36.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa252d9d640 1 -- 172.21.15.89:0/1432607007 learned_addr learned my addr 172.21.15.89:0/1432607007 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa25259c640 1 --2- 172.21.15.89:0/1432607007 >> v2:172.21.15.89:3300/0 conn(0x7fa2540ca610 0x7fa2540c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa251d9b640 1 --2- 172.21.15.89:0/1432607007 >> v2:172.21.15.97:3300/0 conn(0x7fa2540bd720 0x7fa2540c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa25159a640 1 -- 172.21.15.89:0/1432607007 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413217957 0 0) 0x7fa254155790 con 0x7fa25406cd90 2023-12-07T10:01:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa25259c640 1 -- 172.21.15.89:0/1432607007 >> v2:172.21.15.97:3300/0 conn(0x7fa2540bd720 msgr2=0x7fa2540c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa25259c640 1 --2- 172.21.15.89:0/1432607007 >> v2:172.21.15.97:3300/0 conn(0x7fa2540bd720 0x7fa2540c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa25259c640 1 -- 172.21.15.89:0/1432607007 >> v1:172.21.15.89:6789/0 conn(0x7fa25406cd90 legacy=0x7fa254158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa25259c640 1 -- 172.21.15.89:0/1432607007 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254157e30 con 0x7fa2540ca610 2023-12-07T10:01:36.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.892+0000 7fa251d9b640 1 --2- 172.21.15.89:0/1432607007 >> v2:172.21.15.97:3300/0 conn(0x7fa2540bd720 0x7fa2540c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:36.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa25259c640 1 --2- 172.21.15.89:0/1432607007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540ca610 0x7fa2540c94c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa2540ca380 tx=0x7fa24401c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5267f90f0b049 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa25159a640 1 -- 172.21.15.89:0/1432607007 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540c52d0 con 0x7fa2540ca610 2023-12-07T10:01:36.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa25159a640 1 -- 172.21.15.89:0/1432607007 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2440a4860 con 0x7fa2540ca610 2023-12-07T10:01:36.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa25159a640 1 -- 172.21.15.89:0/1432607007 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440a4bf0 con 0x7fa2540ca610 2023-12-07T10:01:36.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 -- 172.21.15.89:0/1432607007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540ca610 msgr2=0x7fa2540c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 --2- 172.21.15.89:0/1432607007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540ca610 0x7fa2540c94c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa2540ca380 tx=0x7fa24401c020 comp rx=0 tx=0).stop 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 -- 172.21.15.89:0/1432607007 shutdown_connections 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 --2- 172.21.15.89:0/1432607007 >> v2:172.21.15.97:3300/0 conn(0x7fa2540bd720 0x7fa2540c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 --2- 172.21.15.89:0/1432607007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540ca610 0x7fa2540c94c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 -- 172.21.15.89:0/1432607007 >> 172.21.15.89:0/1432607007 conn(0x7fa254071ea0 msgr2=0x7fa2540722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 -- 172.21.15.89:0/1432607007 shutdown_connections 2023-12-07T10:01:36.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.896+0000 7fa258d72640 1 -- 172.21.15.89:0/1432607007 wait complete. 2023-12-07T10:01:36.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 Processor -- start 2023-12-07T10:01:36.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- start start 2023-12-07T10:01:36.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa25406cd90 0x7fa2541f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 0x7fa2541f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2540ca610 0x7fa2541f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540ac9d0 con 0x7fa2540bd720 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540ac0a0 con 0x7fa25406cd90 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540ac380 con 0x7fa2540ca610 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa25259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa25406cd90 0x7fa2541f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 0x7fa2541f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 0x7fa2541f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36790/0 (socket says 172.21.15.89:36790) 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 -- 172.21.15.89:0/1271066756 learned_addr learned my addr 172.21.15.89:0/1271066756 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa252d9d640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2540ca610 0x7fa2541f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 -- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2540ca610 msgr2=0x7fa2541f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2540ca610 0x7fa2541f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 -- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa25406cd90 msgr2=0x7fa2541f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa25406cd90 0x7fa2541f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 -- 172.21.15.89:0/1271066756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009420 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa251d9b640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 0x7fa2541f1560 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa24800e810 tx=0x7fa24800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800c8d0 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800ca30 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2540ac660 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800cdc0 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254151fb0 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.900+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25404e890 con 0x7fa2540bd720 2023-12-07T10:01:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.904+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa248013410 con 0x7fa2540bd720 2023-12-07T10:01:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.904+0000 7fa242ffd640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2340668d0 0x7fa234068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.904+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa248084260 con 0x7fa2540bd720 2023-12-07T10:01:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.904+0000 7fa25259c640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2340668d0 0x7fa234068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.904+0000 7fa25259c640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2340668d0 0x7fa234068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa2440ae000 tx=0x7fa244008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:36.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:36.908+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2480514f0 con 0x7fa2540bd720 2023-12-07T10:01:37.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.088+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2540ac7f0 con 0x7fa2540bd720 2023-12-07T10:01:37.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.088+0000 7fa242ffd640 1 -- 172.21.15.89:0/1271066756 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4914 (secure 0 0 0) 0x7fa248009480 con 0x7fa2540bd720 2023-12-07T10:01:37.093 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:37.094 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6390,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2462425024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2462425024},{"type":"v1","addr":"172.21.15.89:6837","nonce":2462425024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:37.094 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 39 2023-12-07T10:01:37.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.088+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2340668d0 msgr2=0x7fa234068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.088+0000 7fa258d72640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2340668d0 0x7fa234068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa2440ae000 tx=0x7fa244008040 comp rx=0 tx=0).stop 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.088+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 msgr2=0x7fa2541f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.088+0000 7fa258d72640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 0x7fa2541f1560 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa24800e810 tx=0x7fa24800ecd0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 shutdown_connections 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2340668d0 0x7fa234068d90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2540ca610 0x7fa2541f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2540bd720 0x7fa2541f1560 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 --2- 172.21.15.89:0/1271066756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa25406cd90 0x7fa2541f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 >> 172.21.15.89:0/1271066756 conn(0x7fa254071ea0 msgr2=0x7fa2541570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 shutdown_connections 2023-12-07T10:01:37.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.092+0000 7fa258d72640 1 -- 172.21.15.89:0/1271066756 wait complete. 2023-12-07T10:01:37.115 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:37.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.248+0000 7f2dd7faa640 1 Processor -- start 2023-12-07T10:01:37.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.248+0000 7f2dd7faa640 1 -- start start 2023-12-07T10:01:37.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.248+0000 7f2dd7faa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.248+0000 7f2dd7faa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd006dec0 con 0x7f2dd00c19e0 2023-12-07T10:01:37.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.248+0000 7f2dd7faa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd0156980 con 0x7f2dd014fcc0 2023-12-07T10:01:37.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.248+0000 7f2dd7faa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00aa340 con 0x7f2dd0156500 2023-12-07T10:01:37.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd6547640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2dd00c19e0 0x7f2dd00c1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49402/0 (socket says 172.21.15.89:49402) 2023-12-07T10:01:37.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd6547640 1 -- 172.21.15.89:0/4271318549 learned_addr learned my addr 172.21.15.89:0/4271318549 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:37.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd5545640 1 --2- 172.21.15.89:0/4271318549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934265601 0 0) 0x7f2dd006dec0 con 0x7f2dd00c19e0 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dbc003530 con 0x7f2dd00c19e0 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020465535 0 0) 0x7f2dcc001120 con 0x7f2dd014fcc0 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd006dec0 con 0x7f2dd014fcc0 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506081749 0 0) 0x7f2dbc003530 con 0x7f2dd00c19e0 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd5545640 1 -- 172.21.15.89:0/4271318549 >> v1:172.21.15.97:6789/0 conn(0x7f2dd014fcc0 legacy=0x7f2dd00aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd5545640 1 -- 172.21.15.89:0/4271318549 >> v1:172.21.15.89:6789/0 conn(0x7f2dd00c19e0 legacy=0x7f2dd00c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd5545640 1 -- 172.21.15.89:0/4271318549 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00ab580 con 0x7f2dd0156500 2023-12-07T10:01:37.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.252+0000 7f2dd5545640 1 --2- 172.21.15.89:0/4271318549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd006d980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00097f0 tx=0x7f2dc001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39ebd6546cdb38f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8001a00 con 0x7f2dd0156500 2023-12-07T10:01:37.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc00a7050 con 0x7f2dd0156500 2023-12-07T10:01:37.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd4d44640 1 -- 172.21.15.89:0/4271318549 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00ab600 con 0x7f2dd0156500 2023-12-07T10:01:37.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- 172.21.15.89:0/4271318549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 msgr2=0x7f2dd006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/4271318549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd006d980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00097f0 tx=0x7f2dc001c3b0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- 172.21.15.89:0/4271318549 shutdown_connections 2023-12-07T10:01:37.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/4271318549 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd006d980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- 172.21.15.89:0/4271318549 >> 172.21.15.89:0/4271318549 conn(0x7f2dd00c2ad0 msgr2=0x7f2dd00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:37.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- 172.21.15.89:0/4271318549 shutdown_connections 2023-12-07T10:01:37.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- 172.21.15.89:0/4271318549 wait complete. 2023-12-07T10:01:37.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 Processor -- start 2023-12-07T10:01:37.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- start start 2023-12-07T10:01:37.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 0x7f2dd014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd00bba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd014ea30 0x7f2dd01ede90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd01eea00 con 0x7f2dd00c19e0 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd0149d60 con 0x7f2dd014ea30 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd7faa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd01497a0 con 0x7f2dd0156500 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd5d46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 0x7f2dd014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd5d46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 0x7f2dd014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36800/0 (socket says 172.21.15.89:36800) 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd5d46640 1 -- 172.21.15.89:0/347573470 learned_addr learned my addr 172.21.15.89:0/347573470 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd5545640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd00bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.256+0000 7f2dd6547640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd014ea30 0x7f2dd01ede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5d46640 1 -- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 msgr2=0x7f2dd00bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5d46640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd00bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5d46640 1 -- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd014ea30 msgr2=0x7f2dd01ede90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5d46640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd014ea30 0x7f2dd01ede90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5d46640 1 -- 172.21.15.89:0/347573470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009420 con 0x7f2dd00c19e0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5d46640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 0x7f2dd014a830 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c700 tx=0x7f2dcc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0052d0 con 0x7f2dd00c19e0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc005450 con 0x7f2dd00c19e0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd0149a80 con 0x7f2dd00c19e0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00a860 con 0x7f2dd00c19e0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd00bbf70 con 0x7f2dd00c19e0 2023-12-07T10:01:37.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd004e890 con 0x7f2dd00c19e0 2023-12-07T10:01:37.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2dcc00a9c0 con 0x7f2dd00c19e0 2023-12-07T10:01:37.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dc67fc640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2db40668d0 0x7f2db4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2dcc083e80 con 0x7f2dd00c19e0 2023-12-07T10:01:37.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.260+0000 7f2dd5545640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2db40668d0 0x7f2db4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.264+0000 7f2dd5545640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2db40668d0 0x7f2db4068d90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00ad000 tx=0x7f2dc00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.264+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2dcc051050 con 0x7f2dd00c19e0 2023-12-07T10:01:37.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.444+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dd0156980 con 0x7f2dd00c19e0 2023-12-07T10:01:37.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.444+0000 7f2dc67fc640 1 -- 172.21.15.89:0/347573470 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4914 (secure 0 0 0) 0x7f2dd0156980 con 0x7f2dd00c19e0 2023-12-07T10:01:37.451 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:37.451 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6390,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2462425024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2462425024},{"type":"v1","addr":"172.21.15.89:6837","nonce":2462425024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:06.299292+0000","modified":"2023-12-07T10:01:09.324491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6836/320368182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":320368182},{"type":"v1","addr":"172.21.15.89:6836","nonce":320368182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-07T10:01:37.451 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 39 2023-12-07T10:01:37.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2db40668d0 msgr2=0x7f2db4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2db40668d0 0x7f2db4068d90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00ad000 tx=0x7f2dc00a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:37.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 msgr2=0x7f2dd014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 0x7f2dd014a830 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c700 tx=0x7f2dcc00cbc0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 shutdown_connections 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd014ea30 0x7f2dd01ede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2db40668d0 0x7f2db4068d90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2dd0156500 0x7f2dd00bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 --2- 172.21.15.89:0/347573470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dd00c19e0 0x7f2dd014a830 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 >> 172.21.15.89:0/347573470 conn(0x7f2dd00c2ad0 msgr2=0x7f2dd0154330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 shutdown_connections 2023-12-07T10:01:37.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.448+0000 7f2dd7faa640 1 -- 172.21.15.89:0/347573470 wait complete. 2023-12-07T10:01:37.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:37.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.604+0000 7ff9a4f0f640 1 Processor -- start 2023-12-07T10:01:37.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.604+0000 7ff9a4f0f640 1 -- start start 2023-12-07T10:01:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.604+0000 7ff9a4f0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a0152390 0x7ff9a015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.604+0000 7ff9a4f0f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a01517f0 con 0x7ff9a014f000 2023-12-07T10:01:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.604+0000 7ff9a4f0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a006de70 con 0x7ff9a0071100 2023-12-07T10:01:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.604+0000 7ff9a4f0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a014f3e0 con 0x7ff9a0152390 2023-12-07T10:01:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99e59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff9a014f000 0x7ff9a006b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49410/0 (socket says 172.21.15.89:49410) 2023-12-07T10:01:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99e59c640 1 -- 172.21.15.89:0/1338113426 learned_addr learned my addr 172.21.15.89:0/1338113426 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:37.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99ed9d640 1 --2- 172.21.15.89:0/1338113426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a0152390 0x7ff9a015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654047230 0 0) 0x7ff9a01517f0 con 0x7ff9a014f000 2023-12-07T10:01:37.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff98c003530 con 0x7ff9a014f000 2023-12-07T10:01:37.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711343123 0 0) 0x7ff9a006de70 con 0x7ff9a0071100 2023-12-07T10:01:37.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a01517f0 con 0x7ff9a0071100 2023-12-07T10:01:37.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99ed9d640 1 -- 172.21.15.89:0/1338113426 >> v1:172.21.15.97:6789/0 conn(0x7ff9a0071100 legacy=0x7ff9a0151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99ed9d640 1 -- 172.21.15.89:0/1338113426 >> v1:172.21.15.89:6789/0 conn(0x7ff9a014f000 legacy=0x7ff9a006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644486869 0 0) 0x7ff98c003530 con 0x7ff9a014f000 2023-12-07T10:01:37.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99ed9d640 1 -- 172.21.15.89:0/1338113426 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a006e150 con 0x7ff9a0152390 2023-12-07T10:01:37.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.608+0000 7ff99ed9d640 1 --2- 172.21.15.89:0/1338113426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a0152390 0x7ff9a015cf00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff998009dc0 tx=0x7ff99801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ec6a5972c2df6f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990001680 con 0x7ff9a0152390 2023-12-07T10:01:37.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980a6480 con 0x7ff9a0152390 2023-12-07T10:01:37.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99dd9b640 1 -- 172.21.15.89:0/1338113426 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a6810 con 0x7ff9a0152390 2023-12-07T10:01:37.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/1338113426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a0152390 msgr2=0x7ff9a015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/1338113426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a0152390 0x7ff9a015cf00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff998009dc0 tx=0x7ff99801c800 comp rx=0 tx=0).stop 2023-12-07T10:01:37.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/1338113426 shutdown_connections 2023-12-07T10:01:37.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/1338113426 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a0152390 0x7ff9a015cf00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/1338113426 >> 172.21.15.89:0/1338113426 conn(0x7ff9a00c3240 msgr2=0x7ff9a00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:37.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/1338113426 shutdown_connections 2023-12-07T10:01:37.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/1338113426 wait complete. 2023-12-07T10:01:37.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 Processor -- start 2023-12-07T10:01:37.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- start start 2023-12-07T10:01:37.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a0071100 0x7ff9a00c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a014f000 0x7ff9a013abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 0x7ff9a013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a013b650 con 0x7ff9a0152390 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a014d040 con 0x7ff9a0071100 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff9a4f0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00c2a70 con 0x7ff9a014f000 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 0x7ff9a013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 0x7ff9a013b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36812/0 (socket says 172.21.15.89:36812) 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99ed9d640 1 -- 172.21.15.89:0/2259474751 learned_addr learned my addr 172.21.15.89:0/2259474751 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff99e59c640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a0071100 0x7ff9a00c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.612+0000 7ff997fff640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a014f000 0x7ff9a013abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99ed9d640 1 -- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a014f000 msgr2=0x7ff9a013abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99ed9d640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a014f000 0x7ff9a013abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99ed9d640 1 -- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a0071100 msgr2=0x7ff9a00c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99ed9d640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a0071100 0x7ff9a00c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99ed9d640 1 -- 172.21.15.89:0/2259474751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009a70 con 0x7ff9a0152390 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff997fff640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a014f000 0x7ff9a013abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99ed9d640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 0x7ff9a013b110 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff99801cce0 tx=0x7ff9980195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a7660 con 0x7ff9a0152390 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980b7040 con 0x7ff9a0152390 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a79c0 con 0x7ff9a0152390 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a00c2040 con 0x7ff9a0152390 2023-12-07T10:01:37.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a014d570 con 0x7ff9a0152390 2023-12-07T10:01:37.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0067a40 con 0x7ff9a0152390 2023-12-07T10:01:37.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff9980a7b20 con 0x7ff9a0152390 2023-12-07T10:01:37.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff996ffd640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9800668d0 0x7ff980068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff99811f610 con 0x7ff9a0152390 2023-12-07T10:01:37.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.616+0000 7ff99e59c640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9800668d0 0x7ff980068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.620+0000 7ff99e59c640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9800668d0 0x7ff980068d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff990000f70 tx=0x7ff9900016c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.620+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9980ec7e0 con 0x7ff9a0152390 2023-12-07T10:01:37.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9a00c2840 con 0x7ff9a0152390 2023-12-07T10:01:37.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff996ffd640 1 -- 172.21.15.89:0/2259474751 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16639 (secure 0 0 0) 0x7ff9a00c2840 con 0x7ff9a0152390 2023-12-07T10:01:37.781 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:37.781 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":56,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:34.701550+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:01:04.139867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:01:05.289028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6837/416367230":"2023-12-08T10:01:31.693467+0000","172.21.15.89:6835/416367230":"2023-12-08T10:01:31.693467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:37.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9800668d0 msgr2=0x7ff980068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9800668d0 0x7ff980068d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff990000f70 tx=0x7ff9900016c0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 msgr2=0x7ff9a013b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 0x7ff9a013b110 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff99801cce0 tx=0x7ff9980195a0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 shutdown_connections 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a0152390 0x7ff9a013b110 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9800668d0 0x7ff980068d90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9a014f000 0x7ff9a013abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 --2- 172.21.15.89:0/2259474751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9a0071100 0x7ff9a00c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 >> 172.21.15.89:0/2259474751 conn(0x7ff9a00c3240 msgr2=0x7ff9a006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 shutdown_connections 2023-12-07T10:01:37.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.776+0000 7ff9a4f0f640 1 -- 172.21.15.89:0/2259474751 wait complete. 2023-12-07T10:01:37.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-07T10:01:37.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.936+0000 7fcc298d6640 1 Processor -- start 2023-12-07T10:01:37.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.936+0000 7fcc298d6640 1 -- start start 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.936+0000 7fcc298d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc2414e600 0x7fcc24071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.936+0000 7fcc298d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc240c6270 0x7fcc24071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.936+0000 7fcc298d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc24072210 0x7fcc24157b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc298d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc240c7130 con 0x7fcc240c6270 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc298d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2406b610 con 0x7fcc2414e600 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc298d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2406b050 con 0x7fcc24072210 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc240c6270 0x7fcc24071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc240c6270 0x7fcc24071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36816/0 (socket says 172.21.15.89:36816) 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 -- 172.21.15.89:0/736089333 learned_addr learned my addr 172.21.15.89:0/736089333 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc23fff640 1 --2- 172.21.15.89:0/736089333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc24072210 0x7fcc24157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc22ffd640 1 --2- 172.21.15.89:0/736089333 >> v2:172.21.15.97:3300/0 conn(0x7fcc2414e600 0x7fcc24071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 -- 172.21.15.89:0/736089333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc24072210 msgr2=0x7fcc24157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 --2- 172.21.15.89:0/736089333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc24072210 0x7fcc24157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 -- 172.21.15.89:0/736089333 >> v2:172.21.15.97:3300/0 conn(0x7fcc2414e600 msgr2=0x7fcc24071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:37.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 --2- 172.21.15.89:0/736089333 >> v2:172.21.15.97:3300/0 conn(0x7fcc2414e600 0x7fcc24071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 -- 172.21.15.89:0/736089333 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2406b330 con 0x7fcc240c6270 2023-12-07T10:01:37.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc227fc640 1 --2- 172.21.15.89:0/736089333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc240c6270 0x7fcc24071cd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcc240681b0 tx=0x7fcc1801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305e6d00cd13ba34 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc21ffb640 1 -- 172.21.15.89:0/736089333 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180a7070 con 0x7fcc240c6270 2023-12-07T10:01:37.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc21ffb640 1 -- 172.21.15.89:0/736089333 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180ab430 con 0x7fcc240c6270 2023-12-07T10:01:37.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.940+0000 7fcc21ffb640 1 -- 172.21.15.89:0/736089333 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180ab7c0 con 0x7fcc240c6270 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- 172.21.15.89:0/736089333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc240c6270 msgr2=0x7fcc24071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- 172.21.15.89:0/736089333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc240c6270 0x7fcc24071cd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcc240681b0 tx=0x7fcc1801c470 comp rx=0 tx=0).stop 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- 172.21.15.89:0/736089333 shutdown_connections 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- 172.21.15.89:0/736089333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc24072210 0x7fcc24157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- 172.21.15.89:0/736089333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc240c6270 0x7fcc24071cd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- 172.21.15.89:0/736089333 >> v2:172.21.15.97:3300/0 conn(0x7fcc2414e600 0x7fcc24071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- 172.21.15.89:0/736089333 >> 172.21.15.89:0/736089333 conn(0x7fcc240cb870 msgr2=0x7fcc240cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- 172.21.15.89:0/736089333 shutdown_connections 2023-12-07T10:01:37.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- 172.21.15.89:0/736089333 wait complete. 2023-12-07T10:01:37.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 Processor -- start 2023-12-07T10:01:37.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- start start 2023-12-07T10:01:37.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc24072210 0x7fcc240ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc240c6270 0x7fcc240af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 0x7fcc240afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240cb640 con 0x7fcc2414e600 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240b0370 con 0x7fcc24072210 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc298d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241ed980 con 0x7fcc240c6270 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 0x7fcc240afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc23fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 0x7fcc240afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36824/0 (socket says 172.21.15.89:36824) 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc23fff640 1 -- 172.21.15.89:0/4016195538 learned_addr learned my addr 172.21.15.89:0/4016195538 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc227fc640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc240c6270 0x7fcc240af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc22ffd640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc24072210 0x7fcc240ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc23fff640 1 -- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc240c6270 msgr2=0x7fcc240af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc23fff640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc240c6270 0x7fcc240af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.944+0000 7fcc23fff640 1 -- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc24072210 msgr2=0x7fcc240ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc23fff640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc24072210 0x7fcc240ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:37.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc23fff640 1 -- 172.21.15.89:0/4016195538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180094d0 con 0x7fcc2414e600 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc23fff640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 0x7fcc240afe30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c007d10 tx=0x7fcc1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c014420 con 0x7fcc2414e600 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c014580 con 0x7fcc2414e600 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c014930 con 0x7fcc2414e600 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc241ed0c0 con 0x7fcc2414e600 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc241ede10 con 0x7fcc2414e600 2023-12-07T10:01:37.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2404e890 con 0x7fcc2414e600 2023-12-07T10:01:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc1c014a90 con 0x7fcc2414e600 2023-12-07T10:01:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc0bfff640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc100668d0 0x7fcc10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:37.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcc1c084b50 con 0x7fcc2414e600 2023-12-07T10:01:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.948+0000 7fcc22ffd640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc100668d0 0x7fcc10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:37.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.952+0000 7fcc22ffd640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc100668d0 0x7fcc10068d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc14007a60 tx=0x7fcc14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:37.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:37.952+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc1c051e70 con 0x7fcc2414e600 2023-12-07T10:01:38.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.136+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fcc240c6690 con 0x7fcc2414e600 2023-12-07T10:01:38.143 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T10:01:38.140+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T10:01:38.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.140+0000 7fcc0bfff640 1 -- 172.21.15.89:0/4016195538 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7fcc1c055490 con 0x7fcc2414e600 2023-12-07T10:01:38.146 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T10:01:38.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc100668d0 msgr2=0x7fcc10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:38.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc100668d0 0x7fcc10068d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc14007a60 tx=0x7fcc14008040 comp rx=0 tx=0).stop 2023-12-07T10:01:38.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 msgr2=0x7fcc240afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 0x7fcc240afe30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c007d10 tx=0x7fcc1c00e4b0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 shutdown_connections 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2414e600 0x7fcc240afe30 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcc100668d0 0x7fcc10068d90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcc240c6270 0x7fcc240af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 --2- 172.21.15.89:0/4016195538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc24072210 0x7fcc240ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 >> 172.21.15.89:0/4016195538 conn(0x7fcc240cb870 msgr2=0x7fcc24156600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 shutdown_connections 2023-12-07T10:01:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.144+0000 7fcc298d6640 1 -- 172.21.15.89:0/4016195538 wait complete. 2023-12-07T10:01:38.158 INFO:tasks.ceph.mds.a.smithi089.stderr: -2198> 2023-12-07T10:01:08.808+0000 7f0d0b652640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:01:38.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-07T10:01:38.209 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T10:01:38.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 Processor -- start 2023-12-07T10:01:38.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 -- start start 2023-12-07T10:01:38.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcb81561d0 0x7fdcb80701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:38.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb8158ff0 0x7fdcb8159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:38.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb81599c0 con 0x7fdcb8070760 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb8071020 con 0x7fdcb81561d0 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbfd8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8071300 con 0x7fdcb8158ff0 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbd328640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdcb8070760 0x7fdcb806d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49430/0 (socket says 172.21.15.89:49430) 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbd328640 1 -- 172.21.15.89:0/2767255747 learned_addr learned my addr 172.21.15.89:0/2767255747 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbe32a640 1 --2- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb8158ff0 0x7fdcb8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbdb29640 1 --2- 172.21.15.89:0/2767255747 >> v2:172.21.15.97:3300/0 conn(0x7fdcb81561d0 0x7fdcb80701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbcb27640 1 -- 172.21.15.89:0/2767255747 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250735972 0 0) 0x7fdcb81599c0 con 0x7fdcb8070760 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbcb27640 1 -- 172.21.15.89:0/2767255747 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca4003530 con 0x7fdcb8070760 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbdb29640 1 -- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb8158ff0 msgr2=0x7fdcb8159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbdb29640 1 --2- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb8158ff0 0x7fdcb8159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbdb29640 1 -- 172.21.15.89:0/2767255747 >> v1:172.21.15.89:6789/0 conn(0x7fdcb8070760 legacy=0x7fdcb806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:38.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.312+0000 7fdcbdb29640 1 -- 172.21.15.89:0/2767255747 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80715e0 con 0x7fdcb81561d0 2023-12-07T10:01:38.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbdb29640 1 --2- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb81561d0 0x7fdcb80701f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40097c0 tx=0x7fdcb401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eae79db5ecab7bb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:38.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbcb27640 1 -- 172.21.15.89:0/2767255747 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40ab600 con 0x7fdcb81561d0 2023-12-07T10:01:38.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbcb27640 1 -- 172.21.15.89:0/2767255747 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb40a7050 con 0x7fdcb81561d0 2023-12-07T10:01:38.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbcb27640 1 -- 172.21.15.89:0/2767255747 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40ab980 con 0x7fdcb81561d0 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb81561d0 msgr2=0x7fdcb80701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb81561d0 0x7fdcb80701f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40097c0 tx=0x7fdcb401c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2767255747 shutdown_connections 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb8158ff0 0x7fdcb8159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2767255747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb81561d0 0x7fdcb80701f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2767255747 >> 172.21.15.89:0/2767255747 conn(0x7fdcb80c2a60 msgr2=0x7fdcb80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2767255747 shutdown_connections 2023-12-07T10:01:38.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.316+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2767255747 wait complete. 2023-12-07T10:01:38.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 Processor -- start 2023-12-07T10:01:38.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 -- start start 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb8070760 0x7fdcb8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb81561d0 0x7fdcb8149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 0x7fdcb81f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80abfc0 con 0x7fdcb8158ff0 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb815bac0 con 0x7fdcb8070760 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb815ac10 con 0x7fdcb81561d0 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 0x7fdcb81f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 0x7fdcb81f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36846/0 (socket says 172.21.15.89:36846) 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 -- 172.21.15.89:0/2139610575 learned_addr learned my addr 172.21.15.89:0/2139610575 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbdb29640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb8070760 0x7fdcb8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbd328640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb81561d0 0x7fdcb8149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 -- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb81561d0 msgr2=0x7fdcb8149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb81561d0 0x7fdcb8149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 -- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb8070760 msgr2=0x7fdcb8148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb8070760 0x7fdcb8148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 -- 172.21.15.89:0/2139610575 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009420 con 0x7fdcb8158ff0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbe32a640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 0x7fdcb81f12c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000efc0 tx=0x7fdcb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0009ba0 con 0x7fdcb8158ff0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb000f040 con 0x7fdcb8158ff0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00146c0 con 0x7fdcb8158ff0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb815aeb0 con 0x7fdcb8158ff0 2023-12-07T10:01:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.320+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb815b470 con 0x7fdcb8158ff0 2023-12-07T10:01:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.324+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb804e890 con 0x7fdcb8158ff0 2023-12-07T10:01:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.324+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdcb0014820 con 0x7fdcb8158ff0 2023-12-07T10:01:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.324+0000 7fdcae7fc640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc9c0668d0 0x7fdc9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.324+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fdcb00851a0 con 0x7fdcb8158ff0 2023-12-07T10:01:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.324+0000 7fdcbdb29640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc9c0668d0 0x7fdc9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.324+0000 7fdcbdb29640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc9c0668d0 0x7fdc9c068d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40ad000 tx=0x7fdcb40a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:38.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.328+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcb00523d0 con 0x7fdcb8158ff0 2023-12-07T10:01:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:38.512+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdcb80c2770 con 0x7fdcb8158ff0 2023-12-07T10:01:39.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcae7fc640 1 -- 172.21.15.89:0/2139610575 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 105+0+0 (secure 0 0 0) 0x7fdcb00559f0 con 0x7fdcb8158ff0 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc9c0668d0 msgr2=0x7fdc9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc9c0668d0 0x7fdc9c068d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40ad000 tx=0x7fdcb40a4f90 comp rx=0 tx=0).stop 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 msgr2=0x7fdcb81f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 0x7fdcb81f12c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000efc0 tx=0x7fdcb000c490 comp rx=0 tx=0).stop 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 shutdown_connections 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb8158ff0 0x7fdcb81f12c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc9c0668d0 0x7fdc9c068d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdcb81561d0 0x7fdcb8149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 --2- 172.21.15.89:0/2139610575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb8070760 0x7fdcb8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 >> 172.21.15.89:0/2139610575 conn(0x7fdcb80c2a60 msgr2=0x7fdcb8158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 shutdown_connections 2023-12-07T10:01:39.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.144+0000 7fdcbfd8d640 1 -- 172.21.15.89:0/2139610575 wait complete. 2023-12-07T10:01:39.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-07T10:01:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.348+0000 7f9ceb7c4640 1 Processor -- start 2023-12-07T10:01:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.348+0000 7f9ceb7c4640 1 -- start start 2023-12-07T10:01:39.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ceb7c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ce414e390 0x7f9ce40c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ceb7c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ce41545a0 0x7f9ce41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ceb7c4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce414e770 con 0x7f9ce40abde0 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ceb7c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce406b2e0 con 0x7f9ce41545a0 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ceb7c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce41518d0 con 0x7f9ce414e390 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ce41545a0 0x7f9ce41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ce41545a0 0x7f9ce41549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36852/0 (socket says 172.21.15.89:36852) 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 -- 172.21.15.89:0/1603144377 learned_addr learned my addr 172.21.15.89:0/1603144377 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9560640 1 --2- 172.21.15.89:0/1603144377 >> v2:172.21.15.97:3300/0 conn(0x7f9ce414e390 0x7f9ce40c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 -- 172.21.15.89:0/1603144377 >> v2:172.21.15.97:3300/0 conn(0x7f9ce414e390 msgr2=0x7f9ce40c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 --2- 172.21.15.89:0/1603144377 >> v2:172.21.15.97:3300/0 conn(0x7f9ce414e390 0x7f9ce40c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 -- 172.21.15.89:0/1603144377 >> v1:172.21.15.97:6789/0 conn(0x7f9ce40abde0 legacy=0x7f9ce40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9d61640 1 -- 172.21.15.89:0/1603144377 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4151bb0 con 0x7f9ce41545a0 2023-12-07T10:01:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.352+0000 7f9ce9560640 1 --2- 172.21.15.89:0/1603144377 >> v2:172.21.15.97:3300/0 conn(0x7f9ce414e390 0x7f9ce40c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ce9d61640 1 --2- 172.21.15.89:0/1603144377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce41545a0 0x7f9ce41549d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4074610 tx=0x7f9cdc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f40f5f146a3149d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9cdbfff640 1 -- 172.21.15.89:0/1603144377 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0a5580 con 0x7f9ce41545a0 2023-12-07T10:01:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9cdbfff640 1 -- 172.21.15.89:0/1603144377 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0a56e0 con 0x7f9ce41545a0 2023-12-07T10:01:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9cdbfff640 1 -- 172.21.15.89:0/1603144377 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0a5a70 con 0x7f9ce41545a0 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1603144377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce41545a0 msgr2=0x7f9ce41549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1603144377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce41545a0 0x7f9ce41549d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4074610 tx=0x7f9cdc01c940 comp rx=0 tx=0).stop 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1603144377 shutdown_connections 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1603144377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce41545a0 0x7f9ce41549d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1603144377 >> v2:172.21.15.97:3300/0 conn(0x7f9ce414e390 0x7f9ce40c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1603144377 >> 172.21.15.89:0/1603144377 conn(0x7f9ce406a5a0 msgr2=0x7f9ce406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1603144377 shutdown_connections 2023-12-07T10:01:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1603144377 wait complete. 2023-12-07T10:01:39.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 Processor -- start 2023-12-07T10:01:39.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.356+0000 7f9ceb7c4640 1 -- start start 2023-12-07T10:01:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 0x7f9ce40c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce414e390 0x7f9ce406c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce41545a0 0x7f9ce413bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c49d0 con 0x7f9ce40abde0 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c3d60 con 0x7f9ce41545a0 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c4600 con 0x7f9ce414e390 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 0x7f9ce40c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 0x7f9ce40c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36866/0 (socket says 172.21.15.89:36866) 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 -- 172.21.15.89:0/1471824374 learned_addr learned my addr 172.21.15.89:0/1471824374 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9d61640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce41545a0 0x7f9ce413bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce8d5f640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce414e390 0x7f9ce406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 -- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce414e390 msgr2=0x7f9ce406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce414e390 0x7f9ce406c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 -- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce41545a0 msgr2=0x7f9ce413bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:39.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce41545a0 0x7f9ce413bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 -- 172.21.15.89:0/1471824374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc009b30 con 0x7f9ce40abde0 2023-12-07T10:01:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ce9560640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 0x7f9ce40c5ab0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000e810 tx=0x7f9ce000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000c8d0 con 0x7f9ce40abde0 2023-12-07T10:01:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000ca30 con 0x7f9ce40abde0 2023-12-07T10:01:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000cdc0 con 0x7f9ce40abde0 2023-12-07T10:01:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce41ebc10 con 0x7f9ce40abde0 2023-12-07T10:01:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce40c4290 con 0x7f9ce40abde0 2023-12-07T10:01:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce404e890 con 0x7f9ce40abde0 2023-12-07T10:01:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.360+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ce0013410 con 0x7f9ce40abde0 2023-12-07T10:01:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.364+0000 7f9cd9ffb640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc80668d0 0x7f9cc8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.364+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f9ce0084290 con 0x7f9ce40abde0 2023-12-07T10:01:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.364+0000 7f9ce8d5f640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc80668d0 0x7f9cc8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.364+0000 7f9ce8d5f640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc80668d0 0x7f9cc8068d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40c5ff0 tx=0x7f9cd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.368+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ce00514c0 con 0x7f9ce40abde0 2023-12-07T10:01:39.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:39.516+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ce40c23f0 con 0x7f9ce40abde0 2023-12-07T10:01:40.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9cd9ffb640 1 -- 172.21.15.89:0/1471824374 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v58) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9ce0009480 con 0x7f9ce40abde0 2023-12-07T10:01:40.161 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_metadata' removed 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc80668d0 msgr2=0x7f9cc8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc80668d0 0x7f9cc8068d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40c5ff0 tx=0x7f9cd4009040 comp rx=0 tx=0).stop 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 msgr2=0x7f9ce40c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 0x7f9ce40c5ab0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000e810 tx=0x7f9ce000ecd0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 shutdown_connections 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ce41545a0 0x7f9ce413bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9cc80668d0 0x7f9cc8068d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ce414e390 0x7f9ce406c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 --2- 172.21.15.89:0/1471824374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ce40abde0 0x7f9ce40c5ab0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.156+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 >> 172.21.15.89:0/1471824374 conn(0x7f9ce406a5a0 msgr2=0x7f9ce406ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:40.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.160+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 shutdown_connections 2023-12-07T10:01:40.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.160+0000 7f9ceb7c4640 1 -- 172.21.15.89:0/1471824374 wait complete. 2023-12-07T10:01:40.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-07T10:01:40.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.320+0000 7f3de1ead640 1 Processor -- start 2023-12-07T10:01:40.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.320+0000 7f3de1ead640 1 -- start start 2023-12-07T10:01:40.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de1ead640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc0af3e0 0x7f3ddc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:40.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de1ead640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ddc0bd590 0x7f3ddc158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de1ead640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc155510 con 0x7f3ddc06cb80 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de1ead640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0c8250 con 0x7f3ddc0bd590 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de1ead640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc154560 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de16ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ddc0bd590 0x7f3ddc158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3ddbfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3ddc06cb80 0x7f3ddc157b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57422/0 (socket says 172.21.15.89:57422) 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3ddbfff640 1 -- 172.21.15.89:0/686345557 learned_addr learned my addr 172.21.15.89:0/686345557 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de0eab640 1 --2- 172.21.15.89:0/686345557 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc0af3e0 0x7f3ddc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de16ac640 1 -- 172.21.15.89:0/686345557 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc0af3e0 msgr2=0x7f3ddc0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de16ac640 1 --2- 172.21.15.89:0/686345557 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc0af3e0 0x7f3ddc0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de16ac640 1 -- 172.21.15.89:0/686345557 >> v1:172.21.15.89:6789/0 conn(0x7f3ddc06cb80 legacy=0x7f3ddc157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3de16ac640 1 -- 172.21.15.89:0/686345557 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc154770 con 0x7f3ddc0bd590 2023-12-07T10:01:40.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.324+0000 7f3ddb7fe640 1 -- 172.21.15.89:0/686345557 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176472817 0 0) 0x7f3dc8001120 con 0x7f3ddc06cb80 2023-12-07T10:01:40.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de16ac640 1 --2- 172.21.15.89:0/686345557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc158240 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009d90 tx=0x7f3dd401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1481193ffd78a00 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:40.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3ddb7fe640 1 -- 172.21.15.89:0/686345557 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40a5950 con 0x7f3ddc0bd590 2023-12-07T10:01:40.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3ddb7fe640 1 -- 172.21.15.89:0/686345557 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd40a5ab0 con 0x7f3ddc0bd590 2023-12-07T10:01:40.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3ddb7fe640 1 -- 172.21.15.89:0/686345557 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40a5e40 con 0x7f3ddc0bd590 2023-12-07T10:01:40.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- 172.21.15.89:0/686345557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0bd590 msgr2=0x7f3ddc158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:40.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 --2- 172.21.15.89:0/686345557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc158240 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009d90 tx=0x7f3dd401c890 comp rx=0 tx=0).stop 2023-12-07T10:01:40.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- 172.21.15.89:0/686345557 shutdown_connections 2023-12-07T10:01:40.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 --2- 172.21.15.89:0/686345557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc158240 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 --2- 172.21.15.89:0/686345557 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc0af3e0 0x7f3ddc0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- 172.21.15.89:0/686345557 >> 172.21.15.89:0/686345557 conn(0x7f3ddc0722d0 msgr2=0x7f3ddc0c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:40.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- 172.21.15.89:0/686345557 shutdown_connections 2023-12-07T10:01:40.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- 172.21.15.89:0/686345557 wait complete. 2023-12-07T10:01:40.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 Processor -- start 2023-12-07T10:01:40.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- start start 2023-12-07T10:01:40.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc06cb80 0x7f3ddc0c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:40.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 0x7f3ddc150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:40.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:40.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1579b0 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1589b0 con 0x7f3ddc0bd590 2023-12-07T10:01:40.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.328+0000 7f3de1ead640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0c2040 con 0x7f3ddc06cb80 2023-12-07T10:01:40.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 0x7f3ddc150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:40.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de0eab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc06cb80 0x7f3ddc0c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:40.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de0eab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc06cb80 0x7f3ddc0c2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:53740/0 (socket says 172.21.15.89:53740) 2023-12-07T10:01:40.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 0x7f3ddc150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53486/0 (socket says 172.21.15.89:53486) 2023-12-07T10:01:40.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de0eab640 1 -- 172.21.15.89:0/2529867437 learned_addr learned my addr 172.21.15.89:0/2529867437 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:40.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de16ac640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:40.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 -- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc06cb80 msgr2=0x7f3ddc0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:40.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc06cb80 0x7f3ddc0c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 -- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ddc0bd590 msgr2=0x7f3ddc149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:40.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:40.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 -- 172.21.15.89:0/2529867437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4009a70 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3ddbfff640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 0x7f3ddc150d60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c780 tx=0x7f3dc800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80072d0 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8007450 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8001d20 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc0c32e0 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc0c1d60 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc0c2720 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.332+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3dc80047f0 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.336+0000 7f3dd97fa640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3dc0066900 0x7f3dc0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:40.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.336+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f3dc8083150 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.336+0000 7f3de0eab640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3dc0066900 0x7f3dc0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:40.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.336+0000 7f3de0eab640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3dc0066900 0x7f3dc0068dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc14bbc0 tx=0x7f3dd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.340+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ddc0c2720 con 0x7f3ddc0af3e0 2023-12-07T10:01:40.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:40.492+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ddc155510 con 0x7f3ddc0af3e0 2023-12-07T10:01:41.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:41.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:41.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.164+0000 7f3dd97fa640 1 -- 172.21.15.89:0/2529867437 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v59) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3ddc155510 con 0x7f3ddc0af3e0 2023-12-07T10:01:41.168 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_data' removed 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3dc0066900 msgr2=0x7f3dc0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3dc0066900 0x7f3dc0068dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc14bbc0 tx=0x7f3dd0008040 comp rx=0 tx=0).stop 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 msgr2=0x7f3ddc150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 0x7f3ddc150d60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c780 tx=0x7f3dc800cc40 comp rx=0 tx=0).stop 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 shutdown_connections 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ddc0bd590 0x7f3ddc149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc0af3e0 0x7f3ddc150d60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3dc0066900 0x7f3dc0068dc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 --2- 172.21.15.89:0/2529867437 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ddc06cb80 0x7f3ddc0c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 >> 172.21.15.89:0/2529867437 conn(0x7f3ddc0722d0 msgr2=0x7f3ddc0c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 shutdown_connections 2023-12-07T10:01:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.168+0000 7f3de1ead640 1 -- 172.21.15.89:0/2529867437 wait complete. 2023-12-07T10:01:41.195 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-07T10:01:41.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.332+0000 7f6984e9c640 1 Processor -- start 2023-12-07T10:01:41.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.332+0000 7f6984e9c640 1 -- start start 2023-12-07T10:01:41.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6984e9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f6980070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6984e9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f698006df30 0x7f69800714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6984e9c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6980154b90 con 0x7f6980154000 2023-12-07T10:01:41.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6984e9c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800a8710 con 0x7f698006df30 2023-12-07T10:01:41.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6984e9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800abd70 con 0x7f69800700f0 2023-12-07T10:01:41.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6975d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f6980070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f697e59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6980154000 0x7f69801543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:53668/0 (socket says 172.21.15.89:53668) 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f697e59c640 1 -- 172.21.15.89:0/23700070 learned_addr learned my addr 172.21.15.89:0/23700070 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6975d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f6980070f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:53754/0 (socket says 172.21.15.89:53754) 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f697ed9d640 1 --2- 172.21.15.89:0/23700070 >> v2:172.21.15.97:3300/0 conn(0x7f698006df30 0x7f69800714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f697dd9b640 1 -- 172.21.15.89:0/23700070 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662027784 0 0) 0x7f6980154b90 con 0x7f6980154000 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f697dd9b640 1 -- 172.21.15.89:0/23700070 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f696c003530 con 0x7f6980154000 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6975d9b640 1 -- 172.21.15.89:0/23700070 >> v2:172.21.15.97:3300/0 conn(0x7f698006df30 msgr2=0x7f69800714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6975d9b640 1 --2- 172.21.15.89:0/23700070 >> v2:172.21.15.97:3300/0 conn(0x7f698006df30 0x7f69800714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6975d9b640 1 -- 172.21.15.89:0/23700070 >> v1:172.21.15.97:6789/0 conn(0x7f6980154000 legacy=0x7f69801543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f6975d9b640 1 -- 172.21.15.89:0/23700070 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800ab820 con 0x7f69800700f0 2023-12-07T10:01:41.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.336+0000 7f697ed9d640 1 --2- 172.21.15.89:0/23700070 >> v2:172.21.15.97:3300/0 conn(0x7f698006df30 0x7f69800714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:41.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6975d9b640 1 --2- 172.21.15.89:0/23700070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f6980070f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f696800a960 tx=0x7f696801d730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729ff9187eb74867 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:41.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f697dd9b640 1 -- 172.21.15.89:0/23700070 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680a67a0 con 0x7f69800700f0 2023-12-07T10:01:41.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f697dd9b640 1 -- 172.21.15.89:0/23700070 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69680a6900 con 0x7f69800700f0 2023-12-07T10:01:41.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f697dd9b640 1 -- 172.21.15.89:0/23700070 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680a6c70 con 0x7f69800700f0 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 -- 172.21.15.89:0/23700070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 msgr2=0x7f6980070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 --2- 172.21.15.89:0/23700070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f6980070f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f696800a960 tx=0x7f696801d730 comp rx=0 tx=0).stop 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 -- 172.21.15.89:0/23700070 shutdown_connections 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 --2- 172.21.15.89:0/23700070 >> v2:172.21.15.97:3300/0 conn(0x7f698006df30 0x7f69800714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 --2- 172.21.15.89:0/23700070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f6980070f90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 -- 172.21.15.89:0/23700070 >> 172.21.15.89:0/23700070 conn(0x7f69800c2a60 msgr2=0x7f69800c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 -- 172.21.15.89:0/23700070 shutdown_connections 2023-12-07T10:01:41.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 -- 172.21.15.89:0/23700070 wait complete. 2023-12-07T10:01:41.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 Processor -- start 2023-12-07T10:01:41.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.340+0000 7f6984e9c640 1 -- start start 2023-12-07T10:01:41.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698006df30 0x7f698014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f69801599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 0x7f69800c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800c3dc0 con 0x7f6980154000 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801504c0 con 0x7f698006df30 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69801ed8b0 con 0x7f69800700f0 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 0x7f69800c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 0x7f69800c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53492/0 (socket says 172.21.15.89:53492) 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 -- 172.21.15.89:0/2685145337 learned_addr learned my addr 172.21.15.89:0/2685145337 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697e59c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698006df30 0x7f698014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6975d9b640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f69801599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 -- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 msgr2=0x7f69801599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f69801599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 -- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698006df30 msgr2=0x7f698014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698006df30 0x7f698014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 -- 172.21.15.89:0/2685145337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978009a70 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f697ed9d640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 0x7f69800c5260 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6978009e60 tx=0x7f697800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978009cd0 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800f040 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780039a0 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696800a5c0 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800c4d80 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69800c4f40 con 0x7f6980154000 2023-12-07T10:01:41.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.344+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6978014480 con 0x7f6980154000 2023-12-07T10:01:41.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.348+0000 7f69777fe640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69600668d0 0x7f6960068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.348+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6978084c30 con 0x7f6980154000 2023-12-07T10:01:41.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.348+0000 7f697e59c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69600668d0 0x7f6960068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.348+0000 7f697e59c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69600668d0 0x7f6960068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6970007fd0 tx=0x7f6970009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:41.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.352+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69780521b0 con 0x7f6980154000 2023-12-07T10:01:41.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.500+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f698004e890 con 0x7f6980154000 2023-12-07T10:01:41.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.504+0000 7f69777fe640 1 -- 172.21.15.89:0/2685145337 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69780557d0 con 0x7f6980154000 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69600668d0 msgr2=0x7f6960068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69600668d0 0x7f6960068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6970007fd0 tx=0x7f6970009040 comp rx=0 tx=0).stop 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 msgr2=0x7f69800c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 0x7f69800c5260 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6978009e60 tx=0x7f697800c490 comp rx=0 tx=0).stop 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 shutdown_connections 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6980154000 0x7f69800c5260 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69600668d0 0x7f6960068d90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69800700f0 0x7f69801599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 --2- 172.21.15.89:0/2685145337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f698006df30 0x7f698014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 >> 172.21.15.89:0/2685145337 conn(0x7f69800c2a60 msgr2=0x7f69800a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:41.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 shutdown_connections 2023-12-07T10:01:41.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.508+0000 7f6984e9c640 1 -- 172.21.15.89:0/2685145337 wait complete. 2023-12-07T10:01:41.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-07T10:01:41.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 Processor -- start 2023-12-07T10:01:41.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 -- start start 2023-12-07T10:01:41.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbbc4070b80 0x7fbbc4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbbc40a8470 0x7fbbc406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc406d320 con 0x7fbbc414e9d0 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40721b0 con 0x7fbbc4070b80 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc8df5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40c2830 con 0x7fbbc40a8470 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbbc414e9d0 0x7fbbc40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57428/0 (socket says 172.21.15.89:57428) 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc259c640 1 -- 172.21.15.89:0/304039619 learned_addr learned my addr 172.21.15.89:0/304039619 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbb9d9b640 1 --2- 172.21.15.89:0/304039619 >> v2:172.21.15.89:3300/0 conn(0x7fbbc4070b80 0x7fbbc4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc2d9d640 1 --2- 172.21.15.89:0/304039619 >> v2:172.21.15.97:3300/0 conn(0x7fbbc40a8470 0x7fbbc406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbb9d9b640 1 -- 172.21.15.89:0/304039619 >> v2:172.21.15.97:3300/0 conn(0x7fbbc40a8470 msgr2=0x7fbbc406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbb9d9b640 1 --2- 172.21.15.89:0/304039619 >> v2:172.21.15.97:3300/0 conn(0x7fbbc40a8470 0x7fbbc406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbb9d9b640 1 -- 172.21.15.89:0/304039619 >> v1:172.21.15.89:6789/0 conn(0x7fbbc414e9d0 legacy=0x7fbbc40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbb9d9b640 1 -- 172.21.15.89:0/304039619 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4072450 con 0x7fbbc4070b80 2023-12-07T10:01:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.664+0000 7fbbc1d9b640 1 -- 172.21.15.89:0/304039619 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725845412 0 0) 0x7fbbc406d320 con 0x7fbbc414e9d0 2023-12-07T10:01:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbb9d9b640 1 --2- 172.21.15.89:0/304039619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc4070b80 0x7fbbc4151e60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40c3b30 tx=0x7fbbac01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed65d10439673ccd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc1d9b640 1 -- 172.21.15.89:0/304039619 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a5850 con 0x7fbbc4070b80 2023-12-07T10:01:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc1d9b640 1 -- 172.21.15.89:0/304039619 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0a59b0 con 0x7fbbc4070b80 2023-12-07T10:01:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc1d9b640 1 -- 172.21.15.89:0/304039619 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a5d40 con 0x7fbbc4070b80 2023-12-07T10:01:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 -- 172.21.15.89:0/304039619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc4070b80 msgr2=0x7fbbc4151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/304039619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc4070b80 0x7fbbc4151e60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40c3b30 tx=0x7fbbac01c880 comp rx=0 tx=0).stop 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 -- 172.21.15.89:0/304039619 shutdown_connections 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/304039619 >> v2:172.21.15.97:3300/0 conn(0x7fbbc40a8470 0x7fbbc406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/304039619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc4070b80 0x7fbbc4151e60 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 -- 172.21.15.89:0/304039619 >> 172.21.15.89:0/304039619 conn(0x7fbbc40c2ad0 msgr2=0x7fbbc40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 -- 172.21.15.89:0/304039619 shutdown_connections 2023-12-07T10:01:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.668+0000 7fbbc8df5640 1 -- 172.21.15.89:0/304039619 wait complete. 2023-12-07T10:01:41.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 Processor -- start 2023-12-07T10:01:41.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 -- start start 2023-12-07T10:01:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbc4070b80 0x7fbbc415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbc40a8470 0x7fbbc4142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 0x7fbbc4143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c5c80 con 0x7fbbc414e9d0 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c5420 con 0x7fbbc4070b80 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc41f2450 con 0x7fbbc40a8470 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 0x7fbbc4143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 0x7fbbc4143050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53504/0 (socket says 172.21.15.89:53504) 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 -- 172.21.15.89:0/3165610480 learned_addr learned my addr 172.21.15.89:0/3165610480 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc259c640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbc4070b80 0x7fbbc415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbb9d9b640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbc40a8470 0x7fbbc4142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 -- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbc40a8470 msgr2=0x7fbbc4142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbc40a8470 0x7fbbc4142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 -- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbc4070b80 msgr2=0x7fbbc415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbc4070b80 0x7fbbc415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 -- 172.21.15.89:0/3165610480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009a70 con 0x7fbbc414e9d0 2023-12-07T10:01:41.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc2d9d640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 0x7fbbc4143050 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00d5d0 tx=0x7fbbbc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:41.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0125f0 con 0x7fbbc414e9d0 2023-12-07T10:01:41.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc012770 con 0x7fbbc414e9d0 2023-12-07T10:01:41.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.672+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc40c56c0 con 0x7fbbc414e9d0 2023-12-07T10:01:41.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc012b20 con 0x7fbbc414e9d0 2023-12-07T10:01:41.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc41f2090 con 0x7fbbc414e9d0 2023-12-07T10:01:41.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc404e890 con 0x7fbbc414e9d0 2023-12-07T10:01:41.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbbbc012c80 con 0x7fbbc414e9d0 2023-12-07T10:01:41.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbbb7fe640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba40668d0 0x7fbba4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:41.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbbbc084540 con 0x7fbbc414e9d0 2023-12-07T10:01:41.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbc259c640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba40668d0 0x7fbba4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:41.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.676+0000 7fbbc259c640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba40668d0 0x7fbba4068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000f70 tx=0x7fbbb4007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:41.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.680+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbbc051ac0 con 0x7fbbc414e9d0 2023-12-07T10:01:41.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:41.884+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fbbc40700a0 con 0x7fbbc414e9d0 2023-12-07T10:01:42.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.164+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/3165610480 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v169) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbbbc0550e0 con 0x7fbbc414e9d0 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba40668d0 msgr2=0x7fbba4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba40668d0 0x7fbba4068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000f70 tx=0x7fbbb4007df0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 msgr2=0x7fbbc4143050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 0x7fbbc4143050 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00d5d0 tx=0x7fbbbc00da90 comp rx=0 tx=0).stop 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 shutdown_connections 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbc414e9d0 0x7fbbc4143050 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba40668d0 0x7fbba4068d90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbc40a8470 0x7fbbc4142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 --2- 172.21.15.89:0/3165610480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbc4070b80 0x7fbbc415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 >> 172.21.15.89:0/3165610480 conn(0x7fbbc40c2ad0 msgr2=0x7fbbc40c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:42.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 shutdown_connections 2023-12-07T10:01:42.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.168+0000 7fbbc8df5640 1 -- 172.21.15.89:0/3165610480 wait complete. 2023-12-07T10:01:42.191 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-07T10:01:42.191 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-07T10:01:42.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:42.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 Processor -- start 2023-12-07T10:01:42.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 -- start start 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f983014e9d0 0x7f9830151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f98300a8470 0x7f983006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983006d320 con 0x7f9830070b80 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300721b0 con 0x7f983014e9d0 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.324+0000 7f9836b0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300c2830 con 0x7f98300a8470 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f983014e9d0 0x7f9830151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f983014e9d0 0x7f9830151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53514/0 (socket says 172.21.15.89:53514) 2023-12-07T10:01:42.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 -- 172.21.15.89:0/2518003556 learned_addr learned my addr 172.21.15.89:0/2518003556 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:42.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98350ac640 1 --2- 172.21.15.89:0/2518003556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f98300a8470 0x7f983006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 -- 172.21.15.89:0/2518003556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f98300a8470 msgr2=0x7f983006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:42.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 --2- 172.21.15.89:0/2518003556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f98300a8470 0x7f983006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 -- 172.21.15.89:0/2518003556 >> v1:172.21.15.97:6789/0 conn(0x7f9830070b80 legacy=0x7f98300c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 -- 172.21.15.89:0/2518003556 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830072450 con 0x7f983014e9d0 2023-12-07T10:01:42.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98348ab640 1 --2- 172.21.15.89:0/2518003556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f983014e9d0 0x7f9830151e60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f982c009870 tx=0x7f982c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f7622918c10c91 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98277fe640 1 -- 172.21.15.89:0/2518003556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c0ac620 con 0x7f983014e9d0 2023-12-07T10:01:42.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98277fe640 1 -- 172.21.15.89:0/2518003556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c0ac780 con 0x7f983014e9d0 2023-12-07T10:01:42.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.328+0000 7f98277fe640 1 -- 172.21.15.89:0/2518003556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c0acb10 con 0x7f983014e9d0 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- 172.21.15.89:0/2518003556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f983014e9d0 msgr2=0x7f9830151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 --2- 172.21.15.89:0/2518003556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f983014e9d0 0x7f9830151e60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f982c009870 tx=0x7f982c01c4b0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- 172.21.15.89:0/2518003556 shutdown_connections 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 --2- 172.21.15.89:0/2518003556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f98300a8470 0x7f983006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 --2- 172.21.15.89:0/2518003556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f983014e9d0 0x7f9830151e60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- 172.21.15.89:0/2518003556 >> 172.21.15.89:0/2518003556 conn(0x7f98300c2ad0 msgr2=0x7f98300c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- 172.21.15.89:0/2518003556 shutdown_connections 2023-12-07T10:01:42.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- 172.21.15.89:0/2518003556 wait complete. 2023-12-07T10:01:42.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 Processor -- start 2023-12-07T10:01:42.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- start start 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9830070b80 0x7f9830148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 0x7f98301ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983014e9d0 0x7f9830142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98301ede60 con 0x7f98300a8470 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300aab30 con 0x7f983014e9d0 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9836b0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300c4030 con 0x7f9830070b80 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9827fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 0x7f98301ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9827fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 0x7f98301ed920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53526/0 (socket says 172.21.15.89:53526) 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f9827fff640 1 -- 172.21.15.89:0/1997980438 learned_addr learned my addr 172.21.15.89:0/1997980438 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f98348ab640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9830070b80 0x7f9830148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.332+0000 7f98350ac640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983014e9d0 0x7f9830142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9827fff640 1 -- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9830070b80 msgr2=0x7f9830148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9827fff640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9830070b80 0x7f9830148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9827fff640 1 -- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983014e9d0 msgr2=0x7f9830142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9827fff640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983014e9d0 0x7f9830142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9827fff640 1 -- 172.21.15.89:0/1997980438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0094d0 con 0x7f98300a8470 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9827fff640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 0x7f98301ed920 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f982000c4d0 tx=0x7f982000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200052d0 con 0x7f98300a8470 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820005430 con 0x7f98300a8470 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98300c4310 con 0x7f98300a8470 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820012830 con 0x7f98300a8470 2023-12-07T10:01:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98301431a0 con 0x7f98300a8470 2023-12-07T10:01:42.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98300c10e0 con 0x7f98300a8470 2023-12-07T10:01:42.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.336+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9820012990 con 0x7f98300a8470 2023-12-07T10:01:42.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.340+0000 7f98257fa640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f981c0668d0 0x7f981c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.340+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9820083ad0 con 0x7f98300a8470 2023-12-07T10:01:42.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.340+0000 7f98348ab640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f981c0668d0 0x7f981c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.340+0000 7f98348ab640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f981c0668d0 0x7f981c068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f982c0ae000 tx=0x7f982c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.344+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98200510f0 con 0x7f98300a8470 2023-12-07T10:01:42.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f983004e890 con 0x7f98300a8470 2023-12-07T10:01:42.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f98257fa640 1 -- 172.21.15.89:0/1997980438 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13053 (secure 0 0 0) 0x7f9820054710 con 0x7f98300a8470 2023-12-07T10:01:42.501 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:42.501 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":59,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:41.159733+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6836/320368182":"2023-12-08T10:01:38.141683+0000","172.21.15.89:6834/320368182":"2023-12-08T10:01:38.141683+0000","172.21.15.89:6837/416367230":"2023-12-08T10:01:31.693467+0000","172.21.15.89:6835/416367230":"2023-12-08T10:01:31.693467+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f981c0668d0 msgr2=0x7f981c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f981c0668d0 0x7f981c068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f982c0ae000 tx=0x7f982c0a7000 comp rx=0 tx=0).stop 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 msgr2=0x7f98301ed920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 0x7f98301ed920 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f982000c4d0 tx=0x7f982000c990 comp rx=0 tx=0).stop 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 shutdown_connections 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983014e9d0 0x7f9830142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300a8470 0x7f98301ed920 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f981c0668d0 0x7f981c068d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 --2- 172.21.15.89:0/1997980438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9830070b80 0x7f9830148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 >> 172.21.15.89:0/1997980438 conn(0x7f98300c2ad0 msgr2=0x7f983006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 shutdown_connections 2023-12-07T10:01:42.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.496+0000 7f9836b0f640 1 -- 172.21.15.89:0/1997980438 wait complete. 2023-12-07T10:01:42.522 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:42.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:42.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9ba19d1640 1 Processor -- start 2023-12-07T10:01:42.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9ba19d1640 1 -- start start 2023-12-07T10:01:42.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9ba19d1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b9c0c4fe0 0x7f9b9c0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9ba19d1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c06f320 con 0x7f9b9c0c1b80 2023-12-07T10:01:42.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9ba19d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c06f040 con 0x7f9b9c158b10 2023-12-07T10:01:42.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9ba19d1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c0c6560 con 0x7f9b9c0c4fe0 2023-12-07T10:01:42.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9b927fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b9c0c4fe0 0x7f9b9c0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9b9affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9b9c0c1b80 0x7f9b9c0c7090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57430/0 (socket says 172.21.15.89:57430) 2023-12-07T10:01:42.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9b9affd640 1 -- 172.21.15.89:0/4057902860 learned_addr learned my addr 172.21.15.89:0/4057902860 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:42.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9b927fc640 1 -- 172.21.15.89:0/4057902860 >> v1:172.21.15.97:6789/0 conn(0x7f9b9c158b10 legacy=0x7f9b9c154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:42.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9b927fc640 1 -- 172.21.15.89:0/4057902860 >> v1:172.21.15.89:6789/0 conn(0x7f9b9c0c1b80 legacy=0x7f9b9c0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.660+0000 7f9b927fc640 1 -- 172.21.15.89:0/4057902860 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c158030 con 0x7f9b9c0c4fe0 2023-12-07T10:01:42.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9b927fc640 1 --2- 172.21.15.89:0/4057902860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c0c4fe0 0x7f9b9c0a6d20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009dc0 tx=0x7f9b8401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc5f1c0f9f01438 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9b9a7fc640 1 -- 172.21.15.89:0/4057902860 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840a58f0 con 0x7f9b9c0c4fe0 2023-12-07T10:01:42.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9b9a7fc640 1 -- 172.21.15.89:0/4057902860 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b840a5a50 con 0x7f9b9c0c4fe0 2023-12-07T10:01:42.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9b9a7fc640 1 -- 172.21.15.89:0/4057902860 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840a5de0 con 0x7f9b9c0c4fe0 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 -- 172.21.15.89:0/4057902860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c0c4fe0 msgr2=0x7f9b9c0a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/4057902860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c0c4fe0 0x7f9b9c0a6d20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009dc0 tx=0x7f9b8401c830 comp rx=0 tx=0).stop 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 -- 172.21.15.89:0/4057902860 shutdown_connections 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/4057902860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c0c4fe0 0x7f9b9c0a6d20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 -- 172.21.15.89:0/4057902860 >> 172.21.15.89:0/4057902860 conn(0x7f9b9c06df50 msgr2=0x7f9b9c06e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 -- 172.21.15.89:0/4057902860 shutdown_connections 2023-12-07T10:01:42.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.664+0000 7f9ba19d1640 1 -- 172.21.15.89:0/4057902860 wait complete. 2023-12-07T10:01:42.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 Processor -- start 2023-12-07T10:01:42.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 -- start start 2023-12-07T10:01:42.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b9c0c1b80 0x7f9b9c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b9c0c4fe0 0x7f9b9c06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 0x7f9b9c14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0c33c0 con 0x7f9b9c158b10 2023-12-07T10:01:42.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c14db00 con 0x7f9b9c0c1b80 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c154a20 con 0x7f9b9c0c4fe0 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 0x7f9b9c14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 0x7f9b9c14bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53558/0 (socket says 172.21.15.89:53558) 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 -- 172.21.15.89:0/597154064 learned_addr learned my addr 172.21.15.89:0/597154064 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9affd640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b9c0c1b80 0x7f9b9c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b927fc640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b9c0c4fe0 0x7f9b9c06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 -- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b9c0c4fe0 msgr2=0x7f9b9c06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b9c0c4fe0 0x7f9b9c06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 -- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b9c0c1b80 msgr2=0x7f9b9c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b9c0c1b80 0x7f9b9c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 -- 172.21.15.89:0/597154064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84009a70 con 0x7f9b9c158b10 2023-12-07T10:01:42.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b9b7fe640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 0x7f9b9c14bbc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c3c0 tx=0x7f9b9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94011790 con 0x7f9b9c158b10 2023-12-07T10:01:42.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b940118f0 con 0x7f9b9c158b10 2023-12-07T10:01:42.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c0c2740 con 0x7f9b9c158b10 2023-12-07T10:01:42.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94011ca0 con 0x7f9b9c158b10 2023-12-07T10:01:42.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.668+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c0c2d00 con 0x7f9b9c158b10 2023-12-07T10:01:42.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.672+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c0c3500 con 0x7f9b9c158b10 2023-12-07T10:01:42.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.672+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9b9401c460 con 0x7f9b9c158b10 2023-12-07T10:01:42.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.672+0000 7f9b98ff9640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9b7c0668d0 0x7f9b7c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.672+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9b94083f00 con 0x7f9b9c158b10 2023-12-07T10:01:42.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.672+0000 7f9b9affd640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9b7c0668d0 0x7f9b7c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.672+0000 7f9b9affd640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9b7c0668d0 0x7f9b7c068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c005890 tx=0x7f9b8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.676+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b9c0c3500 con 0x7f9b9c158b10 2023-12-07T10:01:42.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.824+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b9c0c3500 con 0x7f9b9c158b10 2023-12-07T10:01:42.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.824+0000 7f9b98ff9640 1 -- 172.21.15.89:0/597154064 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b9c0c3500 con 0x7f9b9c158b10 2023-12-07T10:01:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:42.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9b7c0668d0 msgr2=0x7f9b7c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9b7c0668d0 0x7f9b7c068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c005890 tx=0x7f9b8c009040 comp rx=0 tx=0).stop 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 msgr2=0x7f9b9c14bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 0x7f9b9c14bbc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c3c0 tx=0x7f9b9400c880 comp rx=0 tx=0).stop 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 shutdown_connections 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b9c158b10 0x7f9b9c14bbc0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9b7c0668d0 0x7f9b7c068d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9b9c0c4fe0 0x7f9b9c06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 --2- 172.21.15.89:0/597154064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b9c0c1b80 0x7f9b9c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 >> 172.21.15.89:0/597154064 conn(0x7f9b9c06df50 msgr2=0x7f9b9c06f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 shutdown_connections 2023-12-07T10:01:42.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.828+0000 7f9ba19d1640 1 -- 172.21.15.89:0/597154064 wait complete. 2023-12-07T10:01:42.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-07T10:01:42.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.984+0000 7f43f9e79640 1 Processor -- start 2023-12-07T10:01:42.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.984+0000 7f43f9e79640 1 -- start start 2023-12-07T10:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.984+0000 7f43f9e79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f43f40aacd0 0x7f43f4154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.984+0000 7f43f9e79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f4072780 con 0x7f43f40700a0 2023-12-07T10:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.984+0000 7f43f9e79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f40ac160 con 0x7f43f40ab7a0 2023-12-07T10:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.984+0000 7f43f9e79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40abe80 con 0x7f43f40aacd0 2023-12-07T10:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f43f40700a0 0x7f43f406c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57434/0 (socket says 172.21.15.89:57434) 2023-12-07T10:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f2ffd640 1 -- 172.21.15.89:0/1100513323 learned_addr learned my addr 172.21.15.89:0/1100513323 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 --2- 172.21.15.89:0/1100513323 >> v2:172.21.15.97:3300/0 conn(0x7f43f40aacd0 0x7f43f4154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703973083 0 0) 0x7f43f4072780 con 0x7f43f40700a0 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43dc003530 con 0x7f43f40700a0 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2822548020 0 0) 0x7f43dc003530 con 0x7f43f40700a0 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 >> v2:172.21.15.97:3300/0 conn(0x7f43f40aacd0 msgr2=0x7f43f4154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 --2- 172.21.15.89:0/1100513323 >> v2:172.21.15.97:3300/0 conn(0x7f43f40aacd0 0x7f43f4154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 >> v1:172.21.15.97:6789/0 conn(0x7f43f40ab7a0 legacy=0x7f43f406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4154cf0 con 0x7f43f40700a0 2023-12-07T10:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f43e8001680 con 0x7f43f40700a0 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 >> v1:172.21.15.89:6789/0 conn(0x7f43f40700a0 legacy=0x7f43f406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc003980 0x7f43dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43dc0047d0 0x7f43dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc0052b0 0x7f43dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40abe80 con 0x7f43dc003980 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc00c180 con 0x7f43dc0047d0 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc00c340 con 0x7f43dc0052b0 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc003980 0x7f43dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f2ffd640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43dc0047d0 0x7f43dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f3fff640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc0052b0 0x7f43dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 -- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc0052b0 msgr2=0x7f43dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc0052b0 0x7f43dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 -- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43dc0047d0 msgr2=0x7f43dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:42.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43dc0047d0 0x7f43dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f37fe640 1 -- 172.21.15.89:0/1100513323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc003530 con 0x7f43dc003980 2023-12-07T10:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.988+0000 7f43f3fff640 1 -- 172.21.15.89:0/1100513323 reap_dead start 2023-12-07T10:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f37fe640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc003980 0x7f43dc003da0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009ab0 tx=0x7f43e401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ec0049905e6b54 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:42.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40a5530 con 0x7f43dc003980 2023-12-07T10:01:42.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e40a5690 con 0x7f43dc003980 2023-12-07T10:01:42.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f27fc640 1 -- 172.21.15.89:0/1100513323 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40a5a40 con 0x7f43dc003980 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 -- 172.21.15.89:0/1100513323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc003980 msgr2=0x7f43dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc003980 0x7f43dc003da0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009ab0 tx=0x7f43e401c9e0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 -- 172.21.15.89:0/1100513323 shutdown_connections 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 --2- 172.21.15.89:0/1100513323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc003980 0x7f43dc003da0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 -- 172.21.15.89:0/1100513323 >> 172.21.15.89:0/1100513323 conn(0x7f43f40c2ad0 msgr2=0x7f43f40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 -- 172.21.15.89:0/1100513323 shutdown_connections 2023-12-07T10:01:42.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 -- 172.21.15.89:0/1100513323 wait complete. 2023-12-07T10:01:42.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 Processor -- start 2023-12-07T10:01:42.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.992+0000 7f43f9e79640 1 -- start start 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc003980 0x7f43f41eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 0x7f43f40c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43f4152210 0x7f43f414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c4250 con 0x7f43f40c52f0 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c4530 con 0x7f43f4152210 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c4810 con 0x7f43dc003980 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 0x7f43f40c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 0x7f43f40c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53568/0 (socket says 172.21.15.89:53568) 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 -- 172.21.15.89:0/3064173899 learned_addr learned my addr 172.21.15.89:0/3064173899 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f37fe640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc003980 0x7f43f41eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f3fff640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43f4152210 0x7f43f414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 -- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc003980 msgr2=0x7f43f41eca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc003980 0x7f43f41eca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:43.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 -- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43f4152210 msgr2=0x7f43f414b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43f4152210 0x7f43f414b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 -- 172.21.15.89:0/3064173899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f40c4af0 con 0x7f43f40c52f0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f2ffd640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 0x7f43f40c3bc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f43e80017b0 tx=0x7f43e8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e800f9c0 con 0x7f43f40c52f0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e800fb40 con 0x7f43f40c52f0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f40c4dd0 con 0x7f43f40c52f0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80133f0 con 0x7f43f40c52f0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f41526c0 con 0x7f43f40c52f0 2023-12-07T10:01:43.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f404e890 con 0x7f43f40c52f0 2023-12-07T10:01:43.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:42.996+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f43e8013550 con 0x7f43f40c52f0 2023-12-07T10:01:43.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:43.000+0000 7f43dbfff640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f43e0066900 0x7f43e0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:43.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:43.000+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f43e80842d0 con 0x7f43f40c52f0 2023-12-07T10:01:43.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:43.000+0000 7f43f37fe640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f43e0066900 0x7f43e0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:43.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:43.000+0000 7f43f37fe640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f43e0066900 0x7f43e0068dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f43e40af000 tx=0x7f43e40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:43.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:43.004+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43e80517c0 con 0x7f43f40c52f0 2023-12-07T10:01:43.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:43.212+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f43f40c15e0 con 0x7f43f40c52f0 2023-12-07T10:01:44.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.168+0000 7f43dbfff640 1 -- 172.21.15.89:0/3064173899 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v171) v1 ==== 162+0+0 (secure 0 0 0) 0x7f43e8054de0 con 0x7f43f40c52f0 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f43e0066900 msgr2=0x7f43e0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f43e0066900 0x7f43e0068dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f43e40af000 tx=0x7f43e40046d0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 msgr2=0x7f43f40c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 0x7f43f40c3bc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f43e80017b0 tx=0x7f43e8007720 comp rx=0 tx=0).stop 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 shutdown_connections 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43f4152210 0x7f43f414b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43f40c52f0 0x7f43f40c3bc0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f43e0066900 0x7f43e0068dc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 --2- 172.21.15.89:0/3064173899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f43dc003980 0x7f43f41eca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 >> 172.21.15.89:0/3064173899 conn(0x7f43f40c2ad0 msgr2=0x7f43f414add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 shutdown_connections 2023-12-07T10:01:44.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.172+0000 7f43f9e79640 1 -- 172.21.15.89:0/3064173899 wait complete. 2023-12-07T10:01:44.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-07T10:01:44.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bf2fe640 1 Processor -- start 2023-12-07T10:01:44.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bf2fe640 1 -- start start 2023-12-07T10:01:44.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bf2fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b8159700 0x7f75b80701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bf2fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b8071020 con 0x7f75b8070760 2023-12-07T10:01:44.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bf2fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b8071300 con 0x7f75b81561d0 2023-12-07T10:01:44.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bf2fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80715e0 con 0x7f75b8159700 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bc899640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f75b8070760 0x7f75b8158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57446/0 (socket says 172.21.15.89:57446) 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bc899640 1 -- 172.21.15.89:0/2890862812 learned_addr learned my addr 172.21.15.89:0/2890862812 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bd89b640 1 --2- 172.21.15.89:0/2890862812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b8159700 0x7f75b80701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371756399 0 0) 0x7f75b8071020 con 0x7f75b8070760 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a4003530 con 0x7f75b8070760 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453132116 0 0) 0x7f75b8071300 con 0x7f75b81561d0 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b8071020 con 0x7f75b81561d0 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bd89b640 1 -- 172.21.15.89:0/2890862812 >> v1:172.21.15.97:6789/0 conn(0x7f75b81561d0 legacy=0x7f75b806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bd89b640 1 -- 172.21.15.89:0/2890862812 >> v1:172.21.15.89:6789/0 conn(0x7f75b8070760 legacy=0x7f75b8158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2221011546 0 0) 0x7f75a4003530 con 0x7f75b8070760 2023-12-07T10:01:44.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.340+0000 7f75bd89b640 1 -- 172.21.15.89:0/2890862812 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80718c0 con 0x7f75b8159700 2023-12-07T10:01:44.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bd89b640 1 --2- 172.21.15.89:0/2890862812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b8159700 0x7f75b80701f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009dc0 tx=0x7f75b001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de169921c2e81e20 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8001680 con 0x7f75b8159700 2023-12-07T10:01:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b00a64a0 con 0x7f75b8159700 2023-12-07T10:01:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75affff640 1 -- 172.21.15.89:0/2890862812 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b00a6830 con 0x7f75b8159700 2023-12-07T10:01:44.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 -- 172.21.15.89:0/2890862812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b8159700 msgr2=0x7f75b80701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/2890862812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b8159700 0x7f75b80701f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009dc0 tx=0x7f75b001c800 comp rx=0 tx=0).stop 2023-12-07T10:01:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 -- 172.21.15.89:0/2890862812 shutdown_connections 2023-12-07T10:01:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/2890862812 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b8159700 0x7f75b80701f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 -- 172.21.15.89:0/2890862812 >> 172.21.15.89:0/2890862812 conn(0x7f75b80c2a60 msgr2=0x7f75b80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 -- 172.21.15.89:0/2890862812 shutdown_connections 2023-12-07T10:01:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.344+0000 7f75bf2fe640 1 -- 172.21.15.89:0/2890862812 wait complete. 2023-12-07T10:01:44.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 Processor -- start 2023-12-07T10:01:44.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 -- start start 2023-12-07T10:01:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 0x7f75b81f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b81561d0 0x7f75b8142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75b8159700 0x7f75b80c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b814b730 con 0x7f75b8070760 2023-12-07T10:01:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b814a6e0 con 0x7f75b8159700 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b814a9c0 con 0x7f75b81561d0 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 0x7f75b81f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 0x7f75b81f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53582/0 (socket says 172.21.15.89:53582) 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 -- 172.21.15.89:0/464036431 learned_addr learned my addr 172.21.15.89:0/464036431 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bc899640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b81561d0 0x7f75b8142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd89b640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75b8159700 0x7f75b80c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 -- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b81561d0 msgr2=0x7f75b8142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b81561d0 0x7f75b8142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 -- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75b8159700 msgr2=0x7f75b80c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75b8159700 0x7f75b80c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 -- 172.21.15.89:0/464036431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0009a70 con 0x7f75b8070760 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd89b640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75b8159700 0x7f75b80c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bc899640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b81561d0 0x7f75b8142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:44.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bd09a640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 0x7f75b81f10d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f75b400c430 tx=0x7f75b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:44.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40052d0 con 0x7f75b8070760 2023-12-07T10:01:44.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4005450 con 0x7f75b8070760 2023-12-07T10:01:44.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b814aca0 con 0x7f75b8070760 2023-12-07T10:01:44.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4003840 con 0x7f75b8070760 2023-12-07T10:01:44.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.348+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b80ac100 con 0x7f75b8070760 2023-12-07T10:01:44.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.352+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b814b8a0 con 0x7f75b8070760 2023-12-07T10:01:44.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.352+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f75b40039a0 con 0x7f75b8070760 2023-12-07T10:01:44.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.352+0000 7f75adffb640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f759c0668d0 0x7f759c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.352+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f75b4083860 con 0x7f75b8070760 2023-12-07T10:01:44.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.352+0000 7f75bc899640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f759c0668d0 0x7f759c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.352+0000 7f75bc899640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f759c0668d0 0x7f759c068d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f75b815cb70 tx=0x7f75a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:44.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.356+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75b4050ca0 con 0x7f75b8070760 2023-12-07T10:01:44.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.508+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f75b804e890 con 0x7f75b8070760 2023-12-07T10:01:44.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75adffb640 1 -- 172.21.15.89:0/464036431 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f75b40542c0 con 0x7f75b8070760 2023-12-07T10:01:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f759c0668d0 msgr2=0x7f759c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f759c0668d0 0x7f759c068d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f75b815cb70 tx=0x7f75a8009040 comp rx=0 tx=0).stop 2023-12-07T10:01:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 msgr2=0x7f75b81f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 0x7f75b81f10d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f75b400c430 tx=0x7f75b400c8f0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 shutdown_connections 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75b8159700 0x7f75b80c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f759c0668d0 0x7f759c068d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f75b81561d0 0x7f75b8142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 --2- 172.21.15.89:0/464036431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b8070760 0x7f75b81f10d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.512+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 >> 172.21.15.89:0/464036431 conn(0x7f75b80c2a60 msgr2=0x7f75b8157030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.516+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 shutdown_connections 2023-12-07T10:01:44.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.516+0000 7f75bf2fe640 1 -- 172.21.15.89:0/464036431 wait complete. 2023-12-07T10:01:44.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T10:01:44.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:01:44.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:01:44.719 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T10:01:44.719 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:01:44.719 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:44.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:01:44.728 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:01:44.728 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:01:44.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:01:44.738 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-07T10:01:44.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:44.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 Processor -- start 2023-12-07T10:01:44.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 -- start start 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d8c06b100 0x7f7d8c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0c7850 con 0x7f7d8c0c48e0 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c8a20 con 0x7f7d8c06b100 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d9189c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0aff30 con 0x7f7d8c0c8570 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d8c06b100 0x7f7d8c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8a7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7d8c0c48e0 0x7f7d8c0c7e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57460/0 (socket says 172.21.15.89:57460) 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8a7fc640 1 -- 172.21.15.89:0/1211905786 learned_addr learned my addr 172.21.15.89:0/1211905786 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:44.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8b7fe640 1 --2- 172.21.15.89:0/1211905786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8affd640 1 -- 172.21.15.89:0/1211905786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 msgr2=0x7f7d8c15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:44.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8affd640 1 --2- 172.21.15.89:0/1211905786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c15ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8affd640 1 -- 172.21.15.89:0/1211905786 >> v1:172.21.15.89:6789/0 conn(0x7f7d8c0c48e0 legacy=0x7f7d8c0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d8affd640 1 -- 172.21.15.89:0/1211905786 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c151f30 con 0x7f7d8c06b100 2023-12-07T10:01:44.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.908+0000 7f7d89ffb640 1 -- 172.21.15.89:0/1211905786 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579248076 0 0) 0x7f7d80001120 con 0x7f7d8c0c48e0 2023-12-07T10:01:44.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d8affd640 1 --2- 172.21.15.89:0/1211905786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c06b4e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0097c0 tx=0x7f7d7c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e789ee1e82bc2ff4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:44.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d89ffb640 1 -- 172.21.15.89:0/1211905786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0ab600 con 0x7f7d8c06b100 2023-12-07T10:01:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d89ffb640 1 -- 172.21.15.89:0/1211905786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0a7050 con 0x7f7d8c06b100 2023-12-07T10:01:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d89ffb640 1 -- 172.21.15.89:0/1211905786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0ab980 con 0x7f7d8c06b100 2023-12-07T10:01:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 -- 172.21.15.89:0/1211905786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 msgr2=0x7f7d8c06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 --2- 172.21.15.89:0/1211905786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c06b4e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0097c0 tx=0x7f7d7c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 -- 172.21.15.89:0/1211905786 shutdown_connections 2023-12-07T10:01:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 --2- 172.21.15.89:0/1211905786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 --2- 172.21.15.89:0/1211905786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c06b4e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 -- 172.21.15.89:0/1211905786 >> 172.21.15.89:0/1211905786 conn(0x7f7d8c0ca360 msgr2=0x7f7d8c0ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 -- 172.21.15.89:0/1211905786 shutdown_connections 2023-12-07T10:01:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 -- 172.21.15.89:0/1211905786 wait complete. 2023-12-07T10:01:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.912+0000 7f7d9189c640 1 Processor -- start 2023-12-07T10:01:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- start start 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c1ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c0c48e0 0x7f7d8c1469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c0ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1ecb00 con 0x7f7d8c06b100 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0acdc0 con 0x7f7d8c0c48e0 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c147a30 con 0x7f7d8c0c8570 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c1ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c1ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53604/0 (socket says 172.21.15.89:53604) 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 -- 172.21.15.89:0/2887295560 learned_addr learned my addr 172.21.15.89:0/2887295560 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 -- 172.21.15.89:0/2887295560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 msgr2=0x7f7d8c0ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c0ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 -- 172.21.15.89:0/2887295560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c0c48e0 msgr2=0x7f7d8c1469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c0c48e0 0x7f7d8c1469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 -- 172.21.15.89:0/2887295560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c009420 con 0x7f7d8c06b100 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d8affd640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c1ed660 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0ae040 tx=0x7f7d7c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b7650 con 0x7f7d8c06b100 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0abe90 con 0x7f7d8c06b100 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c0ae200 con 0x7f7d8c06b100 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b7a10 con 0x7f7d8c06b100 2023-12-07T10:01:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0ae7c0 con 0x7f7d8c06b100 2023-12-07T10:01:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.916+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c04e890 con 0x7f7d8c06b100 2023-12-07T10:01:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.920+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7d7c0b7b70 con 0x7f7d8c06b100 2023-12-07T10:01:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.920+0000 7f7d73fff640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d780668d0 0x7f7d78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.920+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7d7c11ea00 con 0x7f7d8c06b100 2023-12-07T10:01:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.920+0000 7f7d8a7fc640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d780668d0 0x7f7d78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.920+0000 7f7d8a7fc640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d780668d0 0x7f7d78068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c15f060 tx=0x7f7d80007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:44.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:44.924+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d7c0ebed0 con 0x7f7d8c06b100 2023-12-07T10:01:45.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8c0acb90 con 0x7f7d8c06b100 2023-12-07T10:01:45.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d73fff640 1 -- 172.21.15.89:0/2887295560 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f7d7c0b0090 con 0x7f7d8c06b100 2023-12-07T10:01:45.108 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:45.108 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2045891634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2045891634},{"type":"v1","addr":"172.21.15.97:6834","nonce":2045891634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3862300867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3862300867},{"type":"v1","addr":"172.21.15.97:6835","nonce":3862300867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6390,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2462425024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2462425024},{"type":"v1","addr":"172.21.15.89:6837","nonce":2462425024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6480,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2283653283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2283653283},{"type":"v1","addr":"172.21.15.89:6836","nonce":2283653283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2023-12-07T10:01:45.108 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 41 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d780668d0 msgr2=0x7f7d78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d780668d0 0x7f7d78068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c15f060 tx=0x7f7d80007970 comp rx=0 tx=0).stop 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 msgr2=0x7f7d8c1ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c1ed660 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0ae040 tx=0x7f7d7c01ac30 comp rx=0 tx=0).stop 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 shutdown_connections 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d780668d0 0x7f7d78068d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d8c0c8570 0x7f7d8c0ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d8c0c48e0 0x7f7d8c1469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 --2- 172.21.15.89:0/2887295560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d8c06b100 0x7f7d8c1ed660 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 >> 172.21.15.89:0/2887295560 conn(0x7f7d8c0ca360 msgr2=0x7f7d8c1533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 shutdown_connections 2023-12-07T10:01:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.104+0000 7f7d9189c640 1 -- 172.21.15.89:0/2887295560 wait complete. 2023-12-07T10:01:45.129 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-07T10:01:45.129 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-07T10:01:45.129 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-07T10:01:45.129 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:01:45.130 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-07T10:01:45.130 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-07T10:01:45.130 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-07T10:01:45.130 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:01:45.130 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-07T10:01:45.130 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-07T10:01:45.130 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-07T10:01:45.131 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:01:45.131 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-07T10:01:45.131 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-07T10:01:45.131 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-07T10:01:45.131 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:01:45.142 INFO:tasks.ceph.mds.a:Stopped 2023-12-07T10:01:45.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-07T10:01:45.143 INFO:tasks.ceph.mds.c:Stopped 2023-12-07T10:01:45.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-07T10:01:45.146 INFO:tasks.ceph.mds.b:Stopped 2023-12-07T10:01:45.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-07T10:01:45.147 INFO:tasks.ceph.mds.d:Stopped 2023-12-07T10:01:45.147 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-07T10:01:45.189 INFO:tasks.ceph.mds.a:Started 2023-12-07T10:01:45.190 DEBUG:teuthology.parallel:result is None 2023-12-07T10:01:45.192 INFO:tasks.ceph.mds.c:Started 2023-12-07T10:01:45.192 DEBUG:teuthology.parallel:result is None 2023-12-07T10:01:45.195 INFO:tasks.ceph.mds.b:Started 2023-12-07T10:01:45.196 DEBUG:teuthology.parallel:result is None 2023-12-07T10:01:45.197 INFO:tasks.ceph.mds.d:Started 2023-12-07T10:01:45.198 DEBUG:teuthology.parallel:result is None 2023-12-07T10:01:45.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-07T10:01:45.277 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-12-07T10:01:45.278 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T10:01:45.287 INFO:tasks.ceph.mds.d.smithi097.stdout:starting mds.d at 2023-12-07T10:01:45.287 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2023-12-07T10:01:45.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.336+0000 7f23cbdf8640 1 Processor -- start 2023-12-07T10:01:45.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.336+0000 7f23cbdf8640 1 -- start start 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23cbdf8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23c4070b80 0x7f23c4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23cbdf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23cbdf8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c406d320 con 0x7f23c414e9d0 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23cbdf8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40721b0 con 0x7f23c4070b80 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23cbdf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40c2830 con 0x7f23c40a8470 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23c4070b80 0x7f23c4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:45.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23c4070b80 0x7f23c4151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53656/0 (socket says 172.21.15.89:53656) 2023-12-07T10:01:45.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 -- 172.21.15.89:0/3063865405 learned_addr learned my addr 172.21.15.89:0/3063865405 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:45.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23ca395640 1 --2- 172.21.15.89:0/3063865405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:45.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 -- 172.21.15.89:0/3063865405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 msgr2=0x7f23c406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:45.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 --2- 172.21.15.89:0/3063865405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 -- 172.21.15.89:0/3063865405 >> v1:172.21.15.97:6789/0 conn(0x7f23c414e9d0 legacy=0x7f23c40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:45.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.340+0000 7f23c9393640 1 -- 172.21.15.89:0/3063865405 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4072450 con 0x7f23c4070b80 2023-12-07T10:01:45.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23c9393640 1 --2- 172.21.15.89:0/3063865405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c4151e60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009870 tx=0x7f23b401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e9d13d5daab265 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:45.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23c8b92640 1 -- 172.21.15.89:0/3063865405 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40ac620 con 0x7f23c4070b80 2023-12-07T10:01:45.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23c8b92640 1 -- 172.21.15.89:0/3063865405 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b40ac780 con 0x7f23c4070b80 2023-12-07T10:01:45.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23c8b92640 1 -- 172.21.15.89:0/3063865405 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40acb10 con 0x7f23c4070b80 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 -- 172.21.15.89:0/3063865405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 msgr2=0x7f23c4151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/3063865405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c4151e60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009870 tx=0x7f23b401c4b0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 -- 172.21.15.89:0/3063865405 shutdown_connections 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/3063865405 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/3063865405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c4151e60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 -- 172.21.15.89:0/3063865405 >> 172.21.15.89:0/3063865405 conn(0x7f23c40c2ad0 msgr2=0x7f23c40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 -- 172.21.15.89:0/3063865405 shutdown_connections 2023-12-07T10:01:45.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 -- 172.21.15.89:0/3063865405 wait complete. 2023-12-07T10:01:45.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 Processor -- start 2023-12-07T10:01:45.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.344+0000 7f23cbdf8640 1 -- start start 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c41eb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c414e9d0 0x7f23c41527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c41513b0 con 0x7f23c4070b80 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c41509e0 con 0x7f23c414e9d0 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c41532d0 con 0x7f23c40a8470 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c41eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c41eb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53660/0 (socket says 172.21.15.89:53660) 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9393640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 -- 172.21.15.89:0/919044789 learned_addr learned my addr 172.21.15.89:0/919044789 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23ca395640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c414e9d0 0x7f23c41527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 -- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 msgr2=0x7f23c4150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c4150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 -- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c414e9d0 msgr2=0x7f23c41527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c414e9d0 0x7f23c41527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 -- 172.21.15.89:0/919044789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40094d0 con 0x7f23c4070b80 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23c9b94640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c41eb580 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f23c000c3c0 tx=0x7f23c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00052d0 con 0x7f23c4070b80 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0005430 con 0x7f23c4070b80 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0003840 con 0x7f23c4070b80 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c41503d0 con 0x7f23c4070b80 2023-12-07T10:01:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c4150670 con 0x7f23c4070b80 2023-12-07T10:01:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c404e890 con 0x7f23c4070b80 2023-12-07T10:01:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.348+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f23c00039a0 con 0x7f23c4070b80 2023-12-07T10:01:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.352+0000 7f23ba7fc640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23a80668d0 0x7f23a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.352+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f23c0083620 con 0x7f23c4070b80 2023-12-07T10:01:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.352+0000 7f23c9393640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23a80668d0 0x7f23a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.352+0000 7f23c9393640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23a80668d0 0x7f23a8068d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f23b40ae000 tx=0x7f23b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:45.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.356+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23c0050ba0 con 0x7f23c4070b80 2023-12-07T10:01:45.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:45.516+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f23c40700a0 con 0x7f23c4070b80 2023-12-07T10:01:46.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23ba7fc640 1 -- 172.21.15.89:0/919044789 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23c0083020 con 0x7f23c4070b80 2023-12-07T10:01:46.200 INFO:teuthology.orchestra.run.smithi089.stderr: removed all blocklist entries 2023-12-07T10:01:46.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23a80668d0 msgr2=0x7f23a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23a80668d0 0x7f23a8068d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f23b40ae000 tx=0x7f23b4008040 comp rx=0 tx=0).stop 2023-12-07T10:01:46.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 msgr2=0x7f23c41eb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c41eb580 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f23c000c3c0 tx=0x7f23c000c880 comp rx=0 tx=0).stop 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 shutdown_connections 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c414e9d0 0x7f23c41527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f23a80668d0 0x7f23a8068d90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f23c40a8470 0x7f23c4150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 --2- 172.21.15.89:0/919044789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23c4070b80 0x7f23c41eb580 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 >> 172.21.15.89:0/919044789 conn(0x7f23c40c2ad0 msgr2=0x7f23c415b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 shutdown_connections 2023-12-07T10:01:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.196+0000 7f23cbdf8640 1 -- 172.21.15.89:0/919044789 wait complete. 2023-12-07T10:01:46.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-07T10:01:46.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.356+0000 7fb3d1879640 1 Processor -- start 2023-12-07T10:01:46.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3d1879640 1 -- start start 2023-12-07T10:01:46.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3d1879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc070b80 0x7fb3cc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3d1879640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc06d320 con 0x7fb3cc14e9d0 2023-12-07T10:01:46.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3d1879640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0721b0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3d1879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c2830 con 0x7fb3cc070b80 2023-12-07T10:01:46.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3caffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb3cc14e9d0 0x7fb3cc0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57486/0 (socket says 172.21.15.89:57486) 2023-12-07T10:01:46.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3caffd640 1 -- 172.21.15.89:0/1876857086 learned_addr learned my addr 172.21.15.89:0/1876857086 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:46.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3c3fff640 1 --2- 172.21.15.89:0/1876857086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc070b80 0x7fb3cc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993878467 0 0) 0x7fb3cc06d320 con 0x7fb3cc14e9d0 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b8003530 con 0x7fb3cc14e9d0 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389655002 0 0) 0x7fb3cc0721b0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3cc06d320 con 0x7fb3cc0a8470 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3c3fff640 1 -- 172.21.15.89:0/1876857086 >> v1:172.21.15.97:6789/0 conn(0x7fb3cc0a8470 legacy=0x7fb3cc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3c3fff640 1 -- 172.21.15.89:0/1876857086 >> v1:172.21.15.89:6789/0 conn(0x7fb3cc14e9d0 legacy=0x7fb3cc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.360+0000 7fb3c3fff640 1 -- 172.21.15.89:0/1876857086 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc072450 con 0x7fb3cc070b80 2023-12-07T10:01:46.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3c3fff640 1 --2- 172.21.15.89:0/1876857086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc070b80 0x7fb3cc151e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097f0 tx=0x7fb3b401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd55413ffb3fcca server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:46.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40ab600 con 0x7fb3cc070b80 2023-12-07T10:01:46.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40a7050 con 0x7fb3cc070b80 2023-12-07T10:01:46.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3ca7fc640 1 -- 172.21.15.89:0/1876857086 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40ab980 con 0x7fb3cc070b80 2023-12-07T10:01:46.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 -- 172.21.15.89:0/1876857086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc070b80 msgr2=0x7fb3cc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 --2- 172.21.15.89:0/1876857086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc070b80 0x7fb3cc151e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097f0 tx=0x7fb3b401c430 comp rx=0 tx=0).stop 2023-12-07T10:01:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 -- 172.21.15.89:0/1876857086 shutdown_connections 2023-12-07T10:01:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 --2- 172.21.15.89:0/1876857086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc070b80 0x7fb3cc151e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 -- 172.21.15.89:0/1876857086 >> 172.21.15.89:0/1876857086 conn(0x7fb3cc0c2ad0 msgr2=0x7fb3cc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 -- 172.21.15.89:0/1876857086 shutdown_connections 2023-12-07T10:01:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 -- 172.21.15.89:0/1876857086 wait complete. 2023-12-07T10:01:46.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 Processor -- start 2023-12-07T10:01:46.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.364+0000 7fb3d1879640 1 -- start start 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3cc070b80 0x7fb3cc1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 0x7fb3cc14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc14e9d0 0x7fb3cc150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc14f8d0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1f01c0 con 0x7fb3cc070b80 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1f0780 con 0x7fb3cc14e9d0 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 0x7fb3cc14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 0x7fb3cc14d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53670/0 (socket says 172.21.15.89:53670) 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 -- 172.21.15.89:0/854702210 learned_addr learned my addr 172.21.15.89:0/854702210 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3cb7fe640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc14e9d0 0x7fb3cc150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3caffd640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3cc070b80 0x7fb3cc1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 -- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc14e9d0 msgr2=0x7fb3cc150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc14e9d0 0x7fb3cc150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 -- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3cc070b80 msgr2=0x7fb3cc1f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3cc070b80 0x7fb3cc1f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 -- 172.21.15.89:0/854702210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b4009420 con 0x7fb3cc0a8470 2023-12-07T10:01:46.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c3fff640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 0x7fb3cc14d600 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097f0 tx=0x7fb3b401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:46.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40b4420 con 0x7fb3cc0a8470 2023-12-07T10:01:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40b45a0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40b4950 con 0x7fb3cc0a8470 2023-12-07T10:01:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc150ce0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc1f0410 con 0x7fb3cc0a8470 2023-12-07T10:01:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.368+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc04e890 con 0x7fb3cc0a8470 2023-12-07T10:01:46.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.372+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb3b40b2070 con 0x7fb3cc0a8470 2023-12-07T10:01:46.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.372+0000 7fb3c8ff9640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3ac0668d0 0x7fb3ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.372+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3b411d0f0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.372+0000 7fb3caffd640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3ac0668d0 0x7fb3ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.372+0000 7fb3caffd640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3ac0668d0 0x7fb3ac068d90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc007fd0 tx=0x7fb3bc007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:46.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.376+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3b40ea730 con 0x7fb3cc0a8470 2023-12-07T10:01:46.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.576+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb3cc1f08c0 con 0x7fb3cc0a8470 2023-12-07T10:01:46.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.576+0000 7fb3c8ff9640 1 -- 172.21.15.89:0/854702210 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7fb3b40edd50 con 0x7fb3cc0a8470 2023-12-07T10:01:46.583 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:46.583 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:01:46.583 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_dump": [ 2023-12-07T10:01:46.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.583 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.a", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3Flf1wcOhAACzyi07iCb6OeVrox4hSSoQ==", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.b", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlNmS9ChAAKeb6oUGcE358orATMWlpig==", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:01:46.584 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.c", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3Fl8di0BRAA6GZD2xbIkzOykVG6rHfqew==", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.d", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3Fl/RH+ERAAAUPU8qglPPkntimRXcvGwg==", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.0", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA4l3Fl/Z3VIBAASvuI7XuDpc3FH9/P7lhsww==", 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.586 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.1", 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA7l3FlC/M1KBAAjwhtKGKQ/HZ6yhpOCXV0kw==", 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.587 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.2", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA+l3Fl/y6sLxAAm8pKF8kx9qUmFNUmMbFBMw==", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.3", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBBl3Fl+0hCNxAAIVwKiVgagVbLZsm7QcynUQ==", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.4", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBIl3FlwbtwDBAAk6YFzxYayyMbAudT72sxGA==", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.5", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBLl3Flwt1OFBAAoLwAtcuFIt/FW7gisMaV/w==", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.589 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.6", 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBOl3FlXhU/GhAA/4dl8x5v2OapJqCTPbYFwA==", 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.590 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.7", 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBRl3FlTTKFIBAAUuR+A3irHtSU67nIRnoFug==", 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.0", 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg==", 2023-12-07T10:01:46.591 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow r", 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.1", 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA==", 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow r", 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.admin", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3Fl9gGkHRAABCgzAlOwroY6GO3tuPbihQ==", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.testuser", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQDwl3FlKpd3DhAA8+9gxttS6SPzQ9IT9iSWow==", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow rw fsname=cephfs", 2023-12-07T10:01:46.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.x", 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3FlefecNRAAaSFdy4bxWI1FH6tFc84Hqg==", 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:01:46.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.y", 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA0l3FluC/UMRAA6hAJrSbSRn3I/3XeHlIBCQ==", 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2023-12-07T10:01:46.595 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:01:46.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3ac0668d0 msgr2=0x7fb3ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3ac0668d0 0x7fb3ac068d90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc007fd0 tx=0x7fb3bc007d60 comp rx=0 tx=0).stop 2023-12-07T10:01:46.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 msgr2=0x7fb3cc14d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 0x7fb3cc14d600 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097f0 tx=0x7fb3b401ac70 comp rx=0 tx=0).stop 2023-12-07T10:01:46.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 shutdown_connections 2023-12-07T10:01:46.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb3ac0668d0 0x7fb3ac068d90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb3cc14e9d0 0x7fb3cc150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3cc0a8470 0x7fb3cc14d600 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 --2- 172.21.15.89:0/854702210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3cc070b80 0x7fb3cc1f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 >> 172.21.15.89:0/854702210 conn(0x7fb3cc0c2ad0 msgr2=0x7fb3cc06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:46.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 shutdown_connections 2023-12-07T10:01:46.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.580+0000 7fb3d1879640 1 -- 172.21.15.89:0/854702210 wait complete. 2023-12-07T10:01:46.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-07T10:01:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.736+0000 7fabf8ba1640 1 Processor -- start 2023-12-07T10:01:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.736+0000 7fabf8ba1640 1 -- start start 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf8ba1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabf414ea60 0x7fabf4155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf8ba1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabf406bd00 0x7fabf40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf8ba1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf406c440 con 0x7fabf40bf400 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf8ba1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf4154790 con 0x7fabf414ea60 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf8ba1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf406c6e0 con 0x7fabf406bd00 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabf414ea60 0x7fabf4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabf414ea60 0x7fabf4155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53680/0 (socket says 172.21.15.89:53680) 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 -- 172.21.15.89:0/3469464924 learned_addr learned my addr 172.21.15.89:0/3469464924 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:46.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf1d9b640 1 --2- 172.21.15.89:0/3469464924 >> v2:172.21.15.97:3300/0 conn(0x7fabf406bd00 0x7fabf40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 -- 172.21.15.89:0/3469464924 >> v2:172.21.15.97:3300/0 conn(0x7fabf406bd00 msgr2=0x7fabf40700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 --2- 172.21.15.89:0/3469464924 >> v2:172.21.15.97:3300/0 conn(0x7fabf406bd00 0x7fabf40700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 -- 172.21.15.89:0/3469464924 >> v1:172.21.15.97:6789/0 conn(0x7fabf40bf400 legacy=0x7fabf40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.740+0000 7fabf259c640 1 -- 172.21.15.89:0/3469464924 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4154a50 con 0x7fabf414ea60 2023-12-07T10:01:46.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf259c640 1 --2- 172.21.15.89:0/3469464924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf4155250 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fabf406b370 tx=0x7fabe401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01eb883a14f625b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:46.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf159a640 1 -- 172.21.15.89:0/3469464924 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe40a8050 con 0x7fabf414ea60 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf159a640 1 -- 172.21.15.89:0/3469464924 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe40ac5f0 con 0x7fabf414ea60 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf159a640 1 -- 172.21.15.89:0/3469464924 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe40ac980 con 0x7fabf414ea60 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 -- 172.21.15.89:0/3469464924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 msgr2=0x7fabf4155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/3469464924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf4155250 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fabf406b370 tx=0x7fabe401c3b0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 -- 172.21.15.89:0/3469464924 shutdown_connections 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/3469464924 >> v2:172.21.15.97:3300/0 conn(0x7fabf406bd00 0x7fabf40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/3469464924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf4155250 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 -- 172.21.15.89:0/3469464924 >> 172.21.15.89:0/3469464924 conn(0x7fabf40c2ad0 msgr2=0x7fabf40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 -- 172.21.15.89:0/3469464924 shutdown_connections 2023-12-07T10:01:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 -- 172.21.15.89:0/3469464924 wait complete. 2023-12-07T10:01:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 Processor -- start 2023-12-07T10:01:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.744+0000 7fabf8ba1640 1 -- start start 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabf406bd00 0x7fabf41effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabf40bf400 0x7fabf4145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40aa550 con 0x7fabf414ea60 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41f05c0 con 0x7fabf40bf400 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41f08a0 con 0x7fabf406bd00 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf414cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53682/0 (socket says 172.21.15.89:53682) 2023-12-07T10:01:46.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 -- 172.21.15.89:0/1451962247 learned_addr learned my addr 172.21.15.89:0/1451962247 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf1d9b640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabf40bf400 0x7fabf4145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf259c640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabf406bd00 0x7fabf41effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 -- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabf406bd00 msgr2=0x7fabf41effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabf406bd00 0x7fabf41effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 -- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabf40bf400 msgr2=0x7fabf4145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabf40bf400 0x7fabf4145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 -- 172.21.15.89:0/1451962247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40094d0 con 0x7fabf414ea60 2023-12-07T10:01:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf2d9d640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf414cea0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fabec00c770 tx=0x7fabec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec003b80 con 0x7fabf414ea60 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec003ce0 con 0x7fabf414ea60 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00aa90 con 0x7fabf414ea60 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf41f0b80 con 0x7fabf414ea60 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf41ecb60 con 0x7fabf414ea60 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf404e890 con 0x7fabf414ea60 2023-12-07T10:01:46.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.748+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabec00abf0 con 0x7fabf414ea60 2023-12-07T10:01:46.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.752+0000 7fabe2ffd640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabd40668d0 0x7fabd4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:46.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.752+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fabec083e80 con 0x7fabf414ea60 2023-12-07T10:01:46.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.752+0000 7fabf259c640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabd40668d0 0x7fabd4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.752+0000 7fabf259c640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabd40668d0 0x7fabd4068d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fabe40ae000 tx=0x7fabe4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:46.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.756+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabec051420 con 0x7fabf414ea60 2023-12-07T10:01:46.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.960+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fabf414dde0 con 0x7fabf414ea60 2023-12-07T10:01:46.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.960+0000 7fabe2ffd640 1 -- 172.21.15.89:0/1451962247 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7fabec054a40 con 0x7fabf414ea60 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabd40668d0 msgr2=0x7fabd4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabd40668d0 0x7fabd4068d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fabe40ae000 tx=0x7fabe4009040 comp rx=0 tx=0).stop 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 msgr2=0x7fabf414cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf414cea0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fabec00c770 tx=0x7fabec00cc30 comp rx=0 tx=0).stop 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 shutdown_connections 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabf414ea60 0x7fabf414cea0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabf40bf400 0x7fabf4145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fabd40668d0 0x7fabd4068d90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 --2- 172.21.15.89:0/1451962247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fabf406bd00 0x7fabf41effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 >> 172.21.15.89:0/1451962247 conn(0x7fabf40c2ad0 msgr2=0x7fabf41524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 shutdown_connections 2023-12-07T10:01:46.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:46.964+0000 7fabf8ba1640 1 -- 172.21.15.89:0/1451962247 wait complete. 2023-12-07T10:01:46.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:47.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.120+0000 7f6a0d92a640 1 Processor -- start 2023-12-07T10:01:47.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.120+0000 7f6a0d92a640 1 -- start start 2023-12-07T10:01:47.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f6a0d92a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a08156500 0x7f6a0806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f6a0d92a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0806dec0 con 0x7f6a080c19e0 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f6a0d92a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a08156980 con 0x7f6a0814fcc0 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f6a0d92a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a080aa340 con 0x7f6a08156500 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f69fffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a08156500 0x7f6a0806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f6a077fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6a080c19e0 0x7f6a080c1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57490/0 (socket says 172.21.15.89:57490) 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f6a077fe640 1 -- 172.21.15.89:0/4273625527 learned_addr learned my addr 172.21.15.89:0/4273625527 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f69fffff640 1 -- 172.21.15.89:0/4273625527 >> v1:172.21.15.97:6789/0 conn(0x7f6a0814fcc0 legacy=0x7f6a080aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f69fffff640 1 -- 172.21.15.89:0/4273625527 >> v1:172.21.15.89:6789/0 conn(0x7f6a080c19e0 legacy=0x7f6a080c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.124+0000 7f69fffff640 1 -- 172.21.15.89:0/4273625527 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080ab580 con 0x7f6a08156500 2023-12-07T10:01:47.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f69fffff640 1 --2- 172.21.15.89:0/4273625527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a0806d980 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097c0 tx=0x7f69f001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f2ecd3876b0494 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a067fc640 1 -- 172.21.15.89:0/4273625527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00ab610 con 0x7f6a08156500 2023-12-07T10:01:47.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a067fc640 1 -- 172.21.15.89:0/4273625527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00ab770 con 0x7f6a08156500 2023-12-07T10:01:47.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a067fc640 1 -- 172.21.15.89:0/4273625527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00abb00 con 0x7f6a08156500 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 -- 172.21.15.89:0/4273625527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 msgr2=0x7f6a0806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/4273625527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a0806d980 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097c0 tx=0x7f69f001c410 comp rx=0 tx=0).stop 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 -- 172.21.15.89:0/4273625527 shutdown_connections 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/4273625527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a0806d980 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 -- 172.21.15.89:0/4273625527 >> 172.21.15.89:0/4273625527 conn(0x7f6a080c2ad0 msgr2=0x7f6a080c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 -- 172.21.15.89:0/4273625527 shutdown_connections 2023-12-07T10:01:47.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 -- 172.21.15.89:0/4273625527 wait complete. 2023-12-07T10:01:47.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 Processor -- start 2023-12-07T10:01:47.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.128+0000 7f6a0d92a640 1 -- start start 2023-12-07T10:01:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a080c19e0 0x7f6a0815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a081ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a08151fc0 0x7f6a081ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c4490 con 0x7f6a08156500 2023-12-07T10:01:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c4ca0 con 0x7f6a080c19e0 2023-12-07T10:01:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c46e0 con 0x7f6a08151fc0 2023-12-07T10:01:47.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a081ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a081ecfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53692/0 (socket says 172.21.15.89:53692) 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 -- 172.21.15.89:0/2630476548 learned_addr learned my addr 172.21.15.89:0/2630476548 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a077fe640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a08151fc0 0x7f6a081ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a06ffd640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a080c19e0 0x7f6a0815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 -- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a08151fc0 msgr2=0x7f6a081ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a08151fc0 0x7f6a081ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 -- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a080c19e0 msgr2=0x7f6a0815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a080c19e0 0x7f6a0815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 -- 172.21.15.89:0/2630476548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009420 con 0x7f6a08156500 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a06ffd640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a080c19e0 0x7f6a0815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a077fe640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a08151fc0 0x7f6a081ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f69fffff640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a081ecfa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f69f00ad040 tx=0x7f69f001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00b5810 con 0x7f6a08156500 2023-12-07T10:01:47.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00b59b0 con 0x7f6a08156500 2023-12-07T10:01:47.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a080c49c0 con 0x7f6a08156500 2023-12-07T10:01:47.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00b5d60 con 0x7f6a08156500 2023-12-07T10:01:47.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a08070110 con 0x7f6a08156500 2023-12-07T10:01:47.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.132+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a081ec8e0 con 0x7f6a08156500 2023-12-07T10:01:47.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.136+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f69f00bf410 con 0x7f6a08156500 2023-12-07T10:01:47.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.136+0000 7f6a04ff9640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69e80668d0 0x7f69e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.136+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69f011f080 con 0x7f6a08156500 2023-12-07T10:01:47.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.136+0000 7f6a06ffd640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69e80668d0 0x7f69e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.136+0000 7f6a06ffd640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69e80668d0 0x7f69e8068d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a081512a0 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.140+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a081ec8e0 con 0x7f6a08156500 2023-12-07T10:01:47.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.296+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a08156980 con 0x7f6a08156500 2023-12-07T10:01:47.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.296+0000 7f6a04ff9640 1 -- 172.21.15.89:0/2630476548 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12798 (secure 0 0 0) 0x7f6a08156980 con 0x7f6a08156500 2023-12-07T10:01:47.302 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:47.302 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":63,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:46.205992+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:47.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69e80668d0 msgr2=0x7f69e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69e80668d0 0x7f69e8068d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a081512a0 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 msgr2=0x7f6a081ecfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a081ecfa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f69f00ad040 tx=0x7f69f001ac50 comp rx=0 tx=0).stop 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 shutdown_connections 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69e80668d0 0x7f69e8068d90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a08151fc0 0x7f6a081ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a08156500 0x7f6a081ecfa0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 --2- 172.21.15.89:0/2630476548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a080c19e0 0x7f6a0815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 >> 172.21.15.89:0/2630476548 conn(0x7f6a080c2ad0 msgr2=0x7f6a08153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 shutdown_connections 2023-12-07T10:01:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.300+0000 7f6a0d92a640 1 -- 172.21.15.89:0/2630476548 wait complete. 2023-12-07T10:01:47.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:01:47.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:01:47.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 Processor -- start 2023-12-07T10:01:47.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 -- start start 2023-12-07T10:01:47.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbbb414eaf0 0x7fbbb4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb4151f90 0x7fbbb406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb406de00 con 0x7fbbb40c0370 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb4070390 con 0x7fbbb414eaf0 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbba1f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb414eed0 con 0x7fbbb4151f90 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbb3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbbb40c0370 0x7fbbb406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57504/0 (socket says 172.21.15.89:57504) 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbb3fff640 1 -- 172.21.15.89:0/2057128668 learned_addr learned my addr 172.21.15.89:0/2057128668 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbb37fe640 1 --2- 172.21.15.89:0/2057128668 >> v2:172.21.15.97:3300/0 conn(0x7fbbb414eaf0 0x7fbbb4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.460+0000 7fbbb2ffd640 1 --2- 172.21.15.89:0/2057128668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb4151f90 0x7fbbb406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb27fc640 1 -- 172.21.15.89:0/2057128668 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142615513 0 0) 0x7fbbb406de00 con 0x7fbbb40c0370 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb27fc640 1 -- 172.21.15.89:0/2057128668 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9c003530 con 0x7fbbb40c0370 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb2ffd640 1 -- 172.21.15.89:0/2057128668 >> v2:172.21.15.97:3300/0 conn(0x7fbbb414eaf0 msgr2=0x7fbbb4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb2ffd640 1 --2- 172.21.15.89:0/2057128668 >> v2:172.21.15.97:3300/0 conn(0x7fbbb414eaf0 0x7fbbb4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb2ffd640 1 -- 172.21.15.89:0/2057128668 >> v1:172.21.15.89:6789/0 conn(0x7fbbb40c0370 legacy=0x7fbbb406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb2ffd640 1 -- 172.21.15.89:0/2057128668 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4151270 con 0x7fbbb4151f90 2023-12-07T10:01:47.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb2ffd640 1 --2- 172.21.15.89:0/2057128668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb4151f90 0x7fbbb406d110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097c0 tx=0x7fbba801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=297c97433f6bb038 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb27fc640 1 -- 172.21.15.89:0/2057128668 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba80ab600 con 0x7fbbb4151f90 2023-12-07T10:01:47.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb27fc640 1 -- 172.21.15.89:0/2057128668 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba80a7050 con 0x7fbbb4151f90 2023-12-07T10:01:47.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbb27fc640 1 -- 172.21.15.89:0/2057128668 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba80ab980 con 0x7fbbb4151f90 2023-12-07T10:01:47.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2057128668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb4151f90 msgr2=0x7fbbb406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.464+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2057128668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb4151f90 0x7fbbb406d110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097c0 tx=0x7fbba801c330 comp rx=0 tx=0).stop 2023-12-07T10:01:47.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2057128668 shutdown_connections 2023-12-07T10:01:47.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2057128668 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb4151f90 0x7fbbb406d110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2057128668 >> v2:172.21.15.97:3300/0 conn(0x7fbbb414eaf0 0x7fbbb4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2057128668 >> 172.21.15.89:0/2057128668 conn(0x7fbbb40c2a60 msgr2=0x7fbbb40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:47.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2057128668 shutdown_connections 2023-12-07T10:01:47.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2057128668 wait complete. 2023-12-07T10:01:47.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 Processor -- start 2023-12-07T10:01:47.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- start start 2023-12-07T10:01:47.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbb40c0370 0x7fbbb415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb414eaf0 0x7fbbb40bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 0x7fbbb40c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c28a0 con 0x7fbbb41edd60 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c1fa0 con 0x7fbbb40c0370 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbba1f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb41ed070 con 0x7fbbb414eaf0 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 0x7fbbb40c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 0x7fbbb40c0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53696/0 (socket says 172.21.15.89:53696) 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 -- 172.21.15.89:0/2695375480 learned_addr learned my addr 172.21.15.89:0/2695375480 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb37fe640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbb40c0370 0x7fbbb415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb2ffd640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb414eaf0 0x7fbbb40bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 -- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb414eaf0 msgr2=0x7fbbb40bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb414eaf0 0x7fbbb40bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 -- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbb40c0370 msgr2=0x7fbbb415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbb40c0370 0x7fbbb415cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 -- 172.21.15.89:0/2695375480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009420 con 0x7fbbb41edd60 2023-12-07T10:01:47.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb37fe640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbb40c0370 0x7fbbb415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:47.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.468+0000 7fbbb3fff640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 0x7fbbb40c0860 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00cb40 tx=0x7fbbac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00aca0 con 0x7fbbb41edd60 2023-12-07T10:01:47.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac00ae00 con 0x7fbbb41edd60 2023-12-07T10:01:47.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb41ed8d0 con 0x7fbbb41edd60 2023-12-07T10:01:47.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac012620 con 0x7fbbb41edd60 2023-12-07T10:01:47.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb40c25c0 con 0x7fbbb41edd60 2023-12-07T10:01:47.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb41eda60 con 0x7fbbb41edd60 2023-12-07T10:01:47.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbbac007070 con 0x7fbbb41edd60 2023-12-07T10:01:47.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbb9bfff640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba00668d0 0x7fbba0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbac0841b0 con 0x7fbbb41edd60 2023-12-07T10:01:47.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbbb37fe640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba00668d0 0x7fbba0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.472+0000 7fbbb37fe640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba00668d0 0x7fbba0068d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40bfe30 tx=0x7fbba4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.476+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbac0516a0 con 0x7fbbb41edd60 2023-12-07T10:01:47.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.628+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbb404e890 con 0x7fbbb41edd60 2023-12-07T10:01:47.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbb9bfff640 1 -- 172.21.15.89:0/2695375480 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbac054cc0 con 0x7fbbb41edd60 2023-12-07T10:01:47.635 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:01:47.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba00668d0 msgr2=0x7fbba0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba00668d0 0x7fbba0068d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40bfe30 tx=0x7fbba4008040 comp rx=0 tx=0).stop 2023-12-07T10:01:47.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 msgr2=0x7fbbb40c0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 0x7fbbb40c0860 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00cb40 tx=0x7fbbac00a060 comp rx=0 tx=0).stop 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 shutdown_connections 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb41edd60 0x7fbbb40c0860 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbba00668d0 0x7fbba0068d90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbbb414eaf0 0x7fbbb40bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 --2- 172.21.15.89:0/2695375480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbbb40c0370 0x7fbbb415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 >> 172.21.15.89:0/2695375480 conn(0x7fbbb40c2a60 msgr2=0x7fbbb406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 shutdown_connections 2023-12-07T10:01:47.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.632+0000 7fbbba1f8640 1 -- 172.21.15.89:0/2695375480 wait complete. 2023-12-07T10:01:47.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T10:01:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e19301640 1 Processor -- start 2023-12-07T10:01:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e19301640 1 -- start start 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e19301640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e14151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e19301640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1406d320 con 0x7f0e140a8470 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e19301640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e140721b0 con 0x7f0e14070b80 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e19301640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140c2830 con 0x7f0e1414e9d0 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e137fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0e140a8470 0x7f0e1406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57518/0 (socket says 172.21.15.89:57518) 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e137fe640 1 -- 172.21.15.89:0/840316283 learned_addr learned my addr 172.21.15.89:0/840316283 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e12ffd640 1 --2- 172.21.15.89:0/840316283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e14151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602427028 0 0) 0x7f0e1406d320 con 0x7f0e140a8470 2023-12-07T10:01:47.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.788+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e00003530 con 0x7f0e140a8470 2023-12-07T10:01:47.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813765683 0 0) 0x7f0e140721b0 con 0x7f0e14070b80 2023-12-07T10:01:47.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e1406d320 con 0x7f0e14070b80 2023-12-07T10:01:47.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e12ffd640 1 -- 172.21.15.89:0/840316283 >> v1:172.21.15.97:6789/0 conn(0x7f0e14070b80 legacy=0x7f0e140c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e12ffd640 1 -- 172.21.15.89:0/840316283 >> v1:172.21.15.89:6789/0 conn(0x7f0e140a8470 legacy=0x7f0e1406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e12ffd640 1 -- 172.21.15.89:0/840316283 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14072450 con 0x7f0e1414e9d0 2023-12-07T10:01:47.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e12ffd640 1 --2- 172.21.15.89:0/840316283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e14151e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e040097f0 tx=0x7f0e0401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b041529b602a356f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040ab600 con 0x7f0e1414e9d0 2023-12-07T10:01:47.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e040a7050 con 0x7f0e1414e9d0 2023-12-07T10:01:47.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.792+0000 7f0e127fc640 1 -- 172.21.15.89:0/840316283 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040ab980 con 0x7f0e1414e9d0 2023-12-07T10:01:47.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- 172.21.15.89:0/840316283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 msgr2=0x7f0e14151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 --2- 172.21.15.89:0/840316283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e14151e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e040097f0 tx=0x7f0e0401c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- 172.21.15.89:0/840316283 shutdown_connections 2023-12-07T10:01:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 --2- 172.21.15.89:0/840316283 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e14151e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- 172.21.15.89:0/840316283 >> 172.21.15.89:0/840316283 conn(0x7f0e140c2ad0 msgr2=0x7f0e140c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- 172.21.15.89:0/840316283 shutdown_connections 2023-12-07T10:01:47.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- 172.21.15.89:0/840316283 wait complete. 2023-12-07T10:01:47.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 Processor -- start 2023-12-07T10:01:47.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- start start 2023-12-07T10:01:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e14070b80 0x7f0e141ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 0x7f0e141f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e140bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141f0090 con 0x7f0e140a8470 2023-12-07T10:01:47.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141f1180 con 0x7f0e14070b80 2023-12-07T10:01:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e19301640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140aad80 con 0x7f0e1414e9d0 2023-12-07T10:01:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 0x7f0e141f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e0a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 0x7f0e141f0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53698/0 (socket says 172.21.15.89:53698) 2023-12-07T10:01:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e0a7fc640 1 -- 172.21.15.89:0/2589638731 learned_addr learned my addr 172.21.15.89:0/2589638731 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e12ffd640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e14070b80 0x7f0e141ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.796+0000 7f0e137fe640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e140bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0a7fc640 1 -- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 msgr2=0x7f0e140bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0a7fc640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e140bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0a7fc640 1 -- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e14070b80 msgr2=0x7f0e141ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0a7fc640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e14070b80 0x7f0e141ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0a7fc640 1 -- 172.21.15.89:0/2589638731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009420 con 0x7f0e140a8470 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e12ffd640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e14070b80 0x7f0e141ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e137fe640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e140bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:47.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0a7fc640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 0x7f0e141f0c40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c8c0 tx=0x7f0dfc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc003db0 con 0x7f0e140a8470 2023-12-07T10:01:47.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc005070 con 0x7f0e140a8470 2023-12-07T10:01:47.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc005420 con 0x7f0e140a8470 2023-12-07T10:01:47.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e140ab060 con 0x7f0e140a8470 2023-12-07T10:01:47.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e141ed040 con 0x7f0e140a8470 2023-12-07T10:01:47.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e141ed260 con 0x7f0e140a8470 2023-12-07T10:01:47.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0dfc005580 con 0x7f0e140a8470 2023-12-07T10:01:47.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0bfff640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0df4066920 0x7f0df4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:47.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0dfc083a70 con 0x7f0e140a8470 2023-12-07T10:01:47.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.800+0000 7f0e12ffd640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0df4066920 0x7f0df4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:47.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.804+0000 7f0e12ffd640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0df4066920 0x7f0df4068de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0e040ad000 tx=0x7f0e040a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:47.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.804+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0dfc051070 con 0x7f0e140a8470 2023-12-07T10:01:47.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e1404e890 con 0x7f0e140a8470 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e0bfff640 1 -- 172.21.15.89:0/2589638731 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0dfc017020 con 0x7f0e140a8470 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:01:47.961 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0df4066920 msgr2=0x7f0df4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0df4066920 0x7f0df4068de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0e040ad000 tx=0x7f0e040a4f90 comp rx=0 tx=0).stop 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 msgr2=0x7f0e141f0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 0x7f0e141f0c40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c8c0 tx=0x7f0dfc00cd80 comp rx=0 tx=0).stop 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 shutdown_connections 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0df4066920 0x7f0df4068de0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0e1414e9d0 0x7f0e140bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e140a8470 0x7f0e141f0c40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 --2- 172.21.15.89:0/2589638731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e14070b80 0x7f0e141ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 >> 172.21.15.89:0/2589638731 conn(0x7f0e140c2ad0 msgr2=0x7f0e1415f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 shutdown_connections 2023-12-07T10:01:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:47.956+0000 7f0e19301640 1 -- 172.21.15.89:0/2589638731 wait complete. 2023-12-07T10:01:47.982 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-07T10:01:47.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-07T10:01:48.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 Processor -- start 2023-12-07T10:01:48.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 -- start start 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25e814e390 0x7f25e80c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 0x7f25e8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e814e770 con 0x7f25e80abde0 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e806b2e0 con 0x7f25e814e390 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25ed31d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81518d0 con 0x7f25e81545a0 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25de7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f25e80abde0 0x7f25e80c1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57524/0 (socket says 172.21.15.89:57524) 2023-12-07T10:01:48.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25de7fc640 1 -- 172.21.15.89:0/3529185106 learned_addr learned my addr 172.21.15.89:0/3529185106 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/3529185106 >> v2:172.21.15.97:3300/0 conn(0x7f25e814e390 0x7f25e80c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887586033 0 0) 0x7f25e814e770 con 0x7f25e80abde0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e77fe640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 0x7f25e8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d4003450 con 0x7f25e80abde0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3758245868 0 0) 0x7f25d4003450 con 0x7f25e80abde0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 msgr2=0x7f25e8154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 0x7f25e8154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 >> v2:172.21.15.97:3300/0 conn(0x7f25e814e390 msgr2=0x7f25e80c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 --2- 172.21.15.89:0/3529185106 >> v2:172.21.15.97:3300/0 conn(0x7f25e814e390 0x7f25e80c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8151bb0 con 0x7f25e80abde0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f25d0001680 con 0x7f25e80abde0 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/3529185106 >> v2:172.21.15.97:3300/0 conn(0x7f25e814e390 0x7f25e80c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 >> v1:172.21.15.89:6789/0 conn(0x7f25e80abde0 legacy=0x7f25e80c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25d4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 0x7f25d400a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25d400ae00 0x7f25d400d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e806b2e0 con 0x7f25d4003a70 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81518d0 con 0x7f25d400ae00 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d400db90 con 0x7f25e81545a0 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25d4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e77fe640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25d400ae00 0x7f25d400d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25de7fc640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 0x7f25d400a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 -- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 msgr2=0x7f25d400a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e81545a0 0x7f25d400a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 -- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25d400ae00 msgr2=0x7f25d400d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25d400ae00 0x7f25d400d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:48.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.120+0000 7f25e6ffd640 1 -- 172.21.15.89:0/3529185106 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4003450 con 0x7f25d4003a70 2023-12-07T10:01:48.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25d4003e90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009c80 tx=0x7f25d801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f4c6cdd07f45e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:48.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80a5830 con 0x7f25d4003a70 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d80a5990 con 0x7f25d4003a70 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25e67fc640 1 -- 172.21.15.89:0/3529185106 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80a5d40 con 0x7f25d4003a70 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25ed31d640 1 -- 172.21.15.89:0/3529185106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 msgr2=0x7f25d4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25ed31d640 1 --2- 172.21.15.89:0/3529185106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25d4003e90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009c80 tx=0x7f25d801cc10 comp rx=0 tx=0).stop 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25e77fe640 1 -- 172.21.15.89:0/3529185106 reap_dead start 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25ed31d640 1 -- 172.21.15.89:0/3529185106 shutdown_connections 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25ed31d640 1 -- 172.21.15.89:0/3529185106 >> 172.21.15.89:0/3529185106 conn(0x7f25e806a5a0 msgr2=0x7f25e806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25ed31d640 1 -- 172.21.15.89:0/3529185106 shutdown_connections 2023-12-07T10:01:48.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.124+0000 7f25ed31d640 1 -- 172.21.15.89:0/3529185106 wait complete. 2023-12-07T10:01:48.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 Processor -- start 2023-12-07T10:01:48.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 -- start start 2023-12-07T10:01:48.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25e814d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e814da00 0x7f25e806c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25e806cfb0 0x7f25e81f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80c4090 con 0x7f25d4003a70 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8143f90 con 0x7f25e806cfb0 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8149880 con 0x7f25e814da00 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25e814d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25e814d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53722/0 (socket says 172.21.15.89:53722) 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 -- 172.21.15.89:0/1751928420 learned_addr learned my addr 172.21.15.89:0/1751928420 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e77fe640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25e806cfb0 0x7f25e81f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25de7fc640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e814da00 0x7f25e806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 -- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e814da00 msgr2=0x7f25e806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e814da00 0x7f25e806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 -- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25e806cfb0 msgr2=0x7f25e81f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25e806cfb0 0x7f25e81f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 -- 172.21.15.89:0/1751928420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80c5f00 con 0x7f25d4003a70 2023-12-07T10:01:48.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25de7fc640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e814da00 0x7f25e806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e77fe640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25e806cfb0 0x7f25e81f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25e6ffd640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25e814d4c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f25d801ca40 tx=0x7f25d4003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8004020 con 0x7f25d4003a70 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d80041a0 con 0x7f25d4003a70 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8003620 con 0x7f25d4003a70 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e80c5c20 con 0x7f25d4003a70 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.128+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e8149510 con 0x7f25d4003a70 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.132+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e804e890 con 0x7f25d4003a70 2023-12-07T10:01:48.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.132+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25d80b4040 con 0x7f25d4003a70 2023-12-07T10:01:48.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.132+0000 7f25dffff640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25c8066900 0x7f25c8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:48.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.132+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25d811dd70 con 0x7f25d4003a70 2023-12-07T10:01:48.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.132+0000 7f25de7fc640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25c8066900 0x7f25c8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:48.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.132+0000 7f25de7fc640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25c8066900 0x7f25c8068dc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25e8153dd0 tx=0x7f25d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:48.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.136+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25d80eb390 con 0x7f25d4003a70 2023-12-07T10:01:48.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:48.288+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f25e80c0530 con 0x7f25d4003a70 2023-12-07T10:01:49.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.200+0000 7f25dffff640 1 -- 172.21.15.89:0/1751928420 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f25d80ee9b0 con 0x7f25d4003a70 2023-12-07T10:01:49.206 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2023-12-07T10:01:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25c8066900 msgr2=0x7f25c8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:49.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25c8066900 0x7f25c8068dc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25e8153dd0 tx=0x7f25d0009040 comp rx=0 tx=0).stop 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 msgr2=0x7f25e814d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25e814d4c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f25d801ca40 tx=0x7f25d4003700 comp rx=0 tx=0).stop 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 shutdown_connections 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25e806cfb0 0x7f25e81f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f25c8066900 0x7f25c8068dc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f25e814da00 0x7f25e806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 --2- 172.21.15.89:0/1751928420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25d4003a70 0x7f25e814d4c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 >> 172.21.15.89:0/1751928420 conn(0x7f25e806a5a0 msgr2=0x7f25e8070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 shutdown_connections 2023-12-07T10:01:49.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.204+0000 7f25ed31d640 1 -- 172.21.15.89:0/1751928420 wait complete. 2023-12-07T10:01:49.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T10:01:49.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.376+0000 7f228a5df640 1 Processor -- start 2023-12-07T10:01:49.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.376+0000 7f228a5df640 1 -- start start 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f228a5df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22840c0370 0x7f228406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f228a5df640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f22840a8470 0x7f228406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f228a5df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228406de00 con 0x7f228414eaf0 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f228a5df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2284070390 con 0x7f22840c0370 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f228a5df640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228406db90 con 0x7f22840a8470 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22840c0370 0x7f228406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22840c0370 0x7f228406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53736/0 (socket says 172.21.15.89:53736) 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 -- 172.21.15.89:0/4045464854 learned_addr learned my addr 172.21.15.89:0/4045464854 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f2288b7c640 1 --2- 172.21.15.89:0/4045464854 >> v2:172.21.15.97:3300/0 conn(0x7f22840a8470 0x7f228406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:49.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 -- 172.21.15.89:0/4045464854 >> v2:172.21.15.97:3300/0 conn(0x7f22840a8470 msgr2=0x7f228406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:49.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 --2- 172.21.15.89:0/4045464854 >> v2:172.21.15.97:3300/0 conn(0x7f22840a8470 0x7f228406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 -- 172.21.15.89:0/4045464854 >> v1:172.21.15.97:6789/0 conn(0x7f228414eaf0 legacy=0x7f2284151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:49.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f22837fe640 1 -- 172.21.15.89:0/4045464854 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228414eed0 con 0x7f22840c0370 2023-12-07T10:01:49.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.380+0000 7f2288b7c640 1 --2- 172.21.15.89:0/4045464854 >> v2:172.21.15.97:3300/0 conn(0x7f22840a8470 0x7f228406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:01:49.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f22837fe640 1 --2- 172.21.15.89:0/4045464854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f228406d110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f22840c3910 tx=0x7f227801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ead9c93354f1e42 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:49.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f2282ffd640 1 -- 172.21.15.89:0/4045464854 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780ac620 con 0x7f22840c0370 2023-12-07T10:01:49.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f2282ffd640 1 -- 172.21.15.89:0/4045464854 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780ac780 con 0x7f22840c0370 2023-12-07T10:01:49.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f2282ffd640 1 -- 172.21.15.89:0/4045464854 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780acb10 con 0x7f22840c0370 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 -- 172.21.15.89:0/4045464854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 msgr2=0x7f228406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 --2- 172.21.15.89:0/4045464854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f228406d110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f22840c3910 tx=0x7f227801c3a0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 -- 172.21.15.89:0/4045464854 shutdown_connections 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 --2- 172.21.15.89:0/4045464854 >> v2:172.21.15.97:3300/0 conn(0x7f22840a8470 0x7f228406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 --2- 172.21.15.89:0/4045464854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f228406d110 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 -- 172.21.15.89:0/4045464854 >> 172.21.15.89:0/4045464854 conn(0x7f22840c2a60 msgr2=0x7f22840c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 -- 172.21.15.89:0/4045464854 shutdown_connections 2023-12-07T10:01:49.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 -- 172.21.15.89:0/4045464854 wait complete. 2023-12-07T10:01:49.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 Processor -- start 2023-12-07T10:01:49.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.384+0000 7f228a5df640 1 -- start start 2023-12-07T10:01:49.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840a8470 0x7f228414df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:49.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f22840abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f228414eaf0 0x7f228414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840ab8b0 con 0x7f22840c0370 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841f0e20 con 0x7f22840a8470 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840aa400 con 0x7f228414eaf0 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f22840abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f22840abce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53738/0 (socket says 172.21.15.89:53738) 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 -- 172.21.15.89:0/790465518 learned_addr learned my addr 172.21.15.89:0/790465518 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f2283fff640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840a8470 0x7f228414df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f2288b7c640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f228414eaf0 0x7f228414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 -- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f228414eaf0 msgr2=0x7f228414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f228414eaf0 0x7f228414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 -- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840a8470 msgr2=0x7f228414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840a8470 0x7f228414df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:49.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 -- 172.21.15.89:0/790465518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780094d0 con 0x7f22840c0370 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f22837fe640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f22840abce0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f227801aa50 tx=0x7f227801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780ab990 con 0x7f22840c0370 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780abb10 con 0x7f22840c0370 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780b7420 con 0x7f22840c0370 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22841f1350 con 0x7f22840c0370 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22841f1070 con 0x7f22840c0370 2023-12-07T10:01:49.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.388+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22841555b0 con 0x7f22840c0370 2023-12-07T10:01:49.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.392+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f22780b3040 con 0x7f22840c0370 2023-12-07T10:01:49.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.392+0000 7f2280ff9640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f22700668d0 0x7f2270068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:49.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.392+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f227811ec00 con 0x7f22840c0370 2023-12-07T10:01:49.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.392+0000 7f2283fff640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f22700668d0 0x7f2270068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:49.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.392+0000 7f2283fff640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f22700668d0 0x7f2270068d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f2274009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:49.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.396+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22780ec0c0 con 0x7f22840c0370 2023-12-07T10:01:49.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:49.548+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f22840c0140 con 0x7f22840c0370 2023-12-07T10:01:50.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.212+0000 7f2280ff9640 1 -- 172.21.15.89:0/790465518 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f22780ef6e0 con 0x7f22840c0370 2023-12-07T10:01:50.217 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2023-12-07T10:01:50.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f22700668d0 msgr2=0x7f2270068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f22700668d0 0x7f2270068d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f2274009060 comp rx=0 tx=0).stop 2023-12-07T10:01:50.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 msgr2=0x7f22840abce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f22840abce0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f227801aa50 tx=0x7f227801abe0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 shutdown_connections 2023-12-07T10:01:50.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f22700668d0 0x7f2270068d90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f228414eaf0 0x7f228414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22840c0370 0x7f22840abce0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 --2- 172.21.15.89:0/790465518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22840a8470 0x7f228414df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 >> 172.21.15.89:0/790465518 conn(0x7f22840c2a60 msgr2=0x7f228406d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:50.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.216+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 shutdown_connections 2023-12-07T10:01:50.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.220+0000 7f228a5df640 1 -- 172.21.15.89:0/790465518 wait complete. 2023-12-07T10:01:50.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-07T10:01:50.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842e3df640 1 Processor -- start 2023-12-07T10:01:50.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842e3df640 1 -- start start 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842e3df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84280c8430 0x7f842806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842e3df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842806cf70 con 0x7f84280c7f20 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842e3df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428152160 con 0x7f8428151d80 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842e3df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280c6a30 con 0x7f84280c8430 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f84277fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84280c8430 0x7f842806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842c97c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f84280c7f20 0x7f842806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55638/0 (socket says 172.21.15.89:55638) 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f842c97c640 1 -- 172.21.15.89:0/2091024273 learned_addr learned my addr 172.21.15.89:0/2091024273 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:50.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f84277fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84280c8430 0x7f842806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40790/0 (socket says 172.21.15.89:40790) 2023-12-07T10:01:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f84277fe640 1 -- 172.21.15.89:0/2091024273 >> v1:172.21.15.97:6789/0 conn(0x7f8428151d80 legacy=0x7f84280c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f84277fe640 1 -- 172.21.15.89:0/2091024273 >> v1:172.21.15.89:6789/0 conn(0x7f84280c7f20 legacy=0x7f842806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.396+0000 7f84277fe640 1 -- 172.21.15.89:0/2091024273 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280c72d0 con 0x7f84280c8430 2023-12-07T10:01:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f84277fe640 1 --2- 172.21.15.89:0/2091024273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c8430 0x7f842806b720 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f841c0097c0 tx=0x7f841c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd927ab6c14015b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f8426ffd640 1 -- 172.21.15.89:0/2091024273 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c0ac620 con 0x7f84280c8430 2023-12-07T10:01:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f8426ffd640 1 -- 172.21.15.89:0/2091024273 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c0ac780 con 0x7f84280c8430 2023-12-07T10:01:50.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f8426ffd640 1 -- 172.21.15.89:0/2091024273 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c0acb10 con 0x7f84280c8430 2023-12-07T10:01:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 -- 172.21.15.89:0/2091024273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c8430 msgr2=0x7f842806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 --2- 172.21.15.89:0/2091024273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c8430 0x7f842806b720 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f841c0097c0 tx=0x7f841c01c3c0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 -- 172.21.15.89:0/2091024273 shutdown_connections 2023-12-07T10:01:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 --2- 172.21.15.89:0/2091024273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c8430 0x7f842806b720 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 -- 172.21.15.89:0/2091024273 >> 172.21.15.89:0/2091024273 conn(0x7f84280abd00 msgr2=0x7f84280ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:50.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 -- 172.21.15.89:0/2091024273 shutdown_connections 2023-12-07T10:01:50.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 -- 172.21.15.89:0/2091024273 wait complete. 2023-12-07T10:01:50.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.400+0000 7f842e3df640 1 Processor -- start 2023-12-07T10:01:50.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- start start 2023-12-07T10:01:50.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 0x7f84281537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84280c8430 0x7f84280af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8428151d80 0x7f84281ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280c2740 con 0x7f84280c7f20 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842814bf70 con 0x7f84280c8430 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84281ec9c0 con 0x7f8428151d80 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 0x7f84281537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 0x7f84281537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40804/0 (socket says 172.21.15.89:40804) 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 -- 172.21.15.89:0/2590169317 learned_addr learned my addr 172.21.15.89:0/2590169317 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f84277fe640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84280c8430 0x7f84280af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842c97c640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8428151d80 0x7f84281ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 -- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8428151d80 msgr2=0x7f84281ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8428151d80 0x7f84281ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 -- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84280c8430 msgr2=0x7f84280af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:50.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84280c8430 0x7f84280af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:50.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 -- 172.21.15.89:0/2590169317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c009420 con 0x7f84280c7f20 2023-12-07T10:01:50.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8427fff640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 0x7f84281537e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f841800c500 tx=0x7f841800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:50.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418005220 con 0x7f84280c7f20 2023-12-07T10:01:50.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418005380 con 0x7f84280c7f20 2023-12-07T10:01:50.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84280c35f0 con 0x7f84280c7f20 2023-12-07T10:01:50.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418007270 con 0x7f84280c7f20 2023-12-07T10:01:50.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84280c3890 con 0x7f84280c7f20 2023-12-07T10:01:50.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.404+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842804e890 con 0x7f84280c7f20 2023-12-07T10:01:50.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.408+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f84180073d0 con 0x7f84280c7f20 2023-12-07T10:01:50.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.408+0000 7f8424ff9640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84140668d0 0x7f8414068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:50.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.408+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8418083a50 con 0x7f84280c7f20 2023-12-07T10:01:50.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.408+0000 7f84277fe640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84140668d0 0x7f8414068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:50.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.408+0000 7f84277fe640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84140668d0 0x7f8414068d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f841c0ae000 tx=0x7f841c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:50.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.412+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8418050db0 con 0x7f84280c7f20 2023-12-07T10:01:50.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:50.592+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8428152160 con 0x7f84280c7f20 2023-12-07T10:01:51.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.228+0000 7f8424ff9640 1 -- 172.21.15.89:0/2590169317 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8428152160 con 0x7f84280c7f20 2023-12-07T10:01:51.234 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 12 and data pool 13 2023-12-07T10:01:51.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84140668d0 msgr2=0x7f8414068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84140668d0 0x7f8414068d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f841c0ae000 tx=0x7f841c008040 comp rx=0 tx=0).stop 2023-12-07T10:01:51.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 msgr2=0x7f84281537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 0x7f84281537e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f841800c500 tx=0x7f841800c9c0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 shutdown_connections 2023-12-07T10:01:51.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f84140668d0 0x7f8414068d90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8428151d80 0x7f84281ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84280c8430 0x7f84280af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 --2- 172.21.15.89:0/2590169317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84280c7f20 0x7f84281537e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.232+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 >> 172.21.15.89:0/2590169317 conn(0x7f84280abd00 msgr2=0x7f84281507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:51.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.236+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 shutdown_connections 2023-12-07T10:01:51.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.236+0000 7f842e3df640 1 -- 172.21.15.89:0/2590169317 wait complete. 2023-12-07T10:01:51.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:51.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f639192a640 1 Processor -- start 2023-12-07T10:01:51.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f639192a640 1 -- start start 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f639192a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f638c14fcc0 0x7f638c156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f639192a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c0ab580 con 0x7f638c06d980 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f639192a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c152fe0 con 0x7f638c0c19e0 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f639192a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0aa340 con 0x7f638c14fcc0 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f638c14fcc0 0x7f638c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638a7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f638c06d980 0x7f638c0aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55640/0 (socket says 172.21.15.89:55640) 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f638c14fcc0 0x7f638c156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40816/0 (socket says 172.21.15.89:40816) 2023-12-07T10:01:51.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638a7fc640 1 -- 172.21.15.89:0/3980310059 learned_addr learned my addr 172.21.15.89:0/3980310059 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:51.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638affd640 1 -- 172.21.15.89:0/3980310059 >> v1:172.21.15.97:6789/0 conn(0x7f638c0c19e0 legacy=0x7f638c0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638affd640 1 -- 172.21.15.89:0/3980310059 >> v1:172.21.15.89:6789/0 conn(0x7f638c06d980 legacy=0x7f638c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f6389ffb640 1 -- 172.21.15.89:0/3980310059 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256297226 0 0) 0x7f638c0ab580 con 0x7f638c06d980 2023-12-07T10:01:51.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.416+0000 7f638affd640 1 -- 172.21.15.89:0/3980310059 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c1532c0 con 0x7f638c14fcc0 2023-12-07T10:01:51.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f638affd640 1 --2- 172.21.15.89:0/3980310059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c14fcc0 0x7f638c156500 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097c0 tx=0x7f637c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14925c20d79e2b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:51.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f6389ffb640 1 -- 172.21.15.89:0/3980310059 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0ab650 con 0x7f638c14fcc0 2023-12-07T10:01:51.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f6389ffb640 1 -- 172.21.15.89:0/3980310059 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c0ab7b0 con 0x7f638c14fcc0 2023-12-07T10:01:51.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f6389ffb640 1 -- 172.21.15.89:0/3980310059 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0abb40 con 0x7f638c14fcc0 2023-12-07T10:01:51.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 -- 172.21.15.89:0/3980310059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c14fcc0 msgr2=0x7f638c156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 --2- 172.21.15.89:0/3980310059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c14fcc0 0x7f638c156500 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097c0 tx=0x7f637c01c450 comp rx=0 tx=0).stop 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 -- 172.21.15.89:0/3980310059 shutdown_connections 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 --2- 172.21.15.89:0/3980310059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c14fcc0 0x7f638c156500 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 -- 172.21.15.89:0/3980310059 >> 172.21.15.89:0/3980310059 conn(0x7f638c0c2ad0 msgr2=0x7f638c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 -- 172.21.15.89:0/3980310059 shutdown_connections 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 -- 172.21.15.89:0/3980310059 wait complete. 2023-12-07T10:01:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.420+0000 7f639192a640 1 Processor -- start 2023-12-07T10:01:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- start start 2023-12-07T10:01:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f638c06d980 0x7f638c0bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f638c0c19e0 0x7f638c1ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 0x7f638c1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1ec750 con 0x7f638c0c3bc0 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1481c0 con 0x7f638c0c19e0 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0c52f0 con 0x7f638c06d980 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 0x7f638c1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 0x7f638c1ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40822/0 (socket says 172.21.15.89:40822) 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 -- 172.21.15.89:0/4112775609 learned_addr learned my addr 172.21.15.89:0/4112775609 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638a7fc640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f638c0c19e0 0x7f638c1ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638affd640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f638c06d980 0x7f638c0bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 -- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f638c06d980 msgr2=0x7f638c0bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f638c06d980 0x7f638c0bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 -- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f638c0c19e0 msgr2=0x7f638c1ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f638c0c19e0 0x7f638c1ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 -- 172.21.15.89:0/4112775609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c009420 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638a7fc640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f638c0c19e0 0x7f638c1ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f638b7fe640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 0x7f638c1ed0e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f638400c770 tx=0x7f638400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384003b80 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384003ce0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c0c55d0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400aa90 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c0c5b90 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.424+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c1ec8c0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.428+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f638400abf0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.428+0000 7f6373fff640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63780668d0 0x7f6378068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.428+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6384084200 con 0x7f638c0c3bc0 2023-12-07T10:01:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.428+0000 7f638affd640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63780668d0 0x7f6378068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.428+0000 7f638affd640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63780668d0 0x7f6378068d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f637c0af000 tx=0x7f637c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:51.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.432+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f638c1ec8c0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.584+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f638c1ec8c0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.584+0000 7f6373fff640 1 -- 172.21.15.89:0/4112775609 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f638c1ec8c0 con 0x7f638c0c3bc0 2023-12-07T10:01:51.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:51.590 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":66,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:50.597177+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:51.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63780668d0 msgr2=0x7f6378068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63780668d0 0x7f6378068d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f637c0af000 tx=0x7f637c0a7000 comp rx=0 tx=0).stop 2023-12-07T10:01:51.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 msgr2=0x7f638c1ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 0x7f638c1ed0e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f638400c770 tx=0x7f638400cc30 comp rx=0 tx=0).stop 2023-12-07T10:01:51.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 shutdown_connections 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638c0c3bc0 0x7f638c1ed0e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f638c0c19e0 0x7f638c1ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f63780668d0 0x7f6378068d90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 --2- 172.21.15.89:0/4112775609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f638c06d980 0x7f638c0bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 >> 172.21.15.89:0/4112775609 conn(0x7f638c0c2ad0 msgr2=0x7f638c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 shutdown_connections 2023-12-07T10:01:51.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.588+0000 7f639192a640 1 -- 172.21.15.89:0/4112775609 wait complete. 2023-12-07T10:01:51.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:51.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 Processor -- start 2023-12-07T10:01:51.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 -- start start 2023-12-07T10:01:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b014e9d0 0x7f65b0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65b00a8470 0x7f65b006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b006d320 con 0x7f65b0070b80 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b00721b0 con 0x7f65b00a8470 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b6357640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00c2830 con 0x7f65b014e9d0 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65b00a8470 0x7f65b006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65b00a8470 0x7f65b006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40836/0 (socket says 172.21.15.89:40836) 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 -- 172.21.15.89:0/4087992746 learned_addr learned my addr 172.21.15.89:0/4087992746 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65affff640 1 --2- 172.21.15.89:0/4087992746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b014e9d0 0x7f65b0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 -- 172.21.15.89:0/4087992746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b014e9d0 msgr2=0x7f65b0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 --2- 172.21.15.89:0/4087992746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b014e9d0 0x7f65b0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 -- 172.21.15.89:0/4087992746 >> v1:172.21.15.97:6789/0 conn(0x7f65b0070b80 legacy=0x7f65b00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.744+0000 7f65b48f4640 1 -- 172.21.15.89:0/4087992746 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0072450 con 0x7f65b00a8470 2023-12-07T10:01:51.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b48f4640 1 --2- 172.21.15.89:0/4087992746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b006d7b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f65a800d150 tx=0x7f65a801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46924b2cc2c2cf59 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:51.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65aeffd640 1 -- 172.21.15.89:0/4087992746 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800b2d0 con 0x7f65b00a8470 2023-12-07T10:01:51.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65aeffd640 1 -- 172.21.15.89:0/4087992746 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800b430 con 0x7f65b00a8470 2023-12-07T10:01:51.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65aeffd640 1 -- 172.21.15.89:0/4087992746 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80a7a80 con 0x7f65b00a8470 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 -- 172.21.15.89:0/4087992746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 msgr2=0x7f65b006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 --2- 172.21.15.89:0/4087992746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b006d7b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f65a800d150 tx=0x7f65a801eb80 comp rx=0 tx=0).stop 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 -- 172.21.15.89:0/4087992746 shutdown_connections 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 --2- 172.21.15.89:0/4087992746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b006d7b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 --2- 172.21.15.89:0/4087992746 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b014e9d0 0x7f65b0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 -- 172.21.15.89:0/4087992746 >> 172.21.15.89:0/4087992746 conn(0x7f65b00c2ad0 msgr2=0x7f65b00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 -- 172.21.15.89:0/4087992746 shutdown_connections 2023-12-07T10:01:51.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.748+0000 7f65b6357640 1 -- 172.21.15.89:0/4087992746 wait complete. 2023-12-07T10:01:51.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 Processor -- start 2023-12-07T10:01:51.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 -- start start 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b0070b80 0x7f65b014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b01ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65b014e9d0 0x7f65b0146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00ab820 con 0x7f65b00a8470 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00aa070 con 0x7f65b014e9d0 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00aa980 con 0x7f65b0070b80 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b01ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b01ec3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40842/0 (socket says 172.21.15.89:40842) 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 -- 172.21.15.89:0/4042860192 learned_addr learned my addr 172.21.15.89:0/4042860192 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65affff640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b0070b80 0x7f65b014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b48f4640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65b014e9d0 0x7f65b0146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 -- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b0070b80 msgr2=0x7f65b014ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b0070b80 0x7f65b014ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 -- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65b014e9d0 msgr2=0x7f65b0146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65b014e9d0 0x7f65b0146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 -- 172.21.15.89:0/4042860192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a800bd40 con 0x7f65b00a8470 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65af7fe640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b01ec3d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c4d0 tx=0x7f65a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40052d0 con 0x7f65b00a8470 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4005430 con 0x7f65b00a8470 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b00aa2c0 con 0x7f65b00a8470 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4012830 con 0x7f65b00a8470 2023-12-07T10:01:51.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.752+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b01e9d40 con 0x7f65b00a8470 2023-12-07T10:01:51.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.756+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b00aab50 con 0x7f65b00a8470 2023-12-07T10:01:51.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.756+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f65a4012990 con 0x7f65b00a8470 2023-12-07T10:01:51.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.756+0000 7f65acff9640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f659c0668d0 0x7f659c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:51.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.756+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65a4083ec0 con 0x7f65b00a8470 2023-12-07T10:01:51.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.756+0000 7f65affff640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f659c0668d0 0x7f659c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:51.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.756+0000 7f65affff640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f659c0668d0 0x7f659c068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65a000b930 tx=0x7f65a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:51.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.760+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65a4051190 con 0x7f65b00a8470 2023-12-07T10:01:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.912+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65b01e9870 con 0x7f65b00a8470 2023-12-07T10:01:51.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.912+0000 7f65acff9640 1 -- 172.21.15.89:0/4042860192 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f65a40547b0 con 0x7f65b00a8470 2023-12-07T10:01:51.919 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:51.919 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":66,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:50.597177+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f659c0668d0 msgr2=0x7f659c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f659c0668d0 0x7f659c068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65a000b930 tx=0x7f65a0008040 comp rx=0 tx=0).stop 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 msgr2=0x7f65b01ec3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b01ec3d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c4d0 tx=0x7f65a400c990 comp rx=0 tx=0).stop 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 shutdown_connections 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65b014e9d0 0x7f65b0146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b00a8470 0x7f65b01ec3d0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f659c0668d0 0x7f659c068d90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 --2- 172.21.15.89:0/4042860192 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65b0070b80 0x7f65b014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 >> 172.21.15.89:0/4042860192 conn(0x7f65b00c2ad0 msgr2=0x7f65b014add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 shutdown_connections 2023-12-07T10:01:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:51.916+0000 7f65b6357640 1 -- 172.21.15.89:0/4042860192 wait complete. 2023-12-07T10:01:51.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-07T10:01:52.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f916849a640 1 Processor -- start 2023-12-07T10:01:52.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f916849a640 1 -- start start 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f916849a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f916014eaf0 0x7f9160151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f916849a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916006de00 con 0x7f9160151f90 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f916849a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9160070390 con 0x7f91600c0370 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f916849a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916014eed0 con 0x7f916014eaf0 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9166236640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f916014eaf0 0x7f9160151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9165a35640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9160151f90 0x7f916006d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55646/0 (socket says 172.21.15.89:55646) 2023-12-07T10:01:52.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9165a35640 1 -- 172.21.15.89:0/11947786 learned_addr learned my addr 172.21.15.89:0/11947786 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:52.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9166236640 1 -- 172.21.15.89:0/11947786 >> v1:172.21.15.97:6789/0 conn(0x7f91600c0370 legacy=0x7f916015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:52.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9166236640 1 -- 172.21.15.89:0/11947786 >> v1:172.21.15.89:6789/0 conn(0x7f9160151f90 legacy=0x7f916006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:52.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9165234640 1 -- 172.21.15.89:0/11947786 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799607806 0 0) 0x7f916006de00 con 0x7f9160151f90 2023-12-07T10:01:52.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.076+0000 7f9166236640 1 -- 172.21.15.89:0/11947786 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160151270 con 0x7f916014eaf0 2023-12-07T10:01:52.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f9166236640 1 --2- 172.21.15.89:0/11947786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f9160151a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f915c0097c0 tx=0x7f915c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7254ef598309b9e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:52.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f9165234640 1 -- 172.21.15.89:0/11947786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c0ab600 con 0x7f916014eaf0 2023-12-07T10:01:52.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f9165234640 1 -- 172.21.15.89:0/11947786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c0a7050 con 0x7f916014eaf0 2023-12-07T10:01:52.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f9165234640 1 -- 172.21.15.89:0/11947786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c0ab980 con 0x7f916014eaf0 2023-12-07T10:01:52.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 -- 172.21.15.89:0/11947786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 msgr2=0x7f9160151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:52.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 --2- 172.21.15.89:0/11947786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f9160151a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f915c0097c0 tx=0x7f915c01c330 comp rx=0 tx=0).stop 2023-12-07T10:01:52.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 -- 172.21.15.89:0/11947786 shutdown_connections 2023-12-07T10:01:52.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 --2- 172.21.15.89:0/11947786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f9160151a50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:52.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 -- 172.21.15.89:0/11947786 >> 172.21.15.89:0/11947786 conn(0x7f91600c2a60 msgr2=0x7f91600c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:52.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 -- 172.21.15.89:0/11947786 shutdown_connections 2023-12-07T10:01:52.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 -- 172.21.15.89:0/11947786 wait complete. 2023-12-07T10:01:52.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 Processor -- start 2023-12-07T10:01:52.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.080+0000 7f916849a640 1 -- start start 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91600c0370 0x7f91600ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f91600c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91600c21d0 0x7f916014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160154600 con 0x7f916014eaf0 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601ede80 con 0x7f91600c21d0 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600c2670 con 0x7f91600c0370 2023-12-07T10:01:52.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f91600c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f91600c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40854/0 (socket says 172.21.15.89:40854) 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 -- 172.21.15.89:0/2531532463 learned_addr learned my addr 172.21.15.89:0/2531532463 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9166236640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91600c0370 0x7f91600ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9166a37640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91600c21d0 0x7f916014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 -- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91600c0370 msgr2=0x7f91600ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91600c0370 0x7f91600ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 -- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91600c21d0 msgr2=0x7f916014d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91600c21d0 0x7f916014d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 -- 172.21.15.89:0/2531532463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009420 con 0x7f916014eaf0 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9166236640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91600c0370 0x7f91600ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9165a35640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f91600c1c90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f915000c440 tx=0x7f915000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:52.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500074e0 con 0x7f916014eaf0 2023-12-07T10:01:52.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150007640 con 0x7f916014eaf0 2023-12-07T10:01:52.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91600a9ea0 con 0x7f916014eaf0 2023-12-07T10:01:52.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150004a10 con 0x7f916014eaf0 2023-12-07T10:01:52.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91601ee310 con 0x7f916014eaf0 2023-12-07T10:01:52.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916004e890 con 0x7f916014eaf0 2023-12-07T10:01:52.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.084+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9150004b70 con 0x7f916014eaf0 2023-12-07T10:01:52.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.088+0000 7f9156ffd640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91440668d0 0x7f9144068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:52.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.088+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91500838e0 con 0x7f916014eaf0 2023-12-07T10:01:52.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.088+0000 7f9166236640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91440668d0 0x7f9144068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:52.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.088+0000 7f9166236640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91440668d0 0x7f9144068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f915c0ad000 tx=0x7f915c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:52.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.092+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9150050b10 con 0x7f916014eaf0 2023-12-07T10:01:52.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:52.276+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91601edfc0 con 0x7f916014eaf0 2023-12-07T10:01:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.240+0000 7f9156ffd640 1 -- 172.21.15.89:0/2531532463 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9150018020 con 0x7f916014eaf0 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91440668d0 msgr2=0x7f9144068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91440668d0 0x7f9144068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f915c0ad000 tx=0x7f915c0a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 msgr2=0x7f91600c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f91600c1c90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f915000c440 tx=0x7f915000c900 comp rx=0 tx=0).stop 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 shutdown_connections 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91600c21d0 0x7f916014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f916014eaf0 0x7f91600c1c90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91440668d0 0x7f9144068d90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 --2- 172.21.15.89:0/2531532463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f91600c0370 0x7f91600ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 >> 172.21.15.89:0/2531532463 conn(0x7f91600c2a60 msgr2=0x7f916006c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 shutdown_connections 2023-12-07T10:01:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.244+0000 7f916849a640 1 -- 172.21.15.89:0/2531532463 wait complete. 2023-12-07T10:01:53.272 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T10:01:53.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-07T10:01:53.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3bff8640 1 Processor -- start 2023-12-07T10:01:53.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3bff8640 1 -- start start 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3bff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb3415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3bff8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb34151ea0 con 0x7ffb3414b450 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3bff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb34152180 con 0x7ffb340725e0 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3bff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c1dc0 con 0x7ffb340c3610 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb39d94640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ffb3414b450 0x7ffb3406d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55656/0 (socket says 172.21.15.89:55656) 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb39d94640 1 -- 172.21.15.89:0/1793788044 learned_addr learned my addr 172.21.15.89:0/1793788044 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3a595640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb3415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583563464 0 0) 0x7ffb34151ea0 con 0x7ffb3414b450 2023-12-07T10:01:53.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb20003530 con 0x7ffb3414b450 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527645553 0 0) 0x7ffb34152180 con 0x7ffb340725e0 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb34151ea0 con 0x7ffb340725e0 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756039987 0 0) 0x7ffb20003530 con 0x7ffb3414b450 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 msgr2=0x7ffb3415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb3415cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 >> v1:172.21.15.97:6789/0 conn(0x7ffb340725e0 legacy=0x7ffb340c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340c2700 con 0x7ffb3414b450 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7ffb30001680 con 0x7ffb3414b450 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 >> v1:172.21.15.89:6789/0 conn(0x7ffb3414b450 legacy=0x7ffb3406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb20003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb20004d10 0x7ffb20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c1dc0 con 0x7ffb20003b40 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2000bbd0 con 0x7ffb20004d10 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2000bd90 con 0x7ffb340c3610 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb39d94640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb20003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb39593640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.412+0000 7ffb3a595640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb20004d10 0x7ffb20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39d94640 1 -- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 msgr2=0x7ffb200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39d94640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39d94640 1 -- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb20004d10 msgr2=0x7ffb20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39d94640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb20004d10 0x7ffb20005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39d94640 1 -- 172.21.15.89:0/1793788044 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20003530 con 0x7ffb20003b40 2023-12-07T10:01:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39593640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb340c3610 0x7ffb200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb39d94640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb20003f40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fa0 tx=0x7ffb3001cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64abf1f61686829e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30005ae0 con 0x7ffb20003b40 2023-12-07T10:01:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30005c40 con 0x7ffb20003b40 2023-12-07T10:01:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb38d92640 1 -- 172.21.15.89:0/1793788044 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30007070 con 0x7ffb20003b40 2023-12-07T10:01:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb3bff8640 1 -- 172.21.15.89:0/1793788044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 msgr2=0x7ffb20003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/1793788044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb20003f40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fa0 tx=0x7ffb3001cb00 comp rx=0 tx=0).stop 2023-12-07T10:01:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.416+0000 7ffb3a595640 1 -- 172.21.15.89:0/1793788044 reap_dead start 2023-12-07T10:01:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- 172.21.15.89:0/1793788044 shutdown_connections 2023-12-07T10:01:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- 172.21.15.89:0/1793788044 >> 172.21.15.89:0/1793788044 conn(0x7ffb340c3b70 msgr2=0x7ffb340c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- 172.21.15.89:0/1793788044 shutdown_connections 2023-12-07T10:01:53.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- 172.21.15.89:0/1793788044 wait complete. 2023-12-07T10:01:53.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 Processor -- start 2023-12-07T10:01:53.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- start start 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb341460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb341f0f80 0x7ffb340c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb341ecfe0 0x7ffb34154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341f0550 con 0x7ffb20003b40 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341f13e0 con 0x7ffb341f0f80 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3bff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340abd20 con 0x7ffb341ecfe0 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb341460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb341460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40868/0 (socket says 172.21.15.89:40868) 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 -- 172.21.15.89:0/528532934 learned_addr learned my addr 172.21.15.89:0/528532934 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39593640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb341f0f80 0x7ffb340c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb3a595640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb341ecfe0 0x7ffb34154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 -- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb341ecfe0 msgr2=0x7ffb34154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb341ecfe0 0x7ffb34154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 -- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb341f0f80 msgr2=0x7ffb340c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb341f0f80 0x7ffb340c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 -- 172.21.15.89:0/528532934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340ac000 con 0x7ffb20003b40 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb39d94640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb341460d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fa0 tx=0x7ffb20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb300b4070 con 0x7ffb20003b40 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb300047f0 con 0x7ffb20003b40 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.420+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30004b60 con 0x7ffb20003b40 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb341f07a0 con 0x7ffb20003b40 2023-12-07T10:01:53.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340c0c40 con 0x7ffb20003b40 2023-12-07T10:01:53.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340ac190 con 0x7ffb20003b40 2023-12-07T10:01:53.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb30004cc0 con 0x7ffb20003b40 2023-12-07T10:01:53.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb2a7fc640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb18066900 0x7ffb18068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:53.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb3011d610 con 0x7ffb20003b40 2023-12-07T10:01:53.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb39593640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb18066900 0x7ffb18068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:53.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.424+0000 7ffb39593640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb18066900 0x7ffb18068dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb240010f0 tx=0x7ffb24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:53.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.428+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb300ea7b0 con 0x7ffb20003b40 2023-12-07T10:01:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:53.608+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffb3404e890 con 0x7ffb20003b40 2023-12-07T10:01:54.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb2a7fc640 1 -- 172.21.15.89:0/528532934 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb300eddd0 con 0x7ffb20003b40 2023-12-07T10:01:54.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb18066900 msgr2=0x7ffb18068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb18066900 0x7ffb18068dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb240010f0 tx=0x7ffb24009040 comp rx=0 tx=0).stop 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 msgr2=0x7ffb341460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb341460d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fa0 tx=0x7ffb20005800 comp rx=0 tx=0).stop 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 shutdown_connections 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ffb18066900 0x7ffb18068dc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb341ecfe0 0x7ffb34154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb341f0f80 0x7ffb340c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 --2- 172.21.15.89:0/528532934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb20003b40 0x7ffb341460d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 >> 172.21.15.89:0/528532934 conn(0x7ffb340c3b70 msgr2=0x7ffb34066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 shutdown_connections 2023-12-07T10:01:54.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.244+0000 7ffb3bff8640 1 -- 172.21.15.89:0/528532934 wait complete. 2023-12-07T10:01:54.270 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-07T10:01:54.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:01:54.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.404+0000 7f061ec16640 1 Processor -- start 2023-12-07T10:01:54.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.404+0000 7f061ec16640 1 -- start start 2023-12-07T10:01:54.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061ec16640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0618070b80 0x7f0618151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061ec16640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06180a8470 0x7f061806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061ec16640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061806d320 con 0x7f061814e9d0 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061ec16640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180721b0 con 0x7f0618070b80 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061ec16640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c2830 con 0x7f06180a8470 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061c9b2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f061814e9d0 0x7f06180c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55668/0 (socket says 172.21.15.89:55668) 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061c9b2640 1 -- 172.21.15.89:0/65779626 learned_addr learned my addr 172.21.15.89:0/65779626 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060ffff640 1 --2- 172.21.15.89:0/65779626 >> v2:172.21.15.97:3300/0 conn(0x7f0618070b80 0x7f0618151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f061d1b3640 1 --2- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06180a8470 0x7f061806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060f7fe640 1 -- 172.21.15.89:0/65779626 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202438595 0 0) 0x7f061806d320 con 0x7f061814e9d0 2023-12-07T10:01:54.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060f7fe640 1 -- 172.21.15.89:0/65779626 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0600005740 con 0x7f061814e9d0 2023-12-07T10:01:54.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060ffff640 1 -- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06180a8470 msgr2=0x7f061806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:54.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060ffff640 1 --2- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06180a8470 0x7f061806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060ffff640 1 -- 172.21.15.89:0/65779626 >> v1:172.21.15.89:6789/0 conn(0x7f061814e9d0 legacy=0x7f06180c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.408+0000 7f060ffff640 1 -- 172.21.15.89:0/65779626 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618072450 con 0x7f0618070b80 2023-12-07T10:01:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f060ffff640 1 --2- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0618070b80 0x7f0618151e60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06080097c0 tx=0x7f060801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8032dacb1514d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f060f7fe640 1 -- 172.21.15.89:0/65779626 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080ab600 con 0x7f0618070b80 2023-12-07T10:01:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f060f7fe640 1 -- 172.21.15.89:0/65779626 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06080a7050 con 0x7f0618070b80 2023-12-07T10:01:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f060f7fe640 1 -- 172.21.15.89:0/65779626 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080ab980 con 0x7f0618070b80 2023-12-07T10:01:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 -- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0618070b80 msgr2=0x7f0618151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 --2- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0618070b80 0x7f0618151e60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06080097c0 tx=0x7f060801c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 -- 172.21.15.89:0/65779626 shutdown_connections 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 --2- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f06180a8470 0x7f061806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 --2- 172.21.15.89:0/65779626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0618070b80 0x7f0618151e60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 -- 172.21.15.89:0/65779626 >> 172.21.15.89:0/65779626 conn(0x7f06180c2ad0 msgr2=0x7f06180c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 -- 172.21.15.89:0/65779626 shutdown_connections 2023-12-07T10:01:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 -- 172.21.15.89:0/65779626 wait complete. 2023-12-07T10:01:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 Processor -- start 2023-12-07T10:01:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.412+0000 7f061ec16640 1 -- start start 2023-12-07T10:01:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 0x7f0618144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06180a8470 0x7f06180ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061814e9d0 0x7f06180c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c5de0 con 0x7f0618070b80 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06181edef0 con 0x7f06180a8470 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06181ed020 con 0x7f061814e9d0 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 0x7f0618144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 0x7f0618144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40874/0 (socket says 172.21.15.89:40874) 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 -- 172.21.15.89:0/4265736059 learned_addr learned my addr 172.21.15.89:0/4265736059 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061d1b3640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061814e9d0 0x7f06180c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f060ffff640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06180a8470 0x7f06180ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 -- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061814e9d0 msgr2=0x7f06180c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061814e9d0 0x7f06180c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 -- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06180a8470 msgr2=0x7f06180ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06180a8470 0x7f06180ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 -- 172.21.15.89:0/4265736059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009420 con 0x7f0618070b80 2023-12-07T10:01:54.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061c9b2640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 0x7f0618144db0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f061400c420 tx=0x7f061400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614005cf0 con 0x7f0618070b80 2023-12-07T10:01:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614005e50 con 0x7f0618070b80 2023-12-07T10:01:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06181ed2e0 con 0x7f0618070b80 2023-12-07T10:01:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140072d0 con 0x7f0618070b80 2023-12-07T10:01:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06181ed8a0 con 0x7f0618070b80 2023-12-07T10:01:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061804e890 con 0x7f0618070b80 2023-12-07T10:01:54.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.416+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0614007430 con 0x7f0618070b80 2023-12-07T10:01:54.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.420+0000 7f060d7fa640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06040668d0 0x7f0604068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.420+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0614083960 con 0x7f0618070b80 2023-12-07T10:01:54.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.420+0000 7f060ffff640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06040668d0 0x7f0604068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.420+0000 7f060ffff640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06040668d0 0x7f0604068d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06080ad000 tx=0x7f06080a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:54.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.424+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0614050c40 con 0x7f0618070b80 2023-12-07T10:01:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.600+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06180700a0 con 0x7f0618070b80 2023-12-07T10:01:54.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f060d7fa640 1 -- 172.21.15.89:0/4265736059 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f0614017020 con 0x7f0618070b80 2023-12-07T10:01:54.607 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:54.607 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-07T10:01:54.607 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 48 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06040668d0 msgr2=0x7f0604068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06040668d0 0x7f0604068d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06080ad000 tx=0x7f06080a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 msgr2=0x7f0618144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 0x7f0618144db0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f061400c420 tx=0x7f061400c8e0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 shutdown_connections 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f06040668d0 0x7f0604068d90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061814e9d0 0x7f06180c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f06180a8470 0x7f06180ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 --2- 172.21.15.89:0/4265736059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0618070b80 0x7f0618144db0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 >> 172.21.15.89:0/4265736059 conn(0x7f06180c2ad0 msgr2=0x7f061814c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:54.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 shutdown_connections 2023-12-07T10:01:54.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.604+0000 7f061ec16640 1 -- 172.21.15.89:0/4265736059 wait complete. 2023-12-07T10:01:54.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:01:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.760+0000 7f6d00bb8640 1 Processor -- start 2023-12-07T10:01:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.760+0000 7f6d00bb8640 1 -- start start 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6d00bb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6d00bb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cfc06baf0 0x7f6cfc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6d00bb8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc06e280 con 0x7f6cfc06ed00 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6d00bb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c2150 con 0x7f6cfc06baf0 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6d00bb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc157c60 con 0x7f6cfc155360 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cfc06baf0 0x7f6cfc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cfad9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6cfc06ed00 0x7f6cfc1580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55670/0 (socket says 172.21.15.89:55670) 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cfc06baf0 0x7f6cfc06e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40886/0 (socket says 172.21.15.89:40886) 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cfad9d640 1 -- 172.21.15.89:0/2131769070 learned_addr learned my addr 172.21.15.89:0/2131769070 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cfa59c640 1 --2- 172.21.15.89:0/2131769070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf3fff640 1 -- 172.21.15.89:0/2131769070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 msgr2=0x7f6cfc06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf3fff640 1 --2- 172.21.15.89:0/2131769070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf3fff640 1 -- 172.21.15.89:0/2131769070 >> v1:172.21.15.89:6789/0 conn(0x7f6cfc06ed00 legacy=0x7f6cfc1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf9d9b640 1 -- 172.21.15.89:0/2131769070 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026422470 0 0) 0x7f6cfc06e280 con 0x7f6cfc06ed00 2023-12-07T10:01:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.764+0000 7f6cf3fff640 1 -- 172.21.15.89:0/2131769070 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0c1bd0 con 0x7f6cfc06baf0 2023-12-07T10:01:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6cf3fff640 1 --2- 172.21.15.89:0/2131769070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc06e7c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097c0 tx=0x7f6ce401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dedb639cb21d01 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6cf9d9b640 1 -- 172.21.15.89:0/2131769070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40ab600 con 0x7f6cfc06baf0 2023-12-07T10:01:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6cf9d9b640 1 -- 172.21.15.89:0/2131769070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce40a7050 con 0x7f6cfc06baf0 2023-12-07T10:01:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6cf9d9b640 1 -- 172.21.15.89:0/2131769070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40ab980 con 0x7f6cfc06baf0 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- 172.21.15.89:0/2131769070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 msgr2=0x7f6cfc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/2131769070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc06e7c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097c0 tx=0x7f6ce401c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- 172.21.15.89:0/2131769070 shutdown_connections 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/2131769070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc06e7c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/2131769070 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- 172.21.15.89:0/2131769070 >> 172.21.15.89:0/2131769070 conn(0x7f6cfc0c3240 msgr2=0x7f6cfc0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- 172.21.15.89:0/2131769070 shutdown_connections 2023-12-07T10:01:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- 172.21.15.89:0/2131769070 wait complete. 2023-12-07T10:01:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 Processor -- start 2023-12-07T10:01:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- start start 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cfc06ed00 0x7f6cfc1f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc152f70 con 0x7f6cfc06baf0 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc070f80 con 0x7f6cfc06ed00 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.768+0000 7f6d00bb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc1f1320 con 0x7f6cfc155360 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc0713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40896/0 (socket says 172.21.15.89:40896) 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 -- 172.21.15.89:0/3588655204 learned_addr learned my addr 172.21.15.89:0/3588655204 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfad9d640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf3fff640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cfc06ed00 0x7f6cfc1f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 -- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 msgr2=0x7f6cfc14e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc14e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 -- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cfc06ed00 msgr2=0x7f6cfc1f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cfc06ed00 0x7f6cfc1f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 -- 172.21.15.89:0/3588655204 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4009420 con 0x7f6cfc06baf0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cfa59c640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc0713a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00e930 tx=0x7f6cec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec009690 con 0x7f6cfc06baf0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec00ca00 con 0x7f6cfc06baf0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00cd70 con 0x7f6cfc06baf0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc0a6070 con 0x7f6cfc06baf0 2023-12-07T10:01:54.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc0722c0 con 0x7f6cfc06baf0 2023-12-07T10:01:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc04e890 con 0x7f6cfc06baf0 2023-12-07T10:01:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6cec013470 con 0x7f6cfc06baf0 2023-12-07T10:01:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf2ffd640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6cdc0668d0 0x7f6cdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.772+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cec084a90 con 0x7f6cfc06baf0 2023-12-07T10:01:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.776+0000 7f6cf3fff640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6cdc0668d0 0x7f6cdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.776+0000 7f6cf3fff640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6cdc0668d0 0x7f6cdc068d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40ad000 tx=0x7f6ce40a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:54.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.776+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cec051d80 con 0x7f6cfc06baf0 2023-12-07T10:01:54.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.928+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cfc14d2f0 con 0x7f6cfc06baf0 2023-12-07T10:01:54.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.928+0000 7f6cf2ffd640 1 -- 172.21.15.89:0/3588655204 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16500 (secure 0 0 0) 0x7f6cec017090 con 0x7f6cfc06baf0 2023-12-07T10:01:54.933 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":67,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:52.226259+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6cdc0668d0 msgr2=0x7f6cdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6cdc0668d0 0x7f6cdc068d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40ad000 tx=0x7f6ce40a4f90 comp rx=0 tx=0).stop 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 msgr2=0x7f6cfc0713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc0713a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00e930 tx=0x7f6cec00edf0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 shutdown_connections 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6cdc0668d0 0x7f6cdc068d90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6cfc155360 0x7f6cfc14e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6cfc06ed00 0x7f6cfc1f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 --2- 172.21.15.89:0/3588655204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cfc06baf0 0x7f6cfc0713a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 >> 172.21.15.89:0/3588655204 conn(0x7f6cfc0c3240 msgr2=0x7f6cfc15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 shutdown_connections 2023-12-07T10:01:54.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:54.932+0000 7f6d00bb8640 1 -- 172.21.15.89:0/3588655204 wait complete. 2023-12-07T10:01:54.955 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T10:01:54.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:55.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc3452a640 1 Processor -- start 2023-12-07T10:01:55.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc3452a640 1 -- start start 2023-12-07T10:01:55.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc3452a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc2c0a8470 0x7fdc2c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc3452a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c06d320 con 0x7fdc2c070b80 2023-12-07T10:01:55.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc3452a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c0721b0 con 0x7fdc2c14e9d0 2023-12-07T10:01:55.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc3452a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c0c2830 con 0x7fdc2c0a8470 2023-12-07T10:01:55.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc31ac5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdc2c070b80 0x7fdc2c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55676/0 (socket says 172.21.15.89:55676) 2023-12-07T10:01:55.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc31ac5640 1 -- 172.21.15.89:0/1217784855 learned_addr learned my addr 172.21.15.89:0/1217784855 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc32ac7640 1 --2- 172.21.15.89:0/1217784855 >> v2:172.21.15.97:3300/0 conn(0x7fdc2c0a8470 0x7fdc2c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544432783 0 0) 0x7fdc2c06d320 con 0x7fdc2c070b80 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc18003530 con 0x7fdc2c070b80 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2825040565 0 0) 0x7fdc18003530 con 0x7fdc2c070b80 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 >> v2:172.21.15.97:3300/0 conn(0x7fdc2c0a8470 msgr2=0x7fdc2c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 --2- 172.21.15.89:0/1217784855 >> v2:172.21.15.97:3300/0 conn(0x7fdc2c0a8470 0x7fdc2c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 >> v1:172.21.15.97:6789/0 conn(0x7fdc2c14e9d0 legacy=0x7fdc2c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c072450 con 0x7fdc2c070b80 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fdc1c001680 con 0x7fdc2c070b80 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 >> v1:172.21.15.89:6789/0 conn(0x7fdc2c070b80 legacy=0x7fdc2c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.088+0000 7fdc312c4640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18003980 0x7fdc18003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc18004380 0x7fdc18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc180050f0 0x7fdc1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0c2830 con 0x7fdc18004380 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1800c030 con 0x7fdc18003980 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1800c1f0 con 0x7fdc180050f0 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc18004380 0x7fdc18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc322c6640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18003980 0x7fdc18003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc32ac7640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc180050f0 0x7fdc1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 -- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc180050f0 msgr2=0x7fdc1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc180050f0 0x7fdc1800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 -- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18003980 msgr2=0x7fdc18003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18003980 0x7fdc18003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 -- 172.21.15.89:0/1217784855 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18003530 con 0x7fdc18004380 2023-12-07T10:01:55.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc32ac7640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc180050f0 0x7fdc1800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:55.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc32ac7640 1 -- 172.21.15.89:0/1217784855 reap_dead start 2023-12-07T10:01:55.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc31ac5640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc18004380 0x7fdc18004850 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c070f60 tx=0x7fdc1c01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa140b908bdbf59 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0058e0 con 0x7fdc18004380 2023-12-07T10:01:55.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c005a60 con 0x7fdc18004380 2023-12-07T10:01:55.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.092+0000 7fdc312c4640 1 -- 172.21.15.89:0/1217784855 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c005e50 con 0x7fdc18004380 2023-12-07T10:01:55.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- 172.21.15.89:0/1217784855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc18004380 msgr2=0x7fdc18004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc18004380 0x7fdc18004850 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c070f60 tx=0x7fdc1c01cb00 comp rx=0 tx=0).stop 2023-12-07T10:01:55.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- 172.21.15.89:0/1217784855 shutdown_connections 2023-12-07T10:01:55.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 --2- 172.21.15.89:0/1217784855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc18004380 0x7fdc18004850 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- 172.21.15.89:0/1217784855 >> 172.21.15.89:0/1217784855 conn(0x7fdc2c0c2ad0 msgr2=0x7fdc2c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:55.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- 172.21.15.89:0/1217784855 shutdown_connections 2023-12-07T10:01:55.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- 172.21.15.89:0/1217784855 wait complete. 2023-12-07T10:01:55.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 Processor -- start 2023-12-07T10:01:55.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- start start 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18004380 0x7fdc2c1443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc2c1ed6b0 0x7fdc2c14a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 0x7fdc2c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c1edc20 con 0x7fdc2c144cb0 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c148ff0 con 0x7fdc18004380 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc3452a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c14f540 con 0x7fdc2c1ed6b0 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 0x7fdc2c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 0x7fdc2c14af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40914/0 (socket says 172.21.15.89:40914) 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 -- 172.21.15.89:0/366046321 learned_addr learned my addr 172.21.15.89:0/366046321 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc31ac5640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc2c1ed6b0 0x7fdc2c14a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc322c6640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18004380 0x7fdc2c1443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 -- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc2c1ed6b0 msgr2=0x7fdc2c14a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc2c1ed6b0 0x7fdc2c14a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 -- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18004380 msgr2=0x7fdc2c1443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.096+0000 7fdc32ac7640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18004380 0x7fdc2c1443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc32ac7640 1 -- 172.21.15.89:0/366046321 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c14f820 con 0x7fdc2c144cb0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc322c6640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18004380 0x7fdc2c1443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc32ac7640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 0x7fdc2c14af30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c070030 tx=0x7fdc24009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400e030 con 0x7fdc2c144cb0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24011e60 con 0x7fdc2c144cb0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240166b0 con 0x7fdc2c144cb0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c148c80 con 0x7fdc2c144cb0 2023-12-07T10:01:55.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c0c5b40 con 0x7fdc2c144cb0 2023-12-07T10:01:55.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c148e40 con 0x7fdc2c144cb0 2023-12-07T10:01:55.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc24016810 con 0x7fdc2c144cb0 2023-12-07T10:01:55.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc22ffd640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc10066900 0x7fdc10068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc2400f070 con 0x7fdc2c144cb0 2023-12-07T10:01:55.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.100+0000 7fdc322c6640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc10066900 0x7fdc10068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.104+0000 7fdc322c6640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc10066900 0x7fdc10068dc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c1559a0 tx=0x7fdc28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.104+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc24052420 con 0x7fdc2c144cb0 2023-12-07T10:01:55.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.252+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc2c14f6b0 con 0x7fdc10066900 2023-12-07T10:01:55.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.260+0000 7fdc22ffd640 1 -- 172.21.15.89:0/366046321 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283687 (secure 0 0 0) 0x7fdc2c14f6b0 con 0x7fdc10066900 2023-12-07T10:01:55.268 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:55.269 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:55.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc10066900 msgr2=0x7fdc10068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc10066900 0x7fdc10068dc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c1559a0 tx=0x7fdc28009040 comp rx=0 tx=0).stop 2023-12-07T10:01:55.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 msgr2=0x7fdc2c14af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 0x7fdc2c14af30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c070030 tx=0x7fdc24009f90 comp rx=0 tx=0).stop 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 shutdown_connections 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc2c144cb0 0x7fdc2c14af30 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdc10066900 0x7fdc10068dc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc2c1ed6b0 0x7fdc2c14a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 --2- 172.21.15.89:0/366046321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc18004380 0x7fdc2c1443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 >> 172.21.15.89:0/366046321 conn(0x7fdc2c0c2ad0 msgr2=0x7fdc2c14b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 shutdown_connections 2023-12-07T10:01:55.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.264+0000 7fdc3452a640 1 -- 172.21.15.89:0/366046321 wait complete. 2023-12-07T10:01:55.288 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-07T10:01:54.374009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248428,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726292,"statfs":{"total":773094113280,"available":772839723008,"internally_reserved":0,"allocated":7479296,"data_stored":3897536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.168839"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.239870+0000","last_change":"2023-12-07T10:01:50.239870+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.239870+0000","last_undegraded":"2023-12-07T10:01:50.239870+0000","last_fullsized":"2023-12-07T10:01:50.239870+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223250+0000","last_change":"2023-12-07T10:01:50.223250+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223250+0000","last_undegraded":"2023-12-07T10:01:50.223250+0000","last_fullsized":"2023-12-07T10:01:50.223250+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227090+0000","last_change":"2023-12-07T10:01:50.227090+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227090+0000","last_undegraded":"2023-12-07T10:01:50.227090+0000","last_fullsized":"2023-12-07T10:01:50.227090+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227195+0000","last_change":"2023-12-07T10:01:50.227195+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227195+0000","last_undegraded":"2023-12-07T10:01:50.227195+0000","last_fullsized":"2023-12-07T10:01:50.227195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225226+0000","last_change":"2023-12-07T10:01:50.225226+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225226+0000","last_undegraded":"2023-12-07T10:01:50.225226+0000","last_fullsized":"2023-12-07T10:01:50.225226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226703+0000","last_change":"2023-12-07T10:01:50.226703+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226703+0000","last_undegraded":"2023-12-07T10:01:50.226703+0000","last_fullsized":"2023-12-07T10:01:50.226703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.228164+0000","last_change":"2023-12-07T10:01:50.228164+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.228164+0000","last_undegraded":"2023-12-07T10:01:50.228164+0000","last_fullsized":"2023-12-07T10:01:50.228164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222903+0000","last_change":"2023-12-07T10:01:50.222903+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222903+0000","last_undegraded":"2023-12-07T10:01:50.222903+0000","last_fullsized":"2023-12-07T10:01:50.222903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224340+0000","last_change":"2023-12-07T10:01:50.224340+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224340+0000","last_undegraded":"2023-12-07T10:01:50.224340+0000","last_fullsized":"2023-12-07T10:01:50.224340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.235671+0000","last_change":"2023-12-07T10:01:50.235671+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.235671+0000","last_undegraded":"2023-12-07T10:01:50.235671+0000","last_fullsized":"2023-12-07T10:01:50.235671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223059+0000","last_change":"2023-12-07T10:01:50.223059+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223059+0000","last_undegraded":"2023-12-07T10:01:50.223059+0000","last_fullsized":"2023-12-07T10:01:50.223059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.235102+0000","last_change":"2023-12-07T10:01:50.235102+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.235102+0000","last_undegraded":"2023-12-07T10:01:50.235102+0000","last_fullsized":"2023-12-07T10:01:50.235102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225481+0000","last_change":"2023-12-07T10:01:50.225481+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225481+0000","last_undegraded":"2023-12-07T10:01:50.225481+0000","last_fullsized":"2023-12-07T10:01:50.225481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226655+0000","last_change":"2023-12-07T10:01:50.226655+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226655+0000","last_undegraded":"2023-12-07T10:01:50.226655+0000","last_fullsized":"2023-12-07T10:01:50.226655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220735+0000","last_change":"2023-12-07T10:01:50.220735+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220735+0000","last_undegraded":"2023-12-07T10:01:50.220735+0000","last_fullsized":"2023-12-07T10:01:50.220735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222757+0000","last_change":"2023-12-07T10:01:50.222757+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222757+0000","last_undegraded":"2023-12-07T10:01:50.222757+0000","last_fullsized":"2023-12-07T10:01:50.222757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222862+0000","last_change":"2023-12-07T10:01:50.222862+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222862+0000","last_undegraded":"2023-12-07T10:01:50.222862+0000","last_fullsized":"2023-12-07T10:01:50.222862+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225500+0000","last_change":"2023-12-07T10:01:50.225500+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225500+0000","last_undegraded":"2023-12-07T10:01:50.225500+0000","last_fullsized":"2023-12-07T10:01:50.225500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223920+0000","last_change":"2023-12-07T10:01:50.223920+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223920+0000","last_undegraded":"2023-12-07T10:01:50.223920+0000","last_fullsized":"2023-12-07T10:01:50.223920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225082+0000","last_change":"2023-12-07T10:01:50.225082+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225082+0000","last_undegraded":"2023-12-07T10:01:50.225082+0000","last_fullsized":"2023-12-07T10:01:50.225082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223930+0000","last_change":"2023-12-07T10:01:50.223930+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223930+0000","last_undegraded":"2023-12-07T10:01:50.223930+0000","last_fullsized":"2023-12-07T10:01:50.223930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223420+0000","last_change":"2023-12-07T10:01:50.223420+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223420+0000","last_undegraded":"2023-12-07T10:01:50.223420+0000","last_fullsized":"2023-12-07T10:01:50.223420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234142+0000","last_change":"2023-12-07T10:01:50.234142+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234142+0000","last_undegraded":"2023-12-07T10:01:50.234142+0000","last_fullsized":"2023-12-07T10:01:50.234142+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221489+0000","last_change":"2023-12-07T10:01:50.221489+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221489+0000","last_undegraded":"2023-12-07T10:01:50.221489+0000","last_fullsized":"2023-12-07T10:01:50.221489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222295+0000","last_change":"2023-12-07T10:01:50.222295+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222295+0000","last_undegraded":"2023-12-07T10:01:50.222295+0000","last_fullsized":"2023-12-07T10:01:50.222295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226095+0000","last_change":"2023-12-07T10:01:50.226095+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226095+0000","last_undegraded":"2023-12-07T10:01:50.226095+0000","last_fullsized":"2023-12-07T10:01:50.226095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227999+0000","last_change":"2023-12-07T10:01:50.227999+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227999+0000","last_undegraded":"2023-12-07T10:01:50.227999+0000","last_fullsized":"2023-12-07T10:01:50.227999+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234631+0000","last_change":"2023-12-07T10:01:50.234631+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234631+0000","last_undegraded":"2023-12-07T10:01:50.234631+0000","last_fullsized":"2023-12-07T10:01:50.234631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221986+0000","last_change":"2023-12-07T10:01:50.221986+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221986+0000","last_undegraded":"2023-12-07T10:01:50.221986+0000","last_fullsized":"2023-12-07T10:01:50.221986+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221962+0000","last_change":"2023-12-07T10:01:50.221962+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221962+0000","last_undegraded":"2023-12-07T10:01:50.221962+0000","last_fullsized":"2023-12-07T10:01:50.221962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223911+0000","last_change":"2023-12-07T10:01:50.223911+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223911+0000","last_undegraded":"2023-12-07T10:01:50.223911+0000","last_fullsized":"2023-12-07T10:01:50.223911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.238026+0000","last_change":"2023-12-07T10:01:50.238026+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.238026+0000","last_undegraded":"2023-12-07T10:01:50.238026+0000","last_fullsized":"2023-12-07T10:01:50.238026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.229222+0000","last_change":"2023-12-07T10:01:50.229222+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.229222+0000","last_undegraded":"2023-12-07T10:01:50.229222+0000","last_fullsized":"2023-12-07T10:01:50.229222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.253519+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:01:50.253519+0000","last_peered":"2023-12-07T10:01:50.253519+0000","last_clean":"2023-12-07T10:01:50.253519+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:01:50.253519+0000","last_undegraded":"2023-12-07T10:01:50.253519+0000","last_fullsized":"2023-12-07T10:01:50.253519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:17.732221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.239339+0000","last_change":"2023-12-07T10:01:50.239339+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.239339+0000","last_undegraded":"2023-12-07T10:01:50.239339+0000","last_fullsized":"2023-12-07T10:01:50.239339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239070+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:01:50.239070+0000","last_peered":"2023-12-07T10:01:50.239070+0000","last_clean":"2023-12-07T10:01:50.239070+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:01:50.239070+0000","last_undegraded":"2023-12-07T10:01:50.239070+0000","last_fullsized":"2023-12-07T10:01:50.239070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:17.732221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234070+0000","last_change":"2023-12-07T10:01:50.234070+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234070+0000","last_undegraded":"2023-12-07T10:01:50.234070+0000","last_fullsized":"2023-12-07T10:01:50.234070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239520+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:01:50.239520+0000","last_peered":"2023-12-07T10:01:50.239520+0000","last_clean":"2023-12-07T10:01:50.239520+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:01:50.239520+0000","last_undegraded":"2023-12-07T10:01:50.239520+0000","last_fullsized":"2023-12-07T10:01:50.239520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226560+0000","last_change":"2023-12-07T10:01:50.226560+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226560+0000","last_undegraded":"2023-12-07T10:01:50.226560+0000","last_fullsized":"2023-12-07T10:01:50.226560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242092+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:01:50.242092+0000","last_peered":"2023-12-07T10:01:50.242092+0000","last_clean":"2023-12-07T10:01:50.242092+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:01:50.242092+0000","last_undegraded":"2023-12-07T10:01:50.242092+0000","last_fullsized":"2023-12-07T10:01:50.242092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:49.865873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221448+0000","last_change":"2023-12-07T10:01:50.221448+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221448+0000","last_undegraded":"2023-12-07T10:01:50.221448+0000","last_fullsized":"2023-12-07T10:01:50.221448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238163+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:01:50.238163+0000","last_peered":"2023-12-07T10:01:50.238163+0000","last_clean":"2023-12-07T10:01:50.238163+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:01:50.238163+0000","last_undegraded":"2023-12-07T10:01:50.238163+0000","last_fullsized":"2023-12-07T10:01:50.238163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:31.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223000+0000","last_change":"2023-12-07T10:01:50.223000+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223000+0000","last_undegraded":"2023-12-07T10:01:50.223000+0000","last_fullsized":"2023-12-07T10:01:50.223000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.236614+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:01:50.236614+0000","last_peered":"2023-12-07T10:01:50.236614+0000","last_clean":"2023-12-07T10:01:50.236614+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:01:50.236614+0000","last_undegraded":"2023-12-07T10:01:50.236614+0000","last_fullsized":"2023-12-07T10:01:50.236614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:00.041915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225172+0000","last_change":"2023-12-07T10:01:50.225172+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225172+0000","last_undegraded":"2023-12-07T10:01:50.225172+0000","last_fullsized":"2023-12-07T10:01:50.225172+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242077+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:01:50.242077+0000","last_peered":"2023-12-07T10:01:50.242077+0000","last_clean":"2023-12-07T10:01:50.242077+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:01:50.242077+0000","last_undegraded":"2023-12-07T10:01:50.242077+0000","last_fullsized":"2023-12-07T10:01:50.242077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220280+0000","last_change":"2023-12-07T10:01:50.220280+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220280+0000","last_undegraded":"2023-12-07T10:01:50.220280+0000","last_fullsized":"2023-12-07T10:01:50.220280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238657+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:01:50.238657+0000","last_peered":"2023-12-07T10:01:50.238657+0000","last_clean":"2023-12-07T10:01:50.238657+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:01:50.238657+0000","last_undegraded":"2023-12-07T10:01:50.238657+0000","last_fullsized":"2023-12-07T10:01:50.238657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:15.449621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221254+0000","last_change":"2023-12-07T10:01:50.221254+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221254+0000","last_undegraded":"2023-12-07T10:01:50.221254+0000","last_fullsized":"2023-12-07T10:01:50.221254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250634+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:01:50.250634+0000","last_peered":"2023-12-07T10:01:50.250634+0000","last_clean":"2023-12-07T10:01:50.250634+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:01:50.250634+0000","last_undegraded":"2023-12-07T10:01:50.250634+0000","last_fullsized":"2023-12-07T10:01:50.250634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:00.041915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223789+0000","last_change":"2023-12-07T10:01:50.223789+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223789+0000","last_undegraded":"2023-12-07T10:01:50.223789+0000","last_fullsized":"2023-12-07T10:01:50.223789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250660+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:01:50.250660+0000","last_peered":"2023-12-07T10:01:50.250660+0000","last_clean":"2023-12-07T10:01:50.250660+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:01:50.250660+0000","last_undegraded":"2023-12-07T10:01:50.250660+0000","last_fullsized":"2023-12-07T10:01:50.250660+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:02.688486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225065+0000","last_change":"2023-12-07T10:01:50.225065+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225065+0000","last_undegraded":"2023-12-07T10:01:50.225065+0000","last_fullsized":"2023-12-07T10:01:50.225065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250888+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:01:50.250888+0000","last_peered":"2023-12-07T10:01:50.250888+0000","last_clean":"2023-12-07T10:01:50.250888+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:01:50.250888+0000","last_undegraded":"2023-12-07T10:01:50.250888+0000","last_fullsized":"2023-12-07T10:01:50.250888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227505+0000","last_change":"2023-12-07T10:01:50.227505+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227505+0000","last_undegraded":"2023-12-07T10:01:50.227505+0000","last_fullsized":"2023-12-07T10:01:50.227505+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238988+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:01:50.238988+0000","last_peered":"2023-12-07T10:01:50.238988+0000","last_clean":"2023-12-07T10:01:50.238988+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:01:50.238988+0000","last_undegraded":"2023-12-07T10:01:50.238988+0000","last_fullsized":"2023-12-07T10:01:50.238988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:44.166751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224885+0000","last_change":"2023-12-07T10:01:50.224885+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224885+0000","last_undegraded":"2023-12-07T10:01:50.224885+0000","last_fullsized":"2023-12-07T10:01:50.224885+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.234329+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:01:50.234329+0000","last_peered":"2023-12-07T10:01:50.234329+0000","last_clean":"2023-12-07T10:01:50.234329+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:01:50.234329+0000","last_undegraded":"2023-12-07T10:01:50.234329+0000","last_fullsized":"2023-12-07T10:01:50.234329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224883+0000","last_change":"2023-12-07T10:01:50.224883+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224883+0000","last_undegraded":"2023-12-07T10:01:50.224883+0000","last_fullsized":"2023-12-07T10:01:50.224883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.231500+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:01:50.231500+0000","last_peered":"2023-12-07T10:01:50.231500+0000","last_clean":"2023-12-07T10:01:50.231500+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:01:50.231500+0000","last_undegraded":"2023-12-07T10:01:50.231500+0000","last_fullsized":"2023-12-07T10:01:50.231500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:15.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221642+0000","last_change":"2023-12-07T10:01:50.221642+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221642+0000","last_undegraded":"2023-12-07T10:01:50.221642+0000","last_fullsized":"2023-12-07T10:01:50.221642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.240800+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:01:50.240800+0000","last_peered":"2023-12-07T10:01:50.240800+0000","last_clean":"2023-12-07T10:01:50.240800+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:01:50.240800+0000","last_undegraded":"2023-12-07T10:01:50.240800+0000","last_fullsized":"2023-12-07T10:01:50.240800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:57.968264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221454+0000","last_change":"2023-12-07T10:01:50.221454+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221454+0000","last_undegraded":"2023-12-07T10:01:50.221454+0000","last_fullsized":"2023-12-07T10:01:50.221454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239368+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:01:50.239368+0000","last_peered":"2023-12-07T10:01:50.239368+0000","last_clean":"2023-12-07T10:01:50.239368+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:01:50.239368+0000","last_undegraded":"2023-12-07T10:01:50.239368+0000","last_fullsized":"2023-12-07T10:01:50.239368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225530+0000","last_change":"2023-12-07T10:01:50.225530+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225530+0000","last_undegraded":"2023-12-07T10:01:50.225530+0000","last_fullsized":"2023-12-07T10:01:50.225530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250504+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:01:50.250504+0000","last_peered":"2023-12-07T10:01:50.250504+0000","last_clean":"2023-12-07T10:01:50.250504+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:01:50.250504+0000","last_undegraded":"2023-12-07T10:01:50.250504+0000","last_fullsized":"2023-12-07T10:01:50.250504+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:31.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.236841+0000","last_change":"2023-12-07T10:01:50.236841+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.236841+0000","last_undegraded":"2023-12-07T10:01:50.236841+0000","last_fullsized":"2023-12-07T10:01:50.236841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242194+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:01:50.242194+0000","last_peered":"2023-12-07T10:01:50.242194+0000","last_clean":"2023-12-07T10:01:50.242194+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:01:50.242194+0000","last_undegraded":"2023-12-07T10:01:50.242194+0000","last_fullsized":"2023-12-07T10:01:50.242194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226948+0000","last_change":"2023-12-07T10:01:50.226948+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226948+0000","last_undegraded":"2023-12-07T10:01:50.226948+0000","last_fullsized":"2023-12-07T10:01:50.226948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239643+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:01:50.239643+0000","last_peered":"2023-12-07T10:01:50.239643+0000","last_clean":"2023-12-07T10:01:50.239643+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:01:50.239643+0000","last_undegraded":"2023-12-07T10:01:50.239643+0000","last_fullsized":"2023-12-07T10:01:50.239643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221902+0000","last_change":"2023-12-07T10:01:50.221902+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221902+0000","last_undegraded":"2023-12-07T10:01:50.221902+0000","last_fullsized":"2023-12-07T10:01:50.221902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.241807+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:01:50.241807+0000","last_peered":"2023-12-07T10:01:50.241807+0000","last_clean":"2023-12-07T10:01:50.241807+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:01:50.241807+0000","last_undegraded":"2023-12-07T10:01:50.241807+0000","last_fullsized":"2023-12-07T10:01:50.241807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:46:26.919128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223113+0000","last_change":"2023-12-07T10:01:50.223113+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223113+0000","last_undegraded":"2023-12-07T10:01:50.223113+0000","last_fullsized":"2023-12-07T10:01:50.223113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237822+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:01:50.237822+0000","last_peered":"2023-12-07T10:01:50.237822+0000","last_clean":"2023-12-07T10:01:50.237822+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:01:50.237822+0000","last_undegraded":"2023-12-07T10:01:50.237822+0000","last_fullsized":"2023-12-07T10:01:50.237822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:40.523454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220998+0000","last_change":"2023-12-07T10:01:50.220998+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220998+0000","last_undegraded":"2023-12-07T10:01:50.220998+0000","last_fullsized":"2023-12-07T10:01:50.220998+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.245537+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:01:50.245537+0000","last_peered":"2023-12-07T10:01:50.245537+0000","last_clean":"2023-12-07T10:01:50.245537+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:01:50.245537+0000","last_undegraded":"2023-12-07T10:01:50.245537+0000","last_fullsized":"2023-12-07T10:01:50.245537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:01:29.575944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222386+0000","last_change":"2023-12-07T10:01:50.222386+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222386+0000","last_undegraded":"2023-12-07T10:01:50.222386+0000","last_fullsized":"2023-12-07T10:01:50.222386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237451+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:01:50.237451+0000","last_peered":"2023-12-07T10:01:50.237451+0000","last_clean":"2023-12-07T10:01:50.237451+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:01:50.237451+0000","last_undegraded":"2023-12-07T10:01:50.237451+0000","last_fullsized":"2023-12-07T10:01:50.237451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:03.944315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223658+0000","last_change":"2023-12-07T10:01:50.223658+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223658+0000","last_undegraded":"2023-12-07T10:01:50.223658+0000","last_fullsized":"2023-12-07T10:01:50.223658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237550+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:01:50.237550+0000","last_peered":"2023-12-07T10:01:50.237550+0000","last_clean":"2023-12-07T10:01:50.237550+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:01:50.237550+0000","last_undegraded":"2023-12-07T10:01:50.237550+0000","last_fullsized":"2023-12-07T10:01:50.237550+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:36.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224451+0000","last_change":"2023-12-07T10:01:50.224451+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224451+0000","last_undegraded":"2023-12-07T10:01:50.224451+0000","last_fullsized":"2023-12-07T10:01:50.224451+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239988+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:01:50.239988+0000","last_peered":"2023-12-07T10:01:50.239988+0000","last_clean":"2023-12-07T10:01:50.239988+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:01:50.239988+0000","last_undegraded":"2023-12-07T10:01:50.239988+0000","last_fullsized":"2023-12-07T10:01:50.239988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:36.886388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.233519+0000","last_change":"2023-12-07T10:01:50.233519+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.233519+0000","last_undegraded":"2023-12-07T10:01:50.233519+0000","last_fullsized":"2023-12-07T10:01:50.233519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250907+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:01:50.250907+0000","last_peered":"2023-12-07T10:01:50.250907+0000","last_clean":"2023-12-07T10:01:50.250907+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:01:50.250907+0000","last_undegraded":"2023-12-07T10:01:50.250907+0000","last_fullsized":"2023-12-07T10:01:50.250907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223060+0000","last_change":"2023-12-07T10:01:50.223060+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223060+0000","last_undegraded":"2023-12-07T10:01:50.223060+0000","last_fullsized":"2023-12-07T10:01:50.223060+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250547+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:01:50.250547+0000","last_peered":"2023-12-07T10:01:50.250547+0000","last_clean":"2023-12-07T10:01:50.250547+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:01:50.250547+0000","last_undegraded":"2023-12-07T10:01:50.250547+0000","last_fullsized":"2023-12-07T10:01:50.250547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222534+0000","last_change":"2023-12-07T10:01:50.222534+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222534+0000","last_undegraded":"2023-12-07T10:01:50.222534+0000","last_fullsized":"2023-12-07T10:01:50.222534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237914+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:01:50.237914+0000","last_peered":"2023-12-07T10:01:50.237914+0000","last_clean":"2023-12-07T10:01:50.237914+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:01:50.237914+0000","last_undegraded":"2023-12-07T10:01:50.237914+0000","last_fullsized":"2023-12-07T10:01:50.237914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223799+0000","last_change":"2023-12-07T10:01:50.223799+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223799+0000","last_undegraded":"2023-12-07T10:01:50.223799+0000","last_fullsized":"2023-12-07T10:01:50.223799+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.236594+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:01:50.236594+0000","last_peered":"2023-12-07T10:01:50.236594+0000","last_clean":"2023-12-07T10:01:50.236594+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:01:50.236594+0000","last_undegraded":"2023-12-07T10:01:50.236594+0000","last_fullsized":"2023-12-07T10:01:50.236594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:02.688486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223711+0000","last_change":"2023-12-07T10:01:50.223711+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223711+0000","last_undegraded":"2023-12-07T10:01:50.223711+0000","last_fullsized":"2023-12-07T10:01:50.223711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250605+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:01:50.250605+0000","last_peered":"2023-12-07T10:01:50.250605+0000","last_clean":"2023-12-07T10:01:50.250605+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:01:50.250605+0000","last_undegraded":"2023-12-07T10:01:50.250605+0000","last_fullsized":"2023-12-07T10:01:50.250605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:50:38.825735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.233639+0000","last_change":"2023-12-07T10:01:50.233639+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.233639+0000","last_undegraded":"2023-12-07T10:01:50.233639+0000","last_fullsized":"2023-12-07T10:01:50.233639+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.253450+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:01:50.253450+0000","last_peered":"2023-12-07T10:01:50.253450+0000","last_clean":"2023-12-07T10:01:50.253450+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:01:50.253450+0000","last_undegraded":"2023-12-07T10:01:50.253450+0000","last_fullsized":"2023-12-07T10:01:50.253450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221702+0000","last_change":"2023-12-07T10:01:50.221702+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221702+0000","last_undegraded":"2023-12-07T10:01:50.221702+0000","last_fullsized":"2023-12-07T10:01:50.221702+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.243824+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:01:50.243824+0000","last_peered":"2023-12-07T10:01:50.243824+0000","last_clean":"2023-12-07T10:01:50.243824+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:01:50.243824+0000","last_undegraded":"2023-12-07T10:01:50.243824+0000","last_fullsized":"2023-12-07T10:01:50.243824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-07T10:01:49.208188+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:49.208188+0000","last_peered":"2023-12-07T10:01:49.208188+0000","last_clean":"2023-12-07T10:01:49.208188+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:49.208188+0000","last_undegraded":"2023-12-07T10:01:49.208188+0000","last_fullsized":"2023-12-07T10:01:49.208188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":929968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.752}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.434},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.495}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.621}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.44},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.85199999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.872},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.754},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.745},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.434}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.755},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":929968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.254},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":0.753},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:55.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:55.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 Processor -- start 2023-12-07T10:01:55.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 -- start start 2023-12-07T10:01:55.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcbac070b80 0x7fcbac151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac06d320 con 0x7fcbac14e9d0 2023-12-07T10:01:55.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0721b0 con 0x7fcbac070b80 2023-12-07T10:01:55.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb3079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0c2830 con 0x7fcbac0a8470 2023-12-07T10:01:55.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb0e15640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcbac14e9d0 0x7fcbac0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55680/0 (socket says 172.21.15.89:55680) 2023-12-07T10:01:55.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcbb0e15640 1 -- 172.21.15.89:0/596228201 learned_addr learned my addr 172.21.15.89:0/596228201 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:55.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.464+0000 7fcba3fff640 1 --2- 172.21.15.89:0/596228201 >> v2:172.21.15.89:3300/0 conn(0x7fcbac070b80 0x7fcbac151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb1616640 1 --2- 172.21.15.89:0/596228201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba37fe640 1 -- 172.21.15.89:0/596228201 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443837506 0 0) 0x7fcbac06d320 con 0x7fcbac14e9d0 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba37fe640 1 -- 172.21.15.89:0/596228201 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb94003530 con 0x7fcbac14e9d0 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba3fff640 1 -- 172.21.15.89:0/596228201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 msgr2=0x7fcbac06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba3fff640 1 --2- 172.21.15.89:0/596228201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba3fff640 1 -- 172.21.15.89:0/596228201 >> v1:172.21.15.89:6789/0 conn(0x7fcbac14e9d0 legacy=0x7fcbac0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba3fff640 1 -- 172.21.15.89:0/596228201 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac072450 con 0x7fcbac070b80 2023-12-07T10:01:55.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba3fff640 1 --2- 172.21.15.89:0/596228201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac151e60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0097c0 tx=0x7fcb9c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188c8f6a06050d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba37fe640 1 -- 172.21.15.89:0/596228201 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0ab600 con 0x7fcbac070b80 2023-12-07T10:01:55.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba37fe640 1 -- 172.21.15.89:0/596228201 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0a7050 con 0x7fcbac070b80 2023-12-07T10:01:55.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcba37fe640 1 -- 172.21.15.89:0/596228201 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0ab980 con 0x7fcbac070b80 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb3079640 1 -- 172.21.15.89:0/596228201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 msgr2=0x7fcbac151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb3079640 1 --2- 172.21.15.89:0/596228201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac151e60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0097c0 tx=0x7fcb9c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb3079640 1 -- 172.21.15.89:0/596228201 shutdown_connections 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb3079640 1 --2- 172.21.15.89:0/596228201 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb3079640 1 --2- 172.21.15.89:0/596228201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac151e60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.468+0000 7fcbb3079640 1 -- 172.21.15.89:0/596228201 >> 172.21.15.89:0/596228201 conn(0x7fcbac0c2ad0 msgr2=0x7fcbac0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 -- 172.21.15.89:0/596228201 shutdown_connections 2023-12-07T10:01:55.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 -- 172.21.15.89:0/596228201 wait complete. 2023-12-07T10:01:55.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 Processor -- start 2023-12-07T10:01:55.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 -- start start 2023-12-07T10:01:55.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac1ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbac14e9d0 0x7fcbac151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac144ef0 con 0x7fcbac070b80 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1446d0 con 0x7fcbac14e9d0 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb3079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac152ff0 con 0x7fcbac0a8470 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac1449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40936/0 (socket says 172.21.15.89:40936) 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 -- 172.21.15.89:0/826218790 learned_addr learned my addr 172.21.15.89:0/826218790 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcba3fff640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac1ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb1616640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbac14e9d0 0x7fcbac151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 -- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 msgr2=0x7fcbac1ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac1ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 -- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbac14e9d0 msgr2=0x7fcbac151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbac14e9d0 0x7fcbac151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 -- 172.21.15.89:0/826218790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009420 con 0x7fcbac070b80 2023-12-07T10:01:55.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.472+0000 7fcbb0e15640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac1449b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c420 tx=0x7fcba800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8005cf0 con 0x7fcbac070b80 2023-12-07T10:01:55.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8005e50 con 0x7fcbac070b80 2023-12-07T10:01:55.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac1532d0 con 0x7fcbac070b80 2023-12-07T10:01:55.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba80072d0 con 0x7fcbac070b80 2023-12-07T10:01:55.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac1ed160 con 0x7fcbac070b80 2023-12-07T10:01:55.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac1519b0 con 0x7fcbac070b80 2023-12-07T10:01:55.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcba8007430 con 0x7fcbac070b80 2023-12-07T10:01:55.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba17fa640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb980668d0 0x7fcb98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcba8083960 con 0x7fcbac070b80 2023-12-07T10:01:55.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.476+0000 7fcba3fff640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb980668d0 0x7fcb98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.480+0000 7fcba3fff640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb980668d0 0x7fcb98068d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0ad000 tx=0x7fcb9c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.480+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcba8050c40 con 0x7fcbac070b80 2023-12-07T10:01:55.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.628+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbac15b2d0 con 0x7fcb980668d0 2023-12-07T10:01:55.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.636+0000 7fcba17fa640 1 -- 172.21.15.89:0/826218790 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283687 (secure 0 0 0) 0x7fcbac15b2d0 con 0x7fcb980668d0 2023-12-07T10:01:55.644 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:55.645 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb980668d0 msgr2=0x7fcb98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb980668d0 0x7fcb98068d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0ad000 tx=0x7fcb9c0a6000 comp rx=0 tx=0).stop 2023-12-07T10:01:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 msgr2=0x7fcbac1449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac1449b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c420 tx=0x7fcba800c8e0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 shutdown_connections 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbac14e9d0 0x7fcbac151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb980668d0 0x7fcb98068d90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcbac0a8470 0x7fcbac1ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 --2- 172.21.15.89:0/826218790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbac070b80 0x7fcbac1449b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 >> 172.21.15.89:0/826218790 conn(0x7fcbac0c2ad0 msgr2=0x7fcbac0c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 shutdown_connections 2023-12-07T10:01:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.640+0000 7fcbb3079640 1 -- 172.21.15.89:0/826218790 wait complete. 2023-12-07T10:01:55.666 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-07T10:01:54.374009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248428,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726292,"statfs":{"total":773094113280,"available":772839723008,"internally_reserved":0,"allocated":7479296,"data_stored":3897536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.168839"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.239870+0000","last_change":"2023-12-07T10:01:50.239870+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.239870+0000","last_undegraded":"2023-12-07T10:01:50.239870+0000","last_fullsized":"2023-12-07T10:01:50.239870+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223250+0000","last_change":"2023-12-07T10:01:50.223250+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223250+0000","last_undegraded":"2023-12-07T10:01:50.223250+0000","last_fullsized":"2023-12-07T10:01:50.223250+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227090+0000","last_change":"2023-12-07T10:01:50.227090+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227090+0000","last_undegraded":"2023-12-07T10:01:50.227090+0000","last_fullsized":"2023-12-07T10:01:50.227090+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227195+0000","last_change":"2023-12-07T10:01:50.227195+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227195+0000","last_undegraded":"2023-12-07T10:01:50.227195+0000","last_fullsized":"2023-12-07T10:01:50.227195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225226+0000","last_change":"2023-12-07T10:01:50.225226+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225226+0000","last_undegraded":"2023-12-07T10:01:50.225226+0000","last_fullsized":"2023-12-07T10:01:50.225226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226703+0000","last_change":"2023-12-07T10:01:50.226703+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226703+0000","last_undegraded":"2023-12-07T10:01:50.226703+0000","last_fullsized":"2023-12-07T10:01:50.226703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.228164+0000","last_change":"2023-12-07T10:01:50.228164+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.228164+0000","last_undegraded":"2023-12-07T10:01:50.228164+0000","last_fullsized":"2023-12-07T10:01:50.228164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222903+0000","last_change":"2023-12-07T10:01:50.222903+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222903+0000","last_undegraded":"2023-12-07T10:01:50.222903+0000","last_fullsized":"2023-12-07T10:01:50.222903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224340+0000","last_change":"2023-12-07T10:01:50.224340+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224340+0000","last_undegraded":"2023-12-07T10:01:50.224340+0000","last_fullsized":"2023-12-07T10:01:50.224340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.235671+0000","last_change":"2023-12-07T10:01:50.235671+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.235671+0000","last_undegraded":"2023-12-07T10:01:50.235671+0000","last_fullsized":"2023-12-07T10:01:50.235671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223059+0000","last_change":"2023-12-07T10:01:50.223059+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223059+0000","last_undegraded":"2023-12-07T10:01:50.223059+0000","last_fullsized":"2023-12-07T10:01:50.223059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.235102+0000","last_change":"2023-12-07T10:01:50.235102+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.235102+0000","last_undegraded":"2023-12-07T10:01:50.235102+0000","last_fullsized":"2023-12-07T10:01:50.235102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225481+0000","last_change":"2023-12-07T10:01:50.225481+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225481+0000","last_undegraded":"2023-12-07T10:01:50.225481+0000","last_fullsized":"2023-12-07T10:01:50.225481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226655+0000","last_change":"2023-12-07T10:01:50.226655+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226655+0000","last_undegraded":"2023-12-07T10:01:50.226655+0000","last_fullsized":"2023-12-07T10:01:50.226655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220735+0000","last_change":"2023-12-07T10:01:50.220735+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220735+0000","last_undegraded":"2023-12-07T10:01:50.220735+0000","last_fullsized":"2023-12-07T10:01:50.220735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222757+0000","last_change":"2023-12-07T10:01:50.222757+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222757+0000","last_undegraded":"2023-12-07T10:01:50.222757+0000","last_fullsized":"2023-12-07T10:01:50.222757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222862+0000","last_change":"2023-12-07T10:01:50.222862+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222862+0000","last_undegraded":"2023-12-07T10:01:50.222862+0000","last_fullsized":"2023-12-07T10:01:50.222862+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225500+0000","last_change":"2023-12-07T10:01:50.225500+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225500+0000","last_undegraded":"2023-12-07T10:01:50.225500+0000","last_fullsized":"2023-12-07T10:01:50.225500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223920+0000","last_change":"2023-12-07T10:01:50.223920+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223920+0000","last_undegraded":"2023-12-07T10:01:50.223920+0000","last_fullsized":"2023-12-07T10:01:50.223920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225082+0000","last_change":"2023-12-07T10:01:50.225082+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225082+0000","last_undegraded":"2023-12-07T10:01:50.225082+0000","last_fullsized":"2023-12-07T10:01:50.225082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223930+0000","last_change":"2023-12-07T10:01:50.223930+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223930+0000","last_undegraded":"2023-12-07T10:01:50.223930+0000","last_fullsized":"2023-12-07T10:01:50.223930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223420+0000","last_change":"2023-12-07T10:01:50.223420+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223420+0000","last_undegraded":"2023-12-07T10:01:50.223420+0000","last_fullsized":"2023-12-07T10:01:50.223420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234142+0000","last_change":"2023-12-07T10:01:50.234142+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234142+0000","last_undegraded":"2023-12-07T10:01:50.234142+0000","last_fullsized":"2023-12-07T10:01:50.234142+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221489+0000","last_change":"2023-12-07T10:01:50.221489+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221489+0000","last_undegraded":"2023-12-07T10:01:50.221489+0000","last_fullsized":"2023-12-07T10:01:50.221489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222295+0000","last_change":"2023-12-07T10:01:50.222295+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222295+0000","last_undegraded":"2023-12-07T10:01:50.222295+0000","last_fullsized":"2023-12-07T10:01:50.222295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226095+0000","last_change":"2023-12-07T10:01:50.226095+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226095+0000","last_undegraded":"2023-12-07T10:01:50.226095+0000","last_fullsized":"2023-12-07T10:01:50.226095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227999+0000","last_change":"2023-12-07T10:01:50.227999+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227999+0000","last_undegraded":"2023-12-07T10:01:50.227999+0000","last_fullsized":"2023-12-07T10:01:50.227999+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234631+0000","last_change":"2023-12-07T10:01:50.234631+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234631+0000","last_undegraded":"2023-12-07T10:01:50.234631+0000","last_fullsized":"2023-12-07T10:01:50.234631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221986+0000","last_change":"2023-12-07T10:01:50.221986+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221986+0000","last_undegraded":"2023-12-07T10:01:50.221986+0000","last_fullsized":"2023-12-07T10:01:50.221986+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221962+0000","last_change":"2023-12-07T10:01:50.221962+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221962+0000","last_undegraded":"2023-12-07T10:01:50.221962+0000","last_fullsized":"2023-12-07T10:01:50.221962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223911+0000","last_change":"2023-12-07T10:01:50.223911+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223911+0000","last_undegraded":"2023-12-07T10:01:50.223911+0000","last_fullsized":"2023-12-07T10:01:50.223911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.238026+0000","last_change":"2023-12-07T10:01:50.238026+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.238026+0000","last_undegraded":"2023-12-07T10:01:50.238026+0000","last_fullsized":"2023-12-07T10:01:50.238026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.229222+0000","last_change":"2023-12-07T10:01:50.229222+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.229222+0000","last_undegraded":"2023-12-07T10:01:50.229222+0000","last_fullsized":"2023-12-07T10:01:50.229222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.253519+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:01:50.253519+0000","last_peered":"2023-12-07T10:01:50.253519+0000","last_clean":"2023-12-07T10:01:50.253519+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:01:50.253519+0000","last_undegraded":"2023-12-07T10:01:50.253519+0000","last_fullsized":"2023-12-07T10:01:50.253519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:17.732221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.239339+0000","last_change":"2023-12-07T10:01:50.239339+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.239339+0000","last_undegraded":"2023-12-07T10:01:50.239339+0000","last_fullsized":"2023-12-07T10:01:50.239339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239070+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:01:50.239070+0000","last_peered":"2023-12-07T10:01:50.239070+0000","last_clean":"2023-12-07T10:01:50.239070+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:01:50.239070+0000","last_undegraded":"2023-12-07T10:01:50.239070+0000","last_fullsized":"2023-12-07T10:01:50.239070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:17.732221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234070+0000","last_change":"2023-12-07T10:01:50.234070+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234070+0000","last_undegraded":"2023-12-07T10:01:50.234070+0000","last_fullsized":"2023-12-07T10:01:50.234070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239520+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:01:50.239520+0000","last_peered":"2023-12-07T10:01:50.239520+0000","last_clean":"2023-12-07T10:01:50.239520+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:01:50.239520+0000","last_undegraded":"2023-12-07T10:01:50.239520+0000","last_fullsized":"2023-12-07T10:01:50.239520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226560+0000","last_change":"2023-12-07T10:01:50.226560+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226560+0000","last_undegraded":"2023-12-07T10:01:50.226560+0000","last_fullsized":"2023-12-07T10:01:50.226560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242092+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:01:50.242092+0000","last_peered":"2023-12-07T10:01:50.242092+0000","last_clean":"2023-12-07T10:01:50.242092+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:01:50.242092+0000","last_undegraded":"2023-12-07T10:01:50.242092+0000","last_fullsized":"2023-12-07T10:01:50.242092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:49.865873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221448+0000","last_change":"2023-12-07T10:01:50.221448+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221448+0000","last_undegraded":"2023-12-07T10:01:50.221448+0000","last_fullsized":"2023-12-07T10:01:50.221448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238163+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:01:50.238163+0000","last_peered":"2023-12-07T10:01:50.238163+0000","last_clean":"2023-12-07T10:01:50.238163+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:01:50.238163+0000","last_undegraded":"2023-12-07T10:01:50.238163+0000","last_fullsized":"2023-12-07T10:01:50.238163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:31.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223000+0000","last_change":"2023-12-07T10:01:50.223000+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223000+0000","last_undegraded":"2023-12-07T10:01:50.223000+0000","last_fullsized":"2023-12-07T10:01:50.223000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.236614+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:01:50.236614+0000","last_peered":"2023-12-07T10:01:50.236614+0000","last_clean":"2023-12-07T10:01:50.236614+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:01:50.236614+0000","last_undegraded":"2023-12-07T10:01:50.236614+0000","last_fullsized":"2023-12-07T10:01:50.236614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:00.041915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225172+0000","last_change":"2023-12-07T10:01:50.225172+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225172+0000","last_undegraded":"2023-12-07T10:01:50.225172+0000","last_fullsized":"2023-12-07T10:01:50.225172+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242077+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:01:50.242077+0000","last_peered":"2023-12-07T10:01:50.242077+0000","last_clean":"2023-12-07T10:01:50.242077+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:01:50.242077+0000","last_undegraded":"2023-12-07T10:01:50.242077+0000","last_fullsized":"2023-12-07T10:01:50.242077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220280+0000","last_change":"2023-12-07T10:01:50.220280+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220280+0000","last_undegraded":"2023-12-07T10:01:50.220280+0000","last_fullsized":"2023-12-07T10:01:50.220280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238657+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:01:50.238657+0000","last_peered":"2023-12-07T10:01:50.238657+0000","last_clean":"2023-12-07T10:01:50.238657+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:01:50.238657+0000","last_undegraded":"2023-12-07T10:01:50.238657+0000","last_fullsized":"2023-12-07T10:01:50.238657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:15.449621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221254+0000","last_change":"2023-12-07T10:01:50.221254+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221254+0000","last_undegraded":"2023-12-07T10:01:50.221254+0000","last_fullsized":"2023-12-07T10:01:50.221254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250634+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:01:50.250634+0000","last_peered":"2023-12-07T10:01:50.250634+0000","last_clean":"2023-12-07T10:01:50.250634+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:01:50.250634+0000","last_undegraded":"2023-12-07T10:01:50.250634+0000","last_fullsized":"2023-12-07T10:01:50.250634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:00.041915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223789+0000","last_change":"2023-12-07T10:01:50.223789+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223789+0000","last_undegraded":"2023-12-07T10:01:50.223789+0000","last_fullsized":"2023-12-07T10:01:50.223789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250660+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:01:50.250660+0000","last_peered":"2023-12-07T10:01:50.250660+0000","last_clean":"2023-12-07T10:01:50.250660+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:01:50.250660+0000","last_undegraded":"2023-12-07T10:01:50.250660+0000","last_fullsized":"2023-12-07T10:01:50.250660+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:02.688486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225065+0000","last_change":"2023-12-07T10:01:50.225065+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225065+0000","last_undegraded":"2023-12-07T10:01:50.225065+0000","last_fullsized":"2023-12-07T10:01:50.225065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250888+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:01:50.250888+0000","last_peered":"2023-12-07T10:01:50.250888+0000","last_clean":"2023-12-07T10:01:50.250888+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:01:50.250888+0000","last_undegraded":"2023-12-07T10:01:50.250888+0000","last_fullsized":"2023-12-07T10:01:50.250888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227505+0000","last_change":"2023-12-07T10:01:50.227505+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227505+0000","last_undegraded":"2023-12-07T10:01:50.227505+0000","last_fullsized":"2023-12-07T10:01:50.227505+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238988+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:01:50.238988+0000","last_peered":"2023-12-07T10:01:50.238988+0000","last_clean":"2023-12-07T10:01:50.238988+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:01:50.238988+0000","last_undegraded":"2023-12-07T10:01:50.238988+0000","last_fullsized":"2023-12-07T10:01:50.238988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:44.166751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224885+0000","last_change":"2023-12-07T10:01:50.224885+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224885+0000","last_undegraded":"2023-12-07T10:01:50.224885+0000","last_fullsized":"2023-12-07T10:01:50.224885+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.234329+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:01:50.234329+0000","last_peered":"2023-12-07T10:01:50.234329+0000","last_clean":"2023-12-07T10:01:50.234329+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:01:50.234329+0000","last_undegraded":"2023-12-07T10:01:50.234329+0000","last_fullsized":"2023-12-07T10:01:50.234329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224883+0000","last_change":"2023-12-07T10:01:50.224883+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224883+0000","last_undegraded":"2023-12-07T10:01:50.224883+0000","last_fullsized":"2023-12-07T10:01:50.224883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.231500+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:01:50.231500+0000","last_peered":"2023-12-07T10:01:50.231500+0000","last_clean":"2023-12-07T10:01:50.231500+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:01:50.231500+0000","last_undegraded":"2023-12-07T10:01:50.231500+0000","last_fullsized":"2023-12-07T10:01:50.231500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:15.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221642+0000","last_change":"2023-12-07T10:01:50.221642+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221642+0000","last_undegraded":"2023-12-07T10:01:50.221642+0000","last_fullsized":"2023-12-07T10:01:50.221642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.240800+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:01:50.240800+0000","last_peered":"2023-12-07T10:01:50.240800+0000","last_clean":"2023-12-07T10:01:50.240800+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:01:50.240800+0000","last_undegraded":"2023-12-07T10:01:50.240800+0000","last_fullsized":"2023-12-07T10:01:50.240800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:57.968264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221454+0000","last_change":"2023-12-07T10:01:50.221454+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221454+0000","last_undegraded":"2023-12-07T10:01:50.221454+0000","last_fullsized":"2023-12-07T10:01:50.221454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239368+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:01:50.239368+0000","last_peered":"2023-12-07T10:01:50.239368+0000","last_clean":"2023-12-07T10:01:50.239368+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:01:50.239368+0000","last_undegraded":"2023-12-07T10:01:50.239368+0000","last_fullsized":"2023-12-07T10:01:50.239368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225530+0000","last_change":"2023-12-07T10:01:50.225530+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225530+0000","last_undegraded":"2023-12-07T10:01:50.225530+0000","last_fullsized":"2023-12-07T10:01:50.225530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250504+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:01:50.250504+0000","last_peered":"2023-12-07T10:01:50.250504+0000","last_clean":"2023-12-07T10:01:50.250504+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:01:50.250504+0000","last_undegraded":"2023-12-07T10:01:50.250504+0000","last_fullsized":"2023-12-07T10:01:50.250504+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:31.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.236841+0000","last_change":"2023-12-07T10:01:50.236841+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.236841+0000","last_undegraded":"2023-12-07T10:01:50.236841+0000","last_fullsized":"2023-12-07T10:01:50.236841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242194+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:01:50.242194+0000","last_peered":"2023-12-07T10:01:50.242194+0000","last_clean":"2023-12-07T10:01:50.242194+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:01:50.242194+0000","last_undegraded":"2023-12-07T10:01:50.242194+0000","last_fullsized":"2023-12-07T10:01:50.242194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226948+0000","last_change":"2023-12-07T10:01:50.226948+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226948+0000","last_undegraded":"2023-12-07T10:01:50.226948+0000","last_fullsized":"2023-12-07T10:01:50.226948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239643+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:01:50.239643+0000","last_peered":"2023-12-07T10:01:50.239643+0000","last_clean":"2023-12-07T10:01:50.239643+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:01:50.239643+0000","last_undegraded":"2023-12-07T10:01:50.239643+0000","last_fullsized":"2023-12-07T10:01:50.239643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221902+0000","last_change":"2023-12-07T10:01:50.221902+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221902+0000","last_undegraded":"2023-12-07T10:01:50.221902+0000","last_fullsized":"2023-12-07T10:01:50.221902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.241807+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:01:50.241807+0000","last_peered":"2023-12-07T10:01:50.241807+0000","last_clean":"2023-12-07T10:01:50.241807+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:01:50.241807+0000","last_undegraded":"2023-12-07T10:01:50.241807+0000","last_fullsized":"2023-12-07T10:01:50.241807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:46:26.919128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223113+0000","last_change":"2023-12-07T10:01:50.223113+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223113+0000","last_undegraded":"2023-12-07T10:01:50.223113+0000","last_fullsized":"2023-12-07T10:01:50.223113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237822+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:01:50.237822+0000","last_peered":"2023-12-07T10:01:50.237822+0000","last_clean":"2023-12-07T10:01:50.237822+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:01:50.237822+0000","last_undegraded":"2023-12-07T10:01:50.237822+0000","last_fullsized":"2023-12-07T10:01:50.237822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:40.523454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220998+0000","last_change":"2023-12-07T10:01:50.220998+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220998+0000","last_undegraded":"2023-12-07T10:01:50.220998+0000","last_fullsized":"2023-12-07T10:01:50.220998+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.245537+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:01:50.245537+0000","last_peered":"2023-12-07T10:01:50.245537+0000","last_clean":"2023-12-07T10:01:50.245537+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:01:50.245537+0000","last_undegraded":"2023-12-07T10:01:50.245537+0000","last_fullsized":"2023-12-07T10:01:50.245537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:01:29.575944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222386+0000","last_change":"2023-12-07T10:01:50.222386+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222386+0000","last_undegraded":"2023-12-07T10:01:50.222386+0000","last_fullsized":"2023-12-07T10:01:50.222386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237451+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:01:50.237451+0000","last_peered":"2023-12-07T10:01:50.237451+0000","last_clean":"2023-12-07T10:01:50.237451+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:01:50.237451+0000","last_undegraded":"2023-12-07T10:01:50.237451+0000","last_fullsized":"2023-12-07T10:01:50.237451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:03.944315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223658+0000","last_change":"2023-12-07T10:01:50.223658+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223658+0000","last_undegraded":"2023-12-07T10:01:50.223658+0000","last_fullsized":"2023-12-07T10:01:50.223658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237550+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:01:50.237550+0000","last_peered":"2023-12-07T10:01:50.237550+0000","last_clean":"2023-12-07T10:01:50.237550+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:01:50.237550+0000","last_undegraded":"2023-12-07T10:01:50.237550+0000","last_fullsized":"2023-12-07T10:01:50.237550+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:36.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224451+0000","last_change":"2023-12-07T10:01:50.224451+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224451+0000","last_undegraded":"2023-12-07T10:01:50.224451+0000","last_fullsized":"2023-12-07T10:01:50.224451+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239988+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:01:50.239988+0000","last_peered":"2023-12-07T10:01:50.239988+0000","last_clean":"2023-12-07T10:01:50.239988+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:01:50.239988+0000","last_undegraded":"2023-12-07T10:01:50.239988+0000","last_fullsized":"2023-12-07T10:01:50.239988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:36.886388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.233519+0000","last_change":"2023-12-07T10:01:50.233519+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.233519+0000","last_undegraded":"2023-12-07T10:01:50.233519+0000","last_fullsized":"2023-12-07T10:01:50.233519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250907+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:01:50.250907+0000","last_peered":"2023-12-07T10:01:50.250907+0000","last_clean":"2023-12-07T10:01:50.250907+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:01:50.250907+0000","last_undegraded":"2023-12-07T10:01:50.250907+0000","last_fullsized":"2023-12-07T10:01:50.250907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223060+0000","last_change":"2023-12-07T10:01:50.223060+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223060+0000","last_undegraded":"2023-12-07T10:01:50.223060+0000","last_fullsized":"2023-12-07T10:01:50.223060+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250547+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:01:50.250547+0000","last_peered":"2023-12-07T10:01:50.250547+0000","last_clean":"2023-12-07T10:01:50.250547+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:01:50.250547+0000","last_undegraded":"2023-12-07T10:01:50.250547+0000","last_fullsized":"2023-12-07T10:01:50.250547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222534+0000","last_change":"2023-12-07T10:01:50.222534+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222534+0000","last_undegraded":"2023-12-07T10:01:50.222534+0000","last_fullsized":"2023-12-07T10:01:50.222534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237914+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:01:50.237914+0000","last_peered":"2023-12-07T10:01:50.237914+0000","last_clean":"2023-12-07T10:01:50.237914+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:01:50.237914+0000","last_undegraded":"2023-12-07T10:01:50.237914+0000","last_fullsized":"2023-12-07T10:01:50.237914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223799+0000","last_change":"2023-12-07T10:01:50.223799+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223799+0000","last_undegraded":"2023-12-07T10:01:50.223799+0000","last_fullsized":"2023-12-07T10:01:50.223799+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.236594+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:01:50.236594+0000","last_peered":"2023-12-07T10:01:50.236594+0000","last_clean":"2023-12-07T10:01:50.236594+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:01:50.236594+0000","last_undegraded":"2023-12-07T10:01:50.236594+0000","last_fullsized":"2023-12-07T10:01:50.236594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:02.688486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223711+0000","last_change":"2023-12-07T10:01:50.223711+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223711+0000","last_undegraded":"2023-12-07T10:01:50.223711+0000","last_fullsized":"2023-12-07T10:01:50.223711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250605+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:01:50.250605+0000","last_peered":"2023-12-07T10:01:50.250605+0000","last_clean":"2023-12-07T10:01:50.250605+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:01:50.250605+0000","last_undegraded":"2023-12-07T10:01:50.250605+0000","last_fullsized":"2023-12-07T10:01:50.250605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:50:38.825735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.233639+0000","last_change":"2023-12-07T10:01:50.233639+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.233639+0000","last_undegraded":"2023-12-07T10:01:50.233639+0000","last_fullsized":"2023-12-07T10:01:50.233639+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.253450+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:01:50.253450+0000","last_peered":"2023-12-07T10:01:50.253450+0000","last_clean":"2023-12-07T10:01:50.253450+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:01:50.253450+0000","last_undegraded":"2023-12-07T10:01:50.253450+0000","last_fullsized":"2023-12-07T10:01:50.253450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221702+0000","last_change":"2023-12-07T10:01:50.221702+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221702+0000","last_undegraded":"2023-12-07T10:01:50.221702+0000","last_fullsized":"2023-12-07T10:01:50.221702+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.243824+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:01:50.243824+0000","last_peered":"2023-12-07T10:01:50.243824+0000","last_clean":"2023-12-07T10:01:50.243824+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:01:50.243824+0000","last_undegraded":"2023-12-07T10:01:50.243824+0000","last_fullsized":"2023-12-07T10:01:50.243824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-07T10:01:49.208188+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:49.208188+0000","last_peered":"2023-12-07T10:01:49.208188+0000","last_clean":"2023-12-07T10:01:49.208188+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:49.208188+0000","last_undegraded":"2023-12-07T10:01:49.208188+0000","last_fullsized":"2023-12-07T10:01:49.208188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":929968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.752}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.434},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.495}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.621}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.44},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.85199999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.872},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.754},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.745},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.434}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.755},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":929968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.254},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":0.753},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:55.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:55.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab91d1640 1 Processor -- start 2023-12-07T10:01:55.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab91d1640 1 -- start start 2023-12-07T10:01:55.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab91d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ab40ca610 0x7f1ab40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab91d1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab4155790 con 0x7f1ab40bd720 2023-12-07T10:01:55.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab91d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40c4b00 con 0x7f1ab406cd90 2023-12-07T10:01:55.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab91d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40c4de0 con 0x7f1ab40ca610 2023-12-07T10:01:55.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1aaa59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1ab40bd720 0x7f1ab4158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55688/0 (socket says 172.21.15.89:55688) 2023-12-07T10:01:55.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1aaa59c640 1 -- 172.21.15.89:0/239958019 learned_addr learned my addr 172.21.15.89:0/239958019 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:55.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/239958019 >> v2:172.21.15.97:3300/0 conn(0x7f1ab40ca610 0x7f1ab40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262521279 0 0) 0x7f1ab4155790 con 0x7f1ab40bd720 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa0003530 con 0x7f1ab40bd720 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942949055 0 0) 0x7f1ab40c4b00 con 0x7f1ab406cd90 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab4155790 con 0x7f1ab406cd90 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181299163 0 0) 0x7f1aa0003530 con 0x7f1ab40bd720 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 >> v2:172.21.15.97:3300/0 conn(0x7f1ab40ca610 msgr2=0x7f1ab40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 --2- 172.21.15.89:0/239958019 >> v2:172.21.15.97:3300/0 conn(0x7f1ab40ca610 0x7f1ab40c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 >> v1:172.21.15.97:6789/0 conn(0x7f1ab406cd90 legacy=0x7f1ab40c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4157e30 con 0x7f1ab40bd720 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f1a9c001a00 con 0x7f1ab40bd720 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 >> v1:172.21.15.89:6789/0 conn(0x7f1ab40bd720 legacy=0x7f1ab4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa0003b10 0x7f1aa0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa00047d0 0x7f1aa0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1aa0005200 0x7f1aa000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40c4de0 con 0x7f1aa0003b10 2023-12-07T10:01:55.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000c160 con 0x7f1aa00047d0 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000c320 con 0x7f1aa0005200 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa0003b10 0x7f1aa0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1aaa59c640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa00047d0 0x7f1aa0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab359e640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1aa0005200 0x7f1aa000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 -- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1aa0005200 msgr2=0x7f1aa000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1aa0005200 0x7f1aa000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 -- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa00047d0 msgr2=0x7f1aa0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa00047d0 0x7f1aa0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.844+0000 7f1ab2d9d640 1 -- 172.21.15.89:0/239958019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0003530 con 0x7f1aa0003b10 2023-12-07T10:01:55.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab359e640 1 -- 172.21.15.89:0/239958019 reap_dead start 2023-12-07T10:01:55.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa0003b10 0x7f1aa0003f10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009ae0 tx=0x7f1aa401c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c27213cc9745ce server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40c52d0 con 0x7f1aa0003b10 2023-12-07T10:01:55.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40a4bb0 con 0x7f1aa0003b10 2023-12-07T10:01:55.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab259c640 1 -- 172.21.15.89:0/239958019 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40ac440 con 0x7f1aa0003b10 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 -- 172.21.15.89:0/239958019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa0003b10 msgr2=0x7f1aa0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa0003b10 0x7f1aa0003f10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009ae0 tx=0x7f1aa401c750 comp rx=0 tx=0).stop 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 -- 172.21.15.89:0/239958019 shutdown_connections 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/239958019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa0003b10 0x7f1aa0003f10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 -- 172.21.15.89:0/239958019 >> 172.21.15.89:0/239958019 conn(0x7f1ab4071ea0 msgr2=0x7f1ab40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 -- 172.21.15.89:0/239958019 shutdown_connections 2023-12-07T10:01:55.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.848+0000 7f1ab91d1640 1 -- 172.21.15.89:0/239958019 wait complete. 2023-12-07T10:01:55.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 Processor -- start 2023-12-07T10:01:55.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 -- start start 2023-12-07T10:01:55.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa0003b10 0x7f1ab40abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 0x7f1ab41ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab41e2960 0x7f1ab41f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40c18a0 con 0x7f1ab41e3770 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4148430 con 0x7f1aa0003b10 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41e3c70 con 0x7f1ab41e2960 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 0x7f1ab41ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 0x7f1ab41ef360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40948/0 (socket says 172.21.15.89:40948) 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 -- 172.21.15.89:0/1082700240 learned_addr learned my addr 172.21.15.89:0/1082700240 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa0003b10 0x7f1ab40abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab359e640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab41e2960 0x7f1ab41f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 -- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab41e2960 msgr2=0x7f1ab41f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab41e2960 0x7f1ab41f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 -- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa0003b10 msgr2=0x7f1ab40abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa0003b10 0x7f1ab40abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 -- 172.21.15.89:0/1082700240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab41e1be0 con 0x7f1ab41e3770 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aaa59c640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 0x7f1ab41ef360 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0079e0 tx=0x7f1a9c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00edf0 con 0x7f1ab41e3770 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c013420 con 0x7f1ab41e3770 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab41e1e80 con 0x7f1ab41e3770 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.852+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c0137d0 con 0x7f1ab41e3770 2023-12-07T10:01:55.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41e2440 con 0x7f1ab41e3770 2023-12-07T10:01:55.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab41e2660 con 0x7f1ab41e3770 2023-12-07T10:01:55.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a9c013930 con 0x7f1ab41e3770 2023-12-07T10:01:55.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1aabfff640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a94066900 0x7f1a94068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:55.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a9c084a00 con 0x7f1ab41e3770 2023-12-07T10:01:55.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a94066900 0x7f1a94068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:55.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.856+0000 7f1ab2d9d640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a94066900 0x7f1a94068dc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40ae000 tx=0x7f1aa40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:55.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:55.860+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a9c051cd0 con 0x7f1ab41e3770 2023-12-07T10:01:56.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.008+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ab406bf90 con 0x7f1a94066900 2023-12-07T10:01:56.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.016+0000 7f1aabfff640 1 -- 172.21.15.89:0/1082700240 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283687 (secure 0 0 0) 0x7f1ab406bf90 con 0x7f1a94066900 2023-12-07T10:01:56.025 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:56.026 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:56.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a94066900 msgr2=0x7f1a94068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a94066900 0x7f1a94068dc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40ae000 tx=0x7f1aa40046d0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 msgr2=0x7f1ab41ef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 0x7f1ab41ef360 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0079e0 tx=0x7f1a9c00e530 comp rx=0 tx=0).stop 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 shutdown_connections 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1a94066900 0x7f1a94068dc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1ab41e2960 0x7f1ab41f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ab41e3770 0x7f1ab41ef360 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 --2- 172.21.15.89:0/1082700240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1aa0003b10 0x7f1ab40abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 >> 172.21.15.89:0/1082700240 conn(0x7f1ab4071ea0 msgr2=0x7f1ab4155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 shutdown_connections 2023-12-07T10:01:56.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.020+0000 7f1ab91d1640 1 -- 172.21.15.89:0/1082700240 wait complete. 2023-12-07T10:01:56.045 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-07T10:01:54.374009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248428,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726292,"statfs":{"total":773094113280,"available":772839723008,"internally_reserved":0,"allocated":7479296,"data_stored":3897536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.168839"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.239870+0000","last_change":"2023-12-07T10:01:50.239870+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.239870+0000","last_undegraded":"2023-12-07T10:01:50.239870+0000","last_fullsized":"2023-12-07T10:01:50.239870+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223250+0000","last_change":"2023-12-07T10:01:50.223250+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223250+0000","last_undegraded":"2023-12-07T10:01:50.223250+0000","last_fullsized":"2023-12-07T10:01:50.223250+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227090+0000","last_change":"2023-12-07T10:01:50.227090+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227090+0000","last_undegraded":"2023-12-07T10:01:50.227090+0000","last_fullsized":"2023-12-07T10:01:50.227090+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227195+0000","last_change":"2023-12-07T10:01:50.227195+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227195+0000","last_undegraded":"2023-12-07T10:01:50.227195+0000","last_fullsized":"2023-12-07T10:01:50.227195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225226+0000","last_change":"2023-12-07T10:01:50.225226+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225226+0000","last_undegraded":"2023-12-07T10:01:50.225226+0000","last_fullsized":"2023-12-07T10:01:50.225226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226703+0000","last_change":"2023-12-07T10:01:50.226703+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226703+0000","last_undegraded":"2023-12-07T10:01:50.226703+0000","last_fullsized":"2023-12-07T10:01:50.226703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.228164+0000","last_change":"2023-12-07T10:01:50.228164+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.228164+0000","last_undegraded":"2023-12-07T10:01:50.228164+0000","last_fullsized":"2023-12-07T10:01:50.228164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222903+0000","last_change":"2023-12-07T10:01:50.222903+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222903+0000","last_undegraded":"2023-12-07T10:01:50.222903+0000","last_fullsized":"2023-12-07T10:01:50.222903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224340+0000","last_change":"2023-12-07T10:01:50.224340+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224340+0000","last_undegraded":"2023-12-07T10:01:50.224340+0000","last_fullsized":"2023-12-07T10:01:50.224340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.235671+0000","last_change":"2023-12-07T10:01:50.235671+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.235671+0000","last_undegraded":"2023-12-07T10:01:50.235671+0000","last_fullsized":"2023-12-07T10:01:50.235671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223059+0000","last_change":"2023-12-07T10:01:50.223059+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223059+0000","last_undegraded":"2023-12-07T10:01:50.223059+0000","last_fullsized":"2023-12-07T10:01:50.223059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.235102+0000","last_change":"2023-12-07T10:01:50.235102+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.235102+0000","last_undegraded":"2023-12-07T10:01:50.235102+0000","last_fullsized":"2023-12-07T10:01:50.235102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225481+0000","last_change":"2023-12-07T10:01:50.225481+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225481+0000","last_undegraded":"2023-12-07T10:01:50.225481+0000","last_fullsized":"2023-12-07T10:01:50.225481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226655+0000","last_change":"2023-12-07T10:01:50.226655+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226655+0000","last_undegraded":"2023-12-07T10:01:50.226655+0000","last_fullsized":"2023-12-07T10:01:50.226655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220735+0000","last_change":"2023-12-07T10:01:50.220735+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220735+0000","last_undegraded":"2023-12-07T10:01:50.220735+0000","last_fullsized":"2023-12-07T10:01:50.220735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222757+0000","last_change":"2023-12-07T10:01:50.222757+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222757+0000","last_undegraded":"2023-12-07T10:01:50.222757+0000","last_fullsized":"2023-12-07T10:01:50.222757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222862+0000","last_change":"2023-12-07T10:01:50.222862+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222862+0000","last_undegraded":"2023-12-07T10:01:50.222862+0000","last_fullsized":"2023-12-07T10:01:50.222862+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225500+0000","last_change":"2023-12-07T10:01:50.225500+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225500+0000","last_undegraded":"2023-12-07T10:01:50.225500+0000","last_fullsized":"2023-12-07T10:01:50.225500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223920+0000","last_change":"2023-12-07T10:01:50.223920+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223920+0000","last_undegraded":"2023-12-07T10:01:50.223920+0000","last_fullsized":"2023-12-07T10:01:50.223920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225082+0000","last_change":"2023-12-07T10:01:50.225082+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225082+0000","last_undegraded":"2023-12-07T10:01:50.225082+0000","last_fullsized":"2023-12-07T10:01:50.225082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223930+0000","last_change":"2023-12-07T10:01:50.223930+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223930+0000","last_undegraded":"2023-12-07T10:01:50.223930+0000","last_fullsized":"2023-12-07T10:01:50.223930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223420+0000","last_change":"2023-12-07T10:01:50.223420+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223420+0000","last_undegraded":"2023-12-07T10:01:50.223420+0000","last_fullsized":"2023-12-07T10:01:50.223420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234142+0000","last_change":"2023-12-07T10:01:50.234142+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234142+0000","last_undegraded":"2023-12-07T10:01:50.234142+0000","last_fullsized":"2023-12-07T10:01:50.234142+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221489+0000","last_change":"2023-12-07T10:01:50.221489+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221489+0000","last_undegraded":"2023-12-07T10:01:50.221489+0000","last_fullsized":"2023-12-07T10:01:50.221489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222295+0000","last_change":"2023-12-07T10:01:50.222295+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222295+0000","last_undegraded":"2023-12-07T10:01:50.222295+0000","last_fullsized":"2023-12-07T10:01:50.222295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226095+0000","last_change":"2023-12-07T10:01:50.226095+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226095+0000","last_undegraded":"2023-12-07T10:01:50.226095+0000","last_fullsized":"2023-12-07T10:01:50.226095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227999+0000","last_change":"2023-12-07T10:01:50.227999+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227999+0000","last_undegraded":"2023-12-07T10:01:50.227999+0000","last_fullsized":"2023-12-07T10:01:50.227999+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234631+0000","last_change":"2023-12-07T10:01:50.234631+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234631+0000","last_undegraded":"2023-12-07T10:01:50.234631+0000","last_fullsized":"2023-12-07T10:01:50.234631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221986+0000","last_change":"2023-12-07T10:01:50.221986+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221986+0000","last_undegraded":"2023-12-07T10:01:50.221986+0000","last_fullsized":"2023-12-07T10:01:50.221986+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221962+0000","last_change":"2023-12-07T10:01:50.221962+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221962+0000","last_undegraded":"2023-12-07T10:01:50.221962+0000","last_fullsized":"2023-12-07T10:01:50.221962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223911+0000","last_change":"2023-12-07T10:01:50.223911+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223911+0000","last_undegraded":"2023-12-07T10:01:50.223911+0000","last_fullsized":"2023-12-07T10:01:50.223911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.238026+0000","last_change":"2023-12-07T10:01:50.238026+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.238026+0000","last_undegraded":"2023-12-07T10:01:50.238026+0000","last_fullsized":"2023-12-07T10:01:50.238026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.229222+0000","last_change":"2023-12-07T10:01:50.229222+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.229222+0000","last_undegraded":"2023-12-07T10:01:50.229222+0000","last_fullsized":"2023-12-07T10:01:50.229222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.253519+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:01:50.253519+0000","last_peered":"2023-12-07T10:01:50.253519+0000","last_clean":"2023-12-07T10:01:50.253519+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:01:50.253519+0000","last_undegraded":"2023-12-07T10:01:50.253519+0000","last_fullsized":"2023-12-07T10:01:50.253519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:17.732221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.239339+0000","last_change":"2023-12-07T10:01:50.239339+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.239339+0000","last_undegraded":"2023-12-07T10:01:50.239339+0000","last_fullsized":"2023-12-07T10:01:50.239339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239070+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:01:50.239070+0000","last_peered":"2023-12-07T10:01:50.239070+0000","last_clean":"2023-12-07T10:01:50.239070+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:01:50.239070+0000","last_undegraded":"2023-12-07T10:01:50.239070+0000","last_fullsized":"2023-12-07T10:01:50.239070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:17.732221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.234070+0000","last_change":"2023-12-07T10:01:50.234070+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.234070+0000","last_undegraded":"2023-12-07T10:01:50.234070+0000","last_fullsized":"2023-12-07T10:01:50.234070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239520+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:01:50.239520+0000","last_peered":"2023-12-07T10:01:50.239520+0000","last_clean":"2023-12-07T10:01:50.239520+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:01:50.239520+0000","last_undegraded":"2023-12-07T10:01:50.239520+0000","last_fullsized":"2023-12-07T10:01:50.239520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226560+0000","last_change":"2023-12-07T10:01:50.226560+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226560+0000","last_undegraded":"2023-12-07T10:01:50.226560+0000","last_fullsized":"2023-12-07T10:01:50.226560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242092+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:01:50.242092+0000","last_peered":"2023-12-07T10:01:50.242092+0000","last_clean":"2023-12-07T10:01:50.242092+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:01:50.242092+0000","last_undegraded":"2023-12-07T10:01:50.242092+0000","last_fullsized":"2023-12-07T10:01:50.242092+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:49.865873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221448+0000","last_change":"2023-12-07T10:01:50.221448+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221448+0000","last_undegraded":"2023-12-07T10:01:50.221448+0000","last_fullsized":"2023-12-07T10:01:50.221448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238163+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:01:50.238163+0000","last_peered":"2023-12-07T10:01:50.238163+0000","last_clean":"2023-12-07T10:01:50.238163+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:01:50.238163+0000","last_undegraded":"2023-12-07T10:01:50.238163+0000","last_fullsized":"2023-12-07T10:01:50.238163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:31.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223000+0000","last_change":"2023-12-07T10:01:50.223000+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223000+0000","last_undegraded":"2023-12-07T10:01:50.223000+0000","last_fullsized":"2023-12-07T10:01:50.223000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.236614+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:01:50.236614+0000","last_peered":"2023-12-07T10:01:50.236614+0000","last_clean":"2023-12-07T10:01:50.236614+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:01:50.236614+0000","last_undegraded":"2023-12-07T10:01:50.236614+0000","last_fullsized":"2023-12-07T10:01:50.236614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:00.041915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225172+0000","last_change":"2023-12-07T10:01:50.225172+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225172+0000","last_undegraded":"2023-12-07T10:01:50.225172+0000","last_fullsized":"2023-12-07T10:01:50.225172+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242077+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:01:50.242077+0000","last_peered":"2023-12-07T10:01:50.242077+0000","last_clean":"2023-12-07T10:01:50.242077+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:01:50.242077+0000","last_undegraded":"2023-12-07T10:01:50.242077+0000","last_fullsized":"2023-12-07T10:01:50.242077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220280+0000","last_change":"2023-12-07T10:01:50.220280+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220280+0000","last_undegraded":"2023-12-07T10:01:50.220280+0000","last_fullsized":"2023-12-07T10:01:50.220280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238657+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:01:50.238657+0000","last_peered":"2023-12-07T10:01:50.238657+0000","last_clean":"2023-12-07T10:01:50.238657+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:01:50.238657+0000","last_undegraded":"2023-12-07T10:01:50.238657+0000","last_fullsized":"2023-12-07T10:01:50.238657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:15.449621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221254+0000","last_change":"2023-12-07T10:01:50.221254+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221254+0000","last_undegraded":"2023-12-07T10:01:50.221254+0000","last_fullsized":"2023-12-07T10:01:50.221254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250634+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:01:50.250634+0000","last_peered":"2023-12-07T10:01:50.250634+0000","last_clean":"2023-12-07T10:01:50.250634+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:01:50.250634+0000","last_undegraded":"2023-12-07T10:01:50.250634+0000","last_fullsized":"2023-12-07T10:01:50.250634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:00.041915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223789+0000","last_change":"2023-12-07T10:01:50.223789+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223789+0000","last_undegraded":"2023-12-07T10:01:50.223789+0000","last_fullsized":"2023-12-07T10:01:50.223789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250660+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:01:50.250660+0000","last_peered":"2023-12-07T10:01:50.250660+0000","last_clean":"2023-12-07T10:01:50.250660+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:01:50.250660+0000","last_undegraded":"2023-12-07T10:01:50.250660+0000","last_fullsized":"2023-12-07T10:01:50.250660+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:02.688486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225065+0000","last_change":"2023-12-07T10:01:50.225065+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225065+0000","last_undegraded":"2023-12-07T10:01:50.225065+0000","last_fullsized":"2023-12-07T10:01:50.225065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250888+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:01:50.250888+0000","last_peered":"2023-12-07T10:01:50.250888+0000","last_clean":"2023-12-07T10:01:50.250888+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:01:50.250888+0000","last_undegraded":"2023-12-07T10:01:50.250888+0000","last_fullsized":"2023-12-07T10:01:50.250888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.227505+0000","last_change":"2023-12-07T10:01:50.227505+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.227505+0000","last_undegraded":"2023-12-07T10:01:50.227505+0000","last_fullsized":"2023-12-07T10:01:50.227505+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.238988+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:01:50.238988+0000","last_peered":"2023-12-07T10:01:50.238988+0000","last_clean":"2023-12-07T10:01:50.238988+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:01:50.238988+0000","last_undegraded":"2023-12-07T10:01:50.238988+0000","last_fullsized":"2023-12-07T10:01:50.238988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:44.166751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224885+0000","last_change":"2023-12-07T10:01:50.224885+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224885+0000","last_undegraded":"2023-12-07T10:01:50.224885+0000","last_fullsized":"2023-12-07T10:01:50.224885+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.234329+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:01:50.234329+0000","last_peered":"2023-12-07T10:01:50.234329+0000","last_clean":"2023-12-07T10:01:50.234329+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:01:50.234329+0000","last_undegraded":"2023-12-07T10:01:50.234329+0000","last_fullsized":"2023-12-07T10:01:50.234329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:41.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224883+0000","last_change":"2023-12-07T10:01:50.224883+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224883+0000","last_undegraded":"2023-12-07T10:01:50.224883+0000","last_fullsized":"2023-12-07T10:01:50.224883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.231500+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:01:50.231500+0000","last_peered":"2023-12-07T10:01:50.231500+0000","last_clean":"2023-12-07T10:01:50.231500+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:01:50.231500+0000","last_undegraded":"2023-12-07T10:01:50.231500+0000","last_fullsized":"2023-12-07T10:01:50.231500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:15.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221642+0000","last_change":"2023-12-07T10:01:50.221642+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221642+0000","last_undegraded":"2023-12-07T10:01:50.221642+0000","last_fullsized":"2023-12-07T10:01:50.221642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.240800+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:01:50.240800+0000","last_peered":"2023-12-07T10:01:50.240800+0000","last_clean":"2023-12-07T10:01:50.240800+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:01:50.240800+0000","last_undegraded":"2023-12-07T10:01:50.240800+0000","last_fullsized":"2023-12-07T10:01:50.240800+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:57.968264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221454+0000","last_change":"2023-12-07T10:01:50.221454+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221454+0000","last_undegraded":"2023-12-07T10:01:50.221454+0000","last_fullsized":"2023-12-07T10:01:50.221454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239368+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:01:50.239368+0000","last_peered":"2023-12-07T10:01:50.239368+0000","last_clean":"2023-12-07T10:01:50.239368+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:01:50.239368+0000","last_undegraded":"2023-12-07T10:01:50.239368+0000","last_fullsized":"2023-12-07T10:01:50.239368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.225530+0000","last_change":"2023-12-07T10:01:50.225530+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.225530+0000","last_undegraded":"2023-12-07T10:01:50.225530+0000","last_fullsized":"2023-12-07T10:01:50.225530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250504+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:01:50.250504+0000","last_peered":"2023-12-07T10:01:50.250504+0000","last_clean":"2023-12-07T10:01:50.250504+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:01:50.250504+0000","last_undegraded":"2023-12-07T10:01:50.250504+0000","last_fullsized":"2023-12-07T10:01:50.250504+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:31.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.236841+0000","last_change":"2023-12-07T10:01:50.236841+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.236841+0000","last_undegraded":"2023-12-07T10:01:50.236841+0000","last_fullsized":"2023-12-07T10:01:50.236841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.242194+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:01:50.242194+0000","last_peered":"2023-12-07T10:01:50.242194+0000","last_clean":"2023-12-07T10:01:50.242194+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:01:50.242194+0000","last_undegraded":"2023-12-07T10:01:50.242194+0000","last_fullsized":"2023-12-07T10:01:50.242194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.226948+0000","last_change":"2023-12-07T10:01:50.226948+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.226948+0000","last_undegraded":"2023-12-07T10:01:50.226948+0000","last_fullsized":"2023-12-07T10:01:50.226948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239643+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:01:50.239643+0000","last_peered":"2023-12-07T10:01:50.239643+0000","last_clean":"2023-12-07T10:01:50.239643+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:01:50.239643+0000","last_undegraded":"2023-12-07T10:01:50.239643+0000","last_fullsized":"2023-12-07T10:01:50.239643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221902+0000","last_change":"2023-12-07T10:01:50.221902+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221902+0000","last_undegraded":"2023-12-07T10:01:50.221902+0000","last_fullsized":"2023-12-07T10:01:50.221902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.241807+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:01:50.241807+0000","last_peered":"2023-12-07T10:01:50.241807+0000","last_clean":"2023-12-07T10:01:50.241807+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:01:50.241807+0000","last_undegraded":"2023-12-07T10:01:50.241807+0000","last_fullsized":"2023-12-07T10:01:50.241807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:46:26.919128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223113+0000","last_change":"2023-12-07T10:01:50.223113+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223113+0000","last_undegraded":"2023-12-07T10:01:50.223113+0000","last_fullsized":"2023-12-07T10:01:50.223113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237822+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:01:50.237822+0000","last_peered":"2023-12-07T10:01:50.237822+0000","last_clean":"2023-12-07T10:01:50.237822+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:01:50.237822+0000","last_undegraded":"2023-12-07T10:01:50.237822+0000","last_fullsized":"2023-12-07T10:01:50.237822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:00:40.523454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.220998+0000","last_change":"2023-12-07T10:01:50.220998+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.220998+0000","last_undegraded":"2023-12-07T10:01:50.220998+0000","last_fullsized":"2023-12-07T10:01:50.220998+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.245537+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:01:50.245537+0000","last_peered":"2023-12-07T10:01:50.245537+0000","last_clean":"2023-12-07T10:01:50.245537+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:01:50.245537+0000","last_undegraded":"2023-12-07T10:01:50.245537+0000","last_fullsized":"2023-12-07T10:01:50.245537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:01:29.575944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222386+0000","last_change":"2023-12-07T10:01:50.222386+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222386+0000","last_undegraded":"2023-12-07T10:01:50.222386+0000","last_fullsized":"2023-12-07T10:01:50.222386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237451+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:01:50.237451+0000","last_peered":"2023-12-07T10:01:50.237451+0000","last_clean":"2023-12-07T10:01:50.237451+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:01:50.237451+0000","last_undegraded":"2023-12-07T10:01:50.237451+0000","last_fullsized":"2023-12-07T10:01:50.237451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:03.944315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223658+0000","last_change":"2023-12-07T10:01:50.223658+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223658+0000","last_undegraded":"2023-12-07T10:01:50.223658+0000","last_fullsized":"2023-12-07T10:01:50.223658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237550+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:01:50.237550+0000","last_peered":"2023-12-07T10:01:50.237550+0000","last_clean":"2023-12-07T10:01:50.237550+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:01:50.237550+0000","last_undegraded":"2023-12-07T10:01:50.237550+0000","last_fullsized":"2023-12-07T10:01:50.237550+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:36.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.224451+0000","last_change":"2023-12-07T10:01:50.224451+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.224451+0000","last_undegraded":"2023-12-07T10:01:50.224451+0000","last_fullsized":"2023-12-07T10:01:50.224451+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.239988+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:01:50.239988+0000","last_peered":"2023-12-07T10:01:50.239988+0000","last_clean":"2023-12-07T10:01:50.239988+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:01:50.239988+0000","last_undegraded":"2023-12-07T10:01:50.239988+0000","last_fullsized":"2023-12-07T10:01:50.239988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:36.886388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.233519+0000","last_change":"2023-12-07T10:01:50.233519+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.233519+0000","last_undegraded":"2023-12-07T10:01:50.233519+0000","last_fullsized":"2023-12-07T10:01:50.233519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250907+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:01:50.250907+0000","last_peered":"2023-12-07T10:01:50.250907+0000","last_clean":"2023-12-07T10:01:50.250907+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:01:50.250907+0000","last_undegraded":"2023-12-07T10:01:50.250907+0000","last_fullsized":"2023-12-07T10:01:50.250907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223060+0000","last_change":"2023-12-07T10:01:50.223060+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223060+0000","last_undegraded":"2023-12-07T10:01:50.223060+0000","last_fullsized":"2023-12-07T10:01:50.223060+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250547+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:01:50.250547+0000","last_peered":"2023-12-07T10:01:50.250547+0000","last_clean":"2023-12-07T10:01:50.250547+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:01:50.250547+0000","last_undegraded":"2023-12-07T10:01:50.250547+0000","last_fullsized":"2023-12-07T10:01:50.250547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.222534+0000","last_change":"2023-12-07T10:01:50.222534+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.222534+0000","last_undegraded":"2023-12-07T10:01:50.222534+0000","last_fullsized":"2023-12-07T10:01:50.222534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.237914+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:01:50.237914+0000","last_peered":"2023-12-07T10:01:50.237914+0000","last_clean":"2023-12-07T10:01:50.237914+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:01:50.237914+0000","last_undegraded":"2023-12-07T10:01:50.237914+0000","last_fullsized":"2023-12-07T10:01:50.237914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223799+0000","last_change":"2023-12-07T10:01:50.223799+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223799+0000","last_undegraded":"2023-12-07T10:01:50.223799+0000","last_fullsized":"2023-12-07T10:01:50.223799+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.236594+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:01:50.236594+0000","last_peered":"2023-12-07T10:01:50.236594+0000","last_clean":"2023-12-07T10:01:50.236594+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:01:50.236594+0000","last_undegraded":"2023-12-07T10:01:50.236594+0000","last_fullsized":"2023-12-07T10:01:50.236594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:02.688486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.223711+0000","last_change":"2023-12-07T10:01:50.223711+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.223711+0000","last_undegraded":"2023-12-07T10:01:50.223711+0000","last_fullsized":"2023-12-07T10:01:50.223711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.250605+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:01:50.250605+0000","last_peered":"2023-12-07T10:01:50.250605+0000","last_clean":"2023-12-07T10:01:50.250605+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:01:50.250605+0000","last_undegraded":"2023-12-07T10:01:50.250605+0000","last_fullsized":"2023-12-07T10:01:50.250605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:50:38.825735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.233639+0000","last_change":"2023-12-07T10:01:50.233639+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.233639+0000","last_undegraded":"2023-12-07T10:01:50.233639+0000","last_fullsized":"2023-12-07T10:01:50.233639+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.253450+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:01:50.253450+0000","last_peered":"2023-12-07T10:01:50.253450+0000","last_clean":"2023-12-07T10:01:50.253450+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:01:50.253450+0000","last_undegraded":"2023-12-07T10:01:50.253450+0000","last_fullsized":"2023-12-07T10:01:50.253450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-07T10:01:50.221702+0000","last_change":"2023-12-07T10:01:50.221702+0000","last_active":"2023-12-07T10:01:50.204346+0000","last_peered":"2023-12-07T10:01:50.204346+0000","last_clean":"2023-12-07T10:01:50.204346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-07T10:01:50.221702+0000","last_undegraded":"2023-12-07T10:01:50.221702+0000","last_fullsized":"2023-12-07T10:01:50.221702+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-07T10:01:50.243824+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:01:50.243824+0000","last_peered":"2023-12-07T10:01:50.243824+0000","last_clean":"2023-12-07T10:01:50.243824+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:01:50.243824+0000","last_undegraded":"2023-12-07T10:01:50.243824+0000","last_fullsized":"2023-12-07T10:01:50.243824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-07T10:01:49.208188+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:49.208188+0000","last_peered":"2023-12-07T10:01:49.208188+0000","last_clean":"2023-12-07T10:01:49.208188+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:49.208188+0000","last_undegraded":"2023-12-07T10:01:49.208188+0000","last_fullsized":"2023-12-07T10:01:49.208188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1380352,"data_stored":929968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.752}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.434},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.495}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.621}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.44},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.85199999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.872},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.754},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.745},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.434}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.755},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":929968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.254},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":0.753},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:56.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-12-07T10:01:56.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.239870+0000', 'last_change': '2023-12-07T10:01:50.239870+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.239870+0000', 'last_undegraded': '2023-12-07T10:01:50.239870+0000', 'last_fullsized': '2023-12-07T10:01:50.239870+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223250+0000', 'last_change': '2023-12-07T10:01:50.223250+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223250+0000', 'last_undegraded': '2023-12-07T10:01:50.223250+0000', 'last_fullsized': '2023-12-07T10:01:50.223250+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.227090+0000', 'last_change': '2023-12-07T10:01:50.227090+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.227090+0000', 'last_undegraded': '2023-12-07T10:01:50.227090+0000', 'last_fullsized': '2023-12-07T10:01:50.227090+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.227195+0000', 'last_change': '2023-12-07T10:01:50.227195+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.227195+0000', 'last_undegraded': '2023-12-07T10:01:50.227195+0000', 'last_fullsized': '2023-12-07T10:01:50.227195+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225226+0000', 'last_change': '2023-12-07T10:01:50.225226+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225226+0000', 'last_undegraded': '2023-12-07T10:01:50.225226+0000', 'last_fullsized': '2023-12-07T10:01:50.225226+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.226703+0000', 'last_change': '2023-12-07T10:01:50.226703+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.226703+0000', 'last_undegraded': '2023-12-07T10:01:50.226703+0000', 'last_fullsized': '2023-12-07T10:01:50.226703+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.228164+0000', 'last_change': '2023-12-07T10:01:50.228164+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.228164+0000', 'last_undegraded': '2023-12-07T10:01:50.228164+0000', 'last_fullsized': '2023-12-07T10:01:50.228164+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.222903+0000', 'last_change': '2023-12-07T10:01:50.222903+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.222903+0000', 'last_undegraded': '2023-12-07T10:01:50.222903+0000', 'last_fullsized': '2023-12-07T10:01:50.222903+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.224340+0000', 'last_change': '2023-12-07T10:01:50.224340+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.224340+0000', 'last_undegraded': '2023-12-07T10:01:50.224340+0000', 'last_fullsized': '2023-12-07T10:01:50.224340+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.235671+0000', 'last_change': '2023-12-07T10:01:50.235671+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.235671+0000', 'last_undegraded': '2023-12-07T10:01:50.235671+0000', 'last_fullsized': '2023-12-07T10:01:50.235671+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223059+0000', 'last_change': '2023-12-07T10:01:50.223059+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223059+0000', 'last_undegraded': '2023-12-07T10:01:50.223059+0000', 'last_fullsized': '2023-12-07T10:01:50.223059+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.235102+0000', 'last_change': '2023-12-07T10:01:50.235102+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.235102+0000', 'last_undegraded': '2023-12-07T10:01:50.235102+0000', 'last_fullsized': '2023-12-07T10:01:50.235102+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225481+0000', 'last_change': '2023-12-07T10:01:50.225481+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225481+0000', 'last_undegraded': '2023-12-07T10:01:50.225481+0000', 'last_fullsized': '2023-12-07T10:01:50.225481+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.226655+0000', 'last_change': '2023-12-07T10:01:50.226655+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.226655+0000', 'last_undegraded': '2023-12-07T10:01:50.226655+0000', 'last_fullsized': '2023-12-07T10:01:50.226655+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.220735+0000', 'last_change': '2023-12-07T10:01:50.220735+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.220735+0000', 'last_undegraded': '2023-12-07T10:01:50.220735+0000', 'last_fullsized': '2023-12-07T10:01:50.220735+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-12-07T10:01:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.222757+0000', 'last_change': '2023-12-07T10:01:50.222757+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.222757+0000', 'last_undegraded': '2023-12-07T10:01:50.222757+0000', 'last_fullsized': '2023-12-07T10:01:50.222757+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.222862+0000', 'last_change': '2023-12-07T10:01:50.222862+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.222862+0000', 'last_undegraded': '2023-12-07T10:01:50.222862+0000', 'last_fullsized': '2023-12-07T10:01:50.222862+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225500+0000', 'last_change': '2023-12-07T10:01:50.225500+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225500+0000', 'last_undegraded': '2023-12-07T10:01:50.225500+0000', 'last_fullsized': '2023-12-07T10:01:50.225500+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223920+0000', 'last_change': '2023-12-07T10:01:50.223920+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223920+0000', 'last_undegraded': '2023-12-07T10:01:50.223920+0000', 'last_fullsized': '2023-12-07T10:01:50.223920+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225082+0000', 'last_change': '2023-12-07T10:01:50.225082+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225082+0000', 'last_undegraded': '2023-12-07T10:01:50.225082+0000', 'last_fullsized': '2023-12-07T10:01:50.225082+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223930+0000', 'last_change': '2023-12-07T10:01:50.223930+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223930+0000', 'last_undegraded': '2023-12-07T10:01:50.223930+0000', 'last_fullsized': '2023-12-07T10:01:50.223930+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-12-07T10:01:56.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223420+0000', 'last_change': '2023-12-07T10:01:50.223420+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223420+0000', 'last_undegraded': '2023-12-07T10:01:50.223420+0000', 'last_fullsized': '2023-12-07T10:01:50.223420+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.234142+0000', 'last_change': '2023-12-07T10:01:50.234142+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.234142+0000', 'last_undegraded': '2023-12-07T10:01:50.234142+0000', 'last_fullsized': '2023-12-07T10:01:50.234142+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221489+0000', 'last_change': '2023-12-07T10:01:50.221489+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221489+0000', 'last_undegraded': '2023-12-07T10:01:50.221489+0000', 'last_fullsized': '2023-12-07T10:01:50.221489+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.222295+0000', 'last_change': '2023-12-07T10:01:50.222295+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.222295+0000', 'last_undegraded': '2023-12-07T10:01:50.222295+0000', 'last_fullsized': '2023-12-07T10:01:50.222295+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-12-07T10:01:56.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.226095+0000', 'last_change': '2023-12-07T10:01:50.226095+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.226095+0000', 'last_undegraded': '2023-12-07T10:01:50.226095+0000', 'last_fullsized': '2023-12-07T10:01:50.226095+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.227999+0000', 'last_change': '2023-12-07T10:01:50.227999+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.227999+0000', 'last_undegraded': '2023-12-07T10:01:50.227999+0000', 'last_fullsized': '2023-12-07T10:01:50.227999+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.234631+0000', 'last_change': '2023-12-07T10:01:50.234631+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.234631+0000', 'last_undegraded': '2023-12-07T10:01:50.234631+0000', 'last_fullsized': '2023-12-07T10:01:50.234631+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221986+0000', 'last_change': '2023-12-07T10:01:50.221986+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221986+0000', 'last_undegraded': '2023-12-07T10:01:50.221986+0000', 'last_fullsized': '2023-12-07T10:01:50.221986+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221962+0000', 'last_change': '2023-12-07T10:01:50.221962+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221962+0000', 'last_undegraded': '2023-12-07T10:01:50.221962+0000', 'last_fullsized': '2023-12-07T10:01:50.221962+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-12-07T10:01:56.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223911+0000', 'last_change': '2023-12-07T10:01:50.223911+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223911+0000', 'last_undegraded': '2023-12-07T10:01:50.223911+0000', 'last_fullsized': '2023-12-07T10:01:50.223911+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-12-07T10:01:56.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.238026+0000', 'last_change': '2023-12-07T10:01:50.238026+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.238026+0000', 'last_undegraded': '2023-12-07T10:01:50.238026+0000', 'last_fullsized': '2023-12-07T10:01:50.238026+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-12-07T10:01:56.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.229222+0000', 'last_change': '2023-12-07T10:01:50.229222+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.229222+0000', 'last_undegraded': '2023-12-07T10:01:50.229222+0000', 'last_fullsized': '2023-12-07T10:01:50.229222+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.239339+0000', 'last_change': '2023-12-07T10:01:50.239339+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.239339+0000', 'last_undegraded': '2023-12-07T10:01:50.239339+0000', 'last_fullsized': '2023-12-07T10:01:50.239339+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.234070+0000', 'last_change': '2023-12-07T10:01:50.234070+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.234070+0000', 'last_undegraded': '2023-12-07T10:01:50.234070+0000', 'last_fullsized': '2023-12-07T10:01:50.234070+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.226560+0000', 'last_change': '2023-12-07T10:01:50.226560+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.226560+0000', 'last_undegraded': '2023-12-07T10:01:50.226560+0000', 'last_fullsized': '2023-12-07T10:01:50.226560+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221448+0000', 'last_change': '2023-12-07T10:01:50.221448+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221448+0000', 'last_undegraded': '2023-12-07T10:01:50.221448+0000', 'last_fullsized': '2023-12-07T10:01:50.221448+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223000+0000', 'last_change': '2023-12-07T10:01:50.223000+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223000+0000', 'last_undegraded': '2023-12-07T10:01:50.223000+0000', 'last_fullsized': '2023-12-07T10:01:50.223000+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-12-07T10:01:56.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225172+0000', 'last_change': '2023-12-07T10:01:50.225172+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225172+0000', 'last_undegraded': '2023-12-07T10:01:50.225172+0000', 'last_fullsized': '2023-12-07T10:01:50.225172+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.220280+0000', 'last_change': '2023-12-07T10:01:50.220280+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.220280+0000', 'last_undegraded': '2023-12-07T10:01:50.220280+0000', 'last_fullsized': '2023-12-07T10:01:50.220280+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221254+0000', 'last_change': '2023-12-07T10:01:50.221254+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221254+0000', 'last_undegraded': '2023-12-07T10:01:50.221254+0000', 'last_fullsized': '2023-12-07T10:01:50.221254+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223789+0000', 'last_change': '2023-12-07T10:01:50.223789+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223789+0000', 'last_undegraded': '2023-12-07T10:01:50.223789+0000', 'last_fullsized': '2023-12-07T10:01:50.223789+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225065+0000', 'last_change': '2023-12-07T10:01:50.225065+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225065+0000', 'last_undegraded': '2023-12-07T10:01:50.225065+0000', 'last_fullsized': '2023-12-07T10:01:50.225065+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.227505+0000', 'last_change': '2023-12-07T10:01:50.227505+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.227505+0000', 'last_undegraded': '2023-12-07T10:01:50.227505+0000', 'last_fullsized': '2023-12-07T10:01:50.227505+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.224885+0000', 'last_change': '2023-12-07T10:01:50.224885+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.224885+0000', 'last_undegraded': '2023-12-07T10:01:50.224885+0000', 'last_fullsized': '2023-12-07T10:01:50.224885+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.224883+0000', 'last_change': '2023-12-07T10:01:50.224883+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.224883+0000', 'last_undegraded': '2023-12-07T10:01:50.224883+0000', 'last_fullsized': '2023-12-07T10:01:50.224883+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221642+0000', 'last_change': '2023-12-07T10:01:50.221642+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221642+0000', 'last_undegraded': '2023-12-07T10:01:50.221642+0000', 'last_fullsized': '2023-12-07T10:01:50.221642+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221454+0000', 'last_change': '2023-12-07T10:01:50.221454+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221454+0000', 'last_undegraded': '2023-12-07T10:01:50.221454+0000', 'last_fullsized': '2023-12-07T10:01:50.221454+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.225530+0000', 'last_change': '2023-12-07T10:01:50.225530+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.225530+0000', 'last_undegraded': '2023-12-07T10:01:50.225530+0000', 'last_fullsized': '2023-12-07T10:01:50.225530+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-12-07T10:01:56.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.236841+0000', 'last_change': '2023-12-07T10:01:50.236841+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.236841+0000', 'last_undegraded': '2023-12-07T10:01:50.236841+0000', 'last_fullsized': '2023-12-07T10:01:50.236841+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.226948+0000', 'last_change': '2023-12-07T10:01:50.226948+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.226948+0000', 'last_undegraded': '2023-12-07T10:01:50.226948+0000', 'last_fullsized': '2023-12-07T10:01:50.226948+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221902+0000', 'last_change': '2023-12-07T10:01:50.221902+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221902+0000', 'last_undegraded': '2023-12-07T10:01:50.221902+0000', 'last_fullsized': '2023-12-07T10:01:50.221902+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223113+0000', 'last_change': '2023-12-07T10:01:50.223113+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223113+0000', 'last_undegraded': '2023-12-07T10:01:50.223113+0000', 'last_fullsized': '2023-12-07T10:01:50.223113+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.220998+0000', 'last_change': '2023-12-07T10:01:50.220998+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.220998+0000', 'last_undegraded': '2023-12-07T10:01:50.220998+0000', 'last_fullsized': '2023-12-07T10:01:50.220998+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.222386+0000', 'last_change': '2023-12-07T10:01:50.222386+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.222386+0000', 'last_undegraded': '2023-12-07T10:01:50.222386+0000', 'last_fullsized': '2023-12-07T10:01:50.222386+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-12-07T10:01:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223658+0000', 'last_change': '2023-12-07T10:01:50.223658+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223658+0000', 'last_undegraded': '2023-12-07T10:01:50.223658+0000', 'last_fullsized': '2023-12-07T10:01:50.223658+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.224451+0000', 'last_change': '2023-12-07T10:01:50.224451+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.224451+0000', 'last_undegraded': '2023-12-07T10:01:50.224451+0000', 'last_fullsized': '2023-12-07T10:01:50.224451+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.233519+0000', 'last_change': '2023-12-07T10:01:50.233519+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.233519+0000', 'last_undegraded': '2023-12-07T10:01:50.233519+0000', 'last_fullsized': '2023-12-07T10:01:50.233519+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223060+0000', 'last_change': '2023-12-07T10:01:50.223060+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223060+0000', 'last_undegraded': '2023-12-07T10:01:50.223060+0000', 'last_fullsized': '2023-12-07T10:01:50.223060+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.222534+0000', 'last_change': '2023-12-07T10:01:50.222534+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.222534+0000', 'last_undegraded': '2023-12-07T10:01:50.222534+0000', 'last_fullsized': '2023-12-07T10:01:50.222534+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-12-07T10:01:56.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223799+0000', 'last_change': '2023-12-07T10:01:50.223799+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223799+0000', 'last_undegraded': '2023-12-07T10:01:50.223799+0000', 'last_fullsized': '2023-12-07T10:01:50.223799+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-07T10:01:56.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-12-07T10:01:56.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.223711+0000', 'last_change': '2023-12-07T10:01:50.223711+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.223711+0000', 'last_undegraded': '2023-12-07T10:01:50.223711+0000', 'last_fullsized': '2023-12-07T10:01:50.223711+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-07T10:01:56.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-12-07T10:01:56.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.233639+0000', 'last_change': '2023-12-07T10:01:50.233639+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.233639+0000', 'last_undegraded': '2023-12-07T10:01:50.233639+0000', 'last_fullsized': '2023-12-07T10:01:50.233639+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-07T10:01:56.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-12-07T10:01:56.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-12-07T10:01:50.221702+0000', 'last_change': '2023-12-07T10:01:50.221702+0000', 'last_active': '2023-12-07T10:01:50.204346+0000', 'last_peered': '2023-12-07T10:01:50.204346+0000', 'last_clean': '2023-12-07T10:01:50.204346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-07T10:01:50.221702+0000', 'last_undegraded': '2023-12-07T10:01:50.221702+0000', 'last_fullsized': '2023-12-07T10:01:50.221702+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'last_clean_scrub_stamp': '2023-12-07T10:01:50.204346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-07T10:01:56.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-07T10:01:56.202 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-12-07T10:01:56.196+0000 7fb2f2a15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:01:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f87650fe640 1 Processor -- start 2023-12-07T10:01:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f87650fe640 1 -- start start 2023-12-07T10:01:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f87650fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600bd720 0x7f8760158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f87650fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8760155790 con 0x7f87600ca610 2023-12-07T10:01:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f87650fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600c4b00 con 0x7f876006cd90 2023-12-07T10:01:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f87650fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600c4de0 con 0x7f87600bd720 2023-12-07T10:01:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875ed9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f87600ca610 0x7f87600c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55698/0 (socket says 172.21.15.89:55698) 2023-12-07T10:01:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875ed9d640 1 -- 172.21.15.89:0/1353174243 learned_addr learned my addr 172.21.15.89:0/1353174243 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875e59c640 1 --2- 172.21.15.89:0/1353174243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600bd720 0x7f8760158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335026765 0 0) 0x7f8760155790 con 0x7f87600ca610 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8748003530 con 0x7f87600ca610 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183161206 0 0) 0x7f87600c4b00 con 0x7f876006cd90 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8760155790 con 0x7f876006cd90 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994163825 0 0) 0x7f8748003530 con 0x7f87600ca610 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875e59c640 1 -- 172.21.15.89:0/1353174243 >> v1:172.21.15.97:6789/0 conn(0x7f876006cd90 legacy=0x7f87600c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875e59c640 1 -- 172.21.15.89:0/1353174243 >> v1:172.21.15.89:6789/0 conn(0x7f87600ca610 legacy=0x7f87600c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.220+0000 7f875e59c640 1 -- 172.21.15.89:0/1353174243 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760157e30 con 0x7f87600bd720 2023-12-07T10:01:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f875e59c640 1 --2- 172.21.15.89:0/1353174243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600bd720 0x7f8760158350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87540097f0 tx=0x7f875401bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=385afa4ed863850 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600c52d0 con 0x7f87600bd720 2023-12-07T10:01:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540a4520 con 0x7f87600bd720 2023-12-07T10:01:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f875dd9b640 1 -- 172.21.15.89:0/1353174243 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750001680 con 0x7f87600bd720 2023-12-07T10:01:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 -- 172.21.15.89:0/1353174243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600bd720 msgr2=0x7f8760158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 --2- 172.21.15.89:0/1353174243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600bd720 0x7f8760158350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87540097f0 tx=0x7f875401bfa0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 -- 172.21.15.89:0/1353174243 shutdown_connections 2023-12-07T10:01:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 --2- 172.21.15.89:0/1353174243 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600bd720 0x7f8760158350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 -- 172.21.15.89:0/1353174243 >> 172.21.15.89:0/1353174243 conn(0x7f8760071ea0 msgr2=0x7f87600722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 -- 172.21.15.89:0/1353174243 shutdown_connections 2023-12-07T10:01:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.224+0000 7f87650fe640 1 -- 172.21.15.89:0/1353174243 wait complete. 2023-12-07T10:01:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 Processor -- start 2023-12-07T10:01:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- start start 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 0x7f87601ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87600bd720 0x7f8760149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600ca610 0x7f8760157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760150f40 con 0x7f876006cd90 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760151220 con 0x7f87600bd720 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8760151500 con 0x7f87600ca610 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 0x7f87601ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 0x7f87601ee000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40962/0 (socket says 172.21.15.89:40962) 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 -- 172.21.15.89:0/2769310463 learned_addr learned my addr 172.21.15.89:0/2769310463 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875e59c640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87600bd720 0x7f8760149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875f59e640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600ca610 0x7f8760157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 -- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600ca610 msgr2=0x7f8760157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600ca610 0x7f8760157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 -- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87600bd720 msgr2=0x7f8760149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87600bd720 0x7f8760149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 -- 172.21.15.89:0/2769310463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754009420 con 0x7f876006cd90 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f875ed9d640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 0x7f87601ee000 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f875000c780 tx=0x7f875000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750005ae0 con 0x7f876006cd90 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750005c60 con 0x7f876006cd90 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87601517e0 con 0x7f876006cd90 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750007070 con 0x7f876006cd90 2023-12-07T10:01:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87601577b0 con 0x7f876006cd90 2023-12-07T10:01:56.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.228+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8760151d00 con 0x7f876006cd90 2023-12-07T10:01:56.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.232+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f87500071d0 con 0x7f876006cd90 2023-12-07T10:01:56.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.232+0000 7f87477fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f874c0668d0 0x7f874c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.232+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8750083ad0 con 0x7f876006cd90 2023-12-07T10:01:56.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.232+0000 7f875e59c640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f874c0668d0 0x7f874c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.232+0000 7f875e59c640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f874c0668d0 0x7f874c068d90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87540ae000 tx=0x7f8754008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:56.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.236+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8760151d00 con 0x7f876006cd90 2023-12-07T10:01:56.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.440+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8760151d00 con 0x7f876006cd90 2023-12-07T10:01:56.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.440+0000 7f87477fe640 1 -- 172.21.15.89:0/2769310463 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1452 (secure 0 0 0) 0x7f8760151d00 con 0x7f876006cd90 2023-12-07T10:01:56.446 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:56.446 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":189,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1701943139,"num_in_osds":8,"osd_in_since":1701943129,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":254390272,"bytes_avail":772839723008,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6561}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-07T10:01:38.371513+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f874c0668d0 msgr2=0x7f874c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f874c0668d0 0x7f874c068d90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87540ae000 tx=0x7f8754008040 comp rx=0 tx=0).stop 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 msgr2=0x7f87601ee000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 0x7f87601ee000 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f875000c780 tx=0x7f875000cc40 comp rx=0 tx=0).stop 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 shutdown_connections 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f874c0668d0 0x7f874c068d90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f87600ca610 0x7f8760157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87600bd720 0x7f8760149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 --2- 172.21.15.89:0/2769310463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f876006cd90 0x7f87601ee000 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 >> 172.21.15.89:0/2769310463 conn(0x7f8760071ea0 msgr2=0x7f87600c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:56.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 shutdown_connections 2023-12-07T10:01:56.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.444+0000 7f87650fe640 1 -- 172.21.15.89:0/2769310463 wait complete. 2023-12-07T10:01:56.467 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-07T10:01:56.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:56.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c32d6640 1 Processor -- start 2023-12-07T10:01:56.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c32d6640 1 -- start start 2023-12-07T10:01:56.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c32d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0bd720 0x7ff1bc158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c32d6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc155790 con 0x7ff1bc0ca610 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c32d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0c4b00 con 0x7ff1bc06cd90 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c32d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0c4de0 con 0x7ff1bc0bd720 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c1072640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff1bc0ca610 0x7ff1bc0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55700/0 (socket says 172.21.15.89:55700) 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c1072640 1 -- 172.21.15.89:0/1896948989 learned_addr learned my addr 172.21.15.89:0/1896948989 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c0871640 1 --2- 172.21.15.89:0/1896948989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0bd720 0x7ff1bc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645350954 0 0) 0x7ff1bc155790 con 0x7ff1bc0ca610 2023-12-07T10:01:56.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a8003530 con 0x7ff1bc0ca610 2023-12-07T10:01:56.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545327300 0 0) 0x7ff1bc0c4b00 con 0x7ff1bc06cd90 2023-12-07T10:01:56.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1bc155790 con 0x7ff1bc06cd90 2023-12-07T10:01:56.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379645601 0 0) 0x7ff1a8003530 con 0x7ff1bc0ca610 2023-12-07T10:01:56.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c0871640 1 -- 172.21.15.89:0/1896948989 >> v1:172.21.15.97:6789/0 conn(0x7ff1bc06cd90 legacy=0x7ff1bc0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c0871640 1 -- 172.21.15.89:0/1896948989 >> v1:172.21.15.89:6789/0 conn(0x7ff1bc0ca610 legacy=0x7ff1bc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.600+0000 7ff1c0871640 1 -- 172.21.15.89:0/1896948989 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc157e30 con 0x7ff1bc0bd720 2023-12-07T10:01:56.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c0871640 1 --2- 172.21.15.89:0/1896948989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0bd720 0x7ff1bc158350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097f0 tx=0x7ff1ac01bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a661f37eb7ecd5ec server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:56.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0c52d0 con 0x7ff1bc0bd720 2023-12-07T10:01:56.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0a4520 con 0x7ff1bc0bd720 2023-12-07T10:01:56.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1b3fff640 1 -- 172.21.15.89:0/1896948989 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8001600 con 0x7ff1bc0bd720 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 -- 172.21.15.89:0/1896948989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0bd720 msgr2=0x7ff1bc158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/1896948989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0bd720 0x7ff1bc158350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097f0 tx=0x7ff1ac01bfa0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 -- 172.21.15.89:0/1896948989 shutdown_connections 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/1896948989 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0bd720 0x7ff1bc158350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 -- 172.21.15.89:0/1896948989 >> 172.21.15.89:0/1896948989 conn(0x7ff1bc071ea0 msgr2=0x7ff1bc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 -- 172.21.15.89:0/1896948989 shutdown_connections 2023-12-07T10:01:56.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.604+0000 7ff1c32d6640 1 -- 172.21.15.89:0/1896948989 wait complete. 2023-12-07T10:01:56.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 Processor -- start 2023-12-07T10:01:56.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 -- start start 2023-12-07T10:01:56.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1bc06cd90 0x7ff1bc1ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 0x7ff1bc149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0ca610 0x7ff1bc157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc150f40 con 0x7ff1bc0bd720 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc151220 con 0x7ff1bc06cd90 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc151500 con 0x7ff1bc0ca610 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 0x7ff1bc149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 0x7ff1bc149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40978/0 (socket says 172.21.15.89:40978) 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 -- 172.21.15.89:0/837151013 learned_addr learned my addr 172.21.15.89:0/837151013 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c1072640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1bc06cd90 0x7ff1bc1ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c1873640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0ca610 0x7ff1bc157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 -- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0ca610 msgr2=0x7ff1bc157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0ca610 0x7ff1bc157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 -- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1bc06cd90 msgr2=0x7ff1bc1ee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1bc06cd90 0x7ff1bc1ee000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 -- 172.21.15.89:0/837151013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac009420 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c0871640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 0x7ff1bc149740 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097f0 tx=0x7ff1ac019060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0ac440 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0ac5a0 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0ac930 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc1517e0 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.608+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc1577b0 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.612+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc04e890 con 0x7ff1bc0bd720 2023-12-07T10:01:56.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.612+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff1ac0b3040 con 0x7ff1bc0bd720 2023-12-07T10:01:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.612+0000 7ff1b1ffb640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff1a00668d0 0x7ff1a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.612+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1ac11d8b0 con 0x7ff1bc0bd720 2023-12-07T10:01:56.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.612+0000 7ff1c1072640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff1a00668d0 0x7ff1a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:56.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.612+0000 7ff1c1072640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff1a00668d0 0x7ff1a0068d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8001ec0 tx=0x7ff1b8001920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:56.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.616+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1ac0eac20 con 0x7ff1bc0bd720 2023-12-07T10:01:56.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.764+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1bc0cac40 con 0x7ff1a00668d0 2023-12-07T10:01:56.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.768+0000 7ff1b1ffb640 1 -- 172.21.15.89:0/837151013 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289034 (secure 0 0 0) 0x7ff1b800f860 con 0x7ff1a00668d0 2023-12-07T10:01:56.778 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:01:56.779 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff1a00668d0 msgr2=0x7ff1a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff1a00668d0 0x7ff1a0068d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8001ec0 tx=0x7ff1b8001920 comp rx=0 tx=0).stop 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 msgr2=0x7ff1bc149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 0x7ff1bc149740 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097f0 tx=0x7ff1ac019060 comp rx=0 tx=0).stop 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 shutdown_connections 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff1a00668d0 0x7ff1a0068d90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff1bc0ca610 0x7ff1bc157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0bd720 0x7ff1bc149740 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 --2- 172.21.15.89:0/837151013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1bc06cd90 0x7ff1bc1ee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 >> 172.21.15.89:0/837151013 conn(0x7ff1bc071ea0 msgr2=0x7ff1bc0c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 shutdown_connections 2023-12-07T10:01:56.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:56.772+0000 7ff1c32d6640 1 -- 172.21.15.89:0/837151013 wait complete. 2023-12-07T10:01:56.797 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-07T10:01:56.374334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252952,"kb_used_data":7656,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721768,"statfs":{"total":773094113280,"available":772835090432,"internally_reserved":0,"allocated":7839744,"data_stored":4057156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":74,"apply_latency_ms":74,"commit_latency_ns":74000000,"apply_latency_ns":74000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.154978"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382675+0000","last_change":"2023-12-07T10:01:51.334457+0000","last_active":"2023-12-07T10:01:52.382675+0000","last_peered":"2023-12-07T10:01:52.382675+0000","last_clean":"2023-12-07T10:01:52.382675+0000","last_became_active":"2023-12-07T10:01:51.333891+0000","last_became_peered":"2023-12-07T10:01:51.333891+0000","last_unstale":"2023-12-07T10:01:52.382675+0000","last_undegraded":"2023-12-07T10:01:52.382675+0000","last_fullsized":"2023-12-07T10:01:52.382675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:50.606836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382696+0000","last_change":"2023-12-07T10:01:51.330897+0000","last_active":"2023-12-07T10:01:52.382696+0000","last_peered":"2023-12-07T10:01:52.382696+0000","last_clean":"2023-12-07T10:01:52.382696+0000","last_became_active":"2023-12-07T10:01:51.330640+0000","last_became_peered":"2023-12-07T10:01:51.330640+0000","last_unstale":"2023-12-07T10:01:52.382696+0000","last_undegraded":"2023-12-07T10:01:52.382696+0000","last_fullsized":"2023-12-07T10:01:52.382696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:57.467622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237925+0000","last_change":"2023-12-07T10:01:51.328745+0000","last_active":"2023-12-07T10:01:52.237925+0000","last_peered":"2023-12-07T10:01:52.237925+0000","last_clean":"2023-12-07T10:01:52.237925+0000","last_became_active":"2023-12-07T10:01:51.328404+0000","last_became_peered":"2023-12-07T10:01:51.328404+0000","last_unstale":"2023-12-07T10:01:52.237925+0000","last_undegraded":"2023-12-07T10:01:52.237925+0000","last_fullsized":"2023-12-07T10:01:52.237925+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:35:05.845534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382616+0000","last_change":"2023-12-07T10:01:51.237718+0000","last_active":"2023-12-07T10:01:52.382616+0000","last_peered":"2023-12-07T10:01:52.382616+0000","last_clean":"2023-12-07T10:01:52.382616+0000","last_became_active":"2023-12-07T10:01:51.237319+0000","last_became_peered":"2023-12-07T10:01:51.237319+0000","last_unstale":"2023-12-07T10:01:52.382616+0000","last_undegraded":"2023-12-07T10:01:52.382616+0000","last_fullsized":"2023-12-07T10:01:52.382616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:33:39.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236366+0000","last_change":"2023-12-07T10:01:51.319209+0000","last_active":"2023-12-07T10:01:52.236366+0000","last_peered":"2023-12-07T10:01:52.236366+0000","last_clean":"2023-12-07T10:01:52.236366+0000","last_became_active":"2023-12-07T10:01:51.318902+0000","last_became_peered":"2023-12-07T10:01:51.318902+0000","last_unstale":"2023-12-07T10:01:52.236366+0000","last_undegraded":"2023-12-07T10:01:52.236366+0000","last_fullsized":"2023-12-07T10:01:52.236366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382105+0000","last_change":"2023-12-07T10:01:51.328543+0000","last_active":"2023-12-07T10:01:52.382105+0000","last_peered":"2023-12-07T10:01:52.382105+0000","last_clean":"2023-12-07T10:01:52.382105+0000","last_became_active":"2023-12-07T10:01:51.327329+0000","last_became_peered":"2023-12-07T10:01:51.327329+0000","last_unstale":"2023-12-07T10:01:52.382105+0000","last_undegraded":"2023-12-07T10:01:52.382105+0000","last_fullsized":"2023-12-07T10:01:52.382105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381556+0000","last_change":"2023-12-07T10:01:51.320165+0000","last_active":"2023-12-07T10:01:52.381556+0000","last_peered":"2023-12-07T10:01:52.381556+0000","last_clean":"2023-12-07T10:01:52.381556+0000","last_became_active":"2023-12-07T10:01:51.319902+0000","last_became_peered":"2023-12-07T10:01:51.319902+0000","last_unstale":"2023-12-07T10:01:52.381556+0000","last_undegraded":"2023-12-07T10:01:52.381556+0000","last_fullsized":"2023-12-07T10:01:52.381556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:42.457874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381776+0000","last_change":"2023-12-07T10:01:51.329061+0000","last_active":"2023-12-07T10:01:52.381776+0000","last_peered":"2023-12-07T10:01:52.381776+0000","last_clean":"2023-12-07T10:01:52.381776+0000","last_became_active":"2023-12-07T10:01:51.326242+0000","last_became_peered":"2023-12-07T10:01:51.326242+0000","last_unstale":"2023-12-07T10:01:52.381776+0000","last_undegraded":"2023-12-07T10:01:52.381776+0000","last_fullsized":"2023-12-07T10:01:52.381776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:55.552580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382631+0000","last_change":"2023-12-07T10:01:51.325239+0000","last_active":"2023-12-07T10:01:52.382631+0000","last_peered":"2023-12-07T10:01:52.382631+0000","last_clean":"2023-12-07T10:01:52.382631+0000","last_became_active":"2023-12-07T10:01:51.324925+0000","last_became_peered":"2023-12-07T10:01:51.324925+0000","last_unstale":"2023-12-07T10:01:52.382631+0000","last_undegraded":"2023-12-07T10:01:52.382631+0000","last_fullsized":"2023-12-07T10:01:52.382631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382577+0000","last_change":"2023-12-07T10:01:51.330222+0000","last_active":"2023-12-07T10:01:52.382577+0000","last_peered":"2023-12-07T10:01:52.382577+0000","last_clean":"2023-12-07T10:01:52.382577+0000","last_became_active":"2023-12-07T10:01:51.329871+0000","last_became_peered":"2023-12-07T10:01:51.329871+0000","last_unstale":"2023-12-07T10:01:52.382577+0000","last_undegraded":"2023-12-07T10:01:52.382577+0000","last_fullsized":"2023-12-07T10:01:52.382577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382390+0000","last_change":"2023-12-07T10:01:51.321607+0000","last_active":"2023-12-07T10:01:52.382390+0000","last_peered":"2023-12-07T10:01:52.382390+0000","last_clean":"2023-12-07T10:01:52.382390+0000","last_became_active":"2023-12-07T10:01:51.321331+0000","last_became_peered":"2023-12-07T10:01:51.321331+0000","last_unstale":"2023-12-07T10:01:52.382390+0000","last_undegraded":"2023-12-07T10:01:52.382390+0000","last_fullsized":"2023-12-07T10:01:52.382390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:50.912945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382259+0000","last_change":"2023-12-07T10:01:51.332752+0000","last_active":"2023-12-07T10:01:52.382259+0000","last_peered":"2023-12-07T10:01:52.382259+0000","last_clean":"2023-12-07T10:01:52.382259+0000","last_became_active":"2023-12-07T10:01:51.332452+0000","last_became_peered":"2023-12-07T10:01:51.332452+0000","last_unstale":"2023-12-07T10:01:52.382259+0000","last_undegraded":"2023-12-07T10:01:52.382259+0000","last_fullsized":"2023-12-07T10:01:52.382259+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237518+0000","last_change":"2023-12-07T10:01:51.331204+0000","last_active":"2023-12-07T10:01:52.237518+0000","last_peered":"2023-12-07T10:01:52.237518+0000","last_clean":"2023-12-07T10:01:52.237518+0000","last_became_active":"2023-12-07T10:01:51.330895+0000","last_became_peered":"2023-12-07T10:01:51.330895+0000","last_unstale":"2023-12-07T10:01:52.237518+0000","last_undegraded":"2023-12-07T10:01:52.237518+0000","last_fullsized":"2023-12-07T10:01:52.237518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382376+0000","last_change":"2023-12-07T10:01:51.244162+0000","last_active":"2023-12-07T10:01:52.382376+0000","last_peered":"2023-12-07T10:01:52.382376+0000","last_clean":"2023-12-07T10:01:52.382376+0000","last_became_active":"2023-12-07T10:01:51.243875+0000","last_became_peered":"2023-12-07T10:01:51.243875+0000","last_unstale":"2023-12-07T10:01:52.382376+0000","last_undegraded":"2023-12-07T10:01:52.382376+0000","last_fullsized":"2023-12-07T10:01:52.382376+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:04:07.590726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.235056+0000","last_change":"2023-12-07T10:01:51.319891+0000","last_active":"2023-12-07T10:01:52.235056+0000","last_peered":"2023-12-07T10:01:52.235056+0000","last_clean":"2023-12-07T10:01:52.235056+0000","last_became_active":"2023-12-07T10:01:51.319557+0000","last_became_peered":"2023-12-07T10:01:51.319557+0000","last_unstale":"2023-12-07T10:01:52.235056+0000","last_undegraded":"2023-12-07T10:01:52.235056+0000","last_fullsized":"2023-12-07T10:01:52.235056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:20:21.004108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236212+0000","last_change":"2023-12-07T10:01:51.331122+0000","last_active":"2023-12-07T10:01:52.236212+0000","last_peered":"2023-12-07T10:01:52.236212+0000","last_clean":"2023-12-07T10:01:52.236212+0000","last_became_active":"2023-12-07T10:01:51.330385+0000","last_became_peered":"2023-12-07T10:01:51.330385+0000","last_unstale":"2023-12-07T10:01:52.236212+0000","last_undegraded":"2023-12-07T10:01:52.236212+0000","last_fullsized":"2023-12-07T10:01:52.236212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237684+0000","last_change":"2023-12-07T10:01:51.326514+0000","last_active":"2023-12-07T10:01:52.237684+0000","last_peered":"2023-12-07T10:01:52.237684+0000","last_clean":"2023-12-07T10:01:52.237684+0000","last_became_active":"2023-12-07T10:01:51.326126+0000","last_became_peered":"2023-12-07T10:01:51.326126+0000","last_unstale":"2023-12-07T10:01:52.237684+0000","last_undegraded":"2023-12-07T10:01:52.237684+0000","last_fullsized":"2023-12-07T10:01:52.237684+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382868+0000","last_change":"2023-12-07T10:01:51.322531+0000","last_active":"2023-12-07T10:01:52.382868+0000","last_peered":"2023-12-07T10:01:52.382868+0000","last_clean":"2023-12-07T10:01:52.382868+0000","last_became_active":"2023-12-07T10:01:51.322236+0000","last_became_peered":"2023-12-07T10:01:51.322236+0000","last_unstale":"2023-12-07T10:01:52.382868+0000","last_undegraded":"2023-12-07T10:01:52.382868+0000","last_fullsized":"2023-12-07T10:01:52.382868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:58:49.154793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382404+0000","last_change":"2023-12-07T10:01:51.246838+0000","last_active":"2023-12-07T10:01:52.382404+0000","last_peered":"2023-12-07T10:01:52.382404+0000","last_clean":"2023-12-07T10:01:52.382404+0000","last_became_active":"2023-12-07T10:01:51.246542+0000","last_became_peered":"2023-12-07T10:01:51.246542+0000","last_unstale":"2023-12-07T10:01:52.382404+0000","last_undegraded":"2023-12-07T10:01:52.382404+0000","last_fullsized":"2023-12-07T10:01:52.382404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382734+0000","last_change":"2023-12-07T10:01:51.238206+0000","last_active":"2023-12-07T10:01:52.382734+0000","last_peered":"2023-12-07T10:01:52.382734+0000","last_clean":"2023-12-07T10:01:52.382734+0000","last_became_active":"2023-12-07T10:01:51.237896+0000","last_became_peered":"2023-12-07T10:01:51.237896+0000","last_unstale":"2023-12-07T10:01:52.382734+0000","last_undegraded":"2023-12-07T10:01:52.382734+0000","last_fullsized":"2023-12-07T10:01:52.382734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:05.717307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382363+0000","last_change":"2023-12-07T10:01:51.239605+0000","last_active":"2023-12-07T10:01:52.382363+0000","last_peered":"2023-12-07T10:01:52.382363+0000","last_clean":"2023-12-07T10:01:52.382363+0000","last_became_active":"2023-12-07T10:01:51.238681+0000","last_became_peered":"2023-12-07T10:01:51.238681+0000","last_unstale":"2023-12-07T10:01:52.382363+0000","last_undegraded":"2023-12-07T10:01:52.382363+0000","last_fullsized":"2023-12-07T10:01:52.382363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:49.151421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381634+0000","last_change":"2023-12-07T10:01:51.239133+0000","last_active":"2023-12-07T10:01:52.381634+0000","last_peered":"2023-12-07T10:01:52.381634+0000","last_clean":"2023-12-07T10:01:52.381634+0000","last_became_active":"2023-12-07T10:01:51.238847+0000","last_became_peered":"2023-12-07T10:01:51.238847+0000","last_unstale":"2023-12-07T10:01:52.381634+0000","last_undegraded":"2023-12-07T10:01:52.381634+0000","last_fullsized":"2023-12-07T10:01:52.381634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:01.049212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382021+0000","last_change":"2023-12-07T10:01:51.326936+0000","last_active":"2023-12-07T10:01:52.382021+0000","last_peered":"2023-12-07T10:01:52.382021+0000","last_clean":"2023-12-07T10:01:52.382021+0000","last_became_active":"2023-12-07T10:01:51.326411+0000","last_became_peered":"2023-12-07T10:01:51.326411+0000","last_unstale":"2023-12-07T10:01:52.382021+0000","last_undegraded":"2023-12-07T10:01:52.382021+0000","last_fullsized":"2023-12-07T10:01:52.382021+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381582+0000","last_change":"2023-12-07T10:01:51.238711+0000","last_active":"2023-12-07T10:01:52.381582+0000","last_peered":"2023-12-07T10:01:52.381582+0000","last_clean":"2023-12-07T10:01:52.381582+0000","last_became_active":"2023-12-07T10:01:51.238406+0000","last_became_peered":"2023-12-07T10:01:51.238406+0000","last_unstale":"2023-12-07T10:01:52.381582+0000","last_undegraded":"2023-12-07T10:01:52.381582+0000","last_fullsized":"2023-12-07T10:01:52.381582+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:37.893685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382658+0000","last_change":"2023-12-07T10:01:51.331406+0000","last_active":"2023-12-07T10:01:52.382658+0000","last_peered":"2023-12-07T10:01:52.382658+0000","last_clean":"2023-12-07T10:01:52.382658+0000","last_became_active":"2023-12-07T10:01:51.330583+0000","last_became_peered":"2023-12-07T10:01:51.330583+0000","last_unstale":"2023-12-07T10:01:52.382658+0000","last_undegraded":"2023-12-07T10:01:52.382658+0000","last_fullsized":"2023-12-07T10:01:52.382658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:45.174048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237991+0000","last_change":"2023-12-07T10:01:51.315626+0000","last_active":"2023-12-07T10:01:52.237991+0000","last_peered":"2023-12-07T10:01:52.237991+0000","last_clean":"2023-12-07T10:01:52.237991+0000","last_became_active":"2023-12-07T10:01:51.315331+0000","last_became_peered":"2023-12-07T10:01:51.315331+0000","last_unstale":"2023-12-07T10:01:52.237991+0000","last_undegraded":"2023-12-07T10:01:52.237991+0000","last_fullsized":"2023-12-07T10:01:52.237991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:26:18.178418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236632+0000","last_change":"2023-12-07T10:01:51.321708+0000","last_active":"2023-12-07T10:01:52.236632+0000","last_peered":"2023-12-07T10:01:52.236632+0000","last_clean":"2023-12-07T10:01:52.236632+0000","last_became_active":"2023-12-07T10:01:51.321404+0000","last_became_peered":"2023-12-07T10:01:51.321404+0000","last_unstale":"2023-12-07T10:01:52.236632+0000","last_undegraded":"2023-12-07T10:01:52.236632+0000","last_fullsized":"2023-12-07T10:01:52.236632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382084+0000","last_change":"2023-12-07T10:01:51.335138+0000","last_active":"2023-12-07T10:01:52.382084+0000","last_peered":"2023-12-07T10:01:52.382084+0000","last_clean":"2023-12-07T10:01:52.382084+0000","last_became_active":"2023-12-07T10:01:51.334865+0000","last_became_peered":"2023-12-07T10:01:51.334865+0000","last_unstale":"2023-12-07T10:01:52.382084+0000","last_undegraded":"2023-12-07T10:01:52.382084+0000","last_fullsized":"2023-12-07T10:01:52.382084+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382671+0000","last_change":"2023-12-07T10:01:51.249276+0000","last_active":"2023-12-07T10:01:52.382671+0000","last_peered":"2023-12-07T10:01:52.382671+0000","last_clean":"2023-12-07T10:01:52.382671+0000","last_became_active":"2023-12-07T10:01:51.247885+0000","last_became_peered":"2023-12-07T10:01:51.247885+0000","last_unstale":"2023-12-07T10:01:52.382671+0000","last_undegraded":"2023-12-07T10:01:52.382671+0000","last_fullsized":"2023-12-07T10:01:52.382671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:58.975561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381768+0000","last_change":"2023-12-07T10:01:51.239757+0000","last_active":"2023-12-07T10:01:52.381768+0000","last_peered":"2023-12-07T10:01:52.381768+0000","last_clean":"2023-12-07T10:01:52.381768+0000","last_became_active":"2023-12-07T10:01:51.239432+0000","last_became_peered":"2023-12-07T10:01:51.239432+0000","last_unstale":"2023-12-07T10:01:52.381768+0000","last_undegraded":"2023-12-07T10:01:52.381768+0000","last_fullsized":"2023-12-07T10:01:52.381768+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:18.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236256+0000","last_change":"2023-12-07T10:01:51.319253+0000","last_active":"2023-12-07T10:01:52.236256+0000","last_peered":"2023-12-07T10:01:52.236256+0000","last_clean":"2023-12-07T10:01:52.236256+0000","last_became_active":"2023-12-07T10:01:51.318371+0000","last_became_peered":"2023-12-07T10:01:51.318371+0000","last_unstale":"2023-12-07T10:01:52.236256+0000","last_undegraded":"2023-12-07T10:01:52.236256+0000","last_fullsized":"2023-12-07T10:01:52.236256+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382418+0000","last_change":"2023-12-07T10:01:51.335614+0000","last_active":"2023-12-07T10:01:52.382418+0000","last_peered":"2023-12-07T10:01:52.382418+0000","last_clean":"2023-12-07T10:01:52.382418+0000","last_became_active":"2023-12-07T10:01:51.335261+0000","last_became_peered":"2023-12-07T10:01:51.335261+0000","last_unstale":"2023-12-07T10:01:52.382418+0000","last_undegraded":"2023-12-07T10:01:52.382418+0000","last_fullsized":"2023-12-07T10:01:52.382418+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237432+0000","last_change":"2023-12-07T10:01:51.334037+0000","last_active":"2023-12-07T10:01:52.237432+0000","last_peered":"2023-12-07T10:01:52.237432+0000","last_clean":"2023-12-07T10:01:52.237432+0000","last_became_active":"2023-12-07T10:01:51.333727+0000","last_became_peered":"2023-12-07T10:01:51.333727+0000","last_unstale":"2023-12-07T10:01:52.237432+0000","last_undegraded":"2023-12-07T10:01:52.237432+0000","last_fullsized":"2023-12-07T10:01:52.237432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"66'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.340233+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:01:51.340233+0000","last_peered":"2023-12-07T10:01:51.340233+0000","last_clean":"2023-12-07T10:01:51.340233+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:01:51.340233+0000","last_undegraded":"2023-12-07T10:01:51.340233+0000","last_fullsized":"2023-12-07T10:01:51.340233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382727+0000","last_change":"2023-12-07T10:01:51.328667+0000","last_active":"2023-12-07T10:01:52.382727+0000","last_peered":"2023-12-07T10:01:52.382727+0000","last_clean":"2023-12-07T10:01:52.382727+0000","last_became_active":"2023-12-07T10:01:51.328402+0000","last_became_peered":"2023-12-07T10:01:51.328402+0000","last_unstale":"2023-12-07T10:01:52.382727+0000","last_undegraded":"2023-12-07T10:01:52.382727+0000","last_fullsized":"2023-12-07T10:01:52.382727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:11.234105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.334148+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:01:51.334148+0000","last_peered":"2023-12-07T10:01:51.334148+0000","last_clean":"2023-12-07T10:01:51.334148+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:01:51.334148+0000","last_undegraded":"2023-12-07T10:01:51.334148+0000","last_fullsized":"2023-12-07T10:01:51.334148+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382236+0000","last_change":"2023-12-07T10:01:51.331609+0000","last_active":"2023-12-07T10:01:52.382236+0000","last_peered":"2023-12-07T10:01:52.382236+0000","last_clean":"2023-12-07T10:01:52.382236+0000","last_became_active":"2023-12-07T10:01:51.331052+0000","last_became_peered":"2023-12-07T10:01:51.331052+0000","last_unstale":"2023-12-07T10:01:52.382236+0000","last_undegraded":"2023-12-07T10:01:52.382236+0000","last_fullsized":"2023-12-07T10:01:52.382236+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.252793+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:01:51.252793+0000","last_peered":"2023-12-07T10:01:51.252793+0000","last_clean":"2023-12-07T10:01:51.252793+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:01:51.252793+0000","last_undegraded":"2023-12-07T10:01:51.252793+0000","last_fullsized":"2023-12-07T10:01:51.252793+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:05.118061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.238043+0000","last_change":"2023-12-07T10:01:51.321279+0000","last_active":"2023-12-07T10:01:52.238043+0000","last_peered":"2023-12-07T10:01:52.238043+0000","last_clean":"2023-12-07T10:01:52.238043+0000","last_became_active":"2023-12-07T10:01:51.320929+0000","last_became_peered":"2023-12-07T10:01:51.320929+0000","last_unstale":"2023-12-07T10:01:52.238043+0000","last_undegraded":"2023-12-07T10:01:52.238043+0000","last_fullsized":"2023-12-07T10:01:52.238043+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:27.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.250846+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:01:51.250846+0000","last_peered":"2023-12-07T10:01:51.250846+0000","last_clean":"2023-12-07T10:01:51.250846+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:01:51.250846+0000","last_undegraded":"2023-12-07T10:01:51.250846+0000","last_fullsized":"2023-12-07T10:01:51.250846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381883+0000","last_change":"2023-12-07T10:01:51.237367+0000","last_active":"2023-12-07T10:01:52.381883+0000","last_peered":"2023-12-07T10:01:52.381883+0000","last_clean":"2023-12-07T10:01:52.381883+0000","last_became_active":"2023-12-07T10:01:51.237071+0000","last_became_peered":"2023-12-07T10:01:51.237071+0000","last_unstale":"2023-12-07T10:01:52.381883+0000","last_undegraded":"2023-12-07T10:01:52.381883+0000","last_fullsized":"2023-12-07T10:01:52.381883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:19:49.846073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.332926+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:01:51.332926+0000","last_peered":"2023-12-07T10:01:51.332926+0000","last_clean":"2023-12-07T10:01:51.332926+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:01:51.332926+0000","last_undegraded":"2023-12-07T10:01:51.332926+0000","last_fullsized":"2023-12-07T10:01:51.332926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236574+0000","last_change":"2023-12-07T10:01:51.318661+0000","last_active":"2023-12-07T10:01:52.236574+0000","last_peered":"2023-12-07T10:01:52.236574+0000","last_clean":"2023-12-07T10:01:52.236574+0000","last_became_active":"2023-12-07T10:01:51.318360+0000","last_became_peered":"2023-12-07T10:01:51.318360+0000","last_unstale":"2023-12-07T10:01:52.236574+0000","last_undegraded":"2023-12-07T10:01:52.236574+0000","last_fullsized":"2023-12-07T10:01:52.236574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.331748+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:01:51.331748+0000","last_peered":"2023-12-07T10:01:51.331748+0000","last_clean":"2023-12-07T10:01:51.331748+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:01:51.331748+0000","last_undegraded":"2023-12-07T10:01:51.331748+0000","last_fullsized":"2023-12-07T10:01:51.331748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236807+0000","last_change":"2023-12-07T10:01:51.322420+0000","last_active":"2023-12-07T10:01:52.236807+0000","last_peered":"2023-12-07T10:01:52.236807+0000","last_clean":"2023-12-07T10:01:52.236807+0000","last_became_active":"2023-12-07T10:01:51.322145+0000","last_became_peered":"2023-12-07T10:01:51.322145+0000","last_unstale":"2023-12-07T10:01:52.236807+0000","last_undegraded":"2023-12-07T10:01:52.236807+0000","last_fullsized":"2023-12-07T10:01:52.236807+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.227596+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:01:51.227596+0000","last_peered":"2023-12-07T10:01:51.227596+0000","last_clean":"2023-12-07T10:01:51.227596+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:01:51.227596+0000","last_undegraded":"2023-12-07T10:01:51.227596+0000","last_fullsized":"2023-12-07T10:01:51.227596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:34.570378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.235113+0000","last_change":"2023-12-07T10:01:51.320957+0000","last_active":"2023-12-07T10:01:52.235113+0000","last_peered":"2023-12-07T10:01:52.235113+0000","last_clean":"2023-12-07T10:01:52.235113+0000","last_became_active":"2023-12-07T10:01:51.320671+0000","last_became_peered":"2023-12-07T10:01:51.320671+0000","last_unstale":"2023-12-07T10:01:52.235113+0000","last_undegraded":"2023-12-07T10:01:52.235113+0000","last_fullsized":"2023-12-07T10:01:52.235113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:10:48.731402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.229767+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:01:51.229767+0000","last_peered":"2023-12-07T10:01:51.229767+0000","last_clean":"2023-12-07T10:01:51.229767+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:01:51.229767+0000","last_undegraded":"2023-12-07T10:01:51.229767+0000","last_fullsized":"2023-12-07T10:01:51.229767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:49.235834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.235496+0000","last_change":"2023-12-07T10:01:51.237604+0000","last_active":"2023-12-07T10:01:52.235496+0000","last_peered":"2023-12-07T10:01:52.235496+0000","last_clean":"2023-12-07T10:01:52.235496+0000","last_became_active":"2023-12-07T10:01:51.237282+0000","last_became_peered":"2023-12-07T10:01:51.237282+0000","last_unstale":"2023-12-07T10:01:52.235496+0000","last_undegraded":"2023-12-07T10:01:52.235496+0000","last_fullsized":"2023-12-07T10:01:52.235496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:25.535134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.320902+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:01:51.320902+0000","last_peered":"2023-12-07T10:01:51.320902+0000","last_clean":"2023-12-07T10:01:51.320902+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:01:51.320902+0000","last_undegraded":"2023-12-07T10:01:51.320902+0000","last_fullsized":"2023-12-07T10:01:51.320902+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382760+0000","last_change":"2023-12-07T10:01:51.329179+0000","last_active":"2023-12-07T10:01:52.382760+0000","last_peered":"2023-12-07T10:01:52.382760+0000","last_clean":"2023-12-07T10:01:52.382760+0000","last_became_active":"2023-12-07T10:01:51.328872+0000","last_became_peered":"2023-12-07T10:01:51.328872+0000","last_unstale":"2023-12-07T10:01:52.382760+0000","last_undegraded":"2023-12-07T10:01:52.382760+0000","last_fullsized":"2023-12-07T10:01:52.382760+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.320807+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:01:51.320807+0000","last_peered":"2023-12-07T10:01:51.320807+0000","last_clean":"2023-12-07T10:01:51.320807+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:01:51.320807+0000","last_undegraded":"2023-12-07T10:01:51.320807+0000","last_fullsized":"2023-12-07T10:01:51.320807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382026+0000","last_change":"2023-12-07T10:01:51.335097+0000","last_active":"2023-12-07T10:01:52.382026+0000","last_peered":"2023-12-07T10:01:52.382026+0000","last_clean":"2023-12-07T10:01:52.382026+0000","last_became_active":"2023-12-07T10:01:51.334754+0000","last_became_peered":"2023-12-07T10:01:51.334754+0000","last_unstale":"2023-12-07T10:01:52.382026+0000","last_undegraded":"2023-12-07T10:01:52.382026+0000","last_fullsized":"2023-12-07T10:01:52.382026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"66'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.338075+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:01:51.338075+0000","last_peered":"2023-12-07T10:01:51.338075+0000","last_clean":"2023-12-07T10:01:51.338075+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:01:51.338075+0000","last_undegraded":"2023-12-07T10:01:51.338075+0000","last_fullsized":"2023-12-07T10:01:51.338075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236854+0000","last_change":"2023-12-07T10:01:51.321371+0000","last_active":"2023-12-07T10:01:52.236854+0000","last_peered":"2023-12-07T10:01:52.236854+0000","last_clean":"2023-12-07T10:01:52.236854+0000","last_became_active":"2023-12-07T10:01:51.321032+0000","last_became_peered":"2023-12-07T10:01:51.321032+0000","last_unstale":"2023-12-07T10:01:52.236854+0000","last_undegraded":"2023-12-07T10:01:52.236854+0000","last_fullsized":"2023-12-07T10:01:52.236854+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"66'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.338070+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:01:51.338070+0000","last_peered":"2023-12-07T10:01:51.338070+0000","last_clean":"2023-12-07T10:01:51.338070+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:01:51.338070+0000","last_undegraded":"2023-12-07T10:01:51.338070+0000","last_fullsized":"2023-12-07T10:01:51.338070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381233+0000","last_change":"2023-12-07T10:01:51.329045+0000","last_active":"2023-12-07T10:01:52.381233+0000","last_peered":"2023-12-07T10:01:52.381233+0000","last_clean":"2023-12-07T10:01:52.381233+0000","last_became_active":"2023-12-07T10:01:51.328657+0000","last_became_peered":"2023-12-07T10:01:51.328657+0000","last_unstale":"2023-12-07T10:01:52.381233+0000","last_undegraded":"2023-12-07T10:01:52.381233+0000","last_fullsized":"2023-12-07T10:01:52.381233+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.252767+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:01:51.252767+0000","last_peered":"2023-12-07T10:01:51.252767+0000","last_clean":"2023-12-07T10:01:51.252767+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:01:51.252767+0000","last_undegraded":"2023-12-07T10:01:51.252767+0000","last_fullsized":"2023-12-07T10:01:51.252767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237878+0000","last_change":"2023-12-07T10:01:51.321900+0000","last_active":"2023-12-07T10:01:52.237878+0000","last_peered":"2023-12-07T10:01:52.237878+0000","last_clean":"2023-12-07T10:01:52.237878+0000","last_became_active":"2023-12-07T10:01:51.321602+0000","last_became_peered":"2023-12-07T10:01:51.321602+0000","last_unstale":"2023-12-07T10:01:52.237878+0000","last_undegraded":"2023-12-07T10:01:52.237878+0000","last_fullsized":"2023-12-07T10:01:52.237878+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.228286+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:01:51.228286+0000","last_peered":"2023-12-07T10:01:51.228286+0000","last_clean":"2023-12-07T10:01:51.228286+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:01:51.228286+0000","last_undegraded":"2023-12-07T10:01:51.228286+0000","last_fullsized":"2023-12-07T10:01:51.228286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:04:12.916038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381249+0000","last_change":"2023-12-07T10:01:51.235277+0000","last_active":"2023-12-07T10:01:52.381249+0000","last_peered":"2023-12-07T10:01:52.381249+0000","last_clean":"2023-12-07T10:01:52.381249+0000","last_became_active":"2023-12-07T10:01:51.234826+0000","last_became_peered":"2023-12-07T10:01:51.234826+0000","last_unstale":"2023-12-07T10:01:52.381249+0000","last_undegraded":"2023-12-07T10:01:52.381249+0000","last_fullsized":"2023-12-07T10:01:52.381249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:32.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.314843+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:01:51.314843+0000","last_peered":"2023-12-07T10:01:51.314843+0000","last_clean":"2023-12-07T10:01:51.314843+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:01:51.314843+0000","last_undegraded":"2023-12-07T10:01:51.314843+0000","last_fullsized":"2023-12-07T10:01:51.314843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381346+0000","last_change":"2023-12-07T10:01:51.329007+0000","last_active":"2023-12-07T10:01:52.381346+0000","last_peered":"2023-12-07T10:01:52.381346+0000","last_clean":"2023-12-07T10:01:52.381346+0000","last_became_active":"2023-12-07T10:01:51.328735+0000","last_became_peered":"2023-12-07T10:01:51.328735+0000","last_unstale":"2023-12-07T10:01:52.381346+0000","last_undegraded":"2023-12-07T10:01:52.381346+0000","last_fullsized":"2023-12-07T10:01:52.381346+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:03.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"66'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.325127+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:01:51.325127+0000","last_peered":"2023-12-07T10:01:51.325127+0000","last_clean":"2023-12-07T10:01:51.325127+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:01:51.325127+0000","last_undegraded":"2023-12-07T10:01:51.325127+0000","last_fullsized":"2023-12-07T10:01:51.325127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:09.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.238118+0000","last_change":"2023-12-07T10:01:51.327799+0000","last_active":"2023-12-07T10:01:52.238118+0000","last_peered":"2023-12-07T10:01:52.238118+0000","last_clean":"2023-12-07T10:01:52.238118+0000","last_became_active":"2023-12-07T10:01:51.326731+0000","last_became_peered":"2023-12-07T10:01:51.326731+0000","last_unstale":"2023-12-07T10:01:52.238118+0000","last_undegraded":"2023-12-07T10:01:52.238118+0000","last_fullsized":"2023-12-07T10:01:52.238118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:04.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.339280+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:01:51.339280+0000","last_peered":"2023-12-07T10:01:51.339280+0000","last_clean":"2023-12-07T10:01:51.339280+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:01:51.339280+0000","last_undegraded":"2023-12-07T10:01:51.339280+0000","last_fullsized":"2023-12-07T10:01:51.339280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382784+0000","last_change":"2023-12-07T10:01:51.328493+0000","last_active":"2023-12-07T10:01:52.382784+0000","last_peered":"2023-12-07T10:01:52.382784+0000","last_clean":"2023-12-07T10:01:52.382784+0000","last_became_active":"2023-12-07T10:01:51.328019+0000","last_became_peered":"2023-12-07T10:01:51.328019+0000","last_unstale":"2023-12-07T10:01:52.382784+0000","last_undegraded":"2023-12-07T10:01:52.382784+0000","last_fullsized":"2023-12-07T10:01:52.382784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:24:21.334700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.328344+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:01:51.328344+0000","last_peered":"2023-12-07T10:01:51.328344+0000","last_clean":"2023-12-07T10:01:51.328344+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:01:51.328344+0000","last_undegraded":"2023-12-07T10:01:51.328344+0000","last_fullsized":"2023-12-07T10:01:51.328344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:56.735390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237130+0000","last_change":"2023-12-07T10:01:51.327301+0000","last_active":"2023-12-07T10:01:52.237130+0000","last_peered":"2023-12-07T10:01:52.237130+0000","last_clean":"2023-12-07T10:01:52.237130+0000","last_became_active":"2023-12-07T10:01:51.325806+0000","last_became_peered":"2023-12-07T10:01:51.325806+0000","last_unstale":"2023-12-07T10:01:52.237130+0000","last_undegraded":"2023-12-07T10:01:52.237130+0000","last_fullsized":"2023-12-07T10:01:52.237130+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.229560+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:01:51.229560+0000","last_peered":"2023-12-07T10:01:51.229560+0000","last_clean":"2023-12-07T10:01:51.229560+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:01:51.229560+0000","last_undegraded":"2023-12-07T10:01:51.229560+0000","last_fullsized":"2023-12-07T10:01:51.229560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:10.226808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381910+0000","last_change":"2023-12-07T10:01:51.239742+0000","last_active":"2023-12-07T10:01:52.381910+0000","last_peered":"2023-12-07T10:01:52.381910+0000","last_clean":"2023-12-07T10:01:52.381910+0000","last_became_active":"2023-12-07T10:01:51.239468+0000","last_became_peered":"2023-12-07T10:01:51.239468+0000","last_unstale":"2023-12-07T10:01:52.381910+0000","last_undegraded":"2023-12-07T10:01:52.381910+0000","last_fullsized":"2023-12-07T10:01:52.381910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:16.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.249776+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:01:51.249776+0000","last_peered":"2023-12-07T10:01:51.249776+0000","last_clean":"2023-12-07T10:01:51.249776+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:01:51.249776+0000","last_undegraded":"2023-12-07T10:01:51.249776+0000","last_fullsized":"2023-12-07T10:01:51.249776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:47.055302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382071+0000","last_change":"2023-12-07T10:01:51.323608+0000","last_active":"2023-12-07T10:01:52.382071+0000","last_peered":"2023-12-07T10:01:52.382071+0000","last_clean":"2023-12-07T10:01:52.382071+0000","last_became_active":"2023-12-07T10:01:51.323254+0000","last_became_peered":"2023-12-07T10:01:51.323254+0000","last_unstale":"2023-12-07T10:01:52.382071+0000","last_undegraded":"2023-12-07T10:01:52.382071+0000","last_fullsized":"2023-12-07T10:01:52.382071+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.221584+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:01:51.221584+0000","last_peered":"2023-12-07T10:01:51.221584+0000","last_clean":"2023-12-07T10:01:51.221584+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:01:51.221584+0000","last_undegraded":"2023-12-07T10:01:51.221584+0000","last_fullsized":"2023-12-07T10:01:51.221584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:55.751747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381731+0000","last_change":"2023-12-07T10:01:51.327531+0000","last_active":"2023-12-07T10:01:52.381731+0000","last_peered":"2023-12-07T10:01:52.381731+0000","last_clean":"2023-12-07T10:01:52.381731+0000","last_became_active":"2023-12-07T10:01:51.326982+0000","last_became_peered":"2023-12-07T10:01:51.326982+0000","last_unstale":"2023-12-07T10:01:52.381731+0000","last_undegraded":"2023-12-07T10:01:52.381731+0000","last_fullsized":"2023-12-07T10:01:52.381731+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:37.353658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.220644+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:01:51.220644+0000","last_peered":"2023-12-07T10:01:51.220644+0000","last_clean":"2023-12-07T10:01:51.220644+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:01:51.220644+0000","last_undegraded":"2023-12-07T10:01:51.220644+0000","last_fullsized":"2023-12-07T10:01:51.220644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:19.396813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381809+0000","last_change":"2023-12-07T10:01:51.322653+0000","last_active":"2023-12-07T10:01:52.381809+0000","last_peered":"2023-12-07T10:01:52.381809+0000","last_clean":"2023-12-07T10:01:52.381809+0000","last_became_active":"2023-12-07T10:01:51.322160+0000","last_became_peered":"2023-12-07T10:01:51.322160+0000","last_unstale":"2023-12-07T10:01:52.381809+0000","last_undegraded":"2023-12-07T10:01:52.381809+0000","last_fullsized":"2023-12-07T10:01:52.381809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:57.285100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.229420+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:01:51.229420+0000","last_peered":"2023-12-07T10:01:51.229420+0000","last_clean":"2023-12-07T10:01:51.229420+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:01:51.229420+0000","last_undegraded":"2023-12-07T10:01:51.229420+0000","last_fullsized":"2023-12-07T10:01:51.229420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:20.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237483+0000","last_change":"2023-12-07T10:01:51.328470+0000","last_active":"2023-12-07T10:01:52.237483+0000","last_peered":"2023-12-07T10:01:52.237483+0000","last_clean":"2023-12-07T10:01:52.237483+0000","last_became_active":"2023-12-07T10:01:51.328195+0000","last_became_peered":"2023-12-07T10:01:51.328195+0000","last_unstale":"2023-12-07T10:01:52.237483+0000","last_undegraded":"2023-12-07T10:01:52.237483+0000","last_fullsized":"2023-12-07T10:01:52.237483+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.325990+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:01:51.325990+0000","last_peered":"2023-12-07T10:01:51.325990+0000","last_clean":"2023-12-07T10:01:51.325990+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:01:51.325990+0000","last_undegraded":"2023-12-07T10:01:51.325990+0000","last_fullsized":"2023-12-07T10:01:51.325990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.238220+0000","last_change":"2023-12-07T10:01:51.330147+0000","last_active":"2023-12-07T10:01:52.238220+0000","last_peered":"2023-12-07T10:01:52.238220+0000","last_clean":"2023-12-07T10:01:52.238220+0000","last_became_active":"2023-12-07T10:01:51.329786+0000","last_became_peered":"2023-12-07T10:01:51.329786+0000","last_unstale":"2023-12-07T10:01:52.238220+0000","last_undegraded":"2023-12-07T10:01:52.238220+0000","last_fullsized":"2023-12-07T10:01:52.238220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:16.697908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382709+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:01:52.382709+0000","last_peered":"2023-12-07T10:01:52.382709+0000","last_clean":"2023-12-07T10:01:52.382709+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:01:52.382709+0000","last_undegraded":"2023-12-07T10:01:52.382709+0000","last_fullsized":"2023-12-07T10:01:52.382709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382398+0000","last_change":"2023-12-07T10:01:51.331632+0000","last_active":"2023-12-07T10:01:52.382398+0000","last_peered":"2023-12-07T10:01:52.382398+0000","last_clean":"2023-12-07T10:01:52.382398+0000","last_became_active":"2023-12-07T10:01:51.331353+0000","last_became_peered":"2023-12-07T10:01:51.331353+0000","last_unstale":"2023-12-07T10:01:52.382398+0000","last_undegraded":"2023-12-07T10:01:52.382398+0000","last_fullsized":"2023-12-07T10:01:52.382398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.320486+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:01:51.320486+0000","last_peered":"2023-12-07T10:01:51.320486+0000","last_clean":"2023-12-07T10:01:51.320486+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:01:51.320486+0000","last_undegraded":"2023-12-07T10:01:51.320486+0000","last_fullsized":"2023-12-07T10:01:51.320486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237249+0000","last_change":"2023-12-07T10:01:51.319139+0000","last_active":"2023-12-07T10:01:52.237249+0000","last_peered":"2023-12-07T10:01:52.237249+0000","last_clean":"2023-12-07T10:01:52.237249+0000","last_became_active":"2023-12-07T10:01:51.318844+0000","last_became_peered":"2023-12-07T10:01:51.318844+0000","last_unstale":"2023-12-07T10:01:52.237249+0000","last_undegraded":"2023-12-07T10:01:52.237249+0000","last_fullsized":"2023-12-07T10:01:52.237249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.323321+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:01:51.323321+0000","last_peered":"2023-12-07T10:01:51.323321+0000","last_clean":"2023-12-07T10:01:51.323321+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:01:51.323321+0000","last_undegraded":"2023-12-07T10:01:51.323321+0000","last_fullsized":"2023-12-07T10:01:51.323321+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382246+0000","last_change":"2023-12-07T10:01:51.329016+0000","last_active":"2023-12-07T10:01:52.382246+0000","last_peered":"2023-12-07T10:01:52.382246+0000","last_clean":"2023-12-07T10:01:52.382246+0000","last_became_active":"2023-12-07T10:01:51.327629+0000","last_became_peered":"2023-12-07T10:01:51.327629+0000","last_unstale":"2023-12-07T10:01:52.382246+0000","last_undegraded":"2023-12-07T10:01:52.382246+0000","last_fullsized":"2023-12-07T10:01:52.382246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.227986+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:01:51.227986+0000","last_peered":"2023-12-07T10:01:51.227986+0000","last_clean":"2023-12-07T10:01:51.227986+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:01:51.227986+0000","last_undegraded":"2023-12-07T10:01:51.227986+0000","last_fullsized":"2023-12-07T10:01:51.227986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:07.169353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381662+0000","last_change":"2023-12-07T10:01:51.329122+0000","last_active":"2023-12-07T10:01:52.381662+0000","last_peered":"2023-12-07T10:01:52.381662+0000","last_clean":"2023-12-07T10:01:52.381662+0000","last_became_active":"2023-12-07T10:01:51.328758+0000","last_became_peered":"2023-12-07T10:01:51.328758+0000","last_unstale":"2023-12-07T10:01:52.381662+0000","last_undegraded":"2023-12-07T10:01:52.381662+0000","last_fullsized":"2023-12-07T10:01:52.381662+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.312473+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:01:51.312473+0000","last_peered":"2023-12-07T10:01:51.312473+0000","last_clean":"2023-12-07T10:01:51.312473+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:01:51.312473+0000","last_undegraded":"2023-12-07T10:01:51.312473+0000","last_fullsized":"2023-12-07T10:01:51.312473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236882+0000","last_change":"2023-12-07T10:01:51.322885+0000","last_active":"2023-12-07T10:01:52.236882+0000","last_peered":"2023-12-07T10:01:52.236882+0000","last_clean":"2023-12-07T10:01:52.236882+0000","last_became_active":"2023-12-07T10:01:51.322135+0000","last_became_peered":"2023-12-07T10:01:51.322135+0000","last_unstale":"2023-12-07T10:01:52.236882+0000","last_undegraded":"2023-12-07T10:01:52.236882+0000","last_fullsized":"2023-12-07T10:01:52.236882+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.316023+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:01:51.316023+0000","last_peered":"2023-12-07T10:01:51.316023+0000","last_clean":"2023-12-07T10:01:51.316023+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:01:51.316023+0000","last_undegraded":"2023-12-07T10:01:51.316023+0000","last_fullsized":"2023-12-07T10:01:51.316023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:56.460325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382508+0000","last_change":"2023-12-07T10:01:51.332156+0000","last_active":"2023-12-07T10:01:52.382508+0000","last_peered":"2023-12-07T10:01:52.382508+0000","last_clean":"2023-12-07T10:01:52.382508+0000","last_became_active":"2023-12-07T10:01:51.331807+0000","last_became_peered":"2023-12-07T10:01:51.331807+0000","last_unstale":"2023-12-07T10:01:52.382508+0000","last_undegraded":"2023-12-07T10:01:52.382508+0000","last_fullsized":"2023-12-07T10:01:52.382508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.317270+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:01:51.317270+0000","last_peered":"2023-12-07T10:01:51.317270+0000","last_clean":"2023-12-07T10:01:51.317270+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:01:51.317270+0000","last_undegraded":"2023-12-07T10:01:51.317270+0000","last_fullsized":"2023-12-07T10:01:51.317270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382314+0000","last_change":"2023-12-07T10:01:51.330158+0000","last_active":"2023-12-07T10:01:52.382314+0000","last_peered":"2023-12-07T10:01:52.382314+0000","last_clean":"2023-12-07T10:01:52.382314+0000","last_became_active":"2023-12-07T10:01:51.329812+0000","last_became_peered":"2023-12-07T10:01:51.329812+0000","last_unstale":"2023-12-07T10:01:52.382314+0000","last_undegraded":"2023-12-07T10:01:52.382314+0000","last_fullsized":"2023-12-07T10:01:52.382314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:08:38.276890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.332214+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:01:51.332214+0000","last_peered":"2023-12-07T10:01:51.332214+0000","last_clean":"2023-12-07T10:01:51.332214+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:01:51.332214+0000","last_undegraded":"2023-12-07T10:01:51.332214+0000","last_fullsized":"2023-12-07T10:01:51.332214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.222788+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:51.222788+0000","last_peered":"2023-12-07T10:01:51.222788+0000","last_clean":"2023-12-07T10:01:51.222788+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:51.222788+0000","last_undegraded":"2023-12-07T10:01:51.222788+0000","last_fullsized":"2023-12-07T10:01:51.222788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":949388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":359644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":360584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.501}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.747}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":358950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":360562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.504},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":359532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.434}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":359144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.374}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":949352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.44}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":1.248},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.004}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.23}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.133},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:01:59.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:01:59.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.944+0000 7f607c032640 1 Processor -- start 2023-12-07T10:01:59.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.944+0000 7f607c032640 1 -- start start 2023-12-07T10:01:59.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607c032640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6074152ce0 0x7f607406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:59.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607c032640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f607406d100 0x7f60740c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:59.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607c032640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607406bea0 con 0x7f607406db80 2023-12-07T10:01:59.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607c032640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6074159b10 con 0x7f607406d100 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607c032640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6074159550 con 0x7f6074152ce0 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f607406d100 0x7f60740c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f607406d100 0x7f60740c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56932/0 (socket says 172.21.15.89:56932) 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 -- 172.21.15.89:0/259241689 learned_addr learned my addr 172.21.15.89:0/259241689 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 -- 172.21.15.89:0/259241689 >> v2:172.21.15.97:3300/0 conn(0x7f6074152ce0 msgr2=0x7f607406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 --2- 172.21.15.89:0/259241689 >> v2:172.21.15.97:3300/0 conn(0x7f6074152ce0 0x7f607406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 -- 172.21.15.89:0/259241689 >> v1:172.21.15.97:6789/0 conn(0x7f607406db80 legacy=0x7f60740700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:01:59.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.948+0000 7f607a5cf640 1 -- 172.21.15.89:0/259241689 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074159830 con 0x7f607406d100 2023-12-07T10:01:59.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607a5cf640 1 --2- 172.21.15.89:0/259241689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607406d100 0x7f60740c19e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f60740c2800 tx=0x7f606c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86f5b554beff197 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:59.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f6078dcc640 1 -- 172.21.15.89:0/259241689 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0a57c0 con 0x7f607406d100 2023-12-07T10:01:59.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f6078dcc640 1 -- 172.21.15.89:0/259241689 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0a5920 con 0x7f607406d100 2023-12-07T10:01:59.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f6078dcc640 1 -- 172.21.15.89:0/259241689 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0a5cb0 con 0x7f607406d100 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 -- 172.21.15.89:0/259241689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607406d100 msgr2=0x7f60740c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 --2- 172.21.15.89:0/259241689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607406d100 0x7f60740c19e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f60740c2800 tx=0x7f606c01c900 comp rx=0 tx=0).stop 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 -- 172.21.15.89:0/259241689 shutdown_connections 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 --2- 172.21.15.89:0/259241689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f607406d100 0x7f60740c19e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 --2- 172.21.15.89:0/259241689 >> v2:172.21.15.97:3300/0 conn(0x7f6074152ce0 0x7f607406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 -- 172.21.15.89:0/259241689 >> 172.21.15.89:0/259241689 conn(0x7f60740c2ad0 msgr2=0x7f60740c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 -- 172.21.15.89:0/259241689 shutdown_connections 2023-12-07T10:01:59.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 -- 172.21.15.89:0/259241689 wait complete. 2023-12-07T10:01:59.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 Processor -- start 2023-12-07T10:01:59.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.952+0000 7f607c032640 1 -- start start 2023-12-07T10:01:59.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607406d100 0x7f60740c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:59.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607406db80 0x7f60740c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:59.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 0x7f607415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:59.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607415a490 con 0x7f6074152ce0 2023-12-07T10:01:59.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607414e2e0 con 0x7f607406db80 2023-12-07T10:01:59.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607415b4f0 con 0x7f607406d100 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 0x7f607415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 0x7f607415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56936/0 (socket says 172.21.15.89:56936) 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 -- 172.21.15.89:0/2454407101 learned_addr learned my addr 172.21.15.89:0/2454407101 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f6079dce640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607406d100 0x7f60740c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f60795cd640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607406db80 0x7f60740c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 -- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607406d100 msgr2=0x7f60740c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:59.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607406d100 0x7f60740c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 -- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607406db80 msgr2=0x7f60740c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607406db80 0x7f60740c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 -- 172.21.15.89:0/2454407101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c009b30 con 0x7f6074152ce0 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607a5cf640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 0x7f607415b980 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f606c0af040 tx=0x7f606c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b8670 con 0x7f6074152ce0 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0b87d0 con 0x7f6074152ce0 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b8b40 con 0x7f6074152ce0 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60740c5880 con 0x7f6074152ce0 2023-12-07T10:01:59.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607414dd20 con 0x7f6074152ce0 2023-12-07T10:01:59.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607415b2a0 con 0x7f6074152ce0 2023-12-07T10:01:59.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.956+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f606c0b8ca0 con 0x7f6074152ce0 2023-12-07T10:01:59.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.960+0000 7f606a7fc640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f60580668d0 0x7f6058068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:01:59.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.960+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f606c11fa90 con 0x7f6074152ce0 2023-12-07T10:01:59.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.960+0000 7f6079dce640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f60580668d0 0x7f6058068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:01:59.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.960+0000 7f6079dce640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f60580668d0 0x7f6058068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6070006fd0 tx=0x7f6070008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:01:59.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:01:59.964+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f606c0ecd70 con 0x7f6074152ce0 2023-12-07T10:02:00.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.112+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f607404e890 con 0x7f60580668d0 2023-12-07T10:02:00.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.120+0000 7f606a7fc640 1 -- 172.21.15.89:0/2454407101 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289034 (secure 0 0 0) 0x7f607404e890 con 0x7f60580668d0 2023-12-07T10:02:00.127 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f60580668d0 msgr2=0x7f6058068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f60580668d0 0x7f6058068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6070006fd0 tx=0x7f6070008040 comp rx=0 tx=0).stop 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 msgr2=0x7f607415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 0x7f607415b980 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f606c0af040 tx=0x7f606c0196a0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 shutdown_connections 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6074152ce0 0x7f607415b980 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f607406db80 0x7f60740c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f60580668d0 0x7f6058068d90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 --2- 172.21.15.89:0/2454407101 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f607406d100 0x7f60740c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 >> 172.21.15.89:0/2454407101 conn(0x7f60740c2ad0 msgr2=0x7f607414c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:00.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 shutdown_connections 2023-12-07T10:02:00.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.124+0000 7f607c032640 1 -- 172.21.15.89:0/2454407101 wait complete. 2023-12-07T10:02:00.147 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-12-07T10:01:58.374887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252952,"kb_used_data":7656,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721768,"statfs":{"total":773094113280,"available":772835090432,"internally_reserved":0,"allocated":7839744,"data_stored":4057156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":74,"apply_latency_ms":74,"commit_latency_ns":74000000,"apply_latency_ns":74000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001525"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382675+0000","last_change":"2023-12-07T10:01:51.334457+0000","last_active":"2023-12-07T10:01:52.382675+0000","last_peered":"2023-12-07T10:01:52.382675+0000","last_clean":"2023-12-07T10:01:52.382675+0000","last_became_active":"2023-12-07T10:01:51.333891+0000","last_became_peered":"2023-12-07T10:01:51.333891+0000","last_unstale":"2023-12-07T10:01:52.382675+0000","last_undegraded":"2023-12-07T10:01:52.382675+0000","last_fullsized":"2023-12-07T10:01:52.382675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:50.606836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382696+0000","last_change":"2023-12-07T10:01:51.330897+0000","last_active":"2023-12-07T10:01:52.382696+0000","last_peered":"2023-12-07T10:01:52.382696+0000","last_clean":"2023-12-07T10:01:52.382696+0000","last_became_active":"2023-12-07T10:01:51.330640+0000","last_became_peered":"2023-12-07T10:01:51.330640+0000","last_unstale":"2023-12-07T10:01:52.382696+0000","last_undegraded":"2023-12-07T10:01:52.382696+0000","last_fullsized":"2023-12-07T10:01:52.382696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:57.467622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237925+0000","last_change":"2023-12-07T10:01:51.328745+0000","last_active":"2023-12-07T10:01:52.237925+0000","last_peered":"2023-12-07T10:01:52.237925+0000","last_clean":"2023-12-07T10:01:52.237925+0000","last_became_active":"2023-12-07T10:01:51.328404+0000","last_became_peered":"2023-12-07T10:01:51.328404+0000","last_unstale":"2023-12-07T10:01:52.237925+0000","last_undegraded":"2023-12-07T10:01:52.237925+0000","last_fullsized":"2023-12-07T10:01:52.237925+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:35:05.845534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382616+0000","last_change":"2023-12-07T10:01:51.237718+0000","last_active":"2023-12-07T10:01:52.382616+0000","last_peered":"2023-12-07T10:01:52.382616+0000","last_clean":"2023-12-07T10:01:52.382616+0000","last_became_active":"2023-12-07T10:01:51.237319+0000","last_became_peered":"2023-12-07T10:01:51.237319+0000","last_unstale":"2023-12-07T10:01:52.382616+0000","last_undegraded":"2023-12-07T10:01:52.382616+0000","last_fullsized":"2023-12-07T10:01:52.382616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:33:39.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236366+0000","last_change":"2023-12-07T10:01:51.319209+0000","last_active":"2023-12-07T10:01:52.236366+0000","last_peered":"2023-12-07T10:01:52.236366+0000","last_clean":"2023-12-07T10:01:52.236366+0000","last_became_active":"2023-12-07T10:01:51.318902+0000","last_became_peered":"2023-12-07T10:01:51.318902+0000","last_unstale":"2023-12-07T10:01:52.236366+0000","last_undegraded":"2023-12-07T10:01:52.236366+0000","last_fullsized":"2023-12-07T10:01:52.236366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382105+0000","last_change":"2023-12-07T10:01:51.328543+0000","last_active":"2023-12-07T10:01:52.382105+0000","last_peered":"2023-12-07T10:01:52.382105+0000","last_clean":"2023-12-07T10:01:52.382105+0000","last_became_active":"2023-12-07T10:01:51.327329+0000","last_became_peered":"2023-12-07T10:01:51.327329+0000","last_unstale":"2023-12-07T10:01:52.382105+0000","last_undegraded":"2023-12-07T10:01:52.382105+0000","last_fullsized":"2023-12-07T10:01:52.382105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381556+0000","last_change":"2023-12-07T10:01:51.320165+0000","last_active":"2023-12-07T10:01:52.381556+0000","last_peered":"2023-12-07T10:01:52.381556+0000","last_clean":"2023-12-07T10:01:52.381556+0000","last_became_active":"2023-12-07T10:01:51.319902+0000","last_became_peered":"2023-12-07T10:01:51.319902+0000","last_unstale":"2023-12-07T10:01:52.381556+0000","last_undegraded":"2023-12-07T10:01:52.381556+0000","last_fullsized":"2023-12-07T10:01:52.381556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:42.457874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381776+0000","last_change":"2023-12-07T10:01:51.329061+0000","last_active":"2023-12-07T10:01:52.381776+0000","last_peered":"2023-12-07T10:01:52.381776+0000","last_clean":"2023-12-07T10:01:52.381776+0000","last_became_active":"2023-12-07T10:01:51.326242+0000","last_became_peered":"2023-12-07T10:01:51.326242+0000","last_unstale":"2023-12-07T10:01:52.381776+0000","last_undegraded":"2023-12-07T10:01:52.381776+0000","last_fullsized":"2023-12-07T10:01:52.381776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:55.552580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382631+0000","last_change":"2023-12-07T10:01:51.325239+0000","last_active":"2023-12-07T10:01:52.382631+0000","last_peered":"2023-12-07T10:01:52.382631+0000","last_clean":"2023-12-07T10:01:52.382631+0000","last_became_active":"2023-12-07T10:01:51.324925+0000","last_became_peered":"2023-12-07T10:01:51.324925+0000","last_unstale":"2023-12-07T10:01:52.382631+0000","last_undegraded":"2023-12-07T10:01:52.382631+0000","last_fullsized":"2023-12-07T10:01:52.382631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382577+0000","last_change":"2023-12-07T10:01:51.330222+0000","last_active":"2023-12-07T10:01:52.382577+0000","last_peered":"2023-12-07T10:01:52.382577+0000","last_clean":"2023-12-07T10:01:52.382577+0000","last_became_active":"2023-12-07T10:01:51.329871+0000","last_became_peered":"2023-12-07T10:01:51.329871+0000","last_unstale":"2023-12-07T10:01:52.382577+0000","last_undegraded":"2023-12-07T10:01:52.382577+0000","last_fullsized":"2023-12-07T10:01:52.382577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382390+0000","last_change":"2023-12-07T10:01:51.321607+0000","last_active":"2023-12-07T10:01:52.382390+0000","last_peered":"2023-12-07T10:01:52.382390+0000","last_clean":"2023-12-07T10:01:52.382390+0000","last_became_active":"2023-12-07T10:01:51.321331+0000","last_became_peered":"2023-12-07T10:01:51.321331+0000","last_unstale":"2023-12-07T10:01:52.382390+0000","last_undegraded":"2023-12-07T10:01:52.382390+0000","last_fullsized":"2023-12-07T10:01:52.382390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:50.912945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382259+0000","last_change":"2023-12-07T10:01:51.332752+0000","last_active":"2023-12-07T10:01:52.382259+0000","last_peered":"2023-12-07T10:01:52.382259+0000","last_clean":"2023-12-07T10:01:52.382259+0000","last_became_active":"2023-12-07T10:01:51.332452+0000","last_became_peered":"2023-12-07T10:01:51.332452+0000","last_unstale":"2023-12-07T10:01:52.382259+0000","last_undegraded":"2023-12-07T10:01:52.382259+0000","last_fullsized":"2023-12-07T10:01:52.382259+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237518+0000","last_change":"2023-12-07T10:01:51.331204+0000","last_active":"2023-12-07T10:01:52.237518+0000","last_peered":"2023-12-07T10:01:52.237518+0000","last_clean":"2023-12-07T10:01:52.237518+0000","last_became_active":"2023-12-07T10:01:51.330895+0000","last_became_peered":"2023-12-07T10:01:51.330895+0000","last_unstale":"2023-12-07T10:01:52.237518+0000","last_undegraded":"2023-12-07T10:01:52.237518+0000","last_fullsized":"2023-12-07T10:01:52.237518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382376+0000","last_change":"2023-12-07T10:01:51.244162+0000","last_active":"2023-12-07T10:01:52.382376+0000","last_peered":"2023-12-07T10:01:52.382376+0000","last_clean":"2023-12-07T10:01:52.382376+0000","last_became_active":"2023-12-07T10:01:51.243875+0000","last_became_peered":"2023-12-07T10:01:51.243875+0000","last_unstale":"2023-12-07T10:01:52.382376+0000","last_undegraded":"2023-12-07T10:01:52.382376+0000","last_fullsized":"2023-12-07T10:01:52.382376+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:04:07.590726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.235056+0000","last_change":"2023-12-07T10:01:51.319891+0000","last_active":"2023-12-07T10:01:52.235056+0000","last_peered":"2023-12-07T10:01:52.235056+0000","last_clean":"2023-12-07T10:01:52.235056+0000","last_became_active":"2023-12-07T10:01:51.319557+0000","last_became_peered":"2023-12-07T10:01:51.319557+0000","last_unstale":"2023-12-07T10:01:52.235056+0000","last_undegraded":"2023-12-07T10:01:52.235056+0000","last_fullsized":"2023-12-07T10:01:52.235056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:20:21.004108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236212+0000","last_change":"2023-12-07T10:01:51.331122+0000","last_active":"2023-12-07T10:01:52.236212+0000","last_peered":"2023-12-07T10:01:52.236212+0000","last_clean":"2023-12-07T10:01:52.236212+0000","last_became_active":"2023-12-07T10:01:51.330385+0000","last_became_peered":"2023-12-07T10:01:51.330385+0000","last_unstale":"2023-12-07T10:01:52.236212+0000","last_undegraded":"2023-12-07T10:01:52.236212+0000","last_fullsized":"2023-12-07T10:01:52.236212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237684+0000","last_change":"2023-12-07T10:01:51.326514+0000","last_active":"2023-12-07T10:01:52.237684+0000","last_peered":"2023-12-07T10:01:52.237684+0000","last_clean":"2023-12-07T10:01:52.237684+0000","last_became_active":"2023-12-07T10:01:51.326126+0000","last_became_peered":"2023-12-07T10:01:51.326126+0000","last_unstale":"2023-12-07T10:01:52.237684+0000","last_undegraded":"2023-12-07T10:01:52.237684+0000","last_fullsized":"2023-12-07T10:01:52.237684+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382868+0000","last_change":"2023-12-07T10:01:51.322531+0000","last_active":"2023-12-07T10:01:52.382868+0000","last_peered":"2023-12-07T10:01:52.382868+0000","last_clean":"2023-12-07T10:01:52.382868+0000","last_became_active":"2023-12-07T10:01:51.322236+0000","last_became_peered":"2023-12-07T10:01:51.322236+0000","last_unstale":"2023-12-07T10:01:52.382868+0000","last_undegraded":"2023-12-07T10:01:52.382868+0000","last_fullsized":"2023-12-07T10:01:52.382868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:58:49.154793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382404+0000","last_change":"2023-12-07T10:01:51.246838+0000","last_active":"2023-12-07T10:01:52.382404+0000","last_peered":"2023-12-07T10:01:52.382404+0000","last_clean":"2023-12-07T10:01:52.382404+0000","last_became_active":"2023-12-07T10:01:51.246542+0000","last_became_peered":"2023-12-07T10:01:51.246542+0000","last_unstale":"2023-12-07T10:01:52.382404+0000","last_undegraded":"2023-12-07T10:01:52.382404+0000","last_fullsized":"2023-12-07T10:01:52.382404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382734+0000","last_change":"2023-12-07T10:01:51.238206+0000","last_active":"2023-12-07T10:01:52.382734+0000","last_peered":"2023-12-07T10:01:52.382734+0000","last_clean":"2023-12-07T10:01:52.382734+0000","last_became_active":"2023-12-07T10:01:51.237896+0000","last_became_peered":"2023-12-07T10:01:51.237896+0000","last_unstale":"2023-12-07T10:01:52.382734+0000","last_undegraded":"2023-12-07T10:01:52.382734+0000","last_fullsized":"2023-12-07T10:01:52.382734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:05.717307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382363+0000","last_change":"2023-12-07T10:01:51.239605+0000","last_active":"2023-12-07T10:01:52.382363+0000","last_peered":"2023-12-07T10:01:52.382363+0000","last_clean":"2023-12-07T10:01:52.382363+0000","last_became_active":"2023-12-07T10:01:51.238681+0000","last_became_peered":"2023-12-07T10:01:51.238681+0000","last_unstale":"2023-12-07T10:01:52.382363+0000","last_undegraded":"2023-12-07T10:01:52.382363+0000","last_fullsized":"2023-12-07T10:01:52.382363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:49.151421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381634+0000","last_change":"2023-12-07T10:01:51.239133+0000","last_active":"2023-12-07T10:01:52.381634+0000","last_peered":"2023-12-07T10:01:52.381634+0000","last_clean":"2023-12-07T10:01:52.381634+0000","last_became_active":"2023-12-07T10:01:51.238847+0000","last_became_peered":"2023-12-07T10:01:51.238847+0000","last_unstale":"2023-12-07T10:01:52.381634+0000","last_undegraded":"2023-12-07T10:01:52.381634+0000","last_fullsized":"2023-12-07T10:01:52.381634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:01.049212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382021+0000","last_change":"2023-12-07T10:01:51.326936+0000","last_active":"2023-12-07T10:01:52.382021+0000","last_peered":"2023-12-07T10:01:52.382021+0000","last_clean":"2023-12-07T10:01:52.382021+0000","last_became_active":"2023-12-07T10:01:51.326411+0000","last_became_peered":"2023-12-07T10:01:51.326411+0000","last_unstale":"2023-12-07T10:01:52.382021+0000","last_undegraded":"2023-12-07T10:01:52.382021+0000","last_fullsized":"2023-12-07T10:01:52.382021+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381582+0000","last_change":"2023-12-07T10:01:51.238711+0000","last_active":"2023-12-07T10:01:52.381582+0000","last_peered":"2023-12-07T10:01:52.381582+0000","last_clean":"2023-12-07T10:01:52.381582+0000","last_became_active":"2023-12-07T10:01:51.238406+0000","last_became_peered":"2023-12-07T10:01:51.238406+0000","last_unstale":"2023-12-07T10:01:52.381582+0000","last_undegraded":"2023-12-07T10:01:52.381582+0000","last_fullsized":"2023-12-07T10:01:52.381582+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:37.893685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382658+0000","last_change":"2023-12-07T10:01:51.331406+0000","last_active":"2023-12-07T10:01:52.382658+0000","last_peered":"2023-12-07T10:01:52.382658+0000","last_clean":"2023-12-07T10:01:52.382658+0000","last_became_active":"2023-12-07T10:01:51.330583+0000","last_became_peered":"2023-12-07T10:01:51.330583+0000","last_unstale":"2023-12-07T10:01:52.382658+0000","last_undegraded":"2023-12-07T10:01:52.382658+0000","last_fullsized":"2023-12-07T10:01:52.382658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:45.174048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237991+0000","last_change":"2023-12-07T10:01:51.315626+0000","last_active":"2023-12-07T10:01:52.237991+0000","last_peered":"2023-12-07T10:01:52.237991+0000","last_clean":"2023-12-07T10:01:52.237991+0000","last_became_active":"2023-12-07T10:01:51.315331+0000","last_became_peered":"2023-12-07T10:01:51.315331+0000","last_unstale":"2023-12-07T10:01:52.237991+0000","last_undegraded":"2023-12-07T10:01:52.237991+0000","last_fullsized":"2023-12-07T10:01:52.237991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:26:18.178418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236632+0000","last_change":"2023-12-07T10:01:51.321708+0000","last_active":"2023-12-07T10:01:52.236632+0000","last_peered":"2023-12-07T10:01:52.236632+0000","last_clean":"2023-12-07T10:01:52.236632+0000","last_became_active":"2023-12-07T10:01:51.321404+0000","last_became_peered":"2023-12-07T10:01:51.321404+0000","last_unstale":"2023-12-07T10:01:52.236632+0000","last_undegraded":"2023-12-07T10:01:52.236632+0000","last_fullsized":"2023-12-07T10:01:52.236632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382084+0000","last_change":"2023-12-07T10:01:51.335138+0000","last_active":"2023-12-07T10:01:52.382084+0000","last_peered":"2023-12-07T10:01:52.382084+0000","last_clean":"2023-12-07T10:01:52.382084+0000","last_became_active":"2023-12-07T10:01:51.334865+0000","last_became_peered":"2023-12-07T10:01:51.334865+0000","last_unstale":"2023-12-07T10:01:52.382084+0000","last_undegraded":"2023-12-07T10:01:52.382084+0000","last_fullsized":"2023-12-07T10:01:52.382084+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382671+0000","last_change":"2023-12-07T10:01:51.249276+0000","last_active":"2023-12-07T10:01:52.382671+0000","last_peered":"2023-12-07T10:01:52.382671+0000","last_clean":"2023-12-07T10:01:52.382671+0000","last_became_active":"2023-12-07T10:01:51.247885+0000","last_became_peered":"2023-12-07T10:01:51.247885+0000","last_unstale":"2023-12-07T10:01:52.382671+0000","last_undegraded":"2023-12-07T10:01:52.382671+0000","last_fullsized":"2023-12-07T10:01:52.382671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:58.975561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381768+0000","last_change":"2023-12-07T10:01:51.239757+0000","last_active":"2023-12-07T10:01:52.381768+0000","last_peered":"2023-12-07T10:01:52.381768+0000","last_clean":"2023-12-07T10:01:52.381768+0000","last_became_active":"2023-12-07T10:01:51.239432+0000","last_became_peered":"2023-12-07T10:01:51.239432+0000","last_unstale":"2023-12-07T10:01:52.381768+0000","last_undegraded":"2023-12-07T10:01:52.381768+0000","last_fullsized":"2023-12-07T10:01:52.381768+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:18.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236256+0000","last_change":"2023-12-07T10:01:51.319253+0000","last_active":"2023-12-07T10:01:52.236256+0000","last_peered":"2023-12-07T10:01:52.236256+0000","last_clean":"2023-12-07T10:01:52.236256+0000","last_became_active":"2023-12-07T10:01:51.318371+0000","last_became_peered":"2023-12-07T10:01:51.318371+0000","last_unstale":"2023-12-07T10:01:52.236256+0000","last_undegraded":"2023-12-07T10:01:52.236256+0000","last_fullsized":"2023-12-07T10:01:52.236256+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382418+0000","last_change":"2023-12-07T10:01:51.335614+0000","last_active":"2023-12-07T10:01:52.382418+0000","last_peered":"2023-12-07T10:01:52.382418+0000","last_clean":"2023-12-07T10:01:52.382418+0000","last_became_active":"2023-12-07T10:01:51.335261+0000","last_became_peered":"2023-12-07T10:01:51.335261+0000","last_unstale":"2023-12-07T10:01:52.382418+0000","last_undegraded":"2023-12-07T10:01:52.382418+0000","last_fullsized":"2023-12-07T10:01:52.382418+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237432+0000","last_change":"2023-12-07T10:01:51.334037+0000","last_active":"2023-12-07T10:01:52.237432+0000","last_peered":"2023-12-07T10:01:52.237432+0000","last_clean":"2023-12-07T10:01:52.237432+0000","last_became_active":"2023-12-07T10:01:51.333727+0000","last_became_peered":"2023-12-07T10:01:51.333727+0000","last_unstale":"2023-12-07T10:01:52.237432+0000","last_undegraded":"2023-12-07T10:01:52.237432+0000","last_fullsized":"2023-12-07T10:01:52.237432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"66'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.340233+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:01:51.340233+0000","last_peered":"2023-12-07T10:01:51.340233+0000","last_clean":"2023-12-07T10:01:51.340233+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:01:51.340233+0000","last_undegraded":"2023-12-07T10:01:51.340233+0000","last_fullsized":"2023-12-07T10:01:51.340233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382727+0000","last_change":"2023-12-07T10:01:51.328667+0000","last_active":"2023-12-07T10:01:52.382727+0000","last_peered":"2023-12-07T10:01:52.382727+0000","last_clean":"2023-12-07T10:01:52.382727+0000","last_became_active":"2023-12-07T10:01:51.328402+0000","last_became_peered":"2023-12-07T10:01:51.328402+0000","last_unstale":"2023-12-07T10:01:52.382727+0000","last_undegraded":"2023-12-07T10:01:52.382727+0000","last_fullsized":"2023-12-07T10:01:52.382727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:11.234105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.334148+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:01:51.334148+0000","last_peered":"2023-12-07T10:01:51.334148+0000","last_clean":"2023-12-07T10:01:51.334148+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:01:51.334148+0000","last_undegraded":"2023-12-07T10:01:51.334148+0000","last_fullsized":"2023-12-07T10:01:51.334148+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382236+0000","last_change":"2023-12-07T10:01:51.331609+0000","last_active":"2023-12-07T10:01:52.382236+0000","last_peered":"2023-12-07T10:01:52.382236+0000","last_clean":"2023-12-07T10:01:52.382236+0000","last_became_active":"2023-12-07T10:01:51.331052+0000","last_became_peered":"2023-12-07T10:01:51.331052+0000","last_unstale":"2023-12-07T10:01:52.382236+0000","last_undegraded":"2023-12-07T10:01:52.382236+0000","last_fullsized":"2023-12-07T10:01:52.382236+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.252793+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:01:51.252793+0000","last_peered":"2023-12-07T10:01:51.252793+0000","last_clean":"2023-12-07T10:01:51.252793+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:01:51.252793+0000","last_undegraded":"2023-12-07T10:01:51.252793+0000","last_fullsized":"2023-12-07T10:01:51.252793+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:05.118061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.238043+0000","last_change":"2023-12-07T10:01:51.321279+0000","last_active":"2023-12-07T10:01:52.238043+0000","last_peered":"2023-12-07T10:01:52.238043+0000","last_clean":"2023-12-07T10:01:52.238043+0000","last_became_active":"2023-12-07T10:01:51.320929+0000","last_became_peered":"2023-12-07T10:01:51.320929+0000","last_unstale":"2023-12-07T10:01:52.238043+0000","last_undegraded":"2023-12-07T10:01:52.238043+0000","last_fullsized":"2023-12-07T10:01:52.238043+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:27.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.250846+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:01:51.250846+0000","last_peered":"2023-12-07T10:01:51.250846+0000","last_clean":"2023-12-07T10:01:51.250846+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:01:51.250846+0000","last_undegraded":"2023-12-07T10:01:51.250846+0000","last_fullsized":"2023-12-07T10:01:51.250846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381883+0000","last_change":"2023-12-07T10:01:51.237367+0000","last_active":"2023-12-07T10:01:52.381883+0000","last_peered":"2023-12-07T10:01:52.381883+0000","last_clean":"2023-12-07T10:01:52.381883+0000","last_became_active":"2023-12-07T10:01:51.237071+0000","last_became_peered":"2023-12-07T10:01:51.237071+0000","last_unstale":"2023-12-07T10:01:52.381883+0000","last_undegraded":"2023-12-07T10:01:52.381883+0000","last_fullsized":"2023-12-07T10:01:52.381883+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:19:49.846073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.332926+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:01:51.332926+0000","last_peered":"2023-12-07T10:01:51.332926+0000","last_clean":"2023-12-07T10:01:51.332926+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:01:51.332926+0000","last_undegraded":"2023-12-07T10:01:51.332926+0000","last_fullsized":"2023-12-07T10:01:51.332926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236574+0000","last_change":"2023-12-07T10:01:51.318661+0000","last_active":"2023-12-07T10:01:52.236574+0000","last_peered":"2023-12-07T10:01:52.236574+0000","last_clean":"2023-12-07T10:01:52.236574+0000","last_became_active":"2023-12-07T10:01:51.318360+0000","last_became_peered":"2023-12-07T10:01:51.318360+0000","last_unstale":"2023-12-07T10:01:52.236574+0000","last_undegraded":"2023-12-07T10:01:52.236574+0000","last_fullsized":"2023-12-07T10:01:52.236574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.331748+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:01:51.331748+0000","last_peered":"2023-12-07T10:01:51.331748+0000","last_clean":"2023-12-07T10:01:51.331748+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:01:51.331748+0000","last_undegraded":"2023-12-07T10:01:51.331748+0000","last_fullsized":"2023-12-07T10:01:51.331748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236807+0000","last_change":"2023-12-07T10:01:51.322420+0000","last_active":"2023-12-07T10:01:52.236807+0000","last_peered":"2023-12-07T10:01:52.236807+0000","last_clean":"2023-12-07T10:01:52.236807+0000","last_became_active":"2023-12-07T10:01:51.322145+0000","last_became_peered":"2023-12-07T10:01:51.322145+0000","last_unstale":"2023-12-07T10:01:52.236807+0000","last_undegraded":"2023-12-07T10:01:52.236807+0000","last_fullsized":"2023-12-07T10:01:52.236807+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.227596+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:01:51.227596+0000","last_peered":"2023-12-07T10:01:51.227596+0000","last_clean":"2023-12-07T10:01:51.227596+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:01:51.227596+0000","last_undegraded":"2023-12-07T10:01:51.227596+0000","last_fullsized":"2023-12-07T10:01:51.227596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:34.570378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.235113+0000","last_change":"2023-12-07T10:01:51.320957+0000","last_active":"2023-12-07T10:01:52.235113+0000","last_peered":"2023-12-07T10:01:52.235113+0000","last_clean":"2023-12-07T10:01:52.235113+0000","last_became_active":"2023-12-07T10:01:51.320671+0000","last_became_peered":"2023-12-07T10:01:51.320671+0000","last_unstale":"2023-12-07T10:01:52.235113+0000","last_undegraded":"2023-12-07T10:01:52.235113+0000","last_fullsized":"2023-12-07T10:01:52.235113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:10:48.731402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.229767+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:01:51.229767+0000","last_peered":"2023-12-07T10:01:51.229767+0000","last_clean":"2023-12-07T10:01:51.229767+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:01:51.229767+0000","last_undegraded":"2023-12-07T10:01:51.229767+0000","last_fullsized":"2023-12-07T10:01:51.229767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:49.235834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.235496+0000","last_change":"2023-12-07T10:01:51.237604+0000","last_active":"2023-12-07T10:01:52.235496+0000","last_peered":"2023-12-07T10:01:52.235496+0000","last_clean":"2023-12-07T10:01:52.235496+0000","last_became_active":"2023-12-07T10:01:51.237282+0000","last_became_peered":"2023-12-07T10:01:51.237282+0000","last_unstale":"2023-12-07T10:01:52.235496+0000","last_undegraded":"2023-12-07T10:01:52.235496+0000","last_fullsized":"2023-12-07T10:01:52.235496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:25.535134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.320902+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:01:51.320902+0000","last_peered":"2023-12-07T10:01:51.320902+0000","last_clean":"2023-12-07T10:01:51.320902+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:01:51.320902+0000","last_undegraded":"2023-12-07T10:01:51.320902+0000","last_fullsized":"2023-12-07T10:01:51.320902+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382760+0000","last_change":"2023-12-07T10:01:51.329179+0000","last_active":"2023-12-07T10:01:52.382760+0000","last_peered":"2023-12-07T10:01:52.382760+0000","last_clean":"2023-12-07T10:01:52.382760+0000","last_became_active":"2023-12-07T10:01:51.328872+0000","last_became_peered":"2023-12-07T10:01:51.328872+0000","last_unstale":"2023-12-07T10:01:52.382760+0000","last_undegraded":"2023-12-07T10:01:52.382760+0000","last_fullsized":"2023-12-07T10:01:52.382760+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.320807+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:01:51.320807+0000","last_peered":"2023-12-07T10:01:51.320807+0000","last_clean":"2023-12-07T10:01:51.320807+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:01:51.320807+0000","last_undegraded":"2023-12-07T10:01:51.320807+0000","last_fullsized":"2023-12-07T10:01:51.320807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382026+0000","last_change":"2023-12-07T10:01:51.335097+0000","last_active":"2023-12-07T10:01:52.382026+0000","last_peered":"2023-12-07T10:01:52.382026+0000","last_clean":"2023-12-07T10:01:52.382026+0000","last_became_active":"2023-12-07T10:01:51.334754+0000","last_became_peered":"2023-12-07T10:01:51.334754+0000","last_unstale":"2023-12-07T10:01:52.382026+0000","last_undegraded":"2023-12-07T10:01:52.382026+0000","last_fullsized":"2023-12-07T10:01:52.382026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"66'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.338075+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:01:51.338075+0000","last_peered":"2023-12-07T10:01:51.338075+0000","last_clean":"2023-12-07T10:01:51.338075+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:01:51.338075+0000","last_undegraded":"2023-12-07T10:01:51.338075+0000","last_fullsized":"2023-12-07T10:01:51.338075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236854+0000","last_change":"2023-12-07T10:01:51.321371+0000","last_active":"2023-12-07T10:01:52.236854+0000","last_peered":"2023-12-07T10:01:52.236854+0000","last_clean":"2023-12-07T10:01:52.236854+0000","last_became_active":"2023-12-07T10:01:51.321032+0000","last_became_peered":"2023-12-07T10:01:51.321032+0000","last_unstale":"2023-12-07T10:01:52.236854+0000","last_undegraded":"2023-12-07T10:01:52.236854+0000","last_fullsized":"2023-12-07T10:01:52.236854+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"66'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.338070+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:01:51.338070+0000","last_peered":"2023-12-07T10:01:51.338070+0000","last_clean":"2023-12-07T10:01:51.338070+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:01:51.338070+0000","last_undegraded":"2023-12-07T10:01:51.338070+0000","last_fullsized":"2023-12-07T10:01:51.338070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381233+0000","last_change":"2023-12-07T10:01:51.329045+0000","last_active":"2023-12-07T10:01:52.381233+0000","last_peered":"2023-12-07T10:01:52.381233+0000","last_clean":"2023-12-07T10:01:52.381233+0000","last_became_active":"2023-12-07T10:01:51.328657+0000","last_became_peered":"2023-12-07T10:01:51.328657+0000","last_unstale":"2023-12-07T10:01:52.381233+0000","last_undegraded":"2023-12-07T10:01:52.381233+0000","last_fullsized":"2023-12-07T10:01:52.381233+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.252767+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:01:51.252767+0000","last_peered":"2023-12-07T10:01:51.252767+0000","last_clean":"2023-12-07T10:01:51.252767+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:01:51.252767+0000","last_undegraded":"2023-12-07T10:01:51.252767+0000","last_fullsized":"2023-12-07T10:01:51.252767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237878+0000","last_change":"2023-12-07T10:01:51.321900+0000","last_active":"2023-12-07T10:01:52.237878+0000","last_peered":"2023-12-07T10:01:52.237878+0000","last_clean":"2023-12-07T10:01:52.237878+0000","last_became_active":"2023-12-07T10:01:51.321602+0000","last_became_peered":"2023-12-07T10:01:51.321602+0000","last_unstale":"2023-12-07T10:01:52.237878+0000","last_undegraded":"2023-12-07T10:01:52.237878+0000","last_fullsized":"2023-12-07T10:01:52.237878+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.228286+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:01:51.228286+0000","last_peered":"2023-12-07T10:01:51.228286+0000","last_clean":"2023-12-07T10:01:51.228286+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:01:51.228286+0000","last_undegraded":"2023-12-07T10:01:51.228286+0000","last_fullsized":"2023-12-07T10:01:51.228286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:04:12.916038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381249+0000","last_change":"2023-12-07T10:01:51.235277+0000","last_active":"2023-12-07T10:01:52.381249+0000","last_peered":"2023-12-07T10:01:52.381249+0000","last_clean":"2023-12-07T10:01:52.381249+0000","last_became_active":"2023-12-07T10:01:51.234826+0000","last_became_peered":"2023-12-07T10:01:51.234826+0000","last_unstale":"2023-12-07T10:01:52.381249+0000","last_undegraded":"2023-12-07T10:01:52.381249+0000","last_fullsized":"2023-12-07T10:01:52.381249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:32.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.314843+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:01:51.314843+0000","last_peered":"2023-12-07T10:01:51.314843+0000","last_clean":"2023-12-07T10:01:51.314843+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:01:51.314843+0000","last_undegraded":"2023-12-07T10:01:51.314843+0000","last_fullsized":"2023-12-07T10:01:51.314843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381346+0000","last_change":"2023-12-07T10:01:51.329007+0000","last_active":"2023-12-07T10:01:52.381346+0000","last_peered":"2023-12-07T10:01:52.381346+0000","last_clean":"2023-12-07T10:01:52.381346+0000","last_became_active":"2023-12-07T10:01:51.328735+0000","last_became_peered":"2023-12-07T10:01:51.328735+0000","last_unstale":"2023-12-07T10:01:52.381346+0000","last_undegraded":"2023-12-07T10:01:52.381346+0000","last_fullsized":"2023-12-07T10:01:52.381346+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:03.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"66'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.325127+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:01:51.325127+0000","last_peered":"2023-12-07T10:01:51.325127+0000","last_clean":"2023-12-07T10:01:51.325127+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:01:51.325127+0000","last_undegraded":"2023-12-07T10:01:51.325127+0000","last_fullsized":"2023-12-07T10:01:51.325127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:09.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.238118+0000","last_change":"2023-12-07T10:01:51.327799+0000","last_active":"2023-12-07T10:01:52.238118+0000","last_peered":"2023-12-07T10:01:52.238118+0000","last_clean":"2023-12-07T10:01:52.238118+0000","last_became_active":"2023-12-07T10:01:51.326731+0000","last_became_peered":"2023-12-07T10:01:51.326731+0000","last_unstale":"2023-12-07T10:01:52.238118+0000","last_undegraded":"2023-12-07T10:01:52.238118+0000","last_fullsized":"2023-12-07T10:01:52.238118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:04.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.339280+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:01:51.339280+0000","last_peered":"2023-12-07T10:01:51.339280+0000","last_clean":"2023-12-07T10:01:51.339280+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:01:51.339280+0000","last_undegraded":"2023-12-07T10:01:51.339280+0000","last_fullsized":"2023-12-07T10:01:51.339280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382784+0000","last_change":"2023-12-07T10:01:51.328493+0000","last_active":"2023-12-07T10:01:52.382784+0000","last_peered":"2023-12-07T10:01:52.382784+0000","last_clean":"2023-12-07T10:01:52.382784+0000","last_became_active":"2023-12-07T10:01:51.328019+0000","last_became_peered":"2023-12-07T10:01:51.328019+0000","last_unstale":"2023-12-07T10:01:52.382784+0000","last_undegraded":"2023-12-07T10:01:52.382784+0000","last_fullsized":"2023-12-07T10:01:52.382784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:24:21.334700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.328344+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:01:51.328344+0000","last_peered":"2023-12-07T10:01:51.328344+0000","last_clean":"2023-12-07T10:01:51.328344+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:01:51.328344+0000","last_undegraded":"2023-12-07T10:01:51.328344+0000","last_fullsized":"2023-12-07T10:01:51.328344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:56.735390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237130+0000","last_change":"2023-12-07T10:01:51.327301+0000","last_active":"2023-12-07T10:01:52.237130+0000","last_peered":"2023-12-07T10:01:52.237130+0000","last_clean":"2023-12-07T10:01:52.237130+0000","last_became_active":"2023-12-07T10:01:51.325806+0000","last_became_peered":"2023-12-07T10:01:51.325806+0000","last_unstale":"2023-12-07T10:01:52.237130+0000","last_undegraded":"2023-12-07T10:01:52.237130+0000","last_fullsized":"2023-12-07T10:01:52.237130+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.229560+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:01:51.229560+0000","last_peered":"2023-12-07T10:01:51.229560+0000","last_clean":"2023-12-07T10:01:51.229560+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:01:51.229560+0000","last_undegraded":"2023-12-07T10:01:51.229560+0000","last_fullsized":"2023-12-07T10:01:51.229560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:10.226808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381910+0000","last_change":"2023-12-07T10:01:51.239742+0000","last_active":"2023-12-07T10:01:52.381910+0000","last_peered":"2023-12-07T10:01:52.381910+0000","last_clean":"2023-12-07T10:01:52.381910+0000","last_became_active":"2023-12-07T10:01:51.239468+0000","last_became_peered":"2023-12-07T10:01:51.239468+0000","last_unstale":"2023-12-07T10:01:52.381910+0000","last_undegraded":"2023-12-07T10:01:52.381910+0000","last_fullsized":"2023-12-07T10:01:52.381910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:16.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.249776+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:01:51.249776+0000","last_peered":"2023-12-07T10:01:51.249776+0000","last_clean":"2023-12-07T10:01:51.249776+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:01:51.249776+0000","last_undegraded":"2023-12-07T10:01:51.249776+0000","last_fullsized":"2023-12-07T10:01:51.249776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:47.055302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382071+0000","last_change":"2023-12-07T10:01:51.323608+0000","last_active":"2023-12-07T10:01:52.382071+0000","last_peered":"2023-12-07T10:01:52.382071+0000","last_clean":"2023-12-07T10:01:52.382071+0000","last_became_active":"2023-12-07T10:01:51.323254+0000","last_became_peered":"2023-12-07T10:01:51.323254+0000","last_unstale":"2023-12-07T10:01:52.382071+0000","last_undegraded":"2023-12-07T10:01:52.382071+0000","last_fullsized":"2023-12-07T10:01:52.382071+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.221584+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:01:51.221584+0000","last_peered":"2023-12-07T10:01:51.221584+0000","last_clean":"2023-12-07T10:01:51.221584+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:01:51.221584+0000","last_undegraded":"2023-12-07T10:01:51.221584+0000","last_fullsized":"2023-12-07T10:01:51.221584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:55.751747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381731+0000","last_change":"2023-12-07T10:01:51.327531+0000","last_active":"2023-12-07T10:01:52.381731+0000","last_peered":"2023-12-07T10:01:52.381731+0000","last_clean":"2023-12-07T10:01:52.381731+0000","last_became_active":"2023-12-07T10:01:51.326982+0000","last_became_peered":"2023-12-07T10:01:51.326982+0000","last_unstale":"2023-12-07T10:01:52.381731+0000","last_undegraded":"2023-12-07T10:01:52.381731+0000","last_fullsized":"2023-12-07T10:01:52.381731+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:37.353658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.220644+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:01:51.220644+0000","last_peered":"2023-12-07T10:01:51.220644+0000","last_clean":"2023-12-07T10:01:51.220644+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:01:51.220644+0000","last_undegraded":"2023-12-07T10:01:51.220644+0000","last_fullsized":"2023-12-07T10:01:51.220644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:19.396813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381809+0000","last_change":"2023-12-07T10:01:51.322653+0000","last_active":"2023-12-07T10:01:52.381809+0000","last_peered":"2023-12-07T10:01:52.381809+0000","last_clean":"2023-12-07T10:01:52.381809+0000","last_became_active":"2023-12-07T10:01:51.322160+0000","last_became_peered":"2023-12-07T10:01:51.322160+0000","last_unstale":"2023-12-07T10:01:52.381809+0000","last_undegraded":"2023-12-07T10:01:52.381809+0000","last_fullsized":"2023-12-07T10:01:52.381809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:57.285100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.229420+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:01:51.229420+0000","last_peered":"2023-12-07T10:01:51.229420+0000","last_clean":"2023-12-07T10:01:51.229420+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:01:51.229420+0000","last_undegraded":"2023-12-07T10:01:51.229420+0000","last_fullsized":"2023-12-07T10:01:51.229420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:20.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237483+0000","last_change":"2023-12-07T10:01:51.328470+0000","last_active":"2023-12-07T10:01:52.237483+0000","last_peered":"2023-12-07T10:01:52.237483+0000","last_clean":"2023-12-07T10:01:52.237483+0000","last_became_active":"2023-12-07T10:01:51.328195+0000","last_became_peered":"2023-12-07T10:01:51.328195+0000","last_unstale":"2023-12-07T10:01:52.237483+0000","last_undegraded":"2023-12-07T10:01:52.237483+0000","last_fullsized":"2023-12-07T10:01:52.237483+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.325990+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:01:51.325990+0000","last_peered":"2023-12-07T10:01:51.325990+0000","last_clean":"2023-12-07T10:01:51.325990+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:01:51.325990+0000","last_undegraded":"2023-12-07T10:01:51.325990+0000","last_fullsized":"2023-12-07T10:01:51.325990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.238220+0000","last_change":"2023-12-07T10:01:51.330147+0000","last_active":"2023-12-07T10:01:52.238220+0000","last_peered":"2023-12-07T10:01:52.238220+0000","last_clean":"2023-12-07T10:01:52.238220+0000","last_became_active":"2023-12-07T10:01:51.329786+0000","last_became_peered":"2023-12-07T10:01:51.329786+0000","last_unstale":"2023-12-07T10:01:52.238220+0000","last_undegraded":"2023-12-07T10:01:52.238220+0000","last_fullsized":"2023-12-07T10:01:52.238220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:16.697908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382709+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:01:52.382709+0000","last_peered":"2023-12-07T10:01:52.382709+0000","last_clean":"2023-12-07T10:01:52.382709+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:01:52.382709+0000","last_undegraded":"2023-12-07T10:01:52.382709+0000","last_fullsized":"2023-12-07T10:01:52.382709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382398+0000","last_change":"2023-12-07T10:01:51.331632+0000","last_active":"2023-12-07T10:01:52.382398+0000","last_peered":"2023-12-07T10:01:52.382398+0000","last_clean":"2023-12-07T10:01:52.382398+0000","last_became_active":"2023-12-07T10:01:51.331353+0000","last_became_peered":"2023-12-07T10:01:51.331353+0000","last_unstale":"2023-12-07T10:01:52.382398+0000","last_undegraded":"2023-12-07T10:01:52.382398+0000","last_fullsized":"2023-12-07T10:01:52.382398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.320486+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:01:51.320486+0000","last_peered":"2023-12-07T10:01:51.320486+0000","last_clean":"2023-12-07T10:01:51.320486+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:01:51.320486+0000","last_undegraded":"2023-12-07T10:01:51.320486+0000","last_fullsized":"2023-12-07T10:01:51.320486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.237249+0000","last_change":"2023-12-07T10:01:51.319139+0000","last_active":"2023-12-07T10:01:52.237249+0000","last_peered":"2023-12-07T10:01:52.237249+0000","last_clean":"2023-12-07T10:01:52.237249+0000","last_became_active":"2023-12-07T10:01:51.318844+0000","last_became_peered":"2023-12-07T10:01:51.318844+0000","last_unstale":"2023-12-07T10:01:52.237249+0000","last_undegraded":"2023-12-07T10:01:52.237249+0000","last_fullsized":"2023-12-07T10:01:52.237249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.323321+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:01:51.323321+0000","last_peered":"2023-12-07T10:01:51.323321+0000","last_clean":"2023-12-07T10:01:51.323321+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:01:51.323321+0000","last_undegraded":"2023-12-07T10:01:51.323321+0000","last_fullsized":"2023-12-07T10:01:51.323321+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382246+0000","last_change":"2023-12-07T10:01:51.329016+0000","last_active":"2023-12-07T10:01:52.382246+0000","last_peered":"2023-12-07T10:01:52.382246+0000","last_clean":"2023-12-07T10:01:52.382246+0000","last_became_active":"2023-12-07T10:01:51.327629+0000","last_became_peered":"2023-12-07T10:01:51.327629+0000","last_unstale":"2023-12-07T10:01:52.382246+0000","last_undegraded":"2023-12-07T10:01:52.382246+0000","last_fullsized":"2023-12-07T10:01:52.382246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.227986+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:01:51.227986+0000","last_peered":"2023-12-07T10:01:51.227986+0000","last_clean":"2023-12-07T10:01:51.227986+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:01:51.227986+0000","last_undegraded":"2023-12-07T10:01:51.227986+0000","last_fullsized":"2023-12-07T10:01:51.227986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:07.169353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.381662+0000","last_change":"2023-12-07T10:01:51.329122+0000","last_active":"2023-12-07T10:01:52.381662+0000","last_peered":"2023-12-07T10:01:52.381662+0000","last_clean":"2023-12-07T10:01:52.381662+0000","last_became_active":"2023-12-07T10:01:51.328758+0000","last_became_peered":"2023-12-07T10:01:51.328758+0000","last_unstale":"2023-12-07T10:01:52.381662+0000","last_undegraded":"2023-12-07T10:01:52.381662+0000","last_fullsized":"2023-12-07T10:01:52.381662+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.312473+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:01:51.312473+0000","last_peered":"2023-12-07T10:01:51.312473+0000","last_clean":"2023-12-07T10:01:51.312473+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:01:51.312473+0000","last_undegraded":"2023-12-07T10:01:51.312473+0000","last_fullsized":"2023-12-07T10:01:51.312473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.236882+0000","last_change":"2023-12-07T10:01:51.322885+0000","last_active":"2023-12-07T10:01:52.236882+0000","last_peered":"2023-12-07T10:01:52.236882+0000","last_clean":"2023-12-07T10:01:52.236882+0000","last_became_active":"2023-12-07T10:01:51.322135+0000","last_became_peered":"2023-12-07T10:01:51.322135+0000","last_unstale":"2023-12-07T10:01:52.236882+0000","last_undegraded":"2023-12-07T10:01:52.236882+0000","last_fullsized":"2023-12-07T10:01:52.236882+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.316023+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:01:51.316023+0000","last_peered":"2023-12-07T10:01:51.316023+0000","last_clean":"2023-12-07T10:01:51.316023+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:01:51.316023+0000","last_undegraded":"2023-12-07T10:01:51.316023+0000","last_fullsized":"2023-12-07T10:01:51.316023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:56.460325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382508+0000","last_change":"2023-12-07T10:01:51.332156+0000","last_active":"2023-12-07T10:01:52.382508+0000","last_peered":"2023-12-07T10:01:52.382508+0000","last_clean":"2023-12-07T10:01:52.382508+0000","last_became_active":"2023-12-07T10:01:51.331807+0000","last_became_peered":"2023-12-07T10:01:51.331807+0000","last_unstale":"2023-12-07T10:01:52.382508+0000","last_undegraded":"2023-12-07T10:01:52.382508+0000","last_fullsized":"2023-12-07T10:01:52.382508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.317270+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:01:51.317270+0000","last_peered":"2023-12-07T10:01:51.317270+0000","last_clean":"2023-12-07T10:01:51.317270+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:01:51.317270+0000","last_undegraded":"2023-12-07T10:01:51.317270+0000","last_fullsized":"2023-12-07T10:01:51.317270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-07T10:01:52.382314+0000","last_change":"2023-12-07T10:01:51.330158+0000","last_active":"2023-12-07T10:01:52.382314+0000","last_peered":"2023-12-07T10:01:52.382314+0000","last_clean":"2023-12-07T10:01:52.382314+0000","last_became_active":"2023-12-07T10:01:51.329812+0000","last_became_peered":"2023-12-07T10:01:51.329812+0000","last_unstale":"2023-12-07T10:01:52.382314+0000","last_undegraded":"2023-12-07T10:01:52.382314+0000","last_fullsized":"2023-12-07T10:01:52.382314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:08:38.276890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.332214+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:01:51.332214+0000","last_peered":"2023-12-07T10:01:51.332214+0000","last_clean":"2023-12-07T10:01:51.332214+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:01:51.332214+0000","last_undegraded":"2023-12-07T10:01:51.332214+0000","last_fullsized":"2023-12-07T10:01:51.332214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-07T10:01:51.222788+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:01:51.222788+0000","last_peered":"2023-12-07T10:01:51.222788+0000","last_clean":"2023-12-07T10:01:51.222788+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:01:51.222788+0000","last_undegraded":"2023-12-07T10:01:51.222788+0000","last_fullsized":"2023-12-07T10:01:51.222788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":949388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93500000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.86899999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.008},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":359644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94299999999999995,"5min":1.387,"15min":1.387},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82099999999999995,"5min":1.26,"15min":1.26},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96199999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":1.649,"15min":1.649},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":1.633,"15min":1.633},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":1.095,"15min":1.095},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90900000000000003,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.014,"5min":1.431,"15min":1.431},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.998,"15min":0.998},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":360584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82699999999999996,"5min":0.88,"15min":0.88},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83799999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.48499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.501}]},{"osd":2,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52900000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.90400000000000003,"5min":1.248,"15min":1.248},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.435,"15min":0.435},"max":{"1min":0.84599999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.747}]},{"osd":7,"last update":"Thu Dec 7 10:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.625,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":358950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.83199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.87,"15min":0.87},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85399999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":1.091,"15min":1.091},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":1.079,"15min":1.079},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84699999999999998,"5min":1.274,"15min":1.274},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82699999999999996,"5min":1.306,"15min":1.306},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89400000000000002,"5min":1.149,"15min":1.149},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.78700000000000003,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80600000000000005,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":360562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.61799999999999999,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57499999999999996,"5min":5.516,"15min":5.516},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.54000000000000004,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.51000000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.57099999999999995,"5min":1.464,"15min":1.464},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.488,"15min":1.488},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59999999999999998,"15min":0.623},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.60999999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64300000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.495,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93700000000000006,"5min":1.599,"15min":1.599},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96699999999999997,"5min":4.617,"15min":4.617},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.80800000000000005,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0069999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.012,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.872,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84699999999999998,"15min":0.86499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92500000000000004,"5min":3.468,"15min":3.468},"last":0.504},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":359532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.93400000000000005,"15min":1.02},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.80900000000000005,"5min":13.016,"15min":13.016},"last":0.434}]},{"osd":1,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.81000000000000005,"15min":0.872},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65900000000000003,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":1.0580000000000001,"15min":1.1559999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68300000000000005,"5min":13.166,"15min":13.166},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.92600000000000005,"15min":1.0069999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68300000000000005,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.0920000000000001,"15min":1.1599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0429999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":1.042,"15min":1.1000000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0900000000000001,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.1539999999999999,"15min":1.2250000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.143,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.0660000000000001,"15min":1.1240000000000001},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":5.75,"15min":5.75},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1830000000000001,"15min":1.2589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.748,"5min":1.0589999999999999,"15min":1.111},"min":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.298,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":359144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51400000000000001,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.53700000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.374}]},{"osd":3,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61899999999999999,"5min":0.87,"15min":0.87},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":1.01,"15min":1.01},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98699999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.877,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":949352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80400000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.64900000000000002,"15min":0.68000000000000005},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89700000000000002,"5min":4.173,"15min":4.173},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.44}]},{"osd":3,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.81699999999999995,"15min":0.86599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0349999999999999,"5min":6.048,"15min":6.048},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0249999999999999,"5min":1.266,"15min":1.266},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97699999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.751,"15min":0.75},"min":{"1min":0.58999999999999997,"5min":0.495,"15min":0.495},"max":{"1min":0.95199999999999996,"5min":1.046,"15min":1.046},"last":1.248},{"interface":"front","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96099999999999997,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.004}]},{"osd":6,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.54500000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0860000000000001,"5min":2.456,"15min":2.456},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1240000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.23}]},{"osd":7,"last update":"Thu Dec 7 10:01:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95199999999999996,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.099,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.133},{"interface":"front","average":{"1min":0.746,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:00.152 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T10:02:00.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-07T10:02:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 Processor -- start 2023-12-07T10:02:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 -- start start 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad840c6220 0x7fad84158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad84151bf0 0x7fad84152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84158580 con 0x7fad840c13a0 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840c2fd0 con 0x7fad840c6220 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad89965640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad84157f50 con 0x7fad84151bf0 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad82ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad840c6220 0x7fad84158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad827fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fad840c13a0 0x7fad840c28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55150/0 (socket says 172.21.15.89:55150) 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad827fc640 1 -- 172.21.15.89:0/703049762 learned_addr learned my addr 172.21.15.89:0/703049762 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad837fe640 1 --2- 172.21.15.89:0/703049762 >> v2:172.21.15.97:3300/0 conn(0x7fad84151bf0 0x7fad84152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad82ffd640 1 -- 172.21.15.89:0/703049762 >> v2:172.21.15.97:3300/0 conn(0x7fad84151bf0 msgr2=0x7fad84152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad82ffd640 1 --2- 172.21.15.89:0/703049762 >> v2:172.21.15.97:3300/0 conn(0x7fad84151bf0 0x7fad84152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad82ffd640 1 -- 172.21.15.89:0/703049762 >> v1:172.21.15.89:6789/0 conn(0x7fad840c13a0 legacy=0x7fad840c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad82ffd640 1 -- 172.21.15.89:0/703049762 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840c1f60 con 0x7fad840c6220 2023-12-07T10:02:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad837fe640 1 --2- 172.21.15.89:0/703049762 >> v2:172.21.15.97:3300/0 conn(0x7fad84151bf0 0x7fad84152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.332+0000 7fad81ffb640 1 -- 172.21.15.89:0/703049762 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220887412 0 0) 0x7fad84158580 con 0x7fad840c13a0 2023-12-07T10:02:00.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad82ffd640 1 --2- 172.21.15.89:0/703049762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad84158a10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fad8406d950 tx=0x7fad7401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43235771fdf7e86b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:00.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad81ffb640 1 -- 172.21.15.89:0/703049762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740a7070 con 0x7fad840c6220 2023-12-07T10:02:00.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad81ffb640 1 -- 172.21.15.89:0/703049762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740ab430 con 0x7fad840c6220 2023-12-07T10:02:00.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad81ffb640 1 -- 172.21.15.89:0/703049762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740ab7c0 con 0x7fad840c6220 2023-12-07T10:02:00.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 -- 172.21.15.89:0/703049762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 msgr2=0x7fad84158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 --2- 172.21.15.89:0/703049762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad84158a10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fad8406d950 tx=0x7fad7401c430 comp rx=0 tx=0).stop 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 -- 172.21.15.89:0/703049762 shutdown_connections 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 --2- 172.21.15.89:0/703049762 >> v2:172.21.15.97:3300/0 conn(0x7fad84151bf0 0x7fad84152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 --2- 172.21.15.89:0/703049762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad84158a10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 -- 172.21.15.89:0/703049762 >> 172.21.15.89:0/703049762 conn(0x7fad8406a5a0 msgr2=0x7fad8406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 -- 172.21.15.89:0/703049762 shutdown_connections 2023-12-07T10:02:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.336+0000 7fad89965640 1 -- 172.21.15.89:0/703049762 wait complete. 2023-12-07T10:02:00.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 Processor -- start 2023-12-07T10:02:00.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 -- start start 2023-12-07T10:02:00.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad840c13a0 0x7fad84150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad841f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad84151bf0 0x7fad8414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8414c040 con 0x7fad840c6220 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8414bda0 con 0x7fad840c13a0 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840ada00 con 0x7fad84151bf0 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad82ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad840c13a0 0x7fad84150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad841f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad841f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56948/0 (socket says 172.21.15.89:56948) 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 -- 172.21.15.89:0/3534573784 learned_addr learned my addr 172.21.15.89:0/3534573784 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad82ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad840c13a0 0x7fad84150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:37040/0 (socket says 172.21.15.89:37040) 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad837fe640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad84151bf0 0x7fad8414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 -- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad84151bf0 msgr2=0x7fad8414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad84151bf0 0x7fad8414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 -- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad840c13a0 msgr2=0x7fad84150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad840c13a0 0x7fad84150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 -- 172.21.15.89:0/3534573784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74009420 con 0x7fad840c6220 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad827fc640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad841f0120 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fad780010f0 tx=0x7fad7800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78007270 con 0x7fad840c6220 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780073d0 con 0x7fad840c6220 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780057b0 con 0x7fad840c6220 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad841efc00 con 0x7fad840c6220 2023-12-07T10:02:00.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.340+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad841556a0 con 0x7fad840c6220 2023-12-07T10:02:00.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.344+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad841efa60 con 0x7fad840c6220 2023-12-07T10:02:00.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.344+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad78005910 con 0x7fad840c6220 2023-12-07T10:02:00.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.344+0000 7fad6bfff640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad700668d0 0x7fad70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.344+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad780839c0 con 0x7fad840c6220 2023-12-07T10:02:00.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.344+0000 7fad82ffd640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad700668d0 0x7fad70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.344+0000 7fad82ffd640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad700668d0 0x7fad70068d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fad740af000 tx=0x7fad740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:00.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.348+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad841efa60 con 0x7fad840c6220 2023-12-07T10:02:00.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.556+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fad841efa60 con 0x7fad840c6220 2023-12-07T10:02:00.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad6bfff640 1 -- 172.21.15.89:0/3534573784 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fad841efa60 con 0x7fad840c6220 2023-12-07T10:02:00.564 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-07T10:02:00.564 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlJI0HFhAAawz1geprIl9oJtl0wiDCvg== 2023-12-07T10:02:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-12-07T10:02:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:02:00.565 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-07T10:02:00.565 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.0 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad700668d0 msgr2=0x7fad70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad700668d0 0x7fad70068d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fad740af000 tx=0x7fad740a7000 comp rx=0 tx=0).stop 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 msgr2=0x7fad841f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad841f0120 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fad780010f0 tx=0x7fad7800cbe0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 shutdown_connections 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fad700668d0 0x7fad70068d90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fad84151bf0 0x7fad8414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad840c6220 0x7fad841f0120 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 --2- 172.21.15.89:0/3534573784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad840c13a0 0x7fad84150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 >> 172.21.15.89:0/3534573784 conn(0x7fad8406a5a0 msgr2=0x7fad8414f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 shutdown_connections 2023-12-07T10:02:00.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.560+0000 7fad89965640 1 -- 172.21.15.89:0/3534573784 wait complete. 2023-12-07T10:02:00.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 Processor -- start 2023-12-07T10:02:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 -- start start 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf08158840 0x7faf080a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf0806ca30 0x7faf0806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080c77b0 con 0x7faf08155570 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080c7a90 con 0x7faf08158840 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf0d617640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0806c510 con 0x7faf0806ca30 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf08158840 0x7faf080a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf08158840 0x7faf080a6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56956/0 (socket says 172.21.15.89:56956) 2023-12-07T10:02:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 -- 172.21.15.89:0/464176525 learned_addr learned my addr 172.21.15.89:0/464176525 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:00.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf077fe640 1 --2- 172.21.15.89:0/464176525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf0806ca30 0x7faf0806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 -- 172.21.15.89:0/464176525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf0806ca30 msgr2=0x7faf0806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:00.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 --2- 172.21.15.89:0/464176525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf0806ca30 0x7faf0806ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 -- 172.21.15.89:0/464176525 >> v1:172.21.15.97:6789/0 conn(0x7faf08155570 legacy=0x7faf080c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.720+0000 7faf067fc640 1 -- 172.21.15.89:0/464176525 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0806c1a0 con 0x7faf08158840 2023-12-07T10:02:00.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf067fc640 1 --2- 172.21.15.89:0/464176525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf08158840 0x7faf080a6c90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c375bb60beede460 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:00.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf05ffb640 1 -- 172.21.15.89:0/464176525 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0ac640 con 0x7faf08158840 2023-12-07T10:02:00.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf05ffb640 1 -- 172.21.15.89:0/464176525 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0ac7a0 con 0x7faf08158840 2023-12-07T10:02:00.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf05ffb640 1 -- 172.21.15.89:0/464176525 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0acb30 con 0x7faf08158840 2023-12-07T10:02:00.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 -- 172.21.15.89:0/464176525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf08158840 msgr2=0x7faf080a6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 --2- 172.21.15.89:0/464176525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf08158840 0x7faf080a6c90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc01c4b0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 -- 172.21.15.89:0/464176525 shutdown_connections 2023-12-07T10:02:00.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 --2- 172.21.15.89:0/464176525 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf0806ca30 0x7faf0806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 --2- 172.21.15.89:0/464176525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf08158840 0x7faf080a6c90 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 -- 172.21.15.89:0/464176525 >> 172.21.15.89:0/464176525 conn(0x7faf080c7e60 msgr2=0x7faf080c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:00.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 -- 172.21.15.89:0/464176525 shutdown_connections 2023-12-07T10:02:00.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 -- 172.21.15.89:0/464176525 wait complete. 2023-12-07T10:02:00.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 Processor -- start 2023-12-07T10:02:00.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.724+0000 7faf0d617640 1 -- start start 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 0x7faf08154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf08155570 0x7faf081ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf08158840 0x7faf0814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080ab710 con 0x7faf0806ca30 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080add50 con 0x7faf08155570 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080c35f0 con 0x7faf08158840 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 0x7faf08154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf067fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf08155570 0x7faf081ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 0x7faf08154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56968/0 (socket says 172.21.15.89:56968) 2023-12-07T10:02:00.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 -- 172.21.15.89:0/465542788 learned_addr learned my addr 172.21.15.89:0/465542788 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:00.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf077fe640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf08158840 0x7faf0814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 -- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf08158840 msgr2=0x7faf0814eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf08158840 0x7faf0814eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 -- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf08155570 msgr2=0x7faf081ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf08155570 0x7faf081ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 -- 172.21.15.89:0/465542788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0094d0 con 0x7faf0806ca30 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf06ffd640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 0x7faf08154640 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faef800c500 tx=0x7faef800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8005220 con 0x7faf0806ca30 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8005380 con 0x7faf0806ca30 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8007270 con 0x7faf0806ca30 2023-12-07T10:02:00.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf080ada70 con 0x7faf0806ca30 2023-12-07T10:02:00.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf080c4d30 con 0x7faf0806ca30 2023-12-07T10:02:00.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.728+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf080a99e0 con 0x7faf0806ca30 2023-12-07T10:02:00.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.732+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faef80073d0 con 0x7faf0806ca30 2023-12-07T10:02:00.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.732+0000 7faeef7fe640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:00.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.732+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faef8083780 con 0x7faf0806ca30 2023-12-07T10:02:00.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.732+0000 7faf067fc640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:00.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.732+0000 7faf067fc640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ae000 tx=0x7faefc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.736+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faef80509e0 con 0x7faf0806ca30 2023-12-07T10:02:00.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf0804e890 con 0x7faf0806ca30 2023-12-07T10:02:00.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faeef7fe640 1 -- 172.21.15.89:0/465542788 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4915 (secure 0 0 0) 0x7faef8054000 con 0x7faf0806ca30 2023-12-07T10:02:00.920 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:00.920 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-07T10:02:00.920 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 48 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 msgr2=0x7faef4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ae000 tx=0x7faefc0a7000 comp rx=0 tx=0).stop 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 msgr2=0x7faf08154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 0x7faf08154640 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faef800c500 tx=0x7faef800c9c0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 shutdown_connections 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7faef40668d0 0x7faef4068d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faf08158840 0x7faf0814eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf08155570 0x7faf081ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 --2- 172.21.15.89:0/465542788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0806ca30 0x7faf08154640 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:00.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 >> 172.21.15.89:0/465542788 conn(0x7faf080c7e60 msgr2=0x7faf080a9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:00.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 shutdown_connections 2023-12-07T10:02:00.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:00.916+0000 7faf0d617640 1 -- 172.21.15.89:0/465542788 wait complete. 2023-12-07T10:02:01.343 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T10:01:50.597494+0000', 'modified': '2023-12-07T10:01:53.613494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6561}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6561': {'gid': 6561, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6836/3031036225', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 3031036225}, {'type': 'v1', 'addr': '172.21.15.89:6836', 'nonce': 3031036225}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-07T10:02:01.343 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T10:02:01.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-07T10:02:01.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01ad0c9640 1 Processor -- start 2023-12-07T10:02:01.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01ad0c9640 1 -- start start 2023-12-07T10:02:01.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01ad0c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a814ea60 0x7f01a8155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01ad0c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a806c440 con 0x7f01a806bd00 2023-12-07T10:02:01.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01ad0c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a8154790 con 0x7f01a80bf400 2023-12-07T10:02:01.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01ad0c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a806c6e0 con 0x7f01a814ea60 2023-12-07T10:02:01.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01a659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f01a806bd00 0x7f01a80700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55162/0 (socket says 172.21.15.89:55162) 2023-12-07T10:02:01.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01a659c640 1 -- 172.21.15.89:0/2950142104 learned_addr learned my addr 172.21.15.89:0/2950142104 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:01.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.480+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/2950142104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a814ea60 0x7f01a8155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a5d9b640 1 -- 172.21.15.89:0/2950142104 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038557511 0 0) 0x7f01a806c440 con 0x7f01a806bd00 2023-12-07T10:02:01.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a5d9b640 1 -- 172.21.15.89:0/2950142104 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0190003530 con 0x7f01a806bd00 2023-12-07T10:02:01.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a6d9d640 1 -- 172.21.15.89:0/2950142104 >> v1:172.21.15.97:6789/0 conn(0x7f01a80bf400 legacy=0x7f01a80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a6d9d640 1 -- 172.21.15.89:0/2950142104 >> v1:172.21.15.89:6789/0 conn(0x7f01a806bd00 legacy=0x7f01a80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a6d9d640 1 -- 172.21.15.89:0/2950142104 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8154a50 con 0x7f01a814ea60 2023-12-07T10:02:01.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/2950142104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a814ea60 0x7f01a8155250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01980097f0 tx=0x7f019801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2871072107529f52 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a5d9b640 1 -- 172.21.15.89:0/2950142104 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980a8050 con 0x7f01a814ea60 2023-12-07T10:02:01.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a5d9b640 1 -- 172.21.15.89:0/2950142104 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980ac5f0 con 0x7f01a814ea60 2023-12-07T10:02:01.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01a5d9b640 1 -- 172.21.15.89:0/2950142104 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980ac980 con 0x7f01a814ea60 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01ad0c9640 1 -- 172.21.15.89:0/2950142104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a814ea60 msgr2=0x7f01a8155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.484+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/2950142104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a814ea60 0x7f01a8155250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01980097f0 tx=0x7f019801c370 comp rx=0 tx=0).stop 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- 172.21.15.89:0/2950142104 shutdown_connections 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/2950142104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a814ea60 0x7f01a8155250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- 172.21.15.89:0/2950142104 >> 172.21.15.89:0/2950142104 conn(0x7f01a80c2ad0 msgr2=0x7f01a80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- 172.21.15.89:0/2950142104 shutdown_connections 2023-12-07T10:02:01.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- 172.21.15.89:0/2950142104 wait complete. 2023-12-07T10:02:01.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 Processor -- start 2023-12-07T10:02:01.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- start start 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a806bd00 0x7f01a8145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a80bf400 0x7f01a81444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 0x7f01a81ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a814d7e0 con 0x7f01a814ea60 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81ee230 con 0x7f01a80bf400 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01ad0c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c5980 con 0x7f01a806bd00 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 0x7f01a81ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 0x7f01a81ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56982/0 (socket says 172.21.15.89:56982) 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 -- 172.21.15.89:0/4277859927 learned_addr learned my addr 172.21.15.89:0/4277859927 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a659c640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a80bf400 0x7f01a81444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a806bd00 0x7f01a8145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 -- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a806bd00 msgr2=0x7f01a8145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a806bd00 0x7f01a8145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 -- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a80bf400 msgr2=0x7f01a81444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a80bf400 0x7f01a81444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.488+0000 7f01a759e640 1 -- 172.21.15.89:0/4277859927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009420 con 0x7f01a814ea60 2023-12-07T10:02:01.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f01a759e640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 0x7f01a81ee6c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c770 tx=0x7f01a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f018f7fe640 1 -- 172.21.15.89:0/4277859927 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0003b80 con 0x7f01a814ea60 2023-12-07T10:02:01.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f018f7fe640 1 -- 172.21.15.89:0/4277859927 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0003ce0 con 0x7f01a814ea60 2023-12-07T10:02:01.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f018f7fe640 1 -- 172.21.15.89:0/4277859927 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000aa90 con 0x7f01a814ea60 2023-12-07T10:02:01.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80c5050 con 0x7f01a814ea60 2023-12-07T10:02:01.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80c5610 con 0x7f01a814ea60 2023-12-07T10:02:01.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f018f7fe640 1 -- 172.21.15.89:0/4277859927 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f01a000abf0 con 0x7f01a814ea60 2023-12-07T10:02:01.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.492+0000 7f018f7fe640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01940668d0 0x7f0194068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f018f7fe640 1 -- 172.21.15.89:0/4277859927 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a0084130 con 0x7f01a814ea60 2023-12-07T10:02:01.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01940668d0 0x7f0194068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 Processor -- start 2023-12-07T10:02:01.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- start start 2023-12-07T10:02:01.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01940668d0 0x7f0194068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01980ae000 tx=0x7f0198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e63a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e63acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e684ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e503110 con 0x556c1e639fc0 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e4939a0 con 0x556c1e63a8e0 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c1e490ed0 con 0x556c1e63b200 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e63a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e63a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56992/0 (socket says 172.21.15.89:56992) 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 -- 172.21.15.89:0/3346240018 learned_addr learned my addr 172.21.15.89:0/3346240018 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a659c640 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e63acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a759e640 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e684ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 -- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 msgr2=0x556c1e684ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e684ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 -- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 msgr2=0x556c1e63acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e63acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 -- 172.21.15.89:0/3346240018 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1e184890 con 0x556c1e639fc0 2023-12-07T10:02:01.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a759e640 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e684ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:01.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e63a3a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f01980af040 tx=0x7f0198004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a2e2325cd59f47 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f018cff9640 1 -- 172.21.15.89:0/3346240018 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980a8040 con 0x556c1e639fc0 2023-12-07T10:02:01.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f018cff9640 1 -- 172.21.15.89:0/3346240018 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980bd040 con 0x556c1e639fc0 2023-12-07T10:02:01.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f018cff9640 1 -- 172.21.15.89:0/3346240018 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980b6ce0 con 0x556c1e639fc0 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- 172.21.15.89:0/3346240018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 msgr2=0x556c1e63a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e63a3a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f01980af040 tx=0x7f0198004740 comp rx=0 tx=0).stop 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- 172.21.15.89:0/3346240018 shutdown_connections 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e684ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e63acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 --2- 172.21.15.89:0/3346240018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e63a3a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- 172.21.15.89:0/3346240018 >> 172.21.15.89:0/3346240018 conn(0x556c1e678830 msgr2=0x556c1e67ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- 172.21.15.89:0/3346240018 shutdown_connections 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.496+0000 7f01b0431000 1 -- 172.21.15.89:0/3346240018 wait complete. 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- start start 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 Processor -- start 2023-12-07T10:02:01.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e641220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e641760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e641ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e48c7c0 con 0x556c1e639fc0 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e444bf0 con 0x556c1e63a8e0 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c1e44aa90 con 0x556c1e63b200 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 10 client.0 _ll_register_callbacks cb 0x556c1e627e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e641220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e641220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57008/0 (socket says 172.21.15.89:57008) 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 -- 172.21.15.89:0/878689872 learned_addr learned my addr 172.21.15.89:0/878689872 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a659c640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e641760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a759e640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e641ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 -- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 msgr2=0x556c1e641ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e641ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 -- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 msgr2=0x556c1e641760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e641760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 -- 172.21.15.89:0/878689872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a8154a50 con 0x556c1e639fc0 2023-12-07T10:02:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e641220 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f01980097f0 tx=0x7f01980046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca7a222307008b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f0185ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T10:02:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f0185ffb640 1 -- 172.21.15.89:0/878689872 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980a8070 con 0x556c1e639fc0 2023-12-07T10:02:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f0185ffb640 1 -- 172.21.15.89:0/878689872 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01980cc660 con 0x556c1e639fc0 2023-12-07T10:02:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c1e44e470 con 0x556c1e639fc0 2023-12-07T10:02:01.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f0185ffb640 1 -- 172.21.15.89:0/878689872 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01980b6e50 con 0x556c1e639fc0 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 10 client.6744 fetch_fsmap learned FSMap version 48 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x556c1e44d190 con 0x556c1e639fc0 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f0185ffb640 1 -- 172.21.15.89:0/878689872 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c1e44e470 con 0x556c1e639fc0 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f0185ffb640 1 -- 172.21.15.89:0/878689872 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01980c0070 con 0x556c1e639fc0 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 10 client.6744 fetch_fsmap finished waiting for FSMap version 48 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 10 client.6744 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 20 client.6744 populate_metadata read hostname 'smithi089' 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e68e310 0x556c1e690700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 4 client.6744 mds_command: new command op to 6561 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 --> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c1e451b50 con 0x556c1e68e310 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.500+0000 7f01a659c640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e68e310 0x556c1e690700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01a659c640 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e68e310 0x556c1e690700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa22ad7e6cd09dc6 server_cookie=6304a4297f5a5e4f in_seq=0 out_seq=0 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f0185ffb640 10 client.6744 ms_handle_connect on v2:172.21.15.89:6834/3031036225 2023-12-07T10:02:01.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f0185ffb640 1 -- 172.21.15.89:0/878689872 <== mds.0 v2:172.21.15.89:6834/3031036225 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c1e451b50 con 0x556c1e68e310 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f0185ffb640 10 client.6744 handle_command_reply: tid=0 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 client.6744 shutdown 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 msgr2=0x556c1e641220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e641220 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f01980097f0 tx=0x7f01980046d0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 shutdown_connections 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e63b200 0x556c1e641ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63a8e0 0x556c1e641760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e68e310 0x556c1e690700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 --2- 172.21.15.89:0/878689872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e641220 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 >> 172.21.15.89:0/878689872 conn(0x556c1e678830 msgr2=0x556c1e67ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f0185ffb640 0 client.6744 ms_handle_reset on v2:172.21.15.89:6834/3031036225 2023-12-07T10:02:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 shutdown_connections 2023-12-07T10:02:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 1 -- 172.21.15.89:0/878689872 wait complete. 2023-12-07T10:02:01.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.504+0000 7f01b0431000 20 client.6744 trim_cache size 0 max 16384 2023-12-07T10:02:01.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 Processor -- start 2023-12-07T10:02:01.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- start start 2023-12-07T10:02:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63d960 0x556c1e639970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e678830 0x556c1e638720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e690700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e145940 con 0x556c1e639fc0 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e4278a0 con 0x556c1e63d960 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c1e48b650 con 0x556c1e678830 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e690700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e690700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57024/0 (socket says 172.21.15.89:57024) 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 -- 172.21.15.89:0/2761705391 learned_addr learned my addr 172.21.15.89:0/2761705391 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63d960 0x556c1e639970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a659c640 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e678830 0x556c1e638720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 -- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e678830 msgr2=0x556c1e638720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e678830 0x556c1e638720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 -- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63d960 msgr2=0x556c1e639970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63d960 0x556c1e639970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 -- 172.21.15.89:0/2761705391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1e433490 con 0x556c1e639fc0 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a659c640 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e678830 0x556c1e638720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01a759e640 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e690700 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f01a000afd0 tx=0x7f01a0084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfedc73c47b2f2c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f018d7fa640 1 -- 172.21.15.89:0/2761705391 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a005d320 con 0x556c1e639fc0 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f018d7fa640 1 -- 172.21.15.89:0/2761705391 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0053470 con 0x556c1e639fc0 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f018d7fa640 1 -- 172.21.15.89:0/2761705391 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a005b0b0 con 0x556c1e639fc0 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- 172.21.15.89:0/2761705391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 msgr2=0x556c1e690700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e690700 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f01a000afd0 tx=0x7f01a0084040 comp rx=0 tx=0).stop 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- 172.21.15.89:0/2761705391 shutdown_connections 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e639fc0 0x556c1e690700 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e678830 0x556c1e638720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 --2- 172.21.15.89:0/2761705391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e63d960 0x556c1e639970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- 172.21.15.89:0/2761705391 >> 172.21.15.89:0/2761705391 conn(0x556c1e641c60 msgr2=0x556c1e677cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- 172.21.15.89:0/2761705391 shutdown_connections 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- 172.21.15.89:0/2761705391 wait complete. 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.520+0000 7f01b0431000 1 -- start start 2023-12-07T10:02:01.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 Processor -- start 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e639fc0 0x556c1e6dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 0x556c1e6dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e678830 0x556c1e6dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e644510 con 0x556c1e63d960 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1e513570 con 0x556c1e678830 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c1e63e3a0 con 0x556c1e639fc0 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 10 client.0 _ll_register_callbacks cb 0x556c1e4978e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 0x556c1e6dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 0x556c1e6dd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57036/0 (socket says 172.21.15.89:57036) 2023-12-07T10:02:01.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 -- 172.21.15.89:0/819677882 learned_addr learned my addr 172.21.15.89:0/819677882 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e639fc0 0x556c1e6dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a759e640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e678830 0x556c1e6dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 -- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e639fc0 msgr2=0x556c1e6dc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e639fc0 0x556c1e6dc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 -- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e678830 msgr2=0x556c1e6dd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e678830 0x556c1e6dd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 -- 172.21.15.89:0/819677882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80c5610 con 0x556c1e63d960 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a759e640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e678830 0x556c1e6dd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a659c640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 0x556c1e6dd1c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f019c0011f0 tx=0x7f019c0070a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef28614e4b7b13a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 1 -- 172.21.15.89:0/819677882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c006320 con 0x556c1e63d960 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 1 -- 172.21.15.89:0/819677882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f019c006480 con 0x556c1e63d960 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c1e63ef60 con 0x556c1e63d960 2023-12-07T10:02:01.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 1 -- 172.21.15.89:0/819677882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f019c006640 con 0x556c1e63d960 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 10 client.6750 fetch_fsmap learned FSMap version 48 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x556c1e184cc0 con 0x556c1e63d960 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 1 -- 172.21.15.89:0/819677882 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c1e63ef60 con 0x556c1e63d960 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 1 -- 172.21.15.89:0/819677882 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f019c025030 con 0x556c1e63d960 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 10 client.6750 fetch_fsmap finished waiting for FSMap version 48 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 10 client.6750 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 20 client.6750 populate_metadata read hostname 'smithi089' 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e63a8e0 0x556c1e6ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 4 client.6750 mds_command: new command op to 6561 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 --> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c1e48b110 con 0x556c1e63a8e0 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e63a8e0 0x556c1e6ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01a6d9d640 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e63a8e0 0x556c1e6ddc40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e56f6530553922 server_cookie=73824ac30fed2418 in_seq=0 out_seq=0 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 10 client.6750 ms_handle_connect on v2:172.21.15.89:6834/3031036225 2023-12-07T10:02:01.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 1 -- 172.21.15.89:0/819677882 <== mds.0 v2:172.21.15.89:6834/3031036225 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x556c1e48b110 con 0x556c1e63a8e0 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 10 client.6750 handle_command_reply: tid=0 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 client.6750 shutdown 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 msgr2=0x556c1e6dd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 0x556c1e6dd1c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f019c0011f0 tx=0x7f019c0070a0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 shutdown_connections 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c1e678830 0x556c1e6dd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:6834/3031036225,v1:172.21.15.89:6836/3031036225] conn(0x556c1e63a8e0 0x556c1e6ddc40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c1e63d960 0x556c1e6dd1c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 --2- 172.21.15.89:0/819677882 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x556c1e639fc0 0x556c1e6dc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f0185ffb640 0 client.6750 ms_handle_reset on v2:172.21.15.89:6834/3031036225 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 >> 172.21.15.89:0/819677882 conn(0x556c1e641c60 msgr2=0x556c1e677420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.524+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 shutdown_connections 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01b0431000 1 -- 172.21.15.89:0/819677882 wait complete. 2023-12-07T10:02:01.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01b0431000 20 client.6750 trim_cache size 0 max 16384 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "06923b89-f6c6-4736-b27e-9e03456ddc01", 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 6561, 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 10.297018709, 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 48, 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 67, 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 67, 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 16.25019666 2023-12-07T10:02:01.536 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:01.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01940668d0 msgr2=0x7f0194068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01940668d0 0x7f0194068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01980ae000 tx=0x7f0198008040 comp rx=0 tx=0).stop 2023-12-07T10:02:01.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 msgr2=0x7f01a81ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 0x7f01a81ee6c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c770 tx=0x7f01a000cc30 comp rx=0 tx=0).stop 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 shutdown_connections 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a814ea60 0x7f01a81ee6c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01a80bf400 0x7f01a81444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01940668d0 0x7f0194068d90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 --2- 172.21.15.89:0/4277859927 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f01a806bd00 0x7f01a8145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 >> 172.21.15.89:0/4277859927 conn(0x7f01a80c2ad0 msgr2=0x7f01a8152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 shutdown_connections 2023-12-07T10:02:01.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.528+0000 7f01ad0c9640 1 -- 172.21.15.89:0/4277859927 wait complete. 2023-12-07T10:02:01.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:02:01.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 Processor -- start 2023-12-07T10:02:01.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 -- start start 2023-12-07T10:02:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4de40ca610 0x7f4de40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4de40bd720 0x7f4de40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de406cd90 0x7f4de4158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de4155790 con 0x7f4de40ca610 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de40c4b00 con 0x7f4de40bd720 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de9d80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40c4de0 con 0x7f4de406cd90 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4de40ca610 0x7f4de40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4de40ca610 0x7f4de40c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57050/0 (socket says 172.21.15.89:57050) 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 -- 172.21.15.89:0/1603574900 learned_addr learned my addr 172.21.15.89:0/1603574900 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4ddbfff640 1 --2- 172.21.15.89:0/1603574900 >> v2:172.21.15.97:3300/0 conn(0x7f4de40bd720 0x7f4de40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de3fff640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de406cd90 0x7f4de4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 -- 172.21.15.89:0/1603574900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de406cd90 msgr2=0x7f4de4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de406cd90 0x7f4de4158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 -- 172.21.15.89:0/1603574900 >> v2:172.21.15.97:3300/0 conn(0x7f4de40bd720 msgr2=0x7f4de40c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 --2- 172.21.15.89:0/1603574900 >> v2:172.21.15.97:3300/0 conn(0x7f4de40bd720 0x7f4de40c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de37fe640 1 -- 172.21.15.89:0/1603574900 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4157e30 con 0x7f4de40ca610 2023-12-07T10:02:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.684+0000 7f4de3fff640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de406cd90 0x7f4de4158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de37fe640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de40ca610 0x7f4de40c94c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ca380 tx=0x7f4dd401c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410fa87ad1beac3e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de2ffd640 1 -- 172.21.15.89:0/1603574900 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40c52d0 con 0x7f4de40ca610 2023-12-07T10:02:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de2ffd640 1 -- 172.21.15.89:0/1603574900 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd40a4880 con 0x7f4de40ca610 2023-12-07T10:02:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de2ffd640 1 -- 172.21.15.89:0/1603574900 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40a4c10 con 0x7f4de40ca610 2023-12-07T10:02:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 -- 172.21.15.89:0/1603574900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de40ca610 msgr2=0x7f4de40c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de40ca610 0x7f4de40c94c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ca380 tx=0x7f4dd401c0c0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 -- 172.21.15.89:0/1603574900 shutdown_connections 2023-12-07T10:02:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de406cd90 0x7f4de4158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 --2- 172.21.15.89:0/1603574900 >> v2:172.21.15.97:3300/0 conn(0x7f4de40bd720 0x7f4de40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 --2- 172.21.15.89:0/1603574900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de40ca610 0x7f4de40c94c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 -- 172.21.15.89:0/1603574900 >> 172.21.15.89:0/1603574900 conn(0x7f4de4071ea0 msgr2=0x7f4de40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 -- 172.21.15.89:0/1603574900 shutdown_connections 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.688+0000 7f4de9d80640 1 -- 172.21.15.89:0/1603574900 wait complete. 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 Processor -- start 2023-12-07T10:02:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 -- start start 2023-12-07T10:02:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 0x7f4de4153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de40bd720 0x7f4de41453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de40ca610 0x7f4de4145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4145e50 con 0x7f4de406cd90 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40a9a70 con 0x7f4de40ca610 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40abfc0 con 0x7f4de40bd720 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 0x7f4de4153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 0x7f4de4153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57058/0 (socket says 172.21.15.89:57058) 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 -- 172.21.15.89:0/2481415219 learned_addr learned my addr 172.21.15.89:0/2481415219 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de3fff640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de40ca610 0x7f4de4145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4ddbfff640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de40bd720 0x7f4de41453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 -- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de40bd720 msgr2=0x7f4de41453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de40bd720 0x7f4de41453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 -- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de40ca610 msgr2=0x7f4de4145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de40ca610 0x7f4de4145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 -- 172.21.15.89:0/2481415219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40094d0 con 0x7f4de406cd90 2023-12-07T10:02:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4ddbfff640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de40bd720 0x7f4de41453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de37fe640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 0x7f4de4153560 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40af040 tx=0x7f4dd4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40b7670 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd40b77f0 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40b7ba0 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de40ac2a0 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.692+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de40ac860 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.696+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de40aca50 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.696+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4dd40b3070 con 0x7f4de406cd90 2023-12-07T10:02:01.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.696+0000 7f4de0ff9640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4dc4066900 0x7f4dc4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:01.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.696+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4de40cac00 con 0x7f4de406cd90 2023-12-07T10:02:01.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.696+0000 7f4ddbfff640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4dc4066900 0x7f4dc4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:01.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.696+0000 7f4ddbfff640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4dc4066900 0x7f4dc4068dc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4de4149150 tx=0x7f4dcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:01.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.700+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4dd40eb170 con 0x7f4de406cd90 2023-12-07T10:02:01.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.880+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4de404e890 con 0x7f4de406cd90 2023-12-07T10:02:01.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.880+0000 7f4de0ff9640 1 -- 172.21.15.89:0/2481415219 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4dd40ee790 con 0x7f4de406cd90 2023-12-07T10:02:01.887 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4dc4066900 msgr2=0x7f4dc4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4dc4066900 0x7f4dc4068dc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4de4149150 tx=0x7f4dcc008040 comp rx=0 tx=0).stop 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 msgr2=0x7f4de4153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 0x7f4de4153560 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40af040 tx=0x7f4dd4019180 comp rx=0 tx=0).stop 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 shutdown_connections 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4de40ca610 0x7f4de4145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4dc4066900 0x7f4dc4068dc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4de40bd720 0x7f4de41453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 --2- 172.21.15.89:0/2481415219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de406cd90 0x7f4de4153560 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 >> 172.21.15.89:0/2481415219 conn(0x7f4de4071ea0 msgr2=0x7f4de40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 shutdown_connections 2023-12-07T10:02:01.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:01.884+0000 7f4de9d80640 1 -- 172.21.15.89:0/2481415219 wait complete. 2023-12-07T10:02:01.907 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:02:01.908 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:02:01.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:01.908 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:01.918 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42238sec preferred_lft 42238sec 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:02:01.919 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:02:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:01.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:01.921 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:02:01.983 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T10:02:01.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:01.984 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T10:02:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:02:02.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.040 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T10:02:02.040 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T10:02:02.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:02:02.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:02:02.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:02:02.040 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T10:02:02.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.133 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:02:02.141 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:02:02.142 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:02:02.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T10:02:02.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:02.207 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:02.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:02.259 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:02.310 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-07T10:02:02.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:02.405 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:02.418 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:02.418 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:02.418 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:02:02.418 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 0@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:02:02.418 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:02:02.421 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:02:02.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:02.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.443 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:02:02.503 INFO:teuthology.orchestra.run.smithi089.stdout:client6759 2023-12-07T10:02:02.504 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:02.504 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:02.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:02:02.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 Processor -- start 2023-12-07T10:02:02.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 -- start start 2023-12-07T10:02:02.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:02.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff3c06cd90 0x7eff3c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:02.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c155790 con 0x7eff3c0bd720 2023-12-07T10:02:02.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0c4b00 con 0x7eff3c06cd90 2023-12-07T10:02:02.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff4191c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0c4de0 con 0x7eff3c0ca610 2023-12-07T10:02:02.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff3c06cd90 0x7eff3c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:02.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff3c06cd90 0x7eff3c0c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57074/0 (socket says 172.21.15.89:57074) 2023-12-07T10:02:02.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 -- 172.21.15.89:0/2786542143 learned_addr learned my addr 172.21.15.89:0/2786542143 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:02.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3affd640 1 --2- 172.21.15.89:0/2786542143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:02.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 -- 172.21.15.89:0/2786542143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 msgr2=0x7eff3c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:02.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 --2- 172.21.15.89:0/2786542143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c0c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 -- 172.21.15.89:0/2786542143 >> v1:172.21.15.97:6789/0 conn(0x7eff3c0bd720 legacy=0x7eff3c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:02.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.732+0000 7eff3b7fe640 1 -- 172.21.15.89:0/2786542143 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c157e30 con 0x7eff3c06cd90 2023-12-07T10:02:02.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff3b7fe640 1 --2- 172.21.15.89:0/2786542143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06cd90 0x7eff3c0c9a00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7eff34009e50 tx=0x7eff3401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c820fd573b301deb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:02.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff3a7fc640 1 -- 172.21.15.89:0/2786542143 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0c52d0 con 0x7eff3c06cd90 2023-12-07T10:02:02.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff3a7fc640 1 -- 172.21.15.89:0/2786542143 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340a7050 con 0x7eff3c06cd90 2023-12-07T10:02:02.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff3a7fc640 1 -- 172.21.15.89:0/2786542143 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340ab620 con 0x7eff3c06cd90 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 -- 172.21.15.89:0/2786542143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06cd90 msgr2=0x7eff3c0c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 --2- 172.21.15.89:0/2786542143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06cd90 0x7eff3c0c9a00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7eff34009e50 tx=0x7eff3401c5d0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 -- 172.21.15.89:0/2786542143 shutdown_connections 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 --2- 172.21.15.89:0/2786542143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06cd90 0x7eff3c0c9a00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 --2- 172.21.15.89:0/2786542143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c0c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 -- 172.21.15.89:0/2786542143 >> 172.21.15.89:0/2786542143 conn(0x7eff3c071ea0 msgr2=0x7eff3c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 -- 172.21.15.89:0/2786542143 shutdown_connections 2023-12-07T10:02:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 -- 172.21.15.89:0/2786542143 wait complete. 2023-12-07T10:02:02.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 Processor -- start 2023-12-07T10:02:02.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.736+0000 7eff4191c640 1 -- start start 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff3c06cd90 0x7eff3c14bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 0x7eff3c155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0ac600 con 0x7eff3c0bd720 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1f1b90 con 0x7eff3c06cd90 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c14c190 con 0x7eff3c0ca610 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 0x7eff3c155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 0x7eff3c155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57078/0 (socket says 172.21.15.89:57078) 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 -- 172.21.15.89:0/3708083168 learned_addr learned my addr 172.21.15.89:0/3708083168 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff3b7fe640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff3affd640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff3c06cd90 0x7eff3c14bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 -- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 msgr2=0x7eff3c156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 -- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff3c06cd90 msgr2=0x7eff3c14bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff3c06cd90 0x7eff3c14bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 -- 172.21.15.89:0/3708083168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009b30 con 0x7eff3c0bd720 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff3affd640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff3c06cd90 0x7eff3c14bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff3b7fe640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:02.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff33fff640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 0x7eff3c155fd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c500 tx=0x7eff2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:02.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24005220 con 0x7eff3c0bd720 2023-12-07T10:02:02.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff24005380 con 0x7eff3c0bd720 2023-12-07T10:02:02.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24007270 con 0x7eff3c0bd720 2023-12-07T10:02:02.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c156a50 con 0x7eff3c0bd720 2023-12-07T10:02:02.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0ac220 con 0x7eff3c0bd720 2023-12-07T10:02:02.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.740+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c149f80 con 0x7eff3c0bd720 2023-12-07T10:02:02.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.744+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff240073d0 con 0x7eff3c0bd720 2023-12-07T10:02:02.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.744+0000 7eff38ff9640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff1c0668d0 0x7eff1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:02.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.744+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff24083db0 con 0x7eff3c0bd720 2023-12-07T10:02:02.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.744+0000 7eff3affd640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff1c0668d0 0x7eff1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:02.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.744+0000 7eff3affd640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff1c0668d0 0x7eff1c068d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00b9f0 tx=0x7eff2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:02.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.748+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff24088070 con 0x7eff3c0bd720 2023-12-07T10:02:02.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.928+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff3c0ac740 con 0x7eff3c0bd720 2023-12-07T10:02:02.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.928+0000 7eff38ff9640 1 -- 172.21.15.89:0/3708083168 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff3c0ac740 con 0x7eff3c0bd720 2023-12-07T10:02:02.934 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:02:02.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff1c0668d0 msgr2=0x7eff1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:02.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff1c0668d0 0x7eff1c068d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00b9f0 tx=0x7eff2c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:02.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 msgr2=0x7eff3c155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:02.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 0x7eff3c155fd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c500 tx=0x7eff2400c9c0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 shutdown_connections 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7eff1c0668d0 0x7eff1c068d90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7eff3c0ca610 0x7eff3c156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c0bd720 0x7eff3c155fd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 --2- 172.21.15.89:0/3708083168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff3c06cd90 0x7eff3c14bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 >> 172.21.15.89:0/3708083168 conn(0x7eff3c071ea0 msgr2=0x7eff3c0adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 shutdown_connections 2023-12-07T10:02:02.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:02.932+0000 7eff4191c640 1 -- 172.21.15.89:0/3708083168 wait complete. 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:02:02.955 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:02.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.956 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:02:02.966 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:02:02.966 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:02:02.966 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:02:02.966 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.966 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:02:02.966 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42253sec preferred_lft 42253sec 2023-12-07T10:02:02.967 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:02:02.968 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:02:02.969 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:02:02.969 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:02.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:02.970 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:02:03.033 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:02:03.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.036 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:02:03.091 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:02:03.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.093 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:02:03.093 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:02:03.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:02:03.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:02:03.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:02:03.093 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:02:03.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.187 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:02:03.197 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:02:03.197 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:03.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.198 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:02:03.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:03.262 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:03.317 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:03.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:03.317 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:03.368 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-07T10:02:03.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.368 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:03.464 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:03.464 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:03.480 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:03.480 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:03.480 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:02:03.480 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:02:03.480 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:02:03.484 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:02:03.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:03.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:03.505 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:02:03.564 INFO:teuthology.orchestra.run.smithi097.stdout:client6768 2023-12-07T10:02:03.564 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:03.564 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:03.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-07T10:02:03.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 Processor -- start 2023-12-07T10:02:03.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 -- start start 2023-12-07T10:02:03.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef480c4890 0x7fef480caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:03.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef480bd5a0 0x7fef480c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:03.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4806b7d0 con 0x7fef480ca620 2023-12-07T10:02:03.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef48155160 con 0x7fef480bd5a0 2023-12-07T10:02:03.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4e281640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4806b180 con 0x7fef480c4890 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4d27f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fef480ca620 0x7fef480c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55168/0 (socket says 172.21.15.89:55168) 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4d27f640 1 -- 172.21.15.89:0/801526513 learned_addr learned my addr 172.21.15.89:0/801526513 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4da80640 1 --2- 172.21.15.89:0/801526513 >> v2:172.21.15.89:3300/0 conn(0x7fef480bd5a0 0x7fef480c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4ca7e640 1 --2- 172.21.15.89:0/801526513 >> v2:172.21.15.97:3300/0 conn(0x7fef480c4890 0x7fef480caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4da80640 1 -- 172.21.15.89:0/801526513 >> v2:172.21.15.97:3300/0 conn(0x7fef480c4890 msgr2=0x7fef480caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4da80640 1 --2- 172.21.15.89:0/801526513 >> v2:172.21.15.97:3300/0 conn(0x7fef480c4890 0x7fef480caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4da80640 1 -- 172.21.15.89:0/801526513 >> v1:172.21.15.89:6789/0 conn(0x7fef480ca620 legacy=0x7fef480c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:03.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4da80640 1 -- 172.21.15.89:0/801526513 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4806b460 con 0x7fef480bd5a0 2023-12-07T10:02:03.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef3ffff640 1 -- 172.21.15.89:0/801526513 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292491369 0 0) 0x7fef4806b7d0 con 0x7fef480ca620 2023-12-07T10:02:03.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.756+0000 7fef4ca7e640 1 --2- 172.21.15.89:0/801526513 >> v2:172.21.15.97:3300/0 conn(0x7fef480c4890 0x7fef480caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:03.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4da80640 1 --2- 172.21.15.89:0/801526513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480bd5a0 0x7fef480c8620 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fef480c9380 tx=0x7fef4001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eb4bb63bc2b1e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:03.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef3ffff640 1 -- 172.21.15.89:0/801526513 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400a58d0 con 0x7fef480bd5a0 2023-12-07T10:02:03.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef3ffff640 1 -- 172.21.15.89:0/801526513 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef400a5a30 con 0x7fef480bd5a0 2023-12-07T10:02:03.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef3ffff640 1 -- 172.21.15.89:0/801526513 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400a5dc0 con 0x7fef480bd5a0 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 -- 172.21.15.89:0/801526513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480bd5a0 msgr2=0x7fef480c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 --2- 172.21.15.89:0/801526513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480bd5a0 0x7fef480c8620 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fef480c9380 tx=0x7fef4001c880 comp rx=0 tx=0).stop 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 -- 172.21.15.89:0/801526513 shutdown_connections 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 --2- 172.21.15.89:0/801526513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480bd5a0 0x7fef480c8620 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 --2- 172.21.15.89:0/801526513 >> v2:172.21.15.97:3300/0 conn(0x7fef480c4890 0x7fef480caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 -- 172.21.15.89:0/801526513 >> 172.21.15.89:0/801526513 conn(0x7fef480ac0a0 msgr2=0x7fef480c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 -- 172.21.15.89:0/801526513 shutdown_connections 2023-12-07T10:02:03.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.760+0000 7fef4e281640 1 -- 172.21.15.89:0/801526513 wait complete. 2023-12-07T10:02:03.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 Processor -- start 2023-12-07T10:02:03.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 -- start start 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef480bd5a0 0x7fef480c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 0x7fef4814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef480ca620 0x7fef4814f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4814fb60 con 0x7fef480c4890 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480c3550 con 0x7fef480ca620 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef480c2f90 con 0x7fef480bd5a0 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 0x7fef4814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 0x7fef4814f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57094/0 (socket says 172.21.15.89:57094) 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 -- 172.21.15.89:0/2845845068 learned_addr learned my addr 172.21.15.89:0/2845845068 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4d27f640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef480bd5a0 0x7fef480c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:03.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4da80640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef480ca620 0x7fef4814f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 -- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef480bd5a0 msgr2=0x7fef480c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef480bd5a0 0x7fef480c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 -- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef480ca620 msgr2=0x7fef4814f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef480ca620 0x7fef4814f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 -- 172.21.15.89:0/2845845068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40009a70 con 0x7fef480c4890 2023-12-07T10:02:03.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4ca7e640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 0x7fef4814f0e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fef3800d800 tx=0x7fef3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:03.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef380096a0 con 0x7fef480c4890 2023-12-07T10:02:03.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38009800 con 0x7fef480c4890 2023-12-07T10:02:03.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef480c3270 con 0x7fef480c4890 2023-12-07T10:02:03.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38009bb0 con 0x7fef480c4890 2023-12-07T10:02:03.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.764+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef480bdf50 con 0x7fef480c4890 2023-12-07T10:02:03.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.768+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4804e890 con 0x7fef480c4890 2023-12-07T10:02:03.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.768+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fef38009d10 con 0x7fef480c4890 2023-12-07T10:02:03.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.768+0000 7fef3dffb640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef2c066900 0x7fef2c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:03.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.768+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef380847b0 con 0x7fef480c4890 2023-12-07T10:02:03.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.768+0000 7fef4d27f640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef2c066900 0x7fef2c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:03.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.768+0000 7fef4d27f640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef2c066900 0x7fef2c068dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fef44007fd0 tx=0x7fef44007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:03.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.772+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef38051a80 con 0x7fef480c4890 2023-12-07T10:02:03.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.976+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fef480c98e0 con 0x7fef480c4890 2023-12-07T10:02:03.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.976+0000 7fef3dffb640 1 -- 172.21.15.89:0/2845845068 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7fef380550a0 con 0x7fef480c4890 2023-12-07T10:02:03.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef2c066900 msgr2=0x7fef2c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef2c066900 0x7fef2c068dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fef44007fd0 tx=0x7fef44007d60 comp rx=0 tx=0).stop 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 msgr2=0x7fef4814f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 0x7fef4814f0e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fef3800d800 tx=0x7fef3800dcc0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 shutdown_connections 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef480ca620 0x7fef4814f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480c4890 0x7fef4814f0e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fef2c066900 0x7fef2c068dc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 --2- 172.21.15.89:0/2845845068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fef480bd5a0 0x7fef480c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 >> 172.21.15.89:0/2845845068 conn(0x7fef480ac0a0 msgr2=0x7fef481545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 shutdown_connections 2023-12-07T10:02:03.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:03.980+0000 7fef4e281640 1 -- 172.21.15.89:0/2845845068 wait complete. 2023-12-07T10:02:04.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 Processor -- start 2023-12-07T10:02:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 -- start start 2023-12-07T10:02:04.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f79ec14fc30 0x7f79ec06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 0x7f79ec0c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec0c09c0 con 0x7f79ec06baf0 2023-12-07T10:02:04.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec0c0c10 con 0x7f79ec14fc30 2023-12-07T10:02:04.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79f1f55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c5fa0 con 0x7f79ec0c1140 2023-12-07T10:02:04.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79eaffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f79ec06baf0 0x7f79ec0c46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55172/0 (socket says 172.21.15.89:55172) 2023-12-07T10:02:04.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79eaffd640 1 -- 172.21.15.89:0/3842414618 learned_addr learned my addr 172.21.15.89:0/3842414618 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:04.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ebfff640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 0x7f79ec0c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79eb7fe640 1 --2- 172.21.15.89:0/3842414618 >> v2:172.21.15.97:3300/0 conn(0x7f79ec14fc30 0x7f79ec06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283830040 0 0) 0x7f79ec0c09c0 con 0x7f79ec06baf0 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d4003530 con 0x7f79ec06baf0 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3107848809 0 0) 0x7f79d4003530 con 0x7f79ec06baf0 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 msgr2=0x7f79ec0c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 0x7f79ec0c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 >> v2:172.21.15.97:3300/0 conn(0x7f79ec14fc30 msgr2=0x7f79ec06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 --2- 172.21.15.89:0/3842414618 >> v2:172.21.15.97:3300/0 conn(0x7f79ec14fc30 0x7f79ec06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec0c6280 con 0x7f79ec06baf0 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f79e0001680 con 0x7f79ec06baf0 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 >> v1:172.21.15.89:6789/0 conn(0x7f79ec06baf0 legacy=0x7f79ec0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 0x7f79d4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d4003f00 0x7f79d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4004d10 0x7f79d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c0c10 con 0x7f79d4003f00 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c5fa0 con 0x7f79d4004d10 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.140+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d400b9e0 con 0x7f79ec0c1140 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d4003f00 0x7f79d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eb7fe640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 0x7f79d4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79ebfff640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4004d10 0x7f79d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 -- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 msgr2=0x7f79d4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec0c1140 0x7f79d4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 -- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4004d10 msgr2=0x7f79d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4004d10 0x7f79d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 -- 172.21.15.89:0/3842414618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4003530 con 0x7f79d4003f00 2023-12-07T10:02:04.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79eaffd640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d4003f00 0x7f79d40047d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c270 tx=0x7f79e001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3c55667f24e330 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00058e0 con 0x7f79d4003f00 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0005a40 con 0x7f79d4003f00 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79ea7fc640 1 -- 172.21.15.89:0/3842414618 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0005e50 con 0x7f79d4003f00 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79f1f55640 1 -- 172.21.15.89:0/3842414618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d4003f00 msgr2=0x7f79d40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79f1f55640 1 --2- 172.21.15.89:0/3842414618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d4003f00 0x7f79d40047d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c270 tx=0x7f79e001cc60 comp rx=0 tx=0).stop 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.144+0000 7f79ebfff640 1 -- 172.21.15.89:0/3842414618 reap_dead start 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- 172.21.15.89:0/3842414618 shutdown_connections 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- 172.21.15.89:0/3842414618 >> 172.21.15.89:0/3842414618 conn(0x7f79ec0c3240 msgr2=0x7f79ec0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- 172.21.15.89:0/3842414618 shutdown_connections 2023-12-07T10:02:04.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- 172.21.15.89:0/3842414618 wait complete. 2023-12-07T10:02:04.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 Processor -- start 2023-12-07T10:02:04.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- start start 2023-12-07T10:02:04.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4003f00 0x7f79ec155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec156640 0x7f79ec1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 0x7f79ec150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec153360 con 0x7f79ec14aa70 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec1505d0 con 0x7f79d4003f00 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79f1f55640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec149f50 con 0x7f79ec156640 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 0x7f79ec150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 0x7f79ec150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57106/0 (socket says 172.21.15.89:57106) 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 -- 172.21.15.89:0/2780185689 learned_addr learned my addr 172.21.15.89:0/2780185689 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79eaffd640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec156640 0x7f79ec1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79eb7fe640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4003f00 0x7f79ec155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 -- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec156640 msgr2=0x7f79ec1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec156640 0x7f79ec1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 -- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4003f00 msgr2=0x7f79ec155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4003f00 0x7f79ec155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.148+0000 7f79ebfff640 1 -- 172.21.15.89:0/2780185689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec152da0 con 0x7f79ec14aa70 2023-12-07T10:02:04.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79ebfff640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 0x7f79ec150f30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c3dc0 tx=0x7f79e400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400e040 con 0x7f79ec14aa70 2023-12-07T10:02:04.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400f040 con 0x7f79ec14aa70 2023-12-07T10:02:04.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec153080 con 0x7f79ec14aa70 2023-12-07T10:02:04.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4015430 con 0x7f79ec14aa70 2023-12-07T10:02:04.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec0a8020 con 0x7f79ec14aa70 2023-12-07T10:02:04.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec150330 con 0x7f79ec14aa70 2023-12-07T10:02:04.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f79e4015590 con 0x7f79ec14aa70 2023-12-07T10:02:04.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79d3fff640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79d80668d0 0x7f79d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e40848f0 con 0x7f79ec14aa70 2023-12-07T10:02:04.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.152+0000 7f79eb7fe640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79d80668d0 0x7f79d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.156+0000 7f79eb7fe640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79d80668d0 0x7f79d8068d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009be0 tx=0x7f79dc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.156+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79ec150330 con 0x7f79ec14aa70 2023-12-07T10:02:04.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79ec150710 con 0x7f79ec14aa70 2023-12-07T10:02:04.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79d3fff640 1 -- 172.21.15.89:0/2780185689 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16500 (secure 0 0 0) 0x7f79ec150710 con 0x7f79ec14aa70 2023-12-07T10:02:04.320 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:04.321 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":67,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:01:52.226259+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79d80668d0 msgr2=0x7f79d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79d80668d0 0x7f79d8068d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009be0 tx=0x7f79dc009190 comp rx=0 tx=0).stop 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 msgr2=0x7f79ec150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 0x7f79ec150f30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c3dc0 tx=0x7f79e400f1b0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 shutdown_connections 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79ec14aa70 0x7f79ec150f30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79d80668d0 0x7f79d8068d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f79ec156640 0x7f79ec1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 --2- 172.21.15.89:0/2780185689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79d4003f00 0x7f79ec155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 >> 172.21.15.89:0/2780185689 conn(0x7f79ec0c3240 msgr2=0x7f79ec14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:04.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 shutdown_connections 2023-12-07T10:02:04.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.316+0000 7f79f1f55640 1 -- 172.21.15.89:0/2780185689 wait complete. 2023-12-07T10:02:04.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:04.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:04.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.480+0000 7f1037ce3640 1 Processor -- start 2023-12-07T10:02:04.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.480+0000 7f1037ce3640 1 -- start start 2023-12-07T10:02:04.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1037ce3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10300c0370 0x7f103006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1037ce3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f10300a8470 0x7f103006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1037ce3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103006de00 con 0x7f103014eaf0 2023-12-07T10:02:04.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1037ce3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1030070390 con 0x7f10300c0370 2023-12-07T10:02:04.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1037ce3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103006db90 con 0x7f10300a8470 2023-12-07T10:02:04.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10300c0370 0x7f103006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10300c0370 0x7f103006d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57116/0 (socket says 172.21.15.89:57116) 2023-12-07T10:02:04.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 -- 172.21.15.89:0/4132980485 learned_addr learned my addr 172.21.15.89:0/4132980485 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:04.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1036280640 1 --2- 172.21.15.89:0/4132980485 >> v2:172.21.15.97:3300/0 conn(0x7f10300a8470 0x7f103006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 -- 172.21.15.89:0/4132980485 >> v2:172.21.15.97:3300/0 conn(0x7f10300a8470 msgr2=0x7f103006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 --2- 172.21.15.89:0/4132980485 >> v2:172.21.15.97:3300/0 conn(0x7f10300a8470 0x7f103006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 -- 172.21.15.89:0/4132980485 >> v1:172.21.15.97:6789/0 conn(0x7f103014eaf0 legacy=0x7f1030151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 -- 172.21.15.89:0/4132980485 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103014eed0 con 0x7f10300c0370 2023-12-07T10:02:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f1036280640 1 --2- 172.21.15.89:0/4132980485 >> v2:172.21.15.97:3300/0 conn(0x7f10300a8470 0x7f103006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:04.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.484+0000 7f103527e640 1 --2- 172.21.15.89:0/4132980485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103006d110 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f10300c3910 tx=0x7f102001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b68246636cc43c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1034a7d640 1 -- 172.21.15.89:0/4132980485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200ab600 con 0x7f10300c0370 2023-12-07T10:02:04.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1034a7d640 1 -- 172.21.15.89:0/4132980485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10200ab760 con 0x7f10300c0370 2023-12-07T10:02:04.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1034a7d640 1 -- 172.21.15.89:0/4132980485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200abaf0 con 0x7f10300c0370 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- 172.21.15.89:0/4132980485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 msgr2=0x7f103006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 --2- 172.21.15.89:0/4132980485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103006d110 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f10300c3910 tx=0x7f102001c3e0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- 172.21.15.89:0/4132980485 shutdown_connections 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 --2- 172.21.15.89:0/4132980485 >> v2:172.21.15.97:3300/0 conn(0x7f10300a8470 0x7f103006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 --2- 172.21.15.89:0/4132980485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103006d110 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- 172.21.15.89:0/4132980485 >> 172.21.15.89:0/4132980485 conn(0x7f10300c2a60 msgr2=0x7f10300c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- 172.21.15.89:0/4132980485 shutdown_connections 2023-12-07T10:02:04.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- 172.21.15.89:0/4132980485 wait complete. 2023-12-07T10:02:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 Processor -- start 2023-12-07T10:02:04.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- start start 2023-12-07T10:02:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10300a8470 0x7f10300bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103013f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103014eaf0 0x7f10301ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10301f03b0 con 0x7f10300c0370 2023-12-07T10:02:04.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10301f0f30 con 0x7f10300a8470 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f1037ce3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10301f0600 con 0x7f103014eaf0 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.488+0000 7f103527e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103013f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103013f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57132/0 (socket says 172.21.15.89:57132) 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 -- 172.21.15.89:0/1942451666 learned_addr learned my addr 172.21.15.89:0/1942451666 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f1036280640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103014eaf0 0x7f10301ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f1035a7f640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10300a8470 0x7f10300bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 -- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103014eaf0 msgr2=0x7f10301ece40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103014eaf0 0x7f10301ece40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 -- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10300a8470 msgr2=0x7f10300bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10300a8470 0x7f10300bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 -- 172.21.15.89:0/1942451666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10200094d0 con 0x7f10300c0370 2023-12-07T10:02:04.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f103527e640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103013f8d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f10200ad040 tx=0x7f102001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200b2b50 con 0x7f10300c0370 2023-12-07T10:02:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10200b2cb0 con 0x7f10300c0370 2023-12-07T10:02:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200be3f0 con 0x7f10300c0370 2023-12-07T10:02:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10301f08e0 con 0x7f10300c0370 2023-12-07T10:02:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10300bfb30 con 0x7f10300c0370 2023-12-07T10:02:04.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103004e890 con 0x7f10300c0370 2023-12-07T10:02:04.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.492+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f10200c7440 con 0x7f10300c0370 2023-12-07T10:02:04.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.496+0000 7f10267fc640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f10140668d0 0x7f1014068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.496+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f102011f250 con 0x7f10300c0370 2023-12-07T10:02:04.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.496+0000 7f1035a7f640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f10140668d0 0x7f1014068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.496+0000 7f1035a7f640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f10140668d0 0x7f1014068d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f10300aa340 tx=0x7f102c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.496+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10200ec530 con 0x7f10300c0370 2023-12-07T10:02:04.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.648+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10301f1070 con 0x7f10300c0370 2023-12-07T10:02:04.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f10267fc640 1 -- 172.21.15.89:0/1942451666 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10200efb50 con 0x7f10300c0370 2023-12-07T10:02:04.655 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f10140668d0 msgr2=0x7f1014068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f10140668d0 0x7f1014068d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f10300aa340 tx=0x7f102c009040 comp rx=0 tx=0).stop 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 msgr2=0x7f103013f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103013f8d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f10200ad040 tx=0x7f102001ac20 comp rx=0 tx=0).stop 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 shutdown_connections 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f10140668d0 0x7f1014068d90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f103014eaf0 0x7f10301ece40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c0370 0x7f103013f8d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 --2- 172.21.15.89:0/1942451666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10300a8470 0x7f10300bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 >> 172.21.15.89:0/1942451666 conn(0x7f10300c2a60 msgr2=0x7f103006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:04.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 shutdown_connections 2023-12-07T10:02:04.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.652+0000 7f1037ce3640 1 -- 172.21.15.89:0/1942451666 wait complete. 2023-12-07T10:02:04.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:04.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2fe9df640 1 Processor -- start 2023-12-07T10:02:04.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2fe9df640 1 -- start start 2023-12-07T10:02:04.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2fe9df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8072420 0x7fc2f80ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2fe9df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80c1490 con 0x7fc2f80705e0 2023-12-07T10:02:04.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2fe9df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80c1ee0 con 0x7fc2f8154ac0 2023-12-07T10:02:04.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2fe9df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c21c0 con 0x7fc2f8072420 2023-12-07T10:02:04.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f77fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc2f80705e0 0x7fc2f80c3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55180/0 (socket says 172.21.15.89:55180) 2023-12-07T10:02:04.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f77fe640 1 -- 172.21.15.89:0/2602926841 learned_addr learned my addr 172.21.15.89:0/2602926841 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:04.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f7fff640 1 --2- 172.21.15.89:0/2602926841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8072420 0x7fc2f80ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f6ffd640 1 -- 172.21.15.89:0/2602926841 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255725258 0 0) 0x7fc2f80c1490 con 0x7fc2f80705e0 2023-12-07T10:02:04.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f6ffd640 1 -- 172.21.15.89:0/2602926841 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e0003530 con 0x7fc2f80705e0 2023-12-07T10:02:04.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f7fff640 1 -- 172.21.15.89:0/2602926841 >> v1:172.21.15.97:6789/0 conn(0x7fc2f8154ac0 legacy=0x7fc2f8154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f6ffd640 1 -- 172.21.15.89:0/2602926841 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931669909 0 0) 0x7fc2f80c1ee0 con 0x7fc2f8154ac0 2023-12-07T10:02:04.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f7fff640 1 -- 172.21.15.89:0/2602926841 >> v1:172.21.15.89:6789/0 conn(0x7fc2f80705e0 legacy=0x7fc2f80c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.812+0000 7fc2f7fff640 1 -- 172.21.15.89:0/2602926841 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80c1120 con 0x7fc2f8072420 2023-12-07T10:02:04.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2f7fff640 1 --2- 172.21.15.89:0/2602926841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8072420 0x7fc2f80ab190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009820 tx=0x7fc2e801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699852277813aa7a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2f6ffd640 1 -- 172.21.15.89:0/2602926841 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ab600 con 0x7fc2f8072420 2023-12-07T10:02:04.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2f6ffd640 1 -- 172.21.15.89:0/2602926841 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80a7050 con 0x7fc2f8072420 2023-12-07T10:02:04.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2f6ffd640 1 -- 172.21.15.89:0/2602926841 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ab960 con 0x7fc2f8072420 2023-12-07T10:02:04.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 -- 172.21.15.89:0/2602926841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8072420 msgr2=0x7fc2f80ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/2602926841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8072420 0x7fc2f80ab190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009820 tx=0x7fc2e801c410 comp rx=0 tx=0).stop 2023-12-07T10:02:04.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 -- 172.21.15.89:0/2602926841 shutdown_connections 2023-12-07T10:02:04.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/2602926841 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8072420 0x7fc2f80ab190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 -- 172.21.15.89:0/2602926841 >> 172.21.15.89:0/2602926841 conn(0x7fc2f80a7a20 msgr2=0x7fc2f80a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:04.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 -- 172.21.15.89:0/2602926841 shutdown_connections 2023-12-07T10:02:04.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.816+0000 7fc2fe9df640 1 -- 172.21.15.89:0/2602926841 wait complete. 2023-12-07T10:02:04.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 Processor -- start 2023-12-07T10:02:04.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 -- start start 2023-12-07T10:02:04.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 0x7fc2f81ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f8072420 0x7fc2f81ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8154ac0 0x7fc2f81ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81ec7a0 con 0x7fc2f80705e0 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81eec50 con 0x7fc2f8072420 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814b930 con 0x7fc2f8154ac0 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 0x7fc2f81ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 0x7fc2f81ee1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57142/0 (socket says 172.21.15.89:57142) 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 -- 172.21.15.89:0/1788197578 learned_addr learned my addr 172.21.15.89:0/1788197578 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f77fe640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f8072420 0x7fc2f81ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fcf7c640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8154ac0 0x7fc2f81ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 -- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8154ac0 msgr2=0x7fc2f81ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8154ac0 0x7fc2f81ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 -- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f8072420 msgr2=0x7fc2f81ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f8072420 0x7fc2f81ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 -- 172.21.15.89:0/1788197578 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009420 con 0x7fc2f80705e0 2023-12-07T10:02:04.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f7fff640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 0x7fc2f81ee1d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000c10 tx=0x7fc2e80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8006e20 con 0x7fc2f80705e0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80b4400 con 0x7fc2f80705e0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80b4770 con 0x7fc2f80705e0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f81ebe70 con 0x7fc2f80705e0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.820+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f81ec430 con 0x7fc2f80705e0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.824+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f81ed930 con 0x7fc2f80705e0 2023-12-07T10:02:04.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.824+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc2e80b2040 con 0x7fc2f80705e0 2023-12-07T10:02:04.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.824+0000 7fc2f4ff9640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2e40668d0 0x7fc2e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:04.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.824+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2e811e3f0 con 0x7fc2f80705e0 2023-12-07T10:02:04.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.824+0000 7fc2f77fe640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2e40668d0 0x7fc2e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:04.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.824+0000 7fc2f77fe640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2e40668d0 0x7fc2e4068d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80a6b40 tx=0x7fc2ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:04.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.828+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2e80eb590 con 0x7fc2f80705e0 2023-12-07T10:02:04.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.976+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2f8074970 con 0x7fc2f80705e0 2023-12-07T10:02:04.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.976+0000 7fc2f4ff9640 1 -- 172.21.15.89:0/1788197578 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2e80eebb0 con 0x7fc2f80705e0 2023-12-07T10:02:04.982 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2e40668d0 msgr2=0x7fc2e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2e40668d0 0x7fc2e4068d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80a6b40 tx=0x7fc2ec009040 comp rx=0 tx=0).stop 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 msgr2=0x7fc2f81ee1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 0x7fc2f81ee1d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000c10 tx=0x7fc2e80191b0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 shutdown_connections 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2e40668d0 0x7fc2e4068d90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2f8154ac0 0x7fc2f81ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f8072420 0x7fc2f81ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 --2- 172.21.15.89:0/1788197578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2f80705e0 0x7fc2f81ee1d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 >> 172.21.15.89:0/1788197578 conn(0x7fc2f80a7a20 msgr2=0x7fc2f8155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 shutdown_connections 2023-12-07T10:02:04.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:04.980+0000 7fc2fe9df640 1 -- 172.21.15.89:0/1788197578 wait complete. 2023-12-07T10:02:05.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:05.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.136+0000 7f51573df640 1 Processor -- start 2023-12-07T10:02:05.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f51573df640 1 -- start start 2023-12-07T10:02:05.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f51573df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f515014eaf0 0x7f5150151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f51573df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515006de00 con 0x7f5150151f90 2023-12-07T10:02:05.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f51573df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150070390 con 0x7f51500c0370 2023-12-07T10:02:05.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f51573df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515014eed0 con 0x7f515014eaf0 2023-12-07T10:02:05.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f515517b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f515014eaf0 0x7f5150151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f515497a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5150151f90 0x7f515006d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55184/0 (socket says 172.21.15.89:55184) 2023-12-07T10:02:05.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f515497a640 1 -- 172.21.15.89:0/3783692187 learned_addr learned my addr 172.21.15.89:0/3783692187 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:05.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f515517b640 1 -- 172.21.15.89:0/3783692187 >> v1:172.21.15.97:6789/0 conn(0x7f51500c0370 legacy=0x7f515015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f515517b640 1 -- 172.21.15.89:0/3783692187 >> v1:172.21.15.89:6789/0 conn(0x7f5150151f90 legacy=0x7f515006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f515517b640 1 -- 172.21.15.89:0/3783692187 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150151270 con 0x7f515014eaf0 2023-12-07T10:02:05.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.140+0000 7f5147fff640 1 -- 172.21.15.89:0/3783692187 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113225141 0 0) 0x7f515006de00 con 0x7f5150151f90 2023-12-07T10:02:05.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f515517b640 1 --2- 172.21.15.89:0/3783692187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f5150151a50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f514c00ba60 tx=0x7f514c01ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c110735d3d9dcc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f5147fff640 1 -- 172.21.15.89:0/3783692187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0a79d0 con 0x7f515014eaf0 2023-12-07T10:02:05.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f5147fff640 1 -- 172.21.15.89:0/3783692187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c0a7b30 con 0x7f515014eaf0 2023-12-07T10:02:05.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f5147fff640 1 -- 172.21.15.89:0/3783692187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0af440 con 0x7f515014eaf0 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 -- 172.21.15.89:0/3783692187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 msgr2=0x7f5150151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 --2- 172.21.15.89:0/3783692187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f5150151a50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f514c00ba60 tx=0x7f514c01ea00 comp rx=0 tx=0).stop 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 -- 172.21.15.89:0/3783692187 shutdown_connections 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 --2- 172.21.15.89:0/3783692187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f5150151a50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 -- 172.21.15.89:0/3783692187 >> 172.21.15.89:0/3783692187 conn(0x7f51500c2a60 msgr2=0x7f51500c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 -- 172.21.15.89:0/3783692187 shutdown_connections 2023-12-07T10:02:05.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 -- 172.21.15.89:0/3783692187 wait complete. 2023-12-07T10:02:05.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 Processor -- start 2023-12-07T10:02:05.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.144+0000 7f51573df640 1 -- start start 2023-12-07T10:02:05.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51500c0370 0x7f51500c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f51500bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5150152b10 0x7f5150149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500c0860 con 0x7f515014eaf0 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500c0ab0 con 0x7f51500c0370 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500c0d90 con 0x7f5150152b10 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f51500bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f51500bf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57152/0 (socket says 172.21.15.89:57152) 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 -- 172.21.15.89:0/1622912789 learned_addr learned my addr 172.21.15.89:0/1622912789 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515517b640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51500c0370 0x7f51500c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515597c640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5150152b10 0x7f5150149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 -- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5150152b10 msgr2=0x7f5150149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5150152b10 0x7f5150149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 -- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51500c0370 msgr2=0x7f51500c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51500c0370 0x7f51500c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 -- 172.21.15.89:0/1622912789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c00b6c0 con 0x7f515014eaf0 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f515497a640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f51500bf560 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f514000c410 tx=0x7f514000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400074e0 con 0x7f515014eaf0 2023-12-07T10:02:05.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140007640 con 0x7f515014eaf0 2023-12-07T10:02:05.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51500c1070 con 0x7f515014eaf0 2023-12-07T10:02:05.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140004a30 con 0x7f515014eaf0 2023-12-07T10:02:05.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51500c25d0 con 0x7f515014eaf0 2023-12-07T10:02:05.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515014c9a0 con 0x7f515014eaf0 2023-12-07T10:02:05.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.148+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5140004b90 con 0x7f515014eaf0 2023-12-07T10:02:05.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.152+0000 7f5145ffb640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f51340668d0 0x7f5134068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.152+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5140084150 con 0x7f515014eaf0 2023-12-07T10:02:05.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.152+0000 7f515517b640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f51340668d0 0x7f5134068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.152+0000 7f515517b640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f51340668d0 0x7f5134068d90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f514c0b1000 tx=0x7f514c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.156+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51400513a0 con 0x7f515014eaf0 2023-12-07T10:02:05.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.304+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f515004e890 con 0x7f515014eaf0 2023-12-07T10:02:05.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.304+0000 7f5145ffb640 1 -- 172.21.15.89:0/1622912789 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51400549c0 con 0x7f515014eaf0 2023-12-07T10:02:05.383 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.304+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f51340668d0 msgr2=0x7f5134068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.304+0000 7f51573df640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f51340668d0 0x7f5134068d90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f514c0b1000 tx=0x7f514c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.304+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 msgr2=0x7f51500bf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.304+0000 7f51573df640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f51500bf560 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f514000c410 tx=0x7f514000c8d0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 shutdown_connections 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f51340668d0 0x7f5134068d90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5150152b10 0x7f5150149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515014eaf0 0x7f51500bf560 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 --2- 172.21.15.89:0/1622912789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51500c0370 0x7f51500c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 >> 172.21.15.89:0/1622912789 conn(0x7f51500c2a60 msgr2=0x7f5150070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:05.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 shutdown_connections 2023-12-07T10:02:05.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.308+0000 7f51573df640 1 -- 172.21.15.89:0/1622912789 wait complete. 2023-12-07T10:02:05.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T10:02:05.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360c1b8640 1 Processor -- start 2023-12-07T10:02:05.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360c1b8640 1 -- start start 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360c1b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f36040c1f70 0x7f360415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360c1b8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36040c2400 con 0x7f36040c1b90 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360c1b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360406d120 con 0x7f36040c01e0 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360c1b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3604070cd0 con 0x7f36040c1f70 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f3609f54640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f36040c1b90 0x7f36040705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55192/0 (socket says 172.21.15.89:55192) 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f3609f54640 1 -- 172.21.15.89:0/212190873 learned_addr learned my addr 172.21.15.89:0/212190873 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360a755640 1 --2- 172.21.15.89:0/212190873 >> v2:172.21.15.89:3300/0 conn(0x7f36040c1f70 0x7f360415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f3608f52640 1 -- 172.21.15.89:0/212190873 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115130113 0 0) 0x7f3600001120 con 0x7f36040c1b90 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f3608f52640 1 -- 172.21.15.89:0/212190873 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f0003530 con 0x7f36040c1b90 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.520+0000 7f360a755640 1 -- 172.21.15.89:0/212190873 >> v1:172.21.15.97:6789/0 conn(0x7f36040c01e0 legacy=0x7f3604161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360a755640 1 -- 172.21.15.89:0/212190873 >> v1:172.21.15.89:6789/0 conn(0x7f36040c1b90 legacy=0x7f36040705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360a755640 1 -- 172.21.15.89:0/212190873 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360406d400 con 0x7f36040c1f70 2023-12-07T10:02:05.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360a755640 1 --2- 172.21.15.89:0/212190873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1f70 0x7f360415bf90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009d90 tx=0x7f35fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250124b0481b5421 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f3608f52640 1 -- 172.21.15.89:0/212190873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0a5920 con 0x7f36040c1f70 2023-12-07T10:02:05.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f3608f52640 1 -- 172.21.15.89:0/212190873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc0a5a80 con 0x7f36040c1f70 2023-12-07T10:02:05.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f3608f52640 1 -- 172.21.15.89:0/212190873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0a5e10 con 0x7f36040c1f70 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 -- 172.21.15.89:0/212190873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1f70 msgr2=0x7f360415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 --2- 172.21.15.89:0/212190873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1f70 0x7f360415bf90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009d90 tx=0x7f35fc01c950 comp rx=0 tx=0).stop 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 -- 172.21.15.89:0/212190873 shutdown_connections 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 --2- 172.21.15.89:0/212190873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1f70 0x7f360415bf90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 -- 172.21.15.89:0/212190873 >> 172.21.15.89:0/212190873 conn(0x7f36040c5f60 msgr2=0x7f36040c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 -- 172.21.15.89:0/212190873 shutdown_connections 2023-12-07T10:02:05.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.524+0000 7f360c1b8640 1 -- 172.21.15.89:0/212190873 wait complete. 2023-12-07T10:02:05.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 Processor -- start 2023-12-07T10:02:05.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 -- start start 2023-12-07T10:02:05.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36040c01e0 0x7f3604153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 0x7f3604151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36040c1f70 0x7f3604152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3604155900 con 0x7f36040c1b90 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3604152780 con 0x7f36040c1f70 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3604155b30 con 0x7f36040c01e0 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 0x7f3604151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 0x7f3604151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57172/0 (socket says 172.21.15.89:57172) 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 -- 172.21.15.89:0/294508465 learned_addr learned my addr 172.21.15.89:0/294508465 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360a755640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36040c1f70 0x7f3604152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609f54640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36040c01e0 0x7f3604153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 -- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36040c01e0 msgr2=0x7f3604153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36040c01e0 0x7f3604153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 -- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36040c1f70 msgr2=0x7f3604152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36040c1f70 0x7f3604152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 -- 172.21.15.89:0/294508465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc009a70 con 0x7f36040c1b90 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f3609753640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 0x7f3604151580 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c430 tx=0x7f35f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f40052d0 con 0x7f36040c1b90 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4005430 con 0x7f36040c1b90 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4007260 con 0x7f36040c1b90 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3604155e10 con 0x7f36040c1b90 2023-12-07T10:02:05.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.528+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3604153010 con 0x7f36040c1b90 2023-12-07T10:02:05.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.532+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36040749e0 con 0x7f36040c1b90 2023-12-07T10:02:05.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.532+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f35f40073c0 con 0x7f36040c1b90 2023-12-07T10:02:05.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.532+0000 7f35fa7fc640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35e80668d0 0x7f35e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.532+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35f40837d0 con 0x7f36040c1b90 2023-12-07T10:02:05.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.532+0000 7f3609f54640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35e80668d0 0x7f35e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.532+0000 7f3609f54640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35e80668d0 0x7f35e8068d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3600001280 tx=0x7f3600009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.536+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35f4050ab0 con 0x7f36040c1b90 2023-12-07T10:02:05.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3604156910 con 0x7f36040c1b90 2023-12-07T10:02:05.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f35fa7fc640 1 -- 172.21.15.89:0/294508465 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) v1 ==== 84+0+209 (secure 0 0 0) 0x7f35f40540d0 con 0x7f36040c1b90 2023-12-07T10:02:05.692 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 12, 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "cephfs_metadata" 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 13, 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "cephfs_data" 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-12-07T10:02:05.693 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-12-07T10:02:05.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35e80668d0 msgr2=0x7f35e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35e80668d0 0x7f35e8068d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3600001280 tx=0x7f3600009040 comp rx=0 tx=0).stop 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 msgr2=0x7f3604151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 0x7f3604151580 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c430 tx=0x7f35f400c8f0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 shutdown_connections 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36040c1f70 0x7f3604152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36040c1b90 0x7f3604151580 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f35e80668d0 0x7f35e8068d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 --2- 172.21.15.89:0/294508465 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f36040c01e0 0x7f3604153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 >> 172.21.15.89:0/294508465 conn(0x7f36040c5f60 msgr2=0x7f360415c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 shutdown_connections 2023-12-07T10:02:05.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.688+0000 7f360c1b8640 1 -- 172.21.15.89:0/294508465 wait complete. 2023-12-07T10:02:05.713 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-07T10:02:05.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-07T10:02:05.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.848+0000 7ff04a054640 1 Processor -- start 2023-12-07T10:02:05.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.848+0000 7ff04a054640 1 -- start start 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff04a054640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff044155f00 0x7ff0440a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff04a054640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0441562e0 0x7ff04406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff04a054640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440abb60 con 0x7ff044156770 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff04a054640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04406c7a0 con 0x7ff0441562e0 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff04a054640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440abdb0 con 0x7ff044155f00 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0441562e0 0x7ff04406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0441562e0 0x7ff04406cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57184/0 (socket says 172.21.15.89:57184) 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 -- 172.21.15.89:0/530811269 learned_addr learned my addr 172.21.15.89:0/530811269 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff0437fe640 1 --2- 172.21.15.89:0/530811269 >> v2:172.21.15.97:3300/0 conn(0x7ff044155f00 0x7ff0440a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 -- 172.21.15.89:0/530811269 >> v2:172.21.15.97:3300/0 conn(0x7ff044155f00 msgr2=0x7ff0440a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 --2- 172.21.15.89:0/530811269 >> v2:172.21.15.97:3300/0 conn(0x7ff044155f00 0x7ff0440a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 -- 172.21.15.89:0/530811269 >> v1:172.21.15.97:6789/0 conn(0x7ff044156770 legacy=0x7ff0440c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.852+0000 7ff03bfff640 1 -- 172.21.15.89:0/530811269 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440ac090 con 0x7ff0441562e0 2023-12-07T10:02:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff03bfff640 1 --2- 172.21.15.89:0/530811269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0441562e0 0x7ff04406cf10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009870 tx=0x7ff02c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554aa5a7da5a38a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff042ffd640 1 -- 172.21.15.89:0/530811269 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0ab600 con 0x7ff0441562e0 2023-12-07T10:02:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff042ffd640 1 -- 172.21.15.89:0/530811269 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0a7050 con 0x7ff0441562e0 2023-12-07T10:02:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff042ffd640 1 -- 172.21.15.89:0/530811269 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0ab980 con 0x7ff0441562e0 2023-12-07T10:02:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 -- 172.21.15.89:0/530811269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0441562e0 msgr2=0x7ff04406cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 --2- 172.21.15.89:0/530811269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0441562e0 0x7ff04406cf10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009870 tx=0x7ff02c01c430 comp rx=0 tx=0).stop 2023-12-07T10:02:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 -- 172.21.15.89:0/530811269 shutdown_connections 2023-12-07T10:02:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 --2- 172.21.15.89:0/530811269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0441562e0 0x7ff04406cf10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 --2- 172.21.15.89:0/530811269 >> v2:172.21.15.97:3300/0 conn(0x7ff044155f00 0x7ff0440a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 -- 172.21.15.89:0/530811269 >> 172.21.15.89:0/530811269 conn(0x7ff04406a5a0 msgr2=0x7ff04406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 -- 172.21.15.89:0/530811269 shutdown_connections 2023-12-07T10:02:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 -- 172.21.15.89:0/530811269 wait complete. 2023-12-07T10:02:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 Processor -- start 2023-12-07T10:02:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 -- start start 2023-12-07T10:02:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.856+0000 7ff04a054640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 0x7ff0441eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0441562e0 0x7ff044148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff044156770 0x7ff044149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0441eba90 con 0x7ff044155f00 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0441505c0 con 0x7ff0441562e0 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0441508a0 con 0x7ff044156770 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 0x7ff0441eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 0x7ff0441eb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57194/0 (socket says 172.21.15.89:57194) 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 -- 172.21.15.89:0/423497267 learned_addr learned my addr 172.21.15.89:0/423497267 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff03bfff640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0441562e0 0x7ff044148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff043fff640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff044156770 0x7ff044149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 -- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff044156770 msgr2=0x7ff044149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff044156770 0x7ff044149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 -- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0441562e0 msgr2=0x7ff044148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0441562e0 0x7ff044148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 -- 172.21.15.89:0/423497267 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0094d0 con 0x7ff044155f00 2023-12-07T10:02:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff0437fe640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 0x7ff0441eb550 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d5f0 tx=0x7ff03400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340125f0 con 0x7ff044155f00 2023-12-07T10:02:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034012750 con 0x7ff044155f00 2023-12-07T10:02:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034012ae0 con 0x7ff044155f00 2023-12-07T10:02:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff044150b80 con 0x7ff044155f00 2023-12-07T10:02:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff044155160 con 0x7ff044155f00 2023-12-07T10:02:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff044149260 con 0x7ff044155f00 2023-12-07T10:02:05.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.860+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff034012c40 con 0x7ff044155f00 2023-12-07T10:02:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.864+0000 7ff040ff9640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff024066900 0x7ff024068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.864+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff034084930 con 0x7ff044155f00 2023-12-07T10:02:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.864+0000 7ff03bfff640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff024066900 0x7ff024068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.864+0000 7ff03bfff640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff024066900 0x7ff024068dc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ad000 tx=0x7ff02c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:05.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:05.868+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff034051b60 con 0x7ff044155f00 2023-12-07T10:02:06.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.016+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff0441ee0d0 con 0x7ff044155f00 2023-12-07T10:02:06.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.496+0000 7ff040ff9640 1 -- 172.21.15.89:0/423497267 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v68) v1 ==== 140+0+0 (secure 0 0 0) 0x7ff034004650 con 0x7ff044155f00 2023-12-07T10:02:06.502 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_metadata' created 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff024066900 msgr2=0x7ff024068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff024066900 0x7ff024068dc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ad000 tx=0x7ff02c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 msgr2=0x7ff0441eb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 0x7ff0441eb550 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d5f0 tx=0x7ff03400dab0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 shutdown_connections 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff024066900 0x7ff024068dc0 secure :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ad000 tx=0x7ff02c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff044156770 0x7ff044149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0441562e0 0x7ff044148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 --2- 172.21.15.89:0/423497267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff044155f00 0x7ff0441eb550 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 >> 172.21.15.89:0/423497267 conn(0x7ff04406a5a0 msgr2=0x7ff0440ab030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 shutdown_connections 2023-12-07T10:02:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.500+0000 7ff04a054640 1 -- 172.21.15.89:0/423497267 wait complete. 2023-12-07T10:02:06.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T10:02:06.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 Processor -- start 2023-12-07T10:02:06.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 -- start start 2023-12-07T10:02:06.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc8440c8430 0x7fc84406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8440c7f20 0x7fc84406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84406cf70 con 0x7fc844151d80 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc844152160 con 0x7fc8440c8430 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc84aa79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c6a30 con 0x7fc8440c7f20 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc843fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc8440c8430 0x7fc84406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc848815640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc844151d80 0x7fc8440c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55198/0 (socket says 172.21.15.89:55198) 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc843fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc8440c8430 0x7fc84406b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57196/0 (socket says 172.21.15.89:57196) 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc848815640 1 -- 172.21.15.89:0/1905444974 learned_addr learned my addr 172.21.15.89:0/1905444974 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc849016640 1 --2- 172.21.15.89:0/1905444974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8440c7f20 0x7fc84406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:06.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc843fff640 1 -- 172.21.15.89:0/1905444974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8440c7f20 msgr2=0x7fc84406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:06.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc843fff640 1 --2- 172.21.15.89:0/1905444974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8440c7f20 0x7fc84406bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc843fff640 1 -- 172.21.15.89:0/1905444974 >> v1:172.21.15.89:6789/0 conn(0x7fc844151d80 legacy=0x7fc8440c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:06.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.672+0000 7fc843fff640 1 -- 172.21.15.89:0/1905444974 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440c72d0 con 0x7fc8440c8430 2023-12-07T10:02:06.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc843fff640 1 --2- 172.21.15.89:0/1905444974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c8430 0x7fc84406b720 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc8300097c0 tx=0x7fc83001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa79e842a919e6c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:06.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc8437fe640 1 -- 172.21.15.89:0/1905444974 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300ac620 con 0x7fc8440c8430 2023-12-07T10:02:06.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc8437fe640 1 -- 172.21.15.89:0/1905444974 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8300ac780 con 0x7fc8440c8430 2023-12-07T10:02:06.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc8437fe640 1 -- 172.21.15.89:0/1905444974 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300acb10 con 0x7fc8440c8430 2023-12-07T10:02:06.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 -- 172.21.15.89:0/1905444974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c8430 msgr2=0x7fc84406b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:06.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 --2- 172.21.15.89:0/1905444974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c8430 0x7fc84406b720 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc8300097c0 tx=0x7fc83001c3c0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 -- 172.21.15.89:0/1905444974 shutdown_connections 2023-12-07T10:02:06.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 --2- 172.21.15.89:0/1905444974 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc8440c7f20 0x7fc84406bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 --2- 172.21.15.89:0/1905444974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c8430 0x7fc84406b720 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 -- 172.21.15.89:0/1905444974 >> 172.21.15.89:0/1905444974 conn(0x7fc8440abd00 msgr2=0x7fc8440ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:06.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 -- 172.21.15.89:0/1905444974 shutdown_connections 2023-12-07T10:02:06.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.676+0000 7fc84aa79640 1 -- 172.21.15.89:0/1905444974 wait complete. 2023-12-07T10:02:06.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 Processor -- start 2023-12-07T10:02:06.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- start start 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 0x7fc84414be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8440c8430 0x7fc84414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc844151d80 0x7fc84414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844145da0 con 0x7fc8440c7f20 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441f1480 con 0x7fc8440c8430 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441f1760 con 0x7fc844151d80 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 0x7fc84414be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 0x7fc84414be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57202/0 (socket says 172.21.15.89:57202) 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 -- 172.21.15.89:0/4135413995 learned_addr learned my addr 172.21.15.89:0/4135413995 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc849016640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc844151d80 0x7fc84414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:06.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc843fff640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8440c8430 0x7fc84414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:06.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 -- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc844151d80 msgr2=0x7fc84414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:06.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc844151d80 0x7fc84414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 -- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8440c8430 msgr2=0x7fc84414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8440c8430 0x7fc84414af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 -- 172.21.15.89:0/4135413995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830009420 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc848815640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 0x7fc84414be20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c400 tx=0x7fc83800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838005cf0 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838005e50 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc844145750 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380072d0 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84414b450 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.680+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8440c4dc0 con 0x7fc8440c7f20 2023-12-07T10:02:06.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.684+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc838007430 con 0x7fc8440c7f20 2023-12-07T10:02:06.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.684+0000 7fc8417fa640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc8280668d0 0x7fc828068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:06.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.684+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fc838083a60 con 0x7fc8440c7f20 2023-12-07T10:02:06.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.684+0000 7fc843fff640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc8280668d0 0x7fc828068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:06.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.684+0000 7fc843fff640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc8280668d0 0x7fc828068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc8300ae000 tx=0x7fc830008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:06.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.688+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc838050bf0 con 0x7fc8440c7f20 2023-12-07T10:02:06.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:06.840+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc84404e890 con 0x7fc8440c7f20 2023-12-07T10:02:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.504+0000 7fc8417fa640 1 -- 172.21.15.89:0/4135413995 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v69) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc8380170d0 con 0x7fc8440c7f20 2023-12-07T10:02:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_data' created 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc8280668d0 msgr2=0x7fc828068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc8280668d0 0x7fc828068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc8300ae000 tx=0x7fc830008040 comp rx=0 tx=0).stop 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 msgr2=0x7fc84414be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 0x7fc84414be20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c400 tx=0x7fc83800c8c0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 shutdown_connections 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc8280668d0 0x7fc828068d90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc844151d80 0x7fc84414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8440c8430 0x7fc84414af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 --2- 172.21.15.89:0/4135413995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8440c7f20 0x7fc84414be20 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 >> 172.21.15.89:0/4135413995 conn(0x7fc8440abd00 msgr2=0x7fc8440ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:07.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 shutdown_connections 2023-12-07T10:02:07.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.508+0000 7fc84aa79640 1 -- 172.21.15.89:0/4135413995 wait complete. 2023-12-07T10:02:07.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-07T10:02:07.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.684+0000 7f0bcb25a640 1 Processor -- start 2023-12-07T10:02:07.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.684+0000 7f0bcb25a640 1 -- start start 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bcb25a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0bc414eaf0 0x7f0bc4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bcb25a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0bc40c0370 0x7f0bc406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bcb25a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc406de00 con 0x7f0bc4151f90 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bcb25a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc4070390 con 0x7f0bc40c0370 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bcb25a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc414eed0 con 0x7f0bc414eaf0 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0bc4151f90 0x7f0bc406d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55204/0 (socket says 172.21.15.89:55204) 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc3fff640 1 -- 172.21.15.89:0/3843376912 learned_addr learned my addr 172.21.15.89:0/3843376912 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc97f7640 1 --2- 172.21.15.89:0/3843376912 >> v2:172.21.15.89:3300/0 conn(0x7f0bc40c0370 0x7f0bc406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc8ff6640 1 --2- 172.21.15.89:0/3843376912 >> v2:172.21.15.97:3300/0 conn(0x7f0bc414eaf0 0x7f0bc4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc37fe640 1 -- 172.21.15.89:0/3843376912 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485478917 0 0) 0x7f0bc406de00 con 0x7f0bc4151f90 2023-12-07T10:02:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc37fe640 1 -- 172.21.15.89:0/3843376912 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb4005740 con 0x7f0bc4151f90 2023-12-07T10:02:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc97f7640 1 -- 172.21.15.89:0/3843376912 >> v2:172.21.15.97:3300/0 conn(0x7f0bc414eaf0 msgr2=0x7f0bc4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc97f7640 1 --2- 172.21.15.89:0/3843376912 >> v2:172.21.15.97:3300/0 conn(0x7f0bc414eaf0 0x7f0bc4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc97f7640 1 -- 172.21.15.89:0/3843376912 >> v1:172.21.15.89:6789/0 conn(0x7f0bc4151f90 legacy=0x7f0bc406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.688+0000 7f0bc97f7640 1 -- 172.21.15.89:0/3843376912 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4151270 con 0x7f0bc40c0370 2023-12-07T10:02:07.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bc97f7640 1 --2- 172.21.15.89:0/3843376912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40c0370 0x7f0bc406d820 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40c3b00 tx=0x7f0bbc01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b12ba7988ea407 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:07.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bc37fe640 1 -- 172.21.15.89:0/3843376912 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0a5780 con 0x7f0bc40c0370 2023-12-07T10:02:07.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bc37fe640 1 -- 172.21.15.89:0/3843376912 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0a58e0 con 0x7f0bc40c0370 2023-12-07T10:02:07.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bc37fe640 1 -- 172.21.15.89:0/3843376912 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0a5c70 con 0x7f0bc40c0370 2023-12-07T10:02:07.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 -- 172.21.15.89:0/3843376912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40c0370 msgr2=0x7f0bc406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:07.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/3843376912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40c0370 0x7f0bc406d820 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40c3b00 tx=0x7f0bbc01c7c0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 -- 172.21.15.89:0/3843376912 shutdown_connections 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/3843376912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40c0370 0x7f0bc406d820 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/3843376912 >> v2:172.21.15.97:3300/0 conn(0x7f0bc414eaf0 0x7f0bc4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 -- 172.21.15.89:0/3843376912 >> 172.21.15.89:0/3843376912 conn(0x7f0bc40c2a60 msgr2=0x7f0bc40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 -- 172.21.15.89:0/3843376912 shutdown_connections 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 -- 172.21.15.89:0/3843376912 wait complete. 2023-12-07T10:02:07.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 Processor -- start 2023-12-07T10:02:07.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.692+0000 7f0bcb25a640 1 -- start start 2023-12-07T10:02:07.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bc40c0370 0x7f0bc413cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:07.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 0x7f0bc41e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bc40c2560 0x7f0bc41e9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc41e9a50 con 0x7f0bc414eaf0 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc41ece10 con 0x7f0bc40c2560 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc41ec520 con 0x7f0bc40c0370 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 0x7f0bc41e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc8ff6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bc40c0370 0x7f0bc413cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 0x7f0bc41e8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57222/0 (socket says 172.21.15.89:57222) 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 -- 172.21.15.89:0/1330311606 learned_addr learned my addr 172.21.15.89:0/1330311606 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc97f7640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bc40c2560 0x7f0bc41e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 -- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bc40c0370 msgr2=0x7f0bc413cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bc40c0370 0x7f0bc413cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 -- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bc40c2560 msgr2=0x7f0bc41e9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bc40c2560 0x7f0bc41e9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:07.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 -- 172.21.15.89:0/1330311606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc009a70 con 0x7f0bc414eaf0 2023-12-07T10:02:07.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc3fff640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 0x7f0bc41e8fd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c450 tx=0x7f0bb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:07.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0005cf0 con 0x7f0bc414eaf0 2023-12-07T10:02:07.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0005e50 con 0x7f0bc414eaf0 2023-12-07T10:02:07.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc414a900 con 0x7f0bc414eaf0 2023-12-07T10:02:07.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0007270 con 0x7f0bc414eaf0 2023-12-07T10:02:07.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc41ec7c0 con 0x7f0bc414eaf0 2023-12-07T10:02:07.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.696+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc404e890 con 0x7f0bc414eaf0 2023-12-07T10:02:07.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.700+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0bb00073d0 con 0x7f0bc414eaf0 2023-12-07T10:02:07.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.700+0000 7f0bc17fa640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0ba80668d0 0x7f0ba8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:07.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.700+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f0bb00840d0 con 0x7f0bc414eaf0 2023-12-07T10:02:07.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.700+0000 7f0bc8ff6640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0ba80668d0 0x7f0ba8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:07.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.700+0000 7f0bc8ff6640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0ba80668d0 0x7f0ba8068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007a60 tx=0x7f0bb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:07.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.704+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bb00510b0 con 0x7f0bc414eaf0 2023-12-07T10:02:07.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:07.884+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f0bc4150e50 con 0x7f0bc414eaf0 2023-12-07T10:02:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.520+0000 7f0bc17fa640 1 -- 172.21.15.89:0/1330311606 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v49) v1 ==== 177+0+0 (secure 0 0 0) 0x7f0bb00546d0 con 0x7f0bc414eaf0 2023-12-07T10:02:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 14 and data pool 15 2023-12-07T10:02:08.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.532+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0ba80668d0 msgr2=0x7f0ba8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.532+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0ba80668d0 0x7f0ba8068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007a60 tx=0x7f0bb8008040 comp rx=0 tx=0).stop 2023-12-07T10:02:08.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.532+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 msgr2=0x7f0bc41e8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.532+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 0x7f0bc41e8fd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000c450 tx=0x7f0bb000c910 comp rx=0 tx=0).stop 2023-12-07T10:02:08.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.536+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 shutdown_connections 2023-12-07T10:02:08.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.536+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bc40c2560 0x7f0bc41e9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.536+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc414eaf0 0x7f0bc41e8fd0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.536+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0ba80668d0 0x7f0ba8068d90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.536+0000 7f0bcb25a640 1 --2- 172.21.15.89:0/1330311606 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0bc40c0370 0x7f0bc413cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.536+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 >> 172.21.15.89:0/1330311606 conn(0x7f0bc40c2a60 msgr2=0x7f0bc4154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:08.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.540+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 shutdown_connections 2023-12-07T10:02:08.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.540+0000 7f0bcb25a640 1 -- 172.21.15.89:0/1330311606 wait complete. 2023-12-07T10:02:08.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:08.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 Processor -- start 2023-12-07T10:02:08.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 -- start start 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40ca610 0x7ff0d40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0d40bd720 0x7ff0d40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff0d406cd90 0x7ff0d4158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d4155790 con 0x7ff0d40bd720 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40c4b00 con 0x7ff0d406cd90 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0db18d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c4de0 con 0x7ff0d40ca610 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0d40bd720 0x7ff0d40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0d40bd720 0x7ff0d40c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57226/0 (socket says 172.21.15.89:57226) 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 -- 172.21.15.89:0/2328253747 learned_addr learned my addr 172.21.15.89:0/2328253747 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d972a640 1 --2- 172.21.15.89:0/2328253747 >> v2:172.21.15.97:3300/0 conn(0x7ff0d406cd90 0x7ff0d4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d8f29640 1 --2- 172.21.15.89:0/2328253747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40ca610 0x7ff0d40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 -- 172.21.15.89:0/2328253747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40ca610 msgr2=0x7ff0d40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 --2- 172.21.15.89:0/2328253747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40ca610 0x7ff0d40c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 -- 172.21.15.89:0/2328253747 >> v2:172.21.15.97:3300/0 conn(0x7ff0d406cd90 msgr2=0x7ff0d4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 --2- 172.21.15.89:0/2328253747 >> v2:172.21.15.97:3300/0 conn(0x7ff0d406cd90 0x7ff0d4158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.708+0000 7ff0d3fff640 1 -- 172.21.15.89:0/2328253747 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4157e30 con 0x7ff0d40bd720 2023-12-07T10:02:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0d3fff640 1 --2- 172.21.15.89:0/2328253747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d40bd720 0x7ff0d40c9a00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4152370 tx=0x7ff0c001c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d2a5326f6d412b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0d37fe640 1 -- 172.21.15.89:0/2328253747 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40c52d0 con 0x7ff0d40bd720 2023-12-07T10:02:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0d37fe640 1 -- 172.21.15.89:0/2328253747 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00a4880 con 0x7ff0d40bd720 2023-12-07T10:02:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0d37fe640 1 -- 172.21.15.89:0/2328253747 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00a4c10 con 0x7ff0d40bd720 2023-12-07T10:02:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 -- 172.21.15.89:0/2328253747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d40bd720 msgr2=0x7ff0d40c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 --2- 172.21.15.89:0/2328253747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d40bd720 0x7ff0d40c9a00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4152370 tx=0x7ff0c001c0c0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 -- 172.21.15.89:0/2328253747 shutdown_connections 2023-12-07T10:02:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 --2- 172.21.15.89:0/2328253747 >> v2:172.21.15.97:3300/0 conn(0x7ff0d406cd90 0x7ff0d4158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 --2- 172.21.15.89:0/2328253747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d40bd720 0x7ff0d40c9a00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 --2- 172.21.15.89:0/2328253747 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40ca610 0x7ff0d40c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 -- 172.21.15.89:0/2328253747 >> 172.21.15.89:0/2328253747 conn(0x7ff0d4071ea0 msgr2=0x7ff0d40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:08.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 -- 172.21.15.89:0/2328253747 shutdown_connections 2023-12-07T10:02:08.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 -- 172.21.15.89:0/2328253747 wait complete. 2023-12-07T10:02:08.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.712+0000 7ff0db18d640 1 Processor -- start 2023-12-07T10:02:08.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- start start 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 0x7ff0d4147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40bd720 0x7ff0d40ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0d40ca610 0x7ff0d40a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4149900 con 0x7ff0d406cd90 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4157bb0 con 0x7ff0d40ca610 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4148550 con 0x7ff0d40bd720 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 0x7ff0d4147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 0x7ff0d4147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57242/0 (socket says 172.21.15.89:57242) 2023-12-07T10:02:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 -- 172.21.15.89:0/1701264491 learned_addr learned my addr 172.21.15.89:0/1701264491 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d3fff640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40bd720 0x7ff0d40ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d972a640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0d40ca610 0x7ff0d40a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 -- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40bd720 msgr2=0x7ff0d40ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40bd720 0x7ff0d40ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 -- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0d40ca610 msgr2=0x7ff0d40a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0d40ca610 0x7ff0d40a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 -- 172.21.15.89:0/1701264491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00094d0 con 0x7ff0d406cd90 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d8f29640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 0x7ff0d4147b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800d5f0 tx=0x7ff0c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80125f0 con 0x7ff0d406cd90 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8012750 con 0x7ff0d406cd90 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8012ae0 con 0x7ff0d406cd90 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d40aae00 con 0x7ff0d406cd90 2023-12-07T10:02:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40aab20 con 0x7ff0d406cd90 2023-12-07T10:02:08.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.716+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d404e890 con 0x7ff0d406cd90 2023-12-07T10:02:08.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.720+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0c8012c40 con 0x7ff0d406cd90 2023-12-07T10:02:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.720+0000 7ff0d17fa640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0b8066900 0x7ff0b8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.720+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff0c8084b10 con 0x7ff0d406cd90 2023-12-07T10:02:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.720+0000 7ff0d3fff640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0b8066900 0x7ff0b8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.720+0000 7ff0d3fff640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0b8066900 0x7ff0b8068dc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00ae000 tx=0x7ff0c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:08.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.724+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0c8051a80 con 0x7ff0d406cd90 2023-12-07T10:02:08.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.872+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d41577d0 con 0x7ff0d406cd90 2023-12-07T10:02:08.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0d17fa640 1 -- 172.21.15.89:0/1701264491 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+20167 (secure 0 0 0) 0x7ff0c8004650 con 0x7ff0d406cd90 2023-12-07T10:02:08.879 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:08.879 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":70,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:07.889672+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:08.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0b8066900 msgr2=0x7ff0b8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0b8066900 0x7ff0b8068dc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00ae000 tx=0x7ff0c0009040 comp rx=0 tx=0).stop 2023-12-07T10:02:08.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 msgr2=0x7ff0d4147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:08.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 0x7ff0d4147b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800d5f0 tx=0x7ff0c800dab0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 shutdown_connections 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff0d40ca610 0x7ff0d40a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff0b8066900 0x7ff0b8068dc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff0d40bd720 0x7ff0d40ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 --2- 172.21.15.89:0/1701264491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d406cd90 0x7ff0d4147b20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 >> 172.21.15.89:0/1701264491 conn(0x7ff0d4071ea0 msgr2=0x7ff0d40c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 shutdown_connections 2023-12-07T10:02:08.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:08.876+0000 7ff0db18d640 1 -- 172.21.15.89:0/1701264491 wait complete. 2023-12-07T10:02:08.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.032+0000 7f388e3f8640 1 Processor -- start 2023-12-07T10:02:09.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.032+0000 7f388e3f8640 1 -- start start 2023-12-07T10:02:09.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f388e3f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f38880ca610 0x7f38880c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f388e3f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f388806cd90 0x7f38880c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f388e3f8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3888155790 con 0x7f38880bd720 2023-12-07T10:02:09.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f388e3f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38880c4b00 con 0x7f388806cd90 2023-12-07T10:02:09.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f388e3f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38880c4de0 con 0x7f38880ca610 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f38877fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f38880bd720 0x7f3888158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55218/0 (socket says 172.21.15.89:55218) 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f38877fe640 1 -- 172.21.15.89:0/3550846428 learned_addr learned my addr 172.21.15.89:0/3550846428 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3887fff640 1 --2- 172.21.15.89:0/3550846428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f38880ca610 0x7f38880c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f388c995640 1 --2- 172.21.15.89:0/3550846428 >> v2:172.21.15.97:3300/0 conn(0x7f388806cd90 0x7f38880c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3886ffd640 1 -- 172.21.15.89:0/3550846428 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247382715 0 0) 0x7f3888155790 con 0x7f38880bd720 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3886ffd640 1 -- 172.21.15.89:0/3550846428 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3870003530 con 0x7f38880bd720 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3887fff640 1 -- 172.21.15.89:0/3550846428 >> v2:172.21.15.97:3300/0 conn(0x7f388806cd90 msgr2=0x7f38880c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3887fff640 1 --2- 172.21.15.89:0/3550846428 >> v2:172.21.15.97:3300/0 conn(0x7f388806cd90 0x7f38880c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3887fff640 1 -- 172.21.15.89:0/3550846428 >> v1:172.21.15.89:6789/0 conn(0x7f38880bd720 legacy=0x7f3888158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.036+0000 7f3887fff640 1 -- 172.21.15.89:0/3550846428 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888157e30 con 0x7f38880ca610 2023-12-07T10:02:09.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f3887fff640 1 --2- 172.21.15.89:0/3550846428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f38880ca610 0x7f38880c94c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38780097c0 tx=0x7f387801c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67e24834d28a0e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:09.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f3886ffd640 1 -- 172.21.15.89:0/3550846428 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880c52d0 con 0x7f38880ca610 2023-12-07T10:02:09.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f3886ffd640 1 -- 172.21.15.89:0/3550846428 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38780a4880 con 0x7f38880ca610 2023-12-07T10:02:09.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f3886ffd640 1 -- 172.21.15.89:0/3550846428 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780a4c10 con 0x7f38880ca610 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 -- 172.21.15.89:0/3550846428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f38880ca610 msgr2=0x7f38880c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 --2- 172.21.15.89:0/3550846428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f38880ca610 0x7f38880c94c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38780097c0 tx=0x7f387801c040 comp rx=0 tx=0).stop 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 -- 172.21.15.89:0/3550846428 shutdown_connections 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 --2- 172.21.15.89:0/3550846428 >> v2:172.21.15.97:3300/0 conn(0x7f388806cd90 0x7f38880c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 --2- 172.21.15.89:0/3550846428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f38880ca610 0x7f38880c94c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 -- 172.21.15.89:0/3550846428 >> 172.21.15.89:0/3550846428 conn(0x7f3888071ea0 msgr2=0x7f38880722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 -- 172.21.15.89:0/3550846428 shutdown_connections 2023-12-07T10:02:09.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 -- 172.21.15.89:0/3550846428 wait complete. 2023-12-07T10:02:09.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 Processor -- start 2023-12-07T10:02:09.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.040+0000 7f388e3f8640 1 -- start start 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f388806cd90 0x7f388814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 0x7f388814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38880ca610 0x7f388814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388814abf0 con 0x7f38880bd720 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3888154350 con 0x7f38880ca610 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3888153a40 con 0x7f388806cd90 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 0x7f388814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 0x7f388814bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57248/0 (socket says 172.21.15.89:57248) 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 -- 172.21.15.89:0/1632927083 learned_addr learned my addr 172.21.15.89:0/1632927083 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f3887fff640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f388806cd90 0x7f388814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388c995640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38880ca610 0x7f388814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 -- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f388806cd90 msgr2=0x7f388814a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f388806cd90 0x7f388814a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 -- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38880ca610 msgr2=0x7f388814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38880ca610 0x7f388814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 -- 172.21.15.89:0/1632927083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009420 con 0x7f38880bd720 2023-12-07T10:02:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f38877fe640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 0x7f388814bf90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c4d0 tx=0x7f387c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c005cf0 con 0x7f38880bd720 2023-12-07T10:02:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c005e50 con 0x7f38880bd720 2023-12-07T10:02:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3888153d00 con 0x7f38880bd720 2023-12-07T10:02:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c007270 con 0x7f38880bd720 2023-12-07T10:02:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38881571f0 con 0x7f38880bd720 2023-12-07T10:02:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38880aa8e0 con 0x7f38880bd720 2023-12-07T10:02:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.044+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f387c0073d0 con 0x7f38880bd720 2023-12-07T10:02:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.048+0000 7f3884ff9640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3874066900 0x7f3874068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.048+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f387c083c20 con 0x7f38880bd720 2023-12-07T10:02:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.048+0000 7f3887fff640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3874066900 0x7f3874068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.048+0000 7f3887fff640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3874066900 0x7f3874068dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38780ae000 tx=0x7f38780a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:09.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.052+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f387c050ba0 con 0x7f38880bd720 2023-12-07T10:02:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.200+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f388804e890 con 0x7f38880bd720 2023-12-07T10:02:09.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f3884ff9640 1 -- 172.21.15.89:0/1632927083 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+20167 (secure 0 0 0) 0x7f387c017020 con 0x7f38880bd720 2023-12-07T10:02:09.208 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:09.208 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":70,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:07.889672+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3874066900 msgr2=0x7f3874068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3874066900 0x7f3874068dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38780ae000 tx=0x7f38780a6070 comp rx=0 tx=0).stop 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 msgr2=0x7f388814bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 0x7f388814bf90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c4d0 tx=0x7f387c00c990 comp rx=0 tx=0).stop 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 shutdown_connections 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38880ca610 0x7f388814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38880bd720 0x7f388814bf90 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3874066900 0x7f3874068dc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 --2- 172.21.15.89:0/1632927083 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f388806cd90 0x7f388814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 >> 172.21.15.89:0/1632927083 conn(0x7f3888071ea0 msgr2=0x7f388814f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 shutdown_connections 2023-12-07T10:02:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.204+0000 7f388e3f8640 1 -- 172.21.15.89:0/1632927083 wait complete. 2023-12-07T10:02:09.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-07T10:02:09.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.364+0000 7f0ac185a640 1 Processor -- start 2023-12-07T10:02:09.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.364+0000 7f0ac185a640 1 -- start start 2023-12-07T10:02:09.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ac185a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0abc070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ac185a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0abc06df30 0x7f0abc0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ac185a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc154b90 con 0x7f0abc154000 2023-12-07T10:02:09.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ac185a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0a8710 con 0x7f0abc06df30 2023-12-07T10:02:09.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ac185a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0abd70 con 0x7f0abc0700f0 2023-12-07T10:02:09.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abaffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0abc154000 0x7f0abc1543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55234/0 (socket says 172.21.15.89:55234) 2023-12-07T10:02:09.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abaffd640 1 -- 172.21.15.89:0/1348769374 learned_addr learned my addr 172.21.15.89:0/1348769374 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ab27fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0abc070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/1348769374 >> v2:172.21.15.97:3300/0 conn(0x7f0abc06df30 0x7f0abc0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942864927 0 0) 0x7f0abc154b90 con 0x7f0abc154000 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa8003530 con 0x7f0abc154000 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3114832993 0 0) 0x7f0aa8003530 con 0x7f0abc154000 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 msgr2=0x7f0abc070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0abc070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 >> v2:172.21.15.97:3300/0 conn(0x7f0abc06df30 msgr2=0x7f0abc0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 --2- 172.21.15.89:0/1348769374 >> v2:172.21.15.97:3300/0 conn(0x7f0abc06df30 0x7f0abc0714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0ab820 con 0x7f0abc154000 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f0aa4001680 con 0x7f0abc154000 2023-12-07T10:02:09.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ab27fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0abc070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 >> v1:172.21.15.89:6789/0 conn(0x7f0abc154000 legacy=0x7f0abc1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0aa8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa8003f10 0x7f0aa80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa8004d10 0x7f0aa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0abd70 con 0x7f0aa8004d10 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa800ba40 con 0x7f0aa8003f10 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa800bbd0 con 0x7f0abc0700f0 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa8004d10 0x7f0aa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abaffd640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0aa8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0ab27fc640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa8003f10 0x7f0aa80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 -- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 msgr2=0x7f0aa8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0abc0700f0 0x7f0aa8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 -- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa8003f10 msgr2=0x7f0aa80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa8003f10 0x7f0aa80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.368+0000 7f0abb7fe640 1 -- 172.21.15.89:0/1348769374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac009420 con 0x7f0aa8004d10 2023-12-07T10:02:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa8004d10 0x7f0aa8005190 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e170 tx=0x7f0ab401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4568887e8e117ddc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40a5b00 con 0x7f0aa8004d10 2023-12-07T10:02:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400f040 con 0x7f0aa8004d10 2023-12-07T10:02:09.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0aba7fc640 1 -- 172.21.15.89:0/1348769374 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40a5ea0 con 0x7f0aa8004d10 2023-12-07T10:02:09.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0ac185a640 1 -- 172.21.15.89:0/1348769374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa8004d10 msgr2=0x7f0aa8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0ac185a640 1 --2- 172.21.15.89:0/1348769374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa8004d10 0x7f0aa8005190 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e170 tx=0x7f0ab401cc80 comp rx=0 tx=0).stop 2023-12-07T10:02:09.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0abb7fe640 1 -- 172.21.15.89:0/1348769374 reap_dead start 2023-12-07T10:02:09.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0ac185a640 1 -- 172.21.15.89:0/1348769374 shutdown_connections 2023-12-07T10:02:09.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0ac185a640 1 -- 172.21.15.89:0/1348769374 >> 172.21.15.89:0/1348769374 conn(0x7f0abc0c2a60 msgr2=0x7f0abc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:09.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0ac185a640 1 -- 172.21.15.89:0/1348769374 shutdown_connections 2023-12-07T10:02:09.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.372+0000 7f0ac185a640 1 -- 172.21.15.89:0/1348769374 wait complete. 2023-12-07T10:02:09.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 Processor -- start 2023-12-07T10:02:09.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- start start 2023-12-07T10:02:09.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0aa8004d10 0x7f0abc1eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0abc0c3b50 0x7f0abc146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 0x7f0abc14caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0c3fe0 con 0x7f0abc0baf80 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0c42c0 con 0x7f0abc0c3b50 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1ee120 con 0x7f0aa8004d10 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 0x7f0abc14caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 0x7f0abc14caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57268/0 (socket says 172.21.15.89:57268) 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 -- 172.21.15.89:0/2450809936 learned_addr learned my addr 172.21.15.89:0/2450809936 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abaffd640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0aa8004d10 0x7f0abc1eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ab27fc640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0abc0c3b50 0x7f0abc146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 -- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0aa8004d10 msgr2=0x7f0abc1eec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0aa8004d10 0x7f0abc1eec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 -- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0abc0c3b50 msgr2=0x7f0abc146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:09.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0abc0c3b50 0x7f0abc146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:09.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 -- 172.21.15.89:0/2450809936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc1ee400 con 0x7f0abc0baf80 2023-12-07T10:02:09.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0abb7fe640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 0x7f0abc14caa0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e170 tx=0x7f0ab4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:09.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40ba070 con 0x7f0abc0baf80 2023-12-07T10:02:09.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40039a0 con 0x7f0abc0baf80 2023-12-07T10:02:09.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4003b30 con 0x7f0abc0baf80 2023-12-07T10:02:09.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc1ee6e0 con 0x7f0abc0baf80 2023-12-07T10:02:09.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc0bfe90 con 0x7f0abc0baf80 2023-12-07T10:02:09.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.376+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc04e890 con 0x7f0abc0baf80 2023-12-07T10:02:09.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.380+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ab40b4040 con 0x7f0abc0baf80 2023-12-07T10:02:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.380+0000 7f0ab8ff9640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a9c0668d0 0x7f0a9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.380+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ab40a5e40 con 0x7f0abc0baf80 2023-12-07T10:02:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.380+0000 7f0abaffd640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a9c0668d0 0x7f0a9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.380+0000 7f0abaffd640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a9c0668d0 0x7f0a9c068d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40010f0 tx=0x7f0aa4001de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:09.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.384+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ab40eaf80 con 0x7f0abc0baf80 2023-12-07T10:02:09.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:09.568+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0abc15afb0 con 0x7f0abc0baf80 2023-12-07T10:02:10.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ab8ff9640 1 -- 172.21.15.89:0/2450809936 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 119+0+0 (secure 0 0 0) 0x7f0ab40b20b0 con 0x7f0abc0baf80 2023-12-07T10:02:10.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a9c0668d0 msgr2=0x7f0a9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:10.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a9c0668d0 0x7f0a9c068d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40010f0 tx=0x7f0aa4001de0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 msgr2=0x7f0abc14caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 0x7f0abc14caa0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e170 tx=0x7f0ab4009750 comp rx=0 tx=0).stop 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 shutdown_connections 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0abc0baf80 0x7f0abc14caa0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0abc0c3b50 0x7f0abc146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f0a9c0668d0 0x7f0a9c068d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 --2- 172.21.15.89:0/2450809936 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0aa8004d10 0x7f0abc1eec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 >> 172.21.15.89:0/2450809936 conn(0x7f0abc0c2a60 msgr2=0x7f0abc15a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 shutdown_connections 2023-12-07T10:02:10.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.536+0000 7f0ac185a640 1 -- 172.21.15.89:0/2450809936 wait complete. 2023-12-07T10:02:10.566 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T10:02:10.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-07T10:02:10.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.704+0000 7fd9baf1d640 1 Processor -- start 2023-12-07T10:02:10.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.704+0000 7fd9baf1d640 1 -- start start 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9baf1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd9b40c0370 0x7fd9b406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9baf1d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b40a8470 0x7fd9b406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9baf1d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b406de00 con 0x7fd9b414eaf0 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9baf1d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b4070390 con 0x7fd9b40a8470 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9baf1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b406db90 con 0x7fd9b40c0370 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b94ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b40a8470 0x7fd9b406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b8cb9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd9b414eaf0 0x7fd9b4151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35094/0 (socket says 172.21.15.89:35094) 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b94ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b40a8470 0x7fd9b406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48088/0 (socket says 172.21.15.89:48088) 2023-12-07T10:02:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b8cb9640 1 -- 172.21.15.89:0/4079530230 learned_addr learned my addr 172.21.15.89:0/4079530230 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9abfff640 1 --2- 172.21.15.89:0/4079530230 >> v2:172.21.15.97:3300/0 conn(0x7fd9b40c0370 0x7fd9b406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b94ba640 1 -- 172.21.15.89:0/4079530230 >> v2:172.21.15.97:3300/0 conn(0x7fd9b40c0370 msgr2=0x7fd9b406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b94ba640 1 --2- 172.21.15.89:0/4079530230 >> v2:172.21.15.97:3300/0 conn(0x7fd9b40c0370 0x7fd9b406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b94ba640 1 -- 172.21.15.89:0/4079530230 >> v1:172.21.15.89:6789/0 conn(0x7fd9b414eaf0 legacy=0x7fd9b4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9b94ba640 1 -- 172.21.15.89:0/4079530230 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b414eed0 con 0x7fd9b40a8470 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9ab7fe640 1 -- 172.21.15.89:0/4079530230 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330008381 0 0) 0x7fd9b406de00 con 0x7fd9b414eaf0 2023-12-07T10:02:10.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.708+0000 7fd9abfff640 1 --2- 172.21.15.89:0/4079530230 >> v2:172.21.15.97:3300/0 conn(0x7fd9b40c0370 0x7fd9b406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9b94ba640 1 --2- 172.21.15.89:0/4079530230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a8470 0x7fd9b406d650 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd9b406e2d0 tx=0x7fd9ac01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceedff8b9a93a592 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9ab7fe640 1 -- 172.21.15.89:0/4079530230 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0a58d0 con 0x7fd9b40a8470 2023-12-07T10:02:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9ab7fe640 1 -- 172.21.15.89:0/4079530230 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac0a5a30 con 0x7fd9b40a8470 2023-12-07T10:02:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9ab7fe640 1 -- 172.21.15.89:0/4079530230 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0a5dc0 con 0x7fd9b40a8470 2023-12-07T10:02:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 -- 172.21.15.89:0/4079530230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a8470 msgr2=0x7fd9b406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/4079530230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a8470 0x7fd9b406d650 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd9b406e2d0 tx=0x7fd9ac01c7f0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 -- 172.21.15.89:0/4079530230 shutdown_connections 2023-12-07T10:02:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/4079530230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40a8470 0x7fd9b406d650 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/4079530230 >> v2:172.21.15.97:3300/0 conn(0x7fd9b40c0370 0x7fd9b406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 -- 172.21.15.89:0/4079530230 >> 172.21.15.89:0/4079530230 conn(0x7fd9b40c2a60 msgr2=0x7fd9b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 -- 172.21.15.89:0/4079530230 shutdown_connections 2023-12-07T10:02:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 -- 172.21.15.89:0/4079530230 wait complete. 2023-12-07T10:02:10.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 Processor -- start 2023-12-07T10:02:10.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.712+0000 7fd9baf1d640 1 -- start start 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9b40a8470 0x7fd9b40bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 0x7fd9b413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9b414eaf0 0x7fd9b413dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c0960 con 0x7fd9b40c0370 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b41eca80 con 0x7fd9b40a8470 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b413e120 con 0x7fd9b414eaf0 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 0x7fd9b413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 0x7fd9b413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48094/0 (socket says 172.21.15.89:48094) 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 -- 172.21.15.89:0/1238479680 learned_addr learned my addr 172.21.15.89:0/1238479680 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9b8cb9640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9b40a8470 0x7fd9b40bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9b94ba640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9b414eaf0 0x7fd9b413dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 -- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9b414eaf0 msgr2=0x7fd9b413dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:10.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9b414eaf0 0x7fd9b413dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 -- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9b40a8470 msgr2=0x7fd9b40bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:10.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9b40a8470 0x7fd9b40bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:10.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 -- 172.21.15.89:0/1238479680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009a70 con 0x7fd9b40c0370 2023-12-07T10:02:10.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9abfff640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 0x7fd9b413d6a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c7f0 tx=0x7fd9a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:10.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4004220 con 0x7fd9b40c0370 2023-12-07T10:02:10.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a4004380 con 0x7fd9b40c0370 2023-12-07T10:02:10.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b41ecc70 con 0x7fd9b40c0370 2023-12-07T10:02:10.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4003840 con 0x7fd9b40c0370 2023-12-07T10:02:10.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b41ed230 con 0x7fd9b40c0370 2023-12-07T10:02:10.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b404e890 con 0x7fd9b40c0370 2023-12-07T10:02:10.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.716+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd9a4003bb0 con 0x7fd9b40c0370 2023-12-07T10:02:10.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.720+0000 7fd9a97fa640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9a00668d0 0x7fd9a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:10.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.720+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd9a40846b0 con 0x7fd9b40c0370 2023-12-07T10:02:10.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.720+0000 7fd9b8cb9640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9a00668d0 0x7fd9a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:10.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.720+0000 7fd9b8cb9640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9a00668d0 0x7fd9a0068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0000f70 tx=0x7fd9b0007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:10.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.724+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9a40515a0 con 0x7fd9b40c0370 2023-12-07T10:02:10.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:10.908+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd9b4142fc0 con 0x7fd9b40c0370 2023-12-07T10:02:11.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:11.112 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:11.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.540+0000 7fd9a97fa640 1 -- 172.21.15.89:0/1238479680 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd9a4003e60 con 0x7fd9b40c0370 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9a00668d0 msgr2=0x7fd9a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9a00668d0 0x7fd9a0068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0000f70 tx=0x7fd9b0007c10 comp rx=0 tx=0).stop 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 msgr2=0x7fd9b413d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 0x7fd9b413d6a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c7f0 tx=0x7fd9a400ccb0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 shutdown_connections 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9a00668d0 0x7fd9a0068d90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd9b414eaf0 0x7fd9b413dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b40c0370 0x7fd9b413d6a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 --2- 172.21.15.89:0/1238479680 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9b40a8470 0x7fd9b40bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 >> 172.21.15.89:0/1238479680 conn(0x7fd9b40c2a60 msgr2=0x7fd9b4071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:11.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 shutdown_connections 2023-12-07T10:02:11.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.544+0000 7fd9baf1d640 1 -- 172.21.15.89:0/1238479680 wait complete. 2023-12-07T10:02:11.569 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-07T10:02:11.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 Processor -- start 2023-12-07T10:02:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 -- start start 2023-12-07T10:02:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd26414fcc0 0x7fd264156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd26406d980 0x7fd2640aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd264152fe0 con 0x7fd2640ab3b0 2023-12-07T10:02:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640aa340 con 0x7fd26406d980 2023-12-07T10:02:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26c617640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641532c0 con 0x7fd26414fcc0 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd269bb2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd26406d980 0x7fd2640aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26abb4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd2640ab3b0 0x7fd2640c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35108/0 (socket says 172.21.15.89:35108) 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26abb4640 1 -- 172.21.15.89:0/3235016656 learned_addr learned my addr 172.21.15.89:0/3235016656 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26a3b3640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd26414fcc0 0x7fd264156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd269bb2640 1 -- 172.21.15.89:0/3235016656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd26414fcc0 msgr2=0x7fd264156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd269bb2640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd26414fcc0 0x7fd264156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd269bb2640 1 -- 172.21.15.89:0/3235016656 >> v1:172.21.15.89:6789/0 conn(0x7fd2640ab3b0 legacy=0x7fd2640c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd269bb2640 1 -- 172.21.15.89:0/3235016656 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264155a20 con 0x7fd26406d980 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd2693b1640 1 -- 172.21.15.89:0/3235016656 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930920920 0 0) 0x7fd264152fe0 con 0x7fd2640ab3b0 2023-12-07T10:02:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.704+0000 7fd26a3b3640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd26414fcc0 0x7fd264156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:11.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd269bb2640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd2640aae70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd2540097c0 tx=0x7fd25401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daf03d0c38b7ded server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:11.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd2693b1640 1 -- 172.21.15.89:0/3235016656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540ab650 con 0x7fd26406d980 2023-12-07T10:02:11.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd2693b1640 1 -- 172.21.15.89:0/3235016656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2540ab7b0 con 0x7fd26406d980 2023-12-07T10:02:11.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd2693b1640 1 -- 172.21.15.89:0/3235016656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540abb40 con 0x7fd26406d980 2023-12-07T10:02:11.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 -- 172.21.15.89:0/3235016656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 msgr2=0x7fd2640aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd2640aae70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd2540097c0 tx=0x7fd25401c450 comp rx=0 tx=0).stop 2023-12-07T10:02:11.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 -- 172.21.15.89:0/3235016656 shutdown_connections 2023-12-07T10:02:11.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd2640aae70 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 --2- 172.21.15.89:0/3235016656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd26414fcc0 0x7fd264156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 -- 172.21.15.89:0/3235016656 >> 172.21.15.89:0/3235016656 conn(0x7fd2640c2ad0 msgr2=0x7fd2640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:11.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 -- 172.21.15.89:0/3235016656 shutdown_connections 2023-12-07T10:02:11.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.708+0000 7fd26c617640 1 -- 172.21.15.89:0/3235016656 wait complete. 2023-12-07T10:02:11.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 Processor -- start 2023-12-07T10:02:11.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 -- start start 2023-12-07T10:02:11.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd264144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2640ab3b0 0x7fd264149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd264146bd0 0x7fd2641ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264154b30 con 0x7fd26406d980 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264153820 con 0x7fd2640ab3b0 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641f07d0 con 0x7fd264146bd0 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd264144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd264144c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48110/0 (socket says 172.21.15.89:48110) 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 -- 172.21.15.89:0/3427201603 learned_addr learned my addr 172.21.15.89:0/3427201603 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26abb4640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd264146bd0 0x7fd2641ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd269bb2640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2640ab3b0 0x7fd264149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 -- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd264146bd0 msgr2=0x7fd2641ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd264146bd0 0x7fd2641ec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 -- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2640ab3b0 msgr2=0x7fd264149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2640ab3b0 0x7fd264149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 -- 172.21.15.89:0/3427201603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254009420 con 0x7fd26406d980 2023-12-07T10:02:11.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26a3b3640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd264144c10 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd26000c7f0 tx=0x7fd26000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:11.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260007820 con 0x7fd26406d980 2023-12-07T10:02:11.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd260007980 con 0x7fd26406d980 2023-12-07T10:02:11.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260007d30 con 0x7fd26406d980 2023-12-07T10:02:11.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2641f0ab0 con 0x7fd26406d980 2023-12-07T10:02:11.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.712+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd264145150 con 0x7fd26406d980 2023-12-07T10:02:11.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.716+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2641f0c40 con 0x7fd26406d980 2023-12-07T10:02:11.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.716+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd2600113f0 con 0x7fd26406d980 2023-12-07T10:02:11.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.716+0000 7fd25affd640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd248066900 0x7fd248068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:11.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.716+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd260084860 con 0x7fd26406d980 2023-12-07T10:02:11.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.716+0000 7fd269bb2640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd248066900 0x7fd248068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:11.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.716+0000 7fd269bb2640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd248066900 0x7fd248068dc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd2540af000 tx=0x7fd2540a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:11.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.720+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd260051730 con 0x7fd26406d980 2023-12-07T10:02:11.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.900+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd26404e890 con 0x7fd26406d980 2023-12-07T10:02:11.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.900+0000 7fd25affd640 1 -- 172.21.15.89:0/3427201603 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7fd260054d50 con 0x7fd26406d980 2023-12-07T10:02:11.905 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:11.906 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:11.906 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 53 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd248066900 msgr2=0x7fd248068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd248066900 0x7fd248068dc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd2540af000 tx=0x7fd2540a7000 comp rx=0 tx=0).stop 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 msgr2=0x7fd264144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd264144c10 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd26000c7f0 tx=0x7fd26000ccb0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 shutdown_connections 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd248066900 0x7fd248068dc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd264146bd0 0x7fd2641ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2640ab3b0 0x7fd264149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 --2- 172.21.15.89:0/3427201603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd26406d980 0x7fd264144c10 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:11.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 >> 172.21.15.89:0/3427201603 conn(0x7fd2640c2ad0 msgr2=0x7fd264156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:11.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 shutdown_connections 2023-12-07T10:02:11.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:11.904+0000 7fd26c617640 1 -- 172.21.15.89:0/3427201603 wait complete. 2023-12-07T10:02:11.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:12.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 Processor -- start 2023-12-07T10:02:12.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 -- start start 2023-12-07T10:02:12.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e1014e9d0 0x7f4e10151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e100a8470 0x7f4e1006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1006d320 con 0x7f4e10070b80 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100721b0 con 0x7f4e100a8470 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.060+0000 7f4e1872a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c2830 con 0x7f4e1014e9d0 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e15cc5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4e10070b80 0x7f4e100c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35118/0 (socket says 172.21.15.89:35118) 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e15cc5640 1 -- 172.21.15.89:0/3818203531 learned_addr learned my addr 172.21.15.89:0/3818203531 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e164c6640 1 --2- 172.21.15.89:0/3818203531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e1014e9d0 0x7f4e10151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e16cc7640 1 --2- 172.21.15.89:0/3818203531 >> v2:172.21.15.97:3300/0 conn(0x7f4e100a8470 0x7f4e1006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e154c4640 1 -- 172.21.15.89:0/3818203531 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266524428 0 0) 0x7f4e1006d320 con 0x7f4e10070b80 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e154c4640 1 -- 172.21.15.89:0/3818203531 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc003530 con 0x7f4e10070b80 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e164c6640 1 -- 172.21.15.89:0/3818203531 >> v2:172.21.15.97:3300/0 conn(0x7f4e100a8470 msgr2=0x7f4e1006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e164c6640 1 --2- 172.21.15.89:0/3818203531 >> v2:172.21.15.97:3300/0 conn(0x7f4e100a8470 0x7f4e1006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e164c6640 1 -- 172.21.15.89:0/3818203531 >> v1:172.21.15.89:6789/0 conn(0x7f4e10070b80 legacy=0x7f4e100c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e164c6640 1 -- 172.21.15.89:0/3818203531 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10072450 con 0x7f4e1014e9d0 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e164c6640 1 --2- 172.21.15.89:0/3818203531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e1014e9d0 0x7f4e10151e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00ba60 tx=0x7f4e0c01eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0da58743a639fb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.064+0000 7f4e154c4640 1 -- 172.21.15.89:0/3818203531 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0a79a0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e154c4640 1 -- 172.21.15.89:0/3818203531 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0a7b00 con 0x7f4e1014e9d0 2023-12-07T10:02:12.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e154c4640 1 -- 172.21.15.89:0/3818203531 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0a7e90 con 0x7f4e1014e9d0 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- 172.21.15.89:0/3818203531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e1014e9d0 msgr2=0x7f4e10151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 --2- 172.21.15.89:0/3818203531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e1014e9d0 0x7f4e10151e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00ba60 tx=0x7f4e0c01eac0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- 172.21.15.89:0/3818203531 shutdown_connections 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 --2- 172.21.15.89:0/3818203531 >> v2:172.21.15.97:3300/0 conn(0x7f4e100a8470 0x7f4e1006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 --2- 172.21.15.89:0/3818203531 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e1014e9d0 0x7f4e10151e60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- 172.21.15.89:0/3818203531 >> 172.21.15.89:0/3818203531 conn(0x7f4e100c2ad0 msgr2=0x7f4e100c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- 172.21.15.89:0/3818203531 shutdown_connections 2023-12-07T10:02:12.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- 172.21.15.89:0/3818203531 wait complete. 2023-12-07T10:02:12.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 Processor -- start 2023-12-07T10:02:12.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- start start 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e10070b80 0x7f4e100aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e100a8470 0x7f4e101456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 0x7f4e10141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10148e10 con 0x7f4e1014e9d0 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c4d60 con 0x7f4e10070b80 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e1872a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c49b0 con 0x7f4e100a8470 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e16cc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 0x7f4e10141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e16cc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 0x7f4e10141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48114/0 (socket says 172.21.15.89:48114) 2023-12-07T10:02:12.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e16cc7640 1 -- 172.21.15.89:0/2105935373 learned_addr learned my addr 172.21.15.89:0/2105935373 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e15cc5640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e100a8470 0x7f4e101456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.068+0000 7f4e164c6640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e10070b80 0x7f4e100aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e16cc7640 1 -- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e100a8470 msgr2=0x7f4e101456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e16cc7640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e100a8470 0x7f4e101456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e16cc7640 1 -- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e10070b80 msgr2=0x7f4e100aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e16cc7640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e10070b80 0x7f4e100aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e16cc7640 1 -- 172.21.15.89:0/2105935373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c00b6c0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e16cc7640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 0x7f4e10141e70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800efc0 tx=0x7f4e0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08009ca0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0800f040 con 0x7f4e1014e9d0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080146c0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e100c4fb0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100c5570 con 0x7f4e1014e9d0 2023-12-07T10:02:12.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1004e890 con 0x7f4e1014e9d0 2023-12-07T10:02:12.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e08014820 con 0x7f4e1014e9d0 2023-12-07T10:02:12.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e06ffd640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4df40668d0 0x7f4df4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e08085550 con 0x7f4e1014e9d0 2023-12-07T10:02:12.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.072+0000 7f4e164c6640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4df40668d0 0x7f4df4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.076+0000 7f4e164c6640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4df40668d0 0x7f4df4068d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0b1000 tx=0x7f4e0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.076+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e080524d0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.205 INFO:tasks.ceph.mds.b.smithi097.stderr:2023-12-07T10:02:12.202+0000 7fe3e04a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:02:12.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.228+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e101558e0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e06ffd640 1 -- 172.21.15.89:0/2105935373 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7f4e08055af0 con 0x7f4e1014e9d0 2023-12-07T10:02:12.236 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4df40668d0 msgr2=0x7f4df4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4df40668d0 0x7f4df4068d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0b1000 tx=0x7f4e0c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 msgr2=0x7f4e10141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 0x7f4e10141e70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800efc0 tx=0x7f4e0800c490 comp rx=0 tx=0).stop 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 shutdown_connections 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1014e9d0 0x7f4e10141e70 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4df40668d0 0x7f4df4068d90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e100a8470 0x7f4e101456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 --2- 172.21.15.89:0/2105935373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e10070b80 0x7f4e100aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 >> 172.21.15.89:0/2105935373 conn(0x7f4e100c2ad0 msgr2=0x7f4e10149280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 shutdown_connections 2023-12-07T10:02:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.232+0000 7f4e1872a640 1 -- 172.21.15.89:0/2105935373 wait complete. 2023-12-07T10:02:12.258 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T10:02:12.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:02:12.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 Processor -- start 2023-12-07T10:02:12.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 -- start start 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e814fcc0 0x7f19e8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19e806d980 0x7f19e80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f19e80ab3b0 0x7f19e80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80aa340 con 0x7f19e806d980 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e8152fe0 con 0x7f19e80ab3b0 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19edaea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81532c0 con 0x7f19e814fcc0 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19e806d980 0x7f19e80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19e806d980 0x7f19e80aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48120/0 (socket says 172.21.15.89:48120) 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 -- 172.21.15.89:0/649414730 learned_addr learned my addr 172.21.15.89:0/649414730 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e77fe640 1 --2- 172.21.15.89:0/649414730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e814fcc0 0x7f19e8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e7fff640 1 --2- 172.21.15.89:0/649414730 >> v2:172.21.15.97:3300/0 conn(0x7f19e80ab3b0 0x7f19e80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 -- 172.21.15.89:0/649414730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e814fcc0 msgr2=0x7f19e8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:12.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 --2- 172.21.15.89:0/649414730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e814fcc0 0x7f19e8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 -- 172.21.15.89:0/649414730 >> v2:172.21.15.97:3300/0 conn(0x7f19e80ab3b0 msgr2=0x7f19e80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:12.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 --2- 172.21.15.89:0/649414730 >> v2:172.21.15.97:3300/0 conn(0x7f19e80ab3b0 0x7f19e80c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.392+0000 7f19e6ffd640 1 -- 172.21.15.89:0/649414730 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8155a20 con 0x7f19e806d980 2023-12-07T10:02:12.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19e6ffd640 1 --2- 172.21.15.89:0/649414730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e806d980 0x7f19e80aae70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f19e806e300 tx=0x7f19dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792741b81bfc2d5a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19e67fc640 1 -- 172.21.15.89:0/649414730 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0aa5f0 con 0x7f19e806d980 2023-12-07T10:02:12.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19e67fc640 1 -- 172.21.15.89:0/649414730 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc0aa750 con 0x7f19e806d980 2023-12-07T10:02:12.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19e67fc640 1 -- 172.21.15.89:0/649414730 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0aaae0 con 0x7f19e806d980 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 -- 172.21.15.89:0/649414730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e806d980 msgr2=0x7f19e80aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 --2- 172.21.15.89:0/649414730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e806d980 0x7f19e80aae70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f19e806e300 tx=0x7f19dc01c4d0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 -- 172.21.15.89:0/649414730 shutdown_connections 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 --2- 172.21.15.89:0/649414730 >> v2:172.21.15.97:3300/0 conn(0x7f19e80ab3b0 0x7f19e80c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 --2- 172.21.15.89:0/649414730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e806d980 0x7f19e80aae70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 --2- 172.21.15.89:0/649414730 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e814fcc0 0x7f19e8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 -- 172.21.15.89:0/649414730 >> 172.21.15.89:0/649414730 conn(0x7f19e80c2ad0 msgr2=0x7f19e80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:12.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 -- 172.21.15.89:0/649414730 shutdown_connections 2023-12-07T10:02:12.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.396+0000 7f19edaea640 1 -- 172.21.15.89:0/649414730 wait complete. 2023-12-07T10:02:12.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 Processor -- start 2023-12-07T10:02:12.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 -- start start 2023-12-07T10:02:12.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19e806d980 0x7f19e80a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e80ab3b0 0x7f19e81f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 0x7f19e8148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e806c9c0 con 0x7f19e814ea80 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8152910 con 0x7f19e806d980 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81523e0 con 0x7f19e80ab3b0 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 0x7f19e8148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 0x7f19e8148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48124/0 (socket says 172.21.15.89:48124) 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 -- 172.21.15.89:0/1226933221 learned_addr learned my addr 172.21.15.89:0/1226933221 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e77fe640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19e806d980 0x7f19e80a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e6ffd640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e80ab3b0 0x7f19e81f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 -- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e80ab3b0 msgr2=0x7f19e81f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e80ab3b0 0x7f19e81f0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 -- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19e806d980 msgr2=0x7f19e80a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19e806d980 0x7f19e80a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 -- 172.21.15.89:0/1226933221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0094d0 con 0x7f19e814ea80 2023-12-07T10:02:12.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19e7fff640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 0x7f19e8148130 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f19e000ef00 tx=0x7f19e000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0010040 con 0x7f19e814ea80 2023-12-07T10:02:12.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0014400 con 0x7f19e814ea80 2023-12-07T10:02:12.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00147b0 con 0x7f19e814ea80 2023-12-07T10:02:12.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e814e5f0 con 0x7f19e814ea80 2023-12-07T10:02:12.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.400+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80c5a80 con 0x7f19e814ea80 2023-12-07T10:02:12.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.404+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e80c58e0 con 0x7f19e814ea80 2023-12-07T10:02:12.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.404+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f19e0014910 con 0x7f19e814ea80 2023-12-07T10:02:12.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.404+0000 7f19cffff640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19d40668d0 0x7f19d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.404+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19e0085100 con 0x7f19e814ea80 2023-12-07T10:02:12.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.404+0000 7f19e77fe640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19d40668d0 0x7f19d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.404+0000 7f19e77fe640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19d40668d0 0x7f19d4068d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f19e80c07f0 tx=0x7f19d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.408+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19e80c58e0 con 0x7f19e814ea80 2023-12-07T10:02:12.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.555+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19e80c58e0 con 0x7f19d40668d0 2023-12-07T10:02:12.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.571+0000 7f19cffff640 1 -- 172.21.15.89:0/1226933221 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527627 (secure 0 0 0) 0x7f19e80c58e0 con 0x7f19d40668d0 2023-12-07T10:02:12.580 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19d40668d0 msgr2=0x7f19d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19d40668d0 0x7f19d4068d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f19e80c07f0 tx=0x7f19d8009190 comp rx=0 tx=0).stop 2023-12-07T10:02:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 msgr2=0x7f19e8148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 0x7f19e8148130 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f19e000ef00 tx=0x7f19e000b480 comp rx=0 tx=0).stop 2023-12-07T10:02:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 shutdown_connections 2023-12-07T10:02:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19e814ea80 0x7f19e8148130 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19d40668d0 0x7f19d4068d90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19e80ab3b0 0x7f19e81f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 --2- 172.21.15.89:0/1226933221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19e806d980 0x7f19e80a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 >> 172.21.15.89:0/1226933221 conn(0x7f19e80c2ad0 msgr2=0x7f19e80bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 shutdown_connections 2023-12-07T10:02:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.575+0000 7f19edaea640 1 -- 172.21.15.89:0/1226933221 wait complete. 2023-12-07T10:02:12.600 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-12-07T10:02:12.378446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":318,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253352,"kb_used_data":8044,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721368,"statfs":{"total":773094113280,"available":772834680832,"internally_reserved":0,"allocated":8237056,"data_stored":4257909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875620"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533487+0000","last_change":"2023-12-07T10:02:08.542836+0000","last_active":"2023-12-07T10:02:09.533487+0000","last_peered":"2023-12-07T10:02:09.533487+0000","last_clean":"2023-12-07T10:02:09.533487+0000","last_became_active":"2023-12-07T10:02:08.539149+0000","last_became_peered":"2023-12-07T10:02:08.539149+0000","last_unstale":"2023-12-07T10:02:09.533487+0000","last_undegraded":"2023-12-07T10:02:09.533487+0000","last_fullsized":"2023-12-07T10:02:09.533487+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:26.703544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526751+0000","last_change":"2023-12-07T10:01:51.334457+0000","last_active":"2023-12-07T10:02:07.526751+0000","last_peered":"2023-12-07T10:02:07.526751+0000","last_clean":"2023-12-07T10:02:07.526751+0000","last_became_active":"2023-12-07T10:01:51.333891+0000","last_became_peered":"2023-12-07T10:01:51.333891+0000","last_unstale":"2023-12-07T10:02:07.526751+0000","last_undegraded":"2023-12-07T10:02:07.526751+0000","last_fullsized":"2023-12-07T10:02:07.526751+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:50.606836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544994+0000","last_change":"2023-12-07T10:02:08.533544+0000","last_active":"2023-12-07T10:02:08.544994+0000","last_peered":"2023-12-07T10:02:08.544994+0000","last_clean":"2023-12-07T10:02:08.544994+0000","last_became_active":"2023-12-07T10:02:08.533273+0000","last_became_peered":"2023-12-07T10:02:08.533273+0000","last_unstale":"2023-12-07T10:02:08.544994+0000","last_undegraded":"2023-12-07T10:02:08.544994+0000","last_fullsized":"2023-12-07T10:02:08.544994+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:24:19.313304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517561+0000","last_change":"2023-12-07T10:01:51.330897+0000","last_active":"2023-12-07T10:02:08.517561+0000","last_peered":"2023-12-07T10:02:08.517561+0000","last_clean":"2023-12-07T10:02:08.517561+0000","last_became_active":"2023-12-07T10:01:51.330640+0000","last_became_peered":"2023-12-07T10:01:51.330640+0000","last_unstale":"2023-12-07T10:02:08.517561+0000","last_undegraded":"2023-12-07T10:02:08.517561+0000","last_fullsized":"2023-12-07T10:02:08.517561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:57.467622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533486+0000","last_change":"2023-12-07T10:02:08.546790+0000","last_active":"2023-12-07T10:02:09.533486+0000","last_peered":"2023-12-07T10:02:09.533486+0000","last_clean":"2023-12-07T10:02:09.533486+0000","last_became_active":"2023-12-07T10:02:08.545914+0000","last_became_peered":"2023-12-07T10:02:08.545914+0000","last_unstale":"2023-12-07T10:02:09.533486+0000","last_undegraded":"2023-12-07T10:02:09.533486+0000","last_fullsized":"2023-12-07T10:02:09.533486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:28.172152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521349+0000","last_change":"2023-12-07T10:01:51.328745+0000","last_active":"2023-12-07T10:02:08.521349+0000","last_peered":"2023-12-07T10:02:08.521349+0000","last_clean":"2023-12-07T10:02:08.521349+0000","last_became_active":"2023-12-07T10:01:51.328404+0000","last_became_peered":"2023-12-07T10:01:51.328404+0000","last_unstale":"2023-12-07T10:02:08.521349+0000","last_undegraded":"2023-12-07T10:02:08.521349+0000","last_fullsized":"2023-12-07T10:02:08.521349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:35:05.845534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297356+0000","last_change":"2023-12-07T10:02:08.541569+0000","last_active":"2023-12-07T10:02:10.297356+0000","last_peered":"2023-12-07T10:02:10.297356+0000","last_clean":"2023-12-07T10:02:10.297356+0000","last_became_active":"2023-12-07T10:02:08.541306+0000","last_became_peered":"2023-12-07T10:02:08.541306+0000","last_unstale":"2023-12-07T10:02:10.297356+0000","last_undegraded":"2023-12-07T10:02:10.297356+0000","last_fullsized":"2023-12-07T10:02:10.297356+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:26.657472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523851+0000","last_change":"2023-12-07T10:01:51.237718+0000","last_active":"2023-12-07T10:02:08.523851+0000","last_peered":"2023-12-07T10:02:08.523851+0000","last_clean":"2023-12-07T10:02:08.523851+0000","last_became_active":"2023-12-07T10:01:51.237319+0000","last_became_peered":"2023-12-07T10:01:51.237319+0000","last_unstale":"2023-12-07T10:02:08.523851+0000","last_undegraded":"2023-12-07T10:02:08.523851+0000","last_fullsized":"2023-12-07T10:02:08.523851+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:33:39.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.535395+0000","last_change":"2023-12-07T10:02:08.537741+0000","last_active":"2023-12-07T10:02:09.535395+0000","last_peered":"2023-12-07T10:02:09.535395+0000","last_clean":"2023-12-07T10:02:09.535395+0000","last_became_active":"2023-12-07T10:02:08.537442+0000","last_became_peered":"2023-12-07T10:02:08.537442+0000","last_unstale":"2023-12-07T10:02:09.535395+0000","last_undegraded":"2023-12-07T10:02:09.535395+0000","last_fullsized":"2023-12-07T10:02:09.535395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:22:48.653437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521386+0000","last_change":"2023-12-07T10:01:51.319209+0000","last_active":"2023-12-07T10:02:08.521386+0000","last_peered":"2023-12-07T10:02:08.521386+0000","last_clean":"2023-12-07T10:02:08.521386+0000","last_became_active":"2023-12-07T10:01:51.318902+0000","last_became_peered":"2023-12-07T10:01:51.318902+0000","last_unstale":"2023-12-07T10:02:08.521386+0000","last_undegraded":"2023-12-07T10:02:08.521386+0000","last_fullsized":"2023-12-07T10:02:08.521386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296478+0000","last_change":"2023-12-07T10:02:08.539017+0000","last_active":"2023-12-07T10:02:10.296478+0000","last_peered":"2023-12-07T10:02:10.296478+0000","last_clean":"2023-12-07T10:02:10.296478+0000","last_became_active":"2023-12-07T10:02:08.537056+0000","last_became_peered":"2023-12-07T10:02:08.537056+0000","last_unstale":"2023-12-07T10:02:10.296478+0000","last_undegraded":"2023-12-07T10:02:10.296478+0000","last_fullsized":"2023-12-07T10:02:10.296478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:34:30.272183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.519085+0000","last_change":"2023-12-07T10:01:51.328543+0000","last_active":"2023-12-07T10:02:07.519085+0000","last_peered":"2023-12-07T10:02:07.519085+0000","last_clean":"2023-12-07T10:02:07.519085+0000","last_became_active":"2023-12-07T10:01:51.327329+0000","last_became_peered":"2023-12-07T10:01:51.327329+0000","last_unstale":"2023-12-07T10:02:07.519085+0000","last_undegraded":"2023-12-07T10:02:07.519085+0000","last_fullsized":"2023-12-07T10:02:07.519085+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556900+0000","last_change":"2023-12-07T10:02:08.552886+0000","last_active":"2023-12-07T10:02:08.556900+0000","last_peered":"2023-12-07T10:02:08.556900+0000","last_clean":"2023-12-07T10:02:08.556900+0000","last_became_active":"2023-12-07T10:02:08.552400+0000","last_became_peered":"2023-12-07T10:02:08.552400+0000","last_unstale":"2023-12-07T10:02:08.556900+0000","last_undegraded":"2023-12-07T10:02:08.556900+0000","last_fullsized":"2023-12-07T10:02:08.556900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:27:45.419988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523477+0000","last_change":"2023-12-07T10:01:51.320165+0000","last_active":"2023-12-07T10:02:08.523477+0000","last_peered":"2023-12-07T10:02:08.523477+0000","last_clean":"2023-12-07T10:02:08.523477+0000","last_became_active":"2023-12-07T10:01:51.319902+0000","last_became_peered":"2023-12-07T10:01:51.319902+0000","last_unstale":"2023-12-07T10:02:08.523477+0000","last_undegraded":"2023-12-07T10:02:08.523477+0000","last_fullsized":"2023-12-07T10:02:08.523477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:42.457874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536522+0000","last_change":"2023-12-07T10:02:08.537760+0000","last_active":"2023-12-07T10:02:09.536522+0000","last_peered":"2023-12-07T10:02:09.536522+0000","last_clean":"2023-12-07T10:02:09.536522+0000","last_became_active":"2023-12-07T10:02:08.537488+0000","last_became_peered":"2023-12-07T10:02:08.537488+0000","last_unstale":"2023-12-07T10:02:09.536522+0000","last_undegraded":"2023-12-07T10:02:09.536522+0000","last_fullsized":"2023-12-07T10:02:09.536522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:18:31.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518430+0000","last_change":"2023-12-07T10:01:51.329061+0000","last_active":"2023-12-07T10:02:07.518430+0000","last_peered":"2023-12-07T10:02:07.518430+0000","last_clean":"2023-12-07T10:02:07.518430+0000","last_became_active":"2023-12-07T10:01:51.326242+0000","last_became_peered":"2023-12-07T10:01:51.326242+0000","last_unstale":"2023-12-07T10:02:07.518430+0000","last_undegraded":"2023-12-07T10:02:07.518430+0000","last_fullsized":"2023-12-07T10:02:07.518430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:55.552580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536169+0000","last_change":"2023-12-07T10:02:08.532517+0000","last_active":"2023-12-07T10:02:09.536169+0000","last_peered":"2023-12-07T10:02:09.536169+0000","last_clean":"2023-12-07T10:02:09.536169+0000","last_became_active":"2023-12-07T10:02:08.532243+0000","last_became_peered":"2023-12-07T10:02:08.532243+0000","last_unstale":"2023-12-07T10:02:09.536169+0000","last_undegraded":"2023-12-07T10:02:09.536169+0000","last_fullsized":"2023-12-07T10:02:09.536169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:50:18.299699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.517675+0000","last_change":"2023-12-07T10:01:51.325239+0000","last_active":"2023-12-07T10:02:07.517675+0000","last_peered":"2023-12-07T10:02:07.517675+0000","last_clean":"2023-12-07T10:02:07.517675+0000","last_became_active":"2023-12-07T10:01:51.324925+0000","last_became_peered":"2023-12-07T10:01:51.324925+0000","last_unstale":"2023-12-07T10:02:07.517675+0000","last_undegraded":"2023-12-07T10:02:07.517675+0000","last_fullsized":"2023-12-07T10:02:07.517675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536165+0000","last_change":"2023-12-07T10:02:08.533695+0000","last_active":"2023-12-07T10:02:09.536165+0000","last_peered":"2023-12-07T10:02:09.536165+0000","last_clean":"2023-12-07T10:02:09.536165+0000","last_became_active":"2023-12-07T10:02:08.531720+0000","last_became_peered":"2023-12-07T10:02:08.531720+0000","last_unstale":"2023-12-07T10:02:09.536165+0000","last_undegraded":"2023-12-07T10:02:09.536165+0000","last_fullsized":"2023-12-07T10:02:09.536165+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:22:32.843134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.528898+0000","last_change":"2023-12-07T10:01:51.330222+0000","last_active":"2023-12-07T10:02:07.528898+0000","last_peered":"2023-12-07T10:02:07.528898+0000","last_clean":"2023-12-07T10:02:07.528898+0000","last_became_active":"2023-12-07T10:01:51.329871+0000","last_became_peered":"2023-12-07T10:01:51.329871+0000","last_unstale":"2023-12-07T10:02:07.528898+0000","last_undegraded":"2023-12-07T10:02:07.528898+0000","last_fullsized":"2023-12-07T10:02:07.528898+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.537206+0000","last_change":"2023-12-07T10:02:08.541680+0000","last_active":"2023-12-07T10:02:09.537206+0000","last_peered":"2023-12-07T10:02:09.537206+0000","last_clean":"2023-12-07T10:02:09.537206+0000","last_became_active":"2023-12-07T10:02:08.541414+0000","last_became_peered":"2023-12-07T10:02:08.541414+0000","last_unstale":"2023-12-07T10:02:09.537206+0000","last_undegraded":"2023-12-07T10:02:09.537206+0000","last_fullsized":"2023-12-07T10:02:09.537206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:24:19.313304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519214+0000","last_change":"2023-12-07T10:01:51.321607+0000","last_active":"2023-12-07T10:02:08.519214+0000","last_peered":"2023-12-07T10:02:08.519214+0000","last_clean":"2023-12-07T10:02:08.519214+0000","last_became_active":"2023-12-07T10:01:51.321331+0000","last_became_peered":"2023-12-07T10:01:51.321331+0000","last_unstale":"2023-12-07T10:02:08.519214+0000","last_undegraded":"2023-12-07T10:02:08.519214+0000","last_fullsized":"2023-12-07T10:02:08.519214+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:50.912945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556368+0000","last_change":"2023-12-07T10:02:08.550834+0000","last_active":"2023-12-07T10:02:08.556368+0000","last_peered":"2023-12-07T10:02:08.556368+0000","last_clean":"2023-12-07T10:02:08.556368+0000","last_became_active":"2023-12-07T10:02:08.550503+0000","last_became_peered":"2023-12-07T10:02:08.550503+0000","last_unstale":"2023-12-07T10:02:08.556368+0000","last_undegraded":"2023-12-07T10:02:08.556368+0000","last_fullsized":"2023-12-07T10:02:08.556368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:20:38.300429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526432+0000","last_change":"2023-12-07T10:01:51.332752+0000","last_active":"2023-12-07T10:02:07.526432+0000","last_peered":"2023-12-07T10:02:07.526432+0000","last_clean":"2023-12-07T10:02:07.526432+0000","last_became_active":"2023-12-07T10:01:51.332452+0000","last_became_peered":"2023-12-07T10:01:51.332452+0000","last_unstale":"2023-12-07T10:02:07.526432+0000","last_undegraded":"2023-12-07T10:02:07.526432+0000","last_fullsized":"2023-12-07T10:02:07.526432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.540012+0000","last_change":"2023-12-07T10:02:08.527867+0000","last_active":"2023-12-07T10:02:08.540012+0000","last_peered":"2023-12-07T10:02:08.540012+0000","last_clean":"2023-12-07T10:02:08.540012+0000","last_became_active":"2023-12-07T10:02:08.527565+0000","last_became_peered":"2023-12-07T10:02:08.527565+0000","last_unstale":"2023-12-07T10:02:08.540012+0000","last_undegraded":"2023-12-07T10:02:08.540012+0000","last_fullsized":"2023-12-07T10:02:08.540012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:19.715794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518044+0000","last_change":"2023-12-07T10:01:51.331204+0000","last_active":"2023-12-07T10:02:08.518044+0000","last_peered":"2023-12-07T10:02:08.518044+0000","last_clean":"2023-12-07T10:02:08.518044+0000","last_became_active":"2023-12-07T10:01:51.330895+0000","last_became_peered":"2023-12-07T10:01:51.330895+0000","last_unstale":"2023-12-07T10:02:08.518044+0000","last_undegraded":"2023-12-07T10:02:08.518044+0000","last_fullsized":"2023-12-07T10:02:08.518044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536286+0000","last_change":"2023-12-07T10:02:08.538242+0000","last_active":"2023-12-07T10:02:09.536286+0000","last_peered":"2023-12-07T10:02:09.536286+0000","last_clean":"2023-12-07T10:02:09.536286+0000","last_became_active":"2023-12-07T10:02:08.537956+0000","last_became_peered":"2023-12-07T10:02:08.537956+0000","last_unstale":"2023-12-07T10:02:09.536286+0000","last_undegraded":"2023-12-07T10:02:09.536286+0000","last_fullsized":"2023-12-07T10:02:09.536286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:43:16.614570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522581+0000","last_change":"2023-12-07T10:01:51.244162+0000","last_active":"2023-12-07T10:02:08.522581+0000","last_peered":"2023-12-07T10:02:08.522581+0000","last_clean":"2023-12-07T10:02:08.522581+0000","last_became_active":"2023-12-07T10:01:51.243875+0000","last_became_peered":"2023-12-07T10:01:51.243875+0000","last_unstale":"2023-12-07T10:02:08.522581+0000","last_undegraded":"2023-12-07T10:02:08.522581+0000","last_fullsized":"2023-12-07T10:02:08.522581+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:04:07.590726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.545041+0000","last_change":"2023-12-07T10:02:08.536957+0000","last_active":"2023-12-07T10:02:08.545041+0000","last_peered":"2023-12-07T10:02:08.545041+0000","last_clean":"2023-12-07T10:02:08.545041+0000","last_became_active":"2023-12-07T10:02:08.536656+0000","last_became_peered":"2023-12-07T10:02:08.536656+0000","last_unstale":"2023-12-07T10:02:08.545041+0000","last_undegraded":"2023-12-07T10:02:08.545041+0000","last_fullsized":"2023-12-07T10:02:08.545041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:23.102199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521709+0000","last_change":"2023-12-07T10:01:51.319891+0000","last_active":"2023-12-07T10:02:07.521709+0000","last_peered":"2023-12-07T10:02:07.521709+0000","last_clean":"2023-12-07T10:02:07.521709+0000","last_became_active":"2023-12-07T10:01:51.319557+0000","last_became_peered":"2023-12-07T10:01:51.319557+0000","last_unstale":"2023-12-07T10:02:07.521709+0000","last_undegraded":"2023-12-07T10:02:07.521709+0000","last_fullsized":"2023-12-07T10:02:07.521709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:20:21.004108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300363+0000","last_change":"2023-12-07T10:02:08.551850+0000","last_active":"2023-12-07T10:02:10.300363+0000","last_peered":"2023-12-07T10:02:10.300363+0000","last_clean":"2023-12-07T10:02:10.300363+0000","last_became_active":"2023-12-07T10:02:08.551529+0000","last_became_peered":"2023-12-07T10:02:08.551529+0000","last_unstale":"2023-12-07T10:02:10.300363+0000","last_undegraded":"2023-12-07T10:02:10.300363+0000","last_fullsized":"2023-12-07T10:02:10.300363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:52.656550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519550+0000","last_change":"2023-12-07T10:01:51.331122+0000","last_active":"2023-12-07T10:02:08.519550+0000","last_peered":"2023-12-07T10:02:08.519550+0000","last_clean":"2023-12-07T10:02:08.519550+0000","last_became_active":"2023-12-07T10:01:51.330385+0000","last_became_peered":"2023-12-07T10:01:51.330385+0000","last_unstale":"2023-12-07T10:02:08.519550+0000","last_undegraded":"2023-12-07T10:02:08.519550+0000","last_fullsized":"2023-12-07T10:02:08.519550+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300977+0000","last_change":"2023-12-07T10:02:08.531810+0000","last_active":"2023-12-07T10:02:10.300977+0000","last_peered":"2023-12-07T10:02:10.300977+0000","last_clean":"2023-12-07T10:02:10.300977+0000","last_became_active":"2023-12-07T10:02:08.531458+0000","last_became_peered":"2023-12-07T10:02:08.531458+0000","last_unstale":"2023-12-07T10:02:10.300977+0000","last_undegraded":"2023-12-07T10:02:10.300977+0000","last_fullsized":"2023-12-07T10:02:10.300977+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:43:11.799328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.528369+0000","last_change":"2023-12-07T10:01:51.326514+0000","last_active":"2023-12-07T10:02:08.528369+0000","last_peered":"2023-12-07T10:02:08.528369+0000","last_clean":"2023-12-07T10:02:08.528369+0000","last_became_active":"2023-12-07T10:01:51.326126+0000","last_became_peered":"2023-12-07T10:01:51.326126+0000","last_unstale":"2023-12-07T10:02:08.528369+0000","last_undegraded":"2023-12-07T10:02:08.528369+0000","last_fullsized":"2023-12-07T10:02:08.528369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536315+0000","last_change":"2023-12-07T10:02:08.543190+0000","last_active":"2023-12-07T10:02:09.536315+0000","last_peered":"2023-12-07T10:02:09.536315+0000","last_clean":"2023-12-07T10:02:09.536315+0000","last_became_active":"2023-12-07T10:02:08.542895+0000","last_became_peered":"2023-12-07T10:02:08.542895+0000","last_unstale":"2023-12-07T10:02:09.536315+0000","last_undegraded":"2023-12-07T10:02:09.536315+0000","last_fullsized":"2023-12-07T10:02:09.536315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:48:01.340980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522719+0000","last_change":"2023-12-07T10:01:51.322531+0000","last_active":"2023-12-07T10:02:08.522719+0000","last_peered":"2023-12-07T10:02:08.522719+0000","last_clean":"2023-12-07T10:02:08.522719+0000","last_became_active":"2023-12-07T10:01:51.322236+0000","last_became_peered":"2023-12-07T10:01:51.322236+0000","last_unstale":"2023-12-07T10:02:08.522719+0000","last_undegraded":"2023-12-07T10:02:08.522719+0000","last_fullsized":"2023-12-07T10:02:08.522719+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:58:49.154793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297603+0000","last_change":"2023-12-07T10:02:08.535406+0000","last_active":"2023-12-07T10:02:10.297603+0000","last_peered":"2023-12-07T10:02:10.297603+0000","last_clean":"2023-12-07T10:02:10.297603+0000","last_became_active":"2023-12-07T10:02:08.535125+0000","last_became_peered":"2023-12-07T10:02:08.535125+0000","last_unstale":"2023-12-07T10:02:10.297603+0000","last_undegraded":"2023-12-07T10:02:10.297603+0000","last_fullsized":"2023-12-07T10:02:10.297603+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:09.906720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.526377+0000","last_change":"2023-12-07T10:01:51.246838+0000","last_active":"2023-12-07T10:02:08.526377+0000","last_peered":"2023-12-07T10:02:08.526377+0000","last_clean":"2023-12-07T10:02:08.526377+0000","last_became_active":"2023-12-07T10:01:51.246542+0000","last_became_peered":"2023-12-07T10:01:51.246542+0000","last_unstale":"2023-12-07T10:02:08.526377+0000","last_undegraded":"2023-12-07T10:02:08.526377+0000","last_fullsized":"2023-12-07T10:02:08.526377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544957+0000","last_change":"2023-12-07T10:02:08.532730+0000","last_active":"2023-12-07T10:02:08.544957+0000","last_peered":"2023-12-07T10:02:08.544957+0000","last_clean":"2023-12-07T10:02:08.544957+0000","last_became_active":"2023-12-07T10:02:08.532461+0000","last_became_peered":"2023-12-07T10:02:08.532461+0000","last_unstale":"2023-12-07T10:02:08.544957+0000","last_undegraded":"2023-12-07T10:02:08.544957+0000","last_fullsized":"2023-12-07T10:02:08.544957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:22:48.653437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523930+0000","last_change":"2023-12-07T10:01:51.238206+0000","last_active":"2023-12-07T10:02:08.523930+0000","last_peered":"2023-12-07T10:02:08.523930+0000","last_clean":"2023-12-07T10:02:08.523930+0000","last_became_active":"2023-12-07T10:01:51.237896+0000","last_became_peered":"2023-12-07T10:01:51.237896+0000","last_unstale":"2023-12-07T10:02:08.523930+0000","last_undegraded":"2023-12-07T10:02:08.523930+0000","last_fullsized":"2023-12-07T10:02:08.523930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:05.717307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296595+0000","last_change":"2023-12-07T10:02:08.539141+0000","last_active":"2023-12-07T10:02:10.296595+0000","last_peered":"2023-12-07T10:02:10.296595+0000","last_clean":"2023-12-07T10:02:10.296595+0000","last_became_active":"2023-12-07T10:02:08.538794+0000","last_became_peered":"2023-12-07T10:02:08.538794+0000","last_unstale":"2023-12-07T10:02:10.296595+0000","last_undegraded":"2023-12-07T10:02:10.296595+0000","last_fullsized":"2023-12-07T10:02:10.296595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:11:58.615209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523020+0000","last_change":"2023-12-07T10:01:51.239605+0000","last_active":"2023-12-07T10:02:08.523020+0000","last_peered":"2023-12-07T10:02:08.523020+0000","last_clean":"2023-12-07T10:02:08.523020+0000","last_became_active":"2023-12-07T10:01:51.238681+0000","last_became_peered":"2023-12-07T10:01:51.238681+0000","last_unstale":"2023-12-07T10:02:08.523020+0000","last_undegraded":"2023-12-07T10:02:08.523020+0000","last_fullsized":"2023-12-07T10:02:08.523020+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:49.151421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.535630+0000","last_change":"2023-12-07T10:02:08.530307+0000","last_active":"2023-12-07T10:02:09.535630+0000","last_peered":"2023-12-07T10:02:09.535630+0000","last_clean":"2023-12-07T10:02:09.535630+0000","last_became_active":"2023-12-07T10:02:08.530020+0000","last_became_peered":"2023-12-07T10:02:08.530020+0000","last_unstale":"2023-12-07T10:02:09.535630+0000","last_undegraded":"2023-12-07T10:02:09.535630+0000","last_fullsized":"2023-12-07T10:02:09.535630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:10:00.973402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518190+0000","last_change":"2023-12-07T10:01:51.239133+0000","last_active":"2023-12-07T10:02:08.518190+0000","last_peered":"2023-12-07T10:02:08.518190+0000","last_clean":"2023-12-07T10:02:08.518190+0000","last_became_active":"2023-12-07T10:01:51.238847+0000","last_became_peered":"2023-12-07T10:01:51.238847+0000","last_unstale":"2023-12-07T10:02:08.518190+0000","last_undegraded":"2023-12-07T10:02:08.518190+0000","last_fullsized":"2023-12-07T10:02:08.518190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:01.049212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300574+0000","last_change":"2023-12-07T10:02:08.540803+0000","last_active":"2023-12-07T10:02:10.300574+0000","last_peered":"2023-12-07T10:02:10.300574+0000","last_clean":"2023-12-07T10:02:10.300574+0000","last_became_active":"2023-12-07T10:02:08.539276+0000","last_became_peered":"2023-12-07T10:02:08.539276+0000","last_unstale":"2023-12-07T10:02:10.300574+0000","last_undegraded":"2023-12-07T10:02:10.300574+0000","last_fullsized":"2023-12-07T10:02:10.300574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:18:14.581421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525220+0000","last_change":"2023-12-07T10:01:51.326936+0000","last_active":"2023-12-07T10:02:07.525220+0000","last_peered":"2023-12-07T10:02:07.525220+0000","last_clean":"2023-12-07T10:02:07.525220+0000","last_became_active":"2023-12-07T10:01:51.326411+0000","last_became_peered":"2023-12-07T10:01:51.326411+0000","last_unstale":"2023-12-07T10:02:07.525220+0000","last_undegraded":"2023-12-07T10:02:07.525220+0000","last_fullsized":"2023-12-07T10:02:07.525220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296769+0000","last_change":"2023-12-07T10:02:08.536160+0000","last_active":"2023-12-07T10:02:10.296769+0000","last_peered":"2023-12-07T10:02:10.296769+0000","last_clean":"2023-12-07T10:02:10.296769+0000","last_became_active":"2023-12-07T10:02:08.535914+0000","last_became_peered":"2023-12-07T10:02:08.535914+0000","last_unstale":"2023-12-07T10:02:10.296769+0000","last_undegraded":"2023-12-07T10:02:10.296769+0000","last_fullsized":"2023-12-07T10:02:10.296769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:01.187656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519928+0000","last_change":"2023-12-07T10:01:51.238711+0000","last_active":"2023-12-07T10:02:08.519928+0000","last_peered":"2023-12-07T10:02:08.519928+0000","last_clean":"2023-12-07T10:02:08.519928+0000","last_became_active":"2023-12-07T10:01:51.238406+0000","last_became_peered":"2023-12-07T10:01:51.238406+0000","last_unstale":"2023-12-07T10:02:08.519928+0000","last_undegraded":"2023-12-07T10:02:08.519928+0000","last_fullsized":"2023-12-07T10:02:08.519928+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:37.893685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536691+0000","last_change":"2023-12-07T10:02:08.533110+0000","last_active":"2023-12-07T10:02:09.536691+0000","last_peered":"2023-12-07T10:02:09.536691+0000","last_clean":"2023-12-07T10:02:09.536691+0000","last_became_active":"2023-12-07T10:02:08.532849+0000","last_became_peered":"2023-12-07T10:02:08.532849+0000","last_unstale":"2023-12-07T10:02:09.536691+0000","last_undegraded":"2023-12-07T10:02:09.536691+0000","last_fullsized":"2023-12-07T10:02:09.536691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:41:17.569813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522674+0000","last_change":"2023-12-07T10:01:51.331406+0000","last_active":"2023-12-07T10:02:08.522674+0000","last_peered":"2023-12-07T10:02:08.522674+0000","last_clean":"2023-12-07T10:02:08.522674+0000","last_became_active":"2023-12-07T10:01:51.330583+0000","last_became_peered":"2023-12-07T10:01:51.330583+0000","last_unstale":"2023-12-07T10:02:08.522674+0000","last_undegraded":"2023-12-07T10:02:08.522674+0000","last_fullsized":"2023-12-07T10:02:08.522674+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:45.174048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.553517+0000","last_change":"2023-12-07T10:02:08.541439+0000","last_active":"2023-12-07T10:02:08.553517+0000","last_peered":"2023-12-07T10:02:08.553517+0000","last_clean":"2023-12-07T10:02:08.553517+0000","last_became_active":"2023-12-07T10:02:08.540964+0000","last_became_peered":"2023-12-07T10:02:08.540964+0000","last_unstale":"2023-12-07T10:02:08.553517+0000","last_undegraded":"2023-12-07T10:02:08.553517+0000","last_fullsized":"2023-12-07T10:02:08.553517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:28:33.184580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522921+0000","last_change":"2023-12-07T10:01:51.315626+0000","last_active":"2023-12-07T10:02:08.522921+0000","last_peered":"2023-12-07T10:02:08.522921+0000","last_clean":"2023-12-07T10:02:08.522921+0000","last_became_active":"2023-12-07T10:01:51.315331+0000","last_became_peered":"2023-12-07T10:01:51.315331+0000","last_unstale":"2023-12-07T10:02:08.522921+0000","last_undegraded":"2023-12-07T10:02:08.522921+0000","last_fullsized":"2023-12-07T10:02:08.522921+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:26:18.178418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556378+0000","last_change":"2023-12-07T10:02:08.550921+0000","last_active":"2023-12-07T10:02:08.556378+0000","last_peered":"2023-12-07T10:02:08.556378+0000","last_clean":"2023-12-07T10:02:08.556378+0000","last_became_active":"2023-12-07T10:02:08.549941+0000","last_became_peered":"2023-12-07T10:02:08.549941+0000","last_unstale":"2023-12-07T10:02:08.556378+0000","last_undegraded":"2023-12-07T10:02:08.556378+0000","last_fullsized":"2023-12-07T10:02:08.556378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:10:05.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524487+0000","last_change":"2023-12-07T10:01:51.321708+0000","last_active":"2023-12-07T10:02:08.524487+0000","last_peered":"2023-12-07T10:02:08.524487+0000","last_clean":"2023-12-07T10:02:08.524487+0000","last_became_active":"2023-12-07T10:01:51.321404+0000","last_became_peered":"2023-12-07T10:01:51.321404+0000","last_unstale":"2023-12-07T10:02:08.524487+0000","last_undegraded":"2023-12-07T10:02:08.524487+0000","last_fullsized":"2023-12-07T10:02:08.524487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297528+0000","last_change":"2023-12-07T10:02:08.537308+0000","last_active":"2023-12-07T10:02:10.297528+0000","last_peered":"2023-12-07T10:02:10.297528+0000","last_clean":"2023-12-07T10:02:10.297528+0000","last_became_active":"2023-12-07T10:02:08.535323+0000","last_became_peered":"2023-12-07T10:02:08.535323+0000","last_unstale":"2023-12-07T10:02:10.297528+0000","last_undegraded":"2023-12-07T10:02:10.297528+0000","last_fullsized":"2023-12-07T10:02:10.297528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:14:04.978124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526524+0000","last_change":"2023-12-07T10:01:51.335138+0000","last_active":"2023-12-07T10:02:07.526524+0000","last_peered":"2023-12-07T10:02:07.526524+0000","last_clean":"2023-12-07T10:02:07.526524+0000","last_became_active":"2023-12-07T10:01:51.334865+0000","last_became_peered":"2023-12-07T10:01:51.334865+0000","last_unstale":"2023-12-07T10:02:07.526524+0000","last_undegraded":"2023-12-07T10:02:07.526524+0000","last_fullsized":"2023-12-07T10:02:07.526524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544885+0000","last_change":"2023-12-07T10:02:08.536025+0000","last_active":"2023-12-07T10:02:08.544885+0000","last_peered":"2023-12-07T10:02:08.544885+0000","last_clean":"2023-12-07T10:02:08.544885+0000","last_became_active":"2023-12-07T10:02:08.535408+0000","last_became_peered":"2023-12-07T10:02:08.535408+0000","last_unstale":"2023-12-07T10:02:08.544885+0000","last_undegraded":"2023-12-07T10:02:08.544885+0000","last_fullsized":"2023-12-07T10:02:08.544885+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:19:19.272138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519371+0000","last_change":"2023-12-07T10:01:51.249276+0000","last_active":"2023-12-07T10:02:08.519371+0000","last_peered":"2023-12-07T10:02:08.519371+0000","last_clean":"2023-12-07T10:02:08.519371+0000","last_became_active":"2023-12-07T10:01:51.247885+0000","last_became_peered":"2023-12-07T10:01:51.247885+0000","last_unstale":"2023-12-07T10:02:08.519371+0000","last_undegraded":"2023-12-07T10:02:08.519371+0000","last_fullsized":"2023-12-07T10:02:08.519371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:58.975561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.532715+0000","last_change":"2023-12-07T10:02:08.539870+0000","last_active":"2023-12-07T10:02:09.532715+0000","last_peered":"2023-12-07T10:02:09.532715+0000","last_clean":"2023-12-07T10:02:09.532715+0000","last_became_active":"2023-12-07T10:02:08.539615+0000","last_became_peered":"2023-12-07T10:02:08.539615+0000","last_unstale":"2023-12-07T10:02:09.532715+0000","last_undegraded":"2023-12-07T10:02:09.532715+0000","last_fullsized":"2023-12-07T10:02:09.532715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:28.530425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518258+0000","last_change":"2023-12-07T10:01:51.239757+0000","last_active":"2023-12-07T10:02:08.518258+0000","last_peered":"2023-12-07T10:02:08.518258+0000","last_clean":"2023-12-07T10:02:08.518258+0000","last_became_active":"2023-12-07T10:01:51.239432+0000","last_became_peered":"2023-12-07T10:01:51.239432+0000","last_unstale":"2023-12-07T10:02:08.518258+0000","last_undegraded":"2023-12-07T10:02:08.518258+0000","last_fullsized":"2023-12-07T10:02:08.518258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:18.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296996+0000","last_change":"2023-12-07T10:02:08.534038+0000","last_active":"2023-12-07T10:02:10.296996+0000","last_peered":"2023-12-07T10:02:10.296996+0000","last_clean":"2023-12-07T10:02:10.296996+0000","last_became_active":"2023-12-07T10:02:08.530522+0000","last_became_peered":"2023-12-07T10:02:08.530522+0000","last_unstale":"2023-12-07T10:02:10.296996+0000","last_undegraded":"2023-12-07T10:02:10.296996+0000","last_fullsized":"2023-12-07T10:02:10.296996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:42:28.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521044+0000","last_change":"2023-12-07T10:01:51.319253+0000","last_active":"2023-12-07T10:02:08.521044+0000","last_peered":"2023-12-07T10:02:08.521044+0000","last_clean":"2023-12-07T10:02:08.521044+0000","last_became_active":"2023-12-07T10:01:51.318371+0000","last_became_peered":"2023-12-07T10:01:51.318371+0000","last_unstale":"2023-12-07T10:02:08.521044+0000","last_undegraded":"2023-12-07T10:02:08.521044+0000","last_fullsized":"2023-12-07T10:02:08.521044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.301170+0000","last_change":"2023-12-07T10:02:08.532149+0000","last_active":"2023-12-07T10:02:10.301170+0000","last_peered":"2023-12-07T10:02:10.301170+0000","last_clean":"2023-12-07T10:02:10.301170+0000","last_became_active":"2023-12-07T10:02:08.531793+0000","last_became_peered":"2023-12-07T10:02:08.531793+0000","last_unstale":"2023-12-07T10:02:10.301170+0000","last_undegraded":"2023-12-07T10:02:10.301170+0000","last_fullsized":"2023-12-07T10:02:10.301170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:57.512346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525134+0000","last_change":"2023-12-07T10:01:51.335614+0000","last_active":"2023-12-07T10:02:07.525134+0000","last_peered":"2023-12-07T10:02:07.525134+0000","last_clean":"2023-12-07T10:02:07.525134+0000","last_became_active":"2023-12-07T10:01:51.335261+0000","last_became_peered":"2023-12-07T10:01:51.335261+0000","last_unstale":"2023-12-07T10:02:07.525134+0000","last_undegraded":"2023-12-07T10:02:07.525134+0000","last_fullsized":"2023-12-07T10:02:07.525134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.534224+0000","last_change":"2023-12-07T10:02:08.536998+0000","last_active":"2023-12-07T10:02:09.534224+0000","last_peered":"2023-12-07T10:02:09.534224+0000","last_clean":"2023-12-07T10:02:09.534224+0000","last_became_active":"2023-12-07T10:02:08.536693+0000","last_became_peered":"2023-12-07T10:02:08.536693+0000","last_unstale":"2023-12-07T10:02:09.534224+0000","last_undegraded":"2023-12-07T10:02:09.534224+0000","last_fullsized":"2023-12-07T10:02:09.534224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:35:23.141855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297429+0000","last_change":"2023-12-07T10:02:07.536272+0000","last_active":"2023-12-07T10:02:10.297429+0000","last_peered":"2023-12-07T10:02:10.297429+0000","last_clean":"2023-12-07T10:02:10.297429+0000","last_became_active":"2023-12-07T10:02:07.536011+0000","last_became_peered":"2023-12-07T10:02:07.536011+0000","last_unstale":"2023-12-07T10:02:10.297429+0000","last_undegraded":"2023-12-07T10:02:10.297429+0000","last_fullsized":"2023-12-07T10:02:10.297429+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:45:31.923825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525169+0000","last_change":"2023-12-07T10:01:51.334037+0000","last_active":"2023-12-07T10:02:08.525169+0000","last_peered":"2023-12-07T10:02:08.525169+0000","last_clean":"2023-12-07T10:02:08.525169+0000","last_became_active":"2023-12-07T10:01:51.333727+0000","last_became_peered":"2023-12-07T10:01:51.333727+0000","last_unstale":"2023-12-07T10:02:08.525169+0000","last_undegraded":"2023-12-07T10:02:08.525169+0000","last_fullsized":"2023-12-07T10:02:08.525169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"66'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527009+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:02:07.527009+0000","last_peered":"2023-12-07T10:02:07.527009+0000","last_clean":"2023-12-07T10:02:07.527009+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:02:07.527009+0000","last_undegraded":"2023-12-07T10:02:07.527009+0000","last_fullsized":"2023-12-07T10:02:07.527009+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536560+0000","last_change":"2023-12-07T10:02:08.547268+0000","last_active":"2023-12-07T10:02:09.536560+0000","last_peered":"2023-12-07T10:02:09.536560+0000","last_clean":"2023-12-07T10:02:09.536560+0000","last_became_active":"2023-12-07T10:02:08.546931+0000","last_became_peered":"2023-12-07T10:02:08.546931+0000","last_unstale":"2023-12-07T10:02:09.536560+0000","last_undegraded":"2023-12-07T10:02:09.536560+0000","last_fullsized":"2023-12-07T10:02:09.536560+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:11.733817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296828+0000","last_change":"2023-12-07T10:02:07.532285+0000","last_active":"2023-12-07T10:02:10.296828+0000","last_peered":"2023-12-07T10:02:10.296828+0000","last_clean":"2023-12-07T10:02:10.296828+0000","last_became_active":"2023-12-07T10:02:07.531881+0000","last_became_peered":"2023-12-07T10:02:07.531881+0000","last_unstale":"2023-12-07T10:02:10.296828+0000","last_undegraded":"2023-12-07T10:02:10.296828+0000","last_fullsized":"2023-12-07T10:02:10.296828+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:10.726346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526835+0000","last_change":"2023-12-07T10:01:51.328667+0000","last_active":"2023-12-07T10:02:07.526835+0000","last_peered":"2023-12-07T10:02:07.526835+0000","last_clean":"2023-12-07T10:02:07.526835+0000","last_became_active":"2023-12-07T10:01:51.328402+0000","last_became_peered":"2023-12-07T10:01:51.328402+0000","last_unstale":"2023-12-07T10:02:07.526835+0000","last_undegraded":"2023-12-07T10:02:07.526835+0000","last_fullsized":"2023-12-07T10:02:07.526835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:11.234105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525370+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:02:08.525370+0000","last_peered":"2023-12-07T10:02:08.525370+0000","last_clean":"2023-12-07T10:02:08.525370+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:02:08.525370+0000","last_undegraded":"2023-12-07T10:02:08.525370+0000","last_fullsized":"2023-12-07T10:02:08.525370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.301048+0000","last_change":"2023-12-07T10:02:08.532963+0000","last_active":"2023-12-07T10:02:10.301048+0000","last_peered":"2023-12-07T10:02:10.301048+0000","last_clean":"2023-12-07T10:02:10.301048+0000","last_became_active":"2023-12-07T10:02:08.532684+0000","last_became_peered":"2023-12-07T10:02:08.532684+0000","last_unstale":"2023-12-07T10:02:10.301048+0000","last_undegraded":"2023-12-07T10:02:10.301048+0000","last_fullsized":"2023-12-07T10:02:10.301048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:09:14.620225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"70'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297393+0000","last_change":"2023-12-07T10:02:07.539988+0000","last_active":"2023-12-07T10:02:10.297393+0000","last_peered":"2023-12-07T10:02:10.297393+0000","last_clean":"2023-12-07T10:02:10.297393+0000","last_became_active":"2023-12-07T10:02:07.539712+0000","last_became_peered":"2023-12-07T10:02:07.539712+0000","last_unstale":"2023-12-07T10:02:10.297393+0000","last_undegraded":"2023-12-07T10:02:10.297393+0000","last_fullsized":"2023-12-07T10:02:10.297393+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:22.094728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526632+0000","last_change":"2023-12-07T10:01:51.331609+0000","last_active":"2023-12-07T10:02:07.526632+0000","last_peered":"2023-12-07T10:02:07.526632+0000","last_clean":"2023-12-07T10:02:07.526632+0000","last_became_active":"2023-12-07T10:01:51.331052+0000","last_became_peered":"2023-12-07T10:01:51.331052+0000","last_unstale":"2023-12-07T10:02:07.526632+0000","last_undegraded":"2023-12-07T10:02:07.526632+0000","last_fullsized":"2023-12-07T10:02:07.526632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.526472+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:02:08.526472+0000","last_peered":"2023-12-07T10:02:08.526472+0000","last_clean":"2023-12-07T10:02:08.526472+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:02:08.526472+0000","last_undegraded":"2023-12-07T10:02:08.526472+0000","last_fullsized":"2023-12-07T10:02:08.526472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:05.118061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.554988+0000","last_change":"2023-12-07T10:02:08.551307+0000","last_active":"2023-12-07T10:02:08.554988+0000","last_peered":"2023-12-07T10:02:08.554988+0000","last_clean":"2023-12-07T10:02:08.554988+0000","last_became_active":"2023-12-07T10:02:08.551023+0000","last_became_peered":"2023-12-07T10:02:08.551023+0000","last_unstale":"2023-12-07T10:02:08.554988+0000","last_undegraded":"2023-12-07T10:02:08.554988+0000","last_fullsized":"2023-12-07T10:02:08.554988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:50:18.299699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536774+0000","last_change":"2023-12-07T10:02:07.536961+0000","last_active":"2023-12-07T10:02:09.536774+0000","last_peered":"2023-12-07T10:02:09.536774+0000","last_clean":"2023-12-07T10:02:09.536774+0000","last_became_active":"2023-12-07T10:02:07.536653+0000","last_became_peered":"2023-12-07T10:02:07.536653+0000","last_unstale":"2023-12-07T10:02:09.536774+0000","last_undegraded":"2023-12-07T10:02:09.536774+0000","last_fullsized":"2023-12-07T10:02:09.536774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:05:39.294446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521892+0000","last_change":"2023-12-07T10:01:51.321279+0000","last_active":"2023-12-07T10:02:08.521892+0000","last_peered":"2023-12-07T10:02:08.521892+0000","last_clean":"2023-12-07T10:02:08.521892+0000","last_became_active":"2023-12-07T10:01:51.320929+0000","last_became_peered":"2023-12-07T10:01:51.320929+0000","last_unstale":"2023-12-07T10:02:08.521892+0000","last_undegraded":"2023-12-07T10:02:08.521892+0000","last_fullsized":"2023-12-07T10:02:08.521892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:27.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518215+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:02:08.518215+0000","last_peered":"2023-12-07T10:02:08.518215+0000","last_clean":"2023-12-07T10:02:08.518215+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:02:08.518215+0000","last_undegraded":"2023-12-07T10:02:08.518215+0000","last_fullsized":"2023-12-07T10:02:08.518215+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.539345+0000","last_change":"2023-12-07T10:02:08.528563+0000","last_active":"2023-12-07T10:02:08.539345+0000","last_peered":"2023-12-07T10:02:08.539345+0000","last_clean":"2023-12-07T10:02:08.539345+0000","last_became_active":"2023-12-07T10:02:08.528212+0000","last_became_peered":"2023-12-07T10:02:08.528212+0000","last_unstale":"2023-12-07T10:02:08.539345+0000","last_undegraded":"2023-12-07T10:02:08.539345+0000","last_fullsized":"2023-12-07T10:02:08.539345+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:59:32.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.529494+0000","last_change":"2023-12-07T10:02:07.539065+0000","last_active":"2023-12-07T10:02:08.529494+0000","last_peered":"2023-12-07T10:02:08.529494+0000","last_clean":"2023-12-07T10:02:08.529494+0000","last_became_active":"2023-12-07T10:02:07.538787+0000","last_became_peered":"2023-12-07T10:02:07.538787+0000","last_unstale":"2023-12-07T10:02:08.529494+0000","last_undegraded":"2023-12-07T10:02:08.529494+0000","last_fullsized":"2023-12-07T10:02:08.529494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:22:31.835663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518328+0000","last_change":"2023-12-07T10:01:51.237367+0000","last_active":"2023-12-07T10:02:08.518328+0000","last_peered":"2023-12-07T10:02:08.518328+0000","last_clean":"2023-12-07T10:02:08.518328+0000","last_became_active":"2023-12-07T10:01:51.237071+0000","last_became_peered":"2023-12-07T10:01:51.237071+0000","last_unstale":"2023-12-07T10:02:08.518328+0000","last_undegraded":"2023-12-07T10:02:08.518328+0000","last_fullsized":"2023-12-07T10:02:08.518328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:19:49.846073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521654+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:02:08.521654+0000","last_peered":"2023-12-07T10:02:08.521654+0000","last_clean":"2023-12-07T10:02:08.521654+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:02:08.521654+0000","last_undegraded":"2023-12-07T10:02:08.521654+0000","last_fullsized":"2023-12-07T10:02:08.521654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536141+0000","last_change":"2023-12-07T10:02:08.547292+0000","last_active":"2023-12-07T10:02:09.536141+0000","last_peered":"2023-12-07T10:02:09.536141+0000","last_clean":"2023-12-07T10:02:09.536141+0000","last_became_active":"2023-12-07T10:02:08.546829+0000","last_became_peered":"2023-12-07T10:02:08.546829+0000","last_unstale":"2023-12-07T10:02:09.536141+0000","last_undegraded":"2023-12-07T10:02:09.536141+0000","last_fullsized":"2023-12-07T10:02:09.536141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:00:26.360487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.532700+0000","last_change":"2023-12-07T10:02:07.534696+0000","last_active":"2023-12-07T10:02:09.532700+0000","last_peered":"2023-12-07T10:02:09.532700+0000","last_clean":"2023-12-07T10:02:09.532700+0000","last_became_active":"2023-12-07T10:02:07.534413+0000","last_became_peered":"2023-12-07T10:02:07.534413+0000","last_unstale":"2023-12-07T10:02:09.532700+0000","last_undegraded":"2023-12-07T10:02:09.532700+0000","last_fullsized":"2023-12-07T10:02:09.532700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:22.414208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521487+0000","last_change":"2023-12-07T10:01:51.318661+0000","last_active":"2023-12-07T10:02:08.521487+0000","last_peered":"2023-12-07T10:02:08.521487+0000","last_clean":"2023-12-07T10:02:08.521487+0000","last_became_active":"2023-12-07T10:01:51.318360+0000","last_became_peered":"2023-12-07T10:01:51.318360+0000","last_unstale":"2023-12-07T10:02:08.521487+0000","last_undegraded":"2023-12-07T10:02:08.521487+0000","last_fullsized":"2023-12-07T10:02:08.521487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522277+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:02:08.522277+0000","last_peered":"2023-12-07T10:02:08.522277+0000","last_clean":"2023-12-07T10:02:08.522277+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:02:08.522277+0000","last_undegraded":"2023-12-07T10:02:08.522277+0000","last_fullsized":"2023-12-07T10:02:08.522277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.540564+0000","last_change":"2023-12-07T10:02:08.532617+0000","last_active":"2023-12-07T10:02:08.540564+0000","last_peered":"2023-12-07T10:02:08.540564+0000","last_clean":"2023-12-07T10:02:08.540564+0000","last_became_active":"2023-12-07T10:02:08.532334+0000","last_became_peered":"2023-12-07T10:02:08.532334+0000","last_unstale":"2023-12-07T10:02:08.540564+0000","last_undegraded":"2023-12-07T10:02:08.540564+0000","last_fullsized":"2023-12-07T10:02:08.540564+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:26:35.474739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533108+0000","last_change":"2023-12-07T10:02:07.533906+0000","last_active":"2023-12-07T10:02:09.533108+0000","last_peered":"2023-12-07T10:02:09.533108+0000","last_clean":"2023-12-07T10:02:09.533108+0000","last_became_active":"2023-12-07T10:02:07.532695+0000","last_became_peered":"2023-12-07T10:02:07.532695+0000","last_unstale":"2023-12-07T10:02:09.533108+0000","last_undegraded":"2023-12-07T10:02:09.533108+0000","last_fullsized":"2023-12-07T10:02:09.533108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:26.825960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518524+0000","last_change":"2023-12-07T10:01:51.322420+0000","last_active":"2023-12-07T10:02:08.518524+0000","last_peered":"2023-12-07T10:02:08.518524+0000","last_clean":"2023-12-07T10:02:08.518524+0000","last_became_active":"2023-12-07T10:01:51.322145+0000","last_became_peered":"2023-12-07T10:01:51.322145+0000","last_unstale":"2023-12-07T10:02:08.518524+0000","last_undegraded":"2023-12-07T10:02:08.518524+0000","last_fullsized":"2023-12-07T10:02:08.518524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517903+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:02:08.517903+0000","last_peered":"2023-12-07T10:02:08.517903+0000","last_clean":"2023-12-07T10:02:08.517903+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:02:08.517903+0000","last_undegraded":"2023-12-07T10:02:08.517903+0000","last_fullsized":"2023-12-07T10:02:08.517903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:34.570378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.535755+0000","last_change":"2023-12-07T10:02:08.540425+0000","last_active":"2023-12-07T10:02:09.535755+0000","last_peered":"2023-12-07T10:02:09.535755+0000","last_clean":"2023-12-07T10:02:09.535755+0000","last_became_active":"2023-12-07T10:02:08.539727+0000","last_became_peered":"2023-12-07T10:02:08.539727+0000","last_unstale":"2023-12-07T10:02:09.535755+0000","last_undegraded":"2023-12-07T10:02:09.535755+0000","last_fullsized":"2023-12-07T10:02:09.535755+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:23.102199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296643+0000","last_change":"2023-12-07T10:02:07.541158+0000","last_active":"2023-12-07T10:02:10.296643+0000","last_peered":"2023-12-07T10:02:10.296643+0000","last_clean":"2023-12-07T10:02:10.296643+0000","last_became_active":"2023-12-07T10:02:07.537239+0000","last_became_peered":"2023-12-07T10:02:07.537239+0000","last_unstale":"2023-12-07T10:02:10.296643+0000","last_undegraded":"2023-12-07T10:02:10.296643+0000","last_fullsized":"2023-12-07T10:02:10.296643+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:40:11.476049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521788+0000","last_change":"2023-12-07T10:01:51.320957+0000","last_active":"2023-12-07T10:02:07.521788+0000","last_peered":"2023-12-07T10:02:07.521788+0000","last_clean":"2023-12-07T10:02:07.521788+0000","last_became_active":"2023-12-07T10:01:51.320671+0000","last_became_peered":"2023-12-07T10:01:51.320671+0000","last_unstale":"2023-12-07T10:02:07.521788+0000","last_undegraded":"2023-12-07T10:02:07.521788+0000","last_fullsized":"2023-12-07T10:02:07.521788+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:10:48.731402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518723+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:02:08.518723+0000","last_peered":"2023-12-07T10:02:08.518723+0000","last_clean":"2023-12-07T10:02:08.518723+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:02:08.518723+0000","last_undegraded":"2023-12-07T10:02:08.518723+0000","last_fullsized":"2023-12-07T10:02:08.518723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:49.235834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556405+0000","last_change":"2023-12-07T10:02:08.550919+0000","last_active":"2023-12-07T10:02:08.556405+0000","last_peered":"2023-12-07T10:02:08.556405+0000","last_clean":"2023-12-07T10:02:08.556405+0000","last_became_active":"2023-12-07T10:02:08.549994+0000","last_became_peered":"2023-12-07T10:02:08.549994+0000","last_unstale":"2023-12-07T10:02:08.556405+0000","last_undegraded":"2023-12-07T10:02:08.556405+0000","last_fullsized":"2023-12-07T10:02:08.556405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:11:06.027723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"70'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536905+0000","last_change":"2023-12-07T10:02:07.526138+0000","last_active":"2023-12-07T10:02:09.536905+0000","last_peered":"2023-12-07T10:02:09.536905+0000","last_clean":"2023-12-07T10:02:09.536905+0000","last_became_active":"2023-12-07T10:02:07.525735+0000","last_became_peered":"2023-12-07T10:02:07.525735+0000","last_unstale":"2023-12-07T10:02:09.536905+0000","last_undegraded":"2023-12-07T10:02:09.536905+0000","last_fullsized":"2023-12-07T10:02:09.536905+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:59:31.761516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.522935+0000","last_change":"2023-12-07T10:01:51.237604+0000","last_active":"2023-12-07T10:02:07.522935+0000","last_peered":"2023-12-07T10:02:07.522935+0000","last_clean":"2023-12-07T10:02:07.522935+0000","last_became_active":"2023-12-07T10:01:51.237282+0000","last_became_peered":"2023-12-07T10:01:51.237282+0000","last_unstale":"2023-12-07T10:02:07.522935+0000","last_undegraded":"2023-12-07T10:02:07.522935+0000","last_fullsized":"2023-12-07T10:02:07.522935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:25.535134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527116+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:02:07.527116+0000","last_peered":"2023-12-07T10:02:07.527116+0000","last_clean":"2023-12-07T10:02:07.527116+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:02:07.527116+0000","last_undegraded":"2023-12-07T10:02:07.527116+0000","last_fullsized":"2023-12-07T10:02:07.527116+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536320+0000","last_change":"2023-12-07T10:02:08.537317+0000","last_active":"2023-12-07T10:02:09.536320+0000","last_peered":"2023-12-07T10:02:09.536320+0000","last_clean":"2023-12-07T10:02:09.536320+0000","last_became_active":"2023-12-07T10:02:08.536736+0000","last_became_peered":"2023-12-07T10:02:08.536736+0000","last_unstale":"2023-12-07T10:02:09.536320+0000","last_undegraded":"2023-12-07T10:02:09.536320+0000","last_fullsized":"2023-12-07T10:02:09.536320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:15:51.076271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"70'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536435+0000","last_change":"2023-12-07T10:02:07.524380+0000","last_active":"2023-12-07T10:02:09.536435+0000","last_peered":"2023-12-07T10:02:09.536435+0000","last_clean":"2023-12-07T10:02:09.536435+0000","last_became_active":"2023-12-07T10:02:07.523889+0000","last_became_peered":"2023-12-07T10:02:07.523889+0000","last_unstale":"2023-12-07T10:02:09.536435+0000","last_undegraded":"2023-12-07T10:02:09.536435+0000","last_fullsized":"2023-12-07T10:02:09.536435+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:11:05.020252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518803+0000","last_change":"2023-12-07T10:01:51.329179+0000","last_active":"2023-12-07T10:02:07.518803+0000","last_peered":"2023-12-07T10:02:07.518803+0000","last_clean":"2023-12-07T10:02:07.518803+0000","last_became_active":"2023-12-07T10:01:51.328872+0000","last_became_peered":"2023-12-07T10:01:51.328872+0000","last_unstale":"2023-12-07T10:02:07.518803+0000","last_undegraded":"2023-12-07T10:02:07.518803+0000","last_fullsized":"2023-12-07T10:02:07.518803+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.528260+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:02:07.528260+0000","last_peered":"2023-12-07T10:02:07.528260+0000","last_clean":"2023-12-07T10:02:07.528260+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:02:07.528260+0000","last_undegraded":"2023-12-07T10:02:07.528260+0000","last_fullsized":"2023-12-07T10:02:07.528260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297076+0000","last_change":"2023-12-07T10:02:08.544653+0000","last_active":"2023-12-07T10:02:10.297076+0000","last_peered":"2023-12-07T10:02:10.297076+0000","last_clean":"2023-12-07T10:02:10.297076+0000","last_became_active":"2023-12-07T10:02:08.543664+0000","last_became_peered":"2023-12-07T10:02:08.543664+0000","last_unstale":"2023-12-07T10:02:10.297076+0000","last_undegraded":"2023-12-07T10:02:10.297076+0000","last_fullsized":"2023-12-07T10:02:10.297076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:22:29.647336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533595+0000","last_change":"2023-12-07T10:02:07.532518+0000","last_active":"2023-12-07T10:02:09.533595+0000","last_peered":"2023-12-07T10:02:09.533595+0000","last_clean":"2023-12-07T10:02:09.533595+0000","last_became_active":"2023-12-07T10:02:07.532245+0000","last_became_peered":"2023-12-07T10:02:07.532245+0000","last_unstale":"2023-12-07T10:02:09.533595+0000","last_undegraded":"2023-12-07T10:02:09.533595+0000","last_fullsized":"2023-12-07T10:02:09.533595+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:26.778663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518123+0000","last_change":"2023-12-07T10:01:51.335097+0000","last_active":"2023-12-07T10:02:08.518123+0000","last_peered":"2023-12-07T10:02:08.518123+0000","last_clean":"2023-12-07T10:02:08.518123+0000","last_became_active":"2023-12-07T10:01:51.334754+0000","last_became_peered":"2023-12-07T10:01:51.334754+0000","last_unstale":"2023-12-07T10:02:08.518123+0000","last_undegraded":"2023-12-07T10:02:08.518123+0000","last_fullsized":"2023-12-07T10:02:08.518123+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"66'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526217+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:02:07.526217+0000","last_peered":"2023-12-07T10:02:07.526217+0000","last_clean":"2023-12-07T10:02:07.526217+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:02:07.526217+0000","last_undegraded":"2023-12-07T10:02:07.526217+0000","last_fullsized":"2023-12-07T10:02:07.526217+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.537417+0000","last_change":"2023-12-07T10:02:08.547934+0000","last_active":"2023-12-07T10:02:09.537417+0000","last_peered":"2023-12-07T10:02:09.537417+0000","last_clean":"2023-12-07T10:02:09.537417+0000","last_became_active":"2023-12-07T10:02:08.547575+0000","last_became_peered":"2023-12-07T10:02:08.547575+0000","last_unstale":"2023-12-07T10:02:09.537417+0000","last_undegraded":"2023-12-07T10:02:09.537417+0000","last_fullsized":"2023-12-07T10:02:09.537417+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:19:19.272138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.520231+0000","last_change":"2023-12-07T10:02:07.539679+0000","last_active":"2023-12-07T10:02:08.520231+0000","last_peered":"2023-12-07T10:02:08.520231+0000","last_clean":"2023-12-07T10:02:08.520231+0000","last_became_active":"2023-12-07T10:02:07.539373+0000","last_became_peered":"2023-12-07T10:02:07.539373+0000","last_unstale":"2023-12-07T10:02:08.520231+0000","last_undegraded":"2023-12-07T10:02:08.520231+0000","last_fullsized":"2023-12-07T10:02:08.520231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:09:59.965931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524648+0000","last_change":"2023-12-07T10:01:51.321371+0000","last_active":"2023-12-07T10:02:08.524648+0000","last_peered":"2023-12-07T10:02:08.524648+0000","last_clean":"2023-12-07T10:02:08.524648+0000","last_became_active":"2023-12-07T10:01:51.321032+0000","last_became_peered":"2023-12-07T10:01:51.321032+0000","last_unstale":"2023-12-07T10:02:08.524648+0000","last_undegraded":"2023-12-07T10:02:08.524648+0000","last_fullsized":"2023-12-07T10:02:08.524648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518924+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:02:07.518924+0000","last_peered":"2023-12-07T10:02:07.518924+0000","last_clean":"2023-12-07T10:02:07.518924+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:02:07.518924+0000","last_undegraded":"2023-12-07T10:02:07.518924+0000","last_fullsized":"2023-12-07T10:02:07.518924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.537126+0000","last_change":"2023-12-07T10:02:08.539546+0000","last_active":"2023-12-07T10:02:09.537126+0000","last_peered":"2023-12-07T10:02:09.537126+0000","last_clean":"2023-12-07T10:02:09.537126+0000","last_became_active":"2023-12-07T10:02:08.538222+0000","last_became_peered":"2023-12-07T10:02:08.538222+0000","last_unstale":"2023-12-07T10:02:09.537126+0000","last_undegraded":"2023-12-07T10:02:09.537126+0000","last_fullsized":"2023-12-07T10:02:09.537126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:40:12.483520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536251+0000","last_change":"2023-12-07T10:02:07.525714+0000","last_active":"2023-12-07T10:02:09.536251+0000","last_peered":"2023-12-07T10:02:09.536251+0000","last_clean":"2023-12-07T10:02:09.536251+0000","last_became_active":"2023-12-07T10:02:07.525399+0000","last_became_peered":"2023-12-07T10:02:07.525399+0000","last_unstale":"2023-12-07T10:02:09.536251+0000","last_undegraded":"2023-12-07T10:02:09.536251+0000","last_fullsized":"2023-12-07T10:02:09.536251+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:37.525343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517097+0000","last_change":"2023-12-07T10:01:51.329045+0000","last_active":"2023-12-07T10:02:08.517097+0000","last_peered":"2023-12-07T10:02:08.517097+0000","last_clean":"2023-12-07T10:02:08.517097+0000","last_became_active":"2023-12-07T10:01:51.328657+0000","last_became_peered":"2023-12-07T10:01:51.328657+0000","last_unstale":"2023-12-07T10:02:08.517097+0000","last_undegraded":"2023-12-07T10:02:08.517097+0000","last_fullsized":"2023-12-07T10:02:08.517097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519534+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:02:08.519534+0000","last_peered":"2023-12-07T10:02:08.519534+0000","last_clean":"2023-12-07T10:02:08.519534+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:02:08.519534+0000","last_undegraded":"2023-12-07T10:02:08.519534+0000","last_fullsized":"2023-12-07T10:02:08.519534+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300253+0000","last_change":"2023-12-07T10:02:08.529038+0000","last_active":"2023-12-07T10:02:10.300253+0000","last_peered":"2023-12-07T10:02:10.300253+0000","last_clean":"2023-12-07T10:02:10.300253+0000","last_became_active":"2023-12-07T10:02:08.528773+0000","last_became_peered":"2023-12-07T10:02:08.528773+0000","last_unstale":"2023-12-07T10:02:10.300253+0000","last_undegraded":"2023-12-07T10:02:10.300253+0000","last_fullsized":"2023-12-07T10:02:10.300253+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:55.462521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"70'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.532803+0000","last_change":"2023-12-07T10:02:07.533776+0000","last_active":"2023-12-07T10:02:09.532803+0000","last_peered":"2023-12-07T10:02:09.532803+0000","last_clean":"2023-12-07T10:02:09.532803+0000","last_became_active":"2023-12-07T10:02:07.533499+0000","last_became_peered":"2023-12-07T10:02:07.533499+0000","last_unstale":"2023-12-07T10:02:09.532803+0000","last_undegraded":"2023-12-07T10:02:09.532803+0000","last_fullsized":"2023-12-07T10:02:09.532803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:51.866525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518072+0000","last_change":"2023-12-07T10:01:51.321900+0000","last_active":"2023-12-07T10:02:08.518072+0000","last_peered":"2023-12-07T10:02:08.518072+0000","last_clean":"2023-12-07T10:02:08.518072+0000","last_became_active":"2023-12-07T10:01:51.321602+0000","last_became_peered":"2023-12-07T10:01:51.321602+0000","last_unstale":"2023-12-07T10:02:08.518072+0000","last_undegraded":"2023-12-07T10:02:08.518072+0000","last_fullsized":"2023-12-07T10:02:08.518072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521957+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:02:07.521957+0000","last_peered":"2023-12-07T10:02:07.521957+0000","last_clean":"2023-12-07T10:02:07.521957+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:02:07.521957+0000","last_undegraded":"2023-12-07T10:02:07.521957+0000","last_fullsized":"2023-12-07T10:02:07.521957+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:04:12.916038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.540188+0000","last_change":"2023-12-07T10:02:08.527958+0000","last_active":"2023-12-07T10:02:08.540188+0000","last_peered":"2023-12-07T10:02:08.540188+0000","last_clean":"2023-12-07T10:02:08.540188+0000","last_became_active":"2023-12-07T10:02:08.527618+0000","last_became_peered":"2023-12-07T10:02:08.527618+0000","last_unstale":"2023-12-07T10:02:08.540188+0000","last_undegraded":"2023-12-07T10:02:08.540188+0000","last_fullsized":"2023-12-07T10:02:08.540188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:22:03.899321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300857+0000","last_change":"2023-12-07T10:02:07.521386+0000","last_active":"2023-12-07T10:02:10.300857+0000","last_peered":"2023-12-07T10:02:10.300857+0000","last_clean":"2023-12-07T10:02:10.300857+0000","last_became_active":"2023-12-07T10:02:07.521026+0000","last_became_peered":"2023-12-07T10:02:07.521026+0000","last_unstale":"2023-12-07T10:02:10.300857+0000","last_undegraded":"2023-12-07T10:02:10.300857+0000","last_fullsized":"2023-12-07T10:02:10.300857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:36:07.305738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518618+0000","last_change":"2023-12-07T10:01:51.235277+0000","last_active":"2023-12-07T10:02:08.518618+0000","last_peered":"2023-12-07T10:02:08.518618+0000","last_clean":"2023-12-07T10:02:08.518618+0000","last_became_active":"2023-12-07T10:01:51.234826+0000","last_became_peered":"2023-12-07T10:01:51.234826+0000","last_unstale":"2023-12-07T10:02:08.518618+0000","last_undegraded":"2023-12-07T10:02:08.518618+0000","last_fullsized":"2023-12-07T10:02:08.518618+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:32.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.517756+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:02:07.517756+0000","last_peered":"2023-12-07T10:02:07.517756+0000","last_clean":"2023-12-07T10:02:07.517756+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:02:07.517756+0000","last_undegraded":"2023-12-07T10:02:07.517756+0000","last_fullsized":"2023-12-07T10:02:07.517756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533195+0000","last_change":"2023-12-07T10:02:08.534924+0000","last_active":"2023-12-07T10:02:09.533195+0000","last_peered":"2023-12-07T10:02:09.533195+0000","last_clean":"2023-12-07T10:02:09.533195+0000","last_became_active":"2023-12-07T10:02:08.533633+0000","last_became_peered":"2023-12-07T10:02:08.533633+0000","last_unstale":"2023-12-07T10:02:09.533195+0000","last_undegraded":"2023-12-07T10:02:09.533195+0000","last_fullsized":"2023-12-07T10:02:09.533195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:24:38.631021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300507+0000","last_change":"2023-12-07T10:02:07.534098+0000","last_active":"2023-12-07T10:02:10.300507+0000","last_peered":"2023-12-07T10:02:10.300507+0000","last_clean":"2023-12-07T10:02:10.300507+0000","last_became_active":"2023-12-07T10:02:07.533836+0000","last_became_peered":"2023-12-07T10:02:07.533836+0000","last_unstale":"2023-12-07T10:02:10.300507+0000","last_undegraded":"2023-12-07T10:02:10.300507+0000","last_fullsized":"2023-12-07T10:02:10.300507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:05.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517620+0000","last_change":"2023-12-07T10:01:51.329007+0000","last_active":"2023-12-07T10:02:08.517620+0000","last_peered":"2023-12-07T10:02:08.517620+0000","last_clean":"2023-12-07T10:02:08.517620+0000","last_became_active":"2023-12-07T10:01:51.328735+0000","last_became_peered":"2023-12-07T10:01:51.328735+0000","last_unstale":"2023-12-07T10:02:08.517620+0000","last_undegraded":"2023-12-07T10:02:08.517620+0000","last_fullsized":"2023-12-07T10:02:08.517620+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:03.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"66'8","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523916+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:02:08.523916+0000","last_peered":"2023-12-07T10:02:08.523916+0000","last_clean":"2023-12-07T10:02:08.523916+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:02:08.523916+0000","last_undegraded":"2023-12-07T10:02:08.523916+0000","last_fullsized":"2023-12-07T10:02:08.523916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:09.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544541+0000","last_change":"2023-12-07T10:02:08.540326+0000","last_active":"2023-12-07T10:02:08.544541+0000","last_peered":"2023-12-07T10:02:08.544541+0000","last_clean":"2023-12-07T10:02:08.544541+0000","last_became_active":"2023-12-07T10:02:08.540002+0000","last_became_peered":"2023-12-07T10:02:08.540002+0000","last_unstale":"2023-12-07T10:02:08.544541+0000","last_undegraded":"2023-12-07T10:02:08.544541+0000","last_fullsized":"2023-12-07T10:02:08.544541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:22.247933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556730+0000","last_change":"2023-12-07T10:02:07.530974+0000","last_active":"2023-12-07T10:02:08.556730+0000","last_peered":"2023-12-07T10:02:08.556730+0000","last_clean":"2023-12-07T10:02:08.556730+0000","last_became_active":"2023-12-07T10:02:07.530598+0000","last_became_peered":"2023-12-07T10:02:07.530598+0000","last_unstale":"2023-12-07T10:02:08.556730+0000","last_undegraded":"2023-12-07T10:02:08.556730+0000","last_fullsized":"2023-12-07T10:02:08.556730+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:48:00.333509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525605+0000","last_change":"2023-12-07T10:01:51.327799+0000","last_active":"2023-12-07T10:02:08.525605+0000","last_peered":"2023-12-07T10:02:08.525605+0000","last_clean":"2023-12-07T10:02:08.525605+0000","last_became_active":"2023-12-07T10:01:51.326731+0000","last_became_peered":"2023-12-07T10:01:51.326731+0000","last_unstale":"2023-12-07T10:02:08.525605+0000","last_undegraded":"2023-12-07T10:02:08.525605+0000","last_fullsized":"2023-12-07T10:02:08.525605+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:04.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"66'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527278+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:02:07.527278+0000","last_peered":"2023-12-07T10:02:07.527278+0000","last_clean":"2023-12-07T10:02:07.527278+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:02:07.527278+0000","last_undegraded":"2023-12-07T10:02:07.527278+0000","last_fullsized":"2023-12-07T10:02:07.527278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536456+0000","last_change":"2023-12-07T10:02:08.544284+0000","last_active":"2023-12-07T10:02:09.536456+0000","last_peered":"2023-12-07T10:02:09.536456+0000","last_clean":"2023-12-07T10:02:09.536456+0000","last_became_active":"2023-12-07T10:02:08.543927+0000","last_became_peered":"2023-12-07T10:02:08.543927+0000","last_unstale":"2023-12-07T10:02:09.536456+0000","last_undegraded":"2023-12-07T10:02:09.536456+0000","last_fullsized":"2023-12-07T10:02:09.536456+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:55.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296962+0000","last_change":"2023-12-07T10:02:07.529093+0000","last_active":"2023-12-07T10:02:10.296962+0000","last_peered":"2023-12-07T10:02:10.296962+0000","last_clean":"2023-12-07T10:02:10.296962+0000","last_became_active":"2023-12-07T10:02:07.528797+0000","last_became_peered":"2023-12-07T10:02:07.528797+0000","last_unstale":"2023-12-07T10:02:10.296962+0000","last_undegraded":"2023-12-07T10:02:10.296962+0000","last_fullsized":"2023-12-07T10:02:10.296962+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:19:18.264667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526913+0000","last_change":"2023-12-07T10:01:51.328493+0000","last_active":"2023-12-07T10:02:07.526913+0000","last_peered":"2023-12-07T10:02:07.526913+0000","last_clean":"2023-12-07T10:02:07.526913+0000","last_became_active":"2023-12-07T10:01:51.328019+0000","last_became_peered":"2023-12-07T10:01:51.328019+0000","last_unstale":"2023-12-07T10:02:07.526913+0000","last_undegraded":"2023-12-07T10:02:07.526913+0000","last_fullsized":"2023-12-07T10:02:07.526913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:24:21.334700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525870+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:02:08.525870+0000","last_peered":"2023-12-07T10:02:08.525870+0000","last_clean":"2023-12-07T10:02:08.525870+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:02:08.525870+0000","last_undegraded":"2023-12-07T10:02:08.525870+0000","last_fullsized":"2023-12-07T10:02:08.525870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:56.735390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556458+0000","last_change":"2023-12-07T10:02:08.551105+0000","last_active":"2023-12-07T10:02:08.556458+0000","last_peered":"2023-12-07T10:02:08.556458+0000","last_clean":"2023-12-07T10:02:08.556458+0000","last_became_active":"2023-12-07T10:02:08.550488+0000","last_became_peered":"2023-12-07T10:02:08.550488+0000","last_unstale":"2023-12-07T10:02:08.556458+0000","last_undegraded":"2023-12-07T10:02:08.556458+0000","last_fullsized":"2023-12-07T10:02:08.556458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:38.532814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536370+0000","last_change":"2023-12-07T10:02:07.529491+0000","last_active":"2023-12-07T10:02:09.536370+0000","last_peered":"2023-12-07T10:02:09.536370+0000","last_clean":"2023-12-07T10:02:09.536370+0000","last_became_active":"2023-12-07T10:02:07.529155+0000","last_became_peered":"2023-12-07T10:02:07.529155+0000","last_unstale":"2023-12-07T10:02:09.536370+0000","last_undegraded":"2023-12-07T10:02:09.536370+0000","last_fullsized":"2023-12-07T10:02:09.536370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:41.823984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524729+0000","last_change":"2023-12-07T10:01:51.327301+0000","last_active":"2023-12-07T10:02:08.524729+0000","last_peered":"2023-12-07T10:02:08.524729+0000","last_clean":"2023-12-07T10:02:08.524729+0000","last_became_active":"2023-12-07T10:01:51.325806+0000","last_became_peered":"2023-12-07T10:01:51.325806+0000","last_unstale":"2023-12-07T10:02:08.524729+0000","last_undegraded":"2023-12-07T10:02:08.524729+0000","last_fullsized":"2023-12-07T10:02:08.524729+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518349+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:02:08.518349+0000","last_peered":"2023-12-07T10:02:08.518349+0000","last_clean":"2023-12-07T10:02:08.518349+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:02:08.518349+0000","last_undegraded":"2023-12-07T10:02:08.518349+0000","last_fullsized":"2023-12-07T10:02:08.518349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:10.226808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300106+0000","last_change":"2023-12-07T10:02:08.542491+0000","last_active":"2023-12-07T10:02:10.300106+0000","last_peered":"2023-12-07T10:02:10.300106+0000","last_clean":"2023-12-07T10:02:10.300106+0000","last_became_active":"2023-12-07T10:02:08.537786+0000","last_became_peered":"2023-12-07T10:02:08.537786+0000","last_unstale":"2023-12-07T10:02:10.300106+0000","last_undegraded":"2023-12-07T10:02:10.300106+0000","last_fullsized":"2023-12-07T10:02:10.300106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:44:58.860252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.514882+0000","last_change":"2023-12-07T10:02:07.527440+0000","last_active":"2023-12-07T10:02:08.514882+0000","last_peered":"2023-12-07T10:02:08.514882+0000","last_clean":"2023-12-07T10:02:08.514882+0000","last_became_active":"2023-12-07T10:02:07.527158+0000","last_became_peered":"2023-12-07T10:02:07.527158+0000","last_unstale":"2023-12-07T10:02:08.514882+0000","last_undegraded":"2023-12-07T10:02:08.514882+0000","last_fullsized":"2023-12-07T10:02:08.514882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:43.402734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.526176+0000","last_change":"2023-12-07T10:01:51.239742+0000","last_active":"2023-12-07T10:02:08.526176+0000","last_peered":"2023-12-07T10:02:08.526176+0000","last_clean":"2023-12-07T10:02:08.526176+0000","last_became_active":"2023-12-07T10:01:51.239468+0000","last_became_peered":"2023-12-07T10:01:51.239468+0000","last_unstale":"2023-12-07T10:02:08.526176+0000","last_undegraded":"2023-12-07T10:02:08.526176+0000","last_fullsized":"2023-12-07T10:02:08.526176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:16.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"66'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.523040+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:02:07.523040+0000","last_peered":"2023-12-07T10:02:07.523040+0000","last_clean":"2023-12-07T10:02:07.523040+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:02:07.523040+0000","last_undegraded":"2023-12-07T10:02:07.523040+0000","last_fullsized":"2023-12-07T10:02:07.523040+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:47.055302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.553584+0000","last_change":"2023-12-07T10:02:08.540355+0000","last_active":"2023-12-07T10:02:08.553584+0000","last_peered":"2023-12-07T10:02:08.553584+0000","last_clean":"2023-12-07T10:02:08.553584+0000","last_became_active":"2023-12-07T10:02:08.539525+0000","last_became_peered":"2023-12-07T10:02:08.539525+0000","last_unstale":"2023-12-07T10:02:08.553584+0000","last_undegraded":"2023-12-07T10:02:08.553584+0000","last_fullsized":"2023-12-07T10:02:08.553584+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:04:31.219655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296447+0000","last_change":"2023-12-07T10:02:07.537226+0000","last_active":"2023-12-07T10:02:10.296447+0000","last_peered":"2023-12-07T10:02:10.296447+0000","last_clean":"2023-12-07T10:02:10.296447+0000","last_became_active":"2023-12-07T10:02:07.536944+0000","last_became_peered":"2023-12-07T10:02:07.536944+0000","last_unstale":"2023-12-07T10:02:10.296447+0000","last_undegraded":"2023-12-07T10:02:10.296447+0000","last_fullsized":"2023-12-07T10:02:10.296447+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:41:16.562342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518618+0000","last_change":"2023-12-07T10:01:51.323608+0000","last_active":"2023-12-07T10:02:07.518618+0000","last_peered":"2023-12-07T10:02:07.518618+0000","last_clean":"2023-12-07T10:02:07.518618+0000","last_became_active":"2023-12-07T10:01:51.323254+0000","last_became_peered":"2023-12-07T10:01:51.323254+0000","last_unstale":"2023-12-07T10:02:07.518618+0000","last_undegraded":"2023-12-07T10:02:07.518618+0000","last_fullsized":"2023-12-07T10:02:07.518618+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522849+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:02:08.522849+0000","last_peered":"2023-12-07T10:02:08.522849+0000","last_clean":"2023-12-07T10:02:08.522849+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:02:08.522849+0000","last_undegraded":"2023-12-07T10:02:08.522849+0000","last_fullsized":"2023-12-07T10:02:08.522849+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:55.751747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300328+0000","last_change":"2023-12-07T10:02:08.536795+0000","last_active":"2023-12-07T10:02:10.300328+0000","last_peered":"2023-12-07T10:02:10.300328+0000","last_clean":"2023-12-07T10:02:10.300328+0000","last_became_active":"2023-12-07T10:02:08.536526+0000","last_became_peered":"2023-12-07T10:02:08.536526+0000","last_unstale":"2023-12-07T10:02:10.300328+0000","last_undegraded":"2023-12-07T10:02:10.300328+0000","last_fullsized":"2023-12-07T10:02:10.300328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:25.112824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297012+0000","last_change":"2023-12-07T10:02:07.532823+0000","last_active":"2023-12-07T10:02:10.297012+0000","last_peered":"2023-12-07T10:02:10.297012+0000","last_clean":"2023-12-07T10:02:10.297012+0000","last_became_active":"2023-12-07T10:02:07.532506+0000","last_became_peered":"2023-12-07T10:02:07.532506+0000","last_unstale":"2023-12-07T10:02:10.297012+0000","last_undegraded":"2023-12-07T10:02:10.297012+0000","last_fullsized":"2023-12-07T10:02:10.297012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:22:02.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.520051+0000","last_change":"2023-12-07T10:01:51.327531+0000","last_active":"2023-12-07T10:02:08.520051+0000","last_peered":"2023-12-07T10:02:08.520051+0000","last_clean":"2023-12-07T10:02:08.520051+0000","last_became_active":"2023-12-07T10:01:51.326982+0000","last_became_peered":"2023-12-07T10:01:51.326982+0000","last_unstale":"2023-12-07T10:02:08.520051+0000","last_undegraded":"2023-12-07T10:02:08.520051+0000","last_fullsized":"2023-12-07T10:02:08.520051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:37.353658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523552+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:02:08.523552+0000","last_peered":"2023-12-07T10:02:08.523552+0000","last_clean":"2023-12-07T10:02:08.523552+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:02:08.523552+0000","last_undegraded":"2023-12-07T10:02:08.523552+0000","last_fullsized":"2023-12-07T10:02:08.523552+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:19.396813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300709+0000","last_change":"2023-12-07T10:02:08.538379+0000","last_active":"2023-12-07T10:02:10.300709+0000","last_peered":"2023-12-07T10:02:10.300709+0000","last_clean":"2023-12-07T10:02:10.300709+0000","last_became_active":"2023-12-07T10:02:08.537973+0000","last_became_peered":"2023-12-07T10:02:08.537973+0000","last_unstale":"2023-12-07T10:02:10.300709+0000","last_undegraded":"2023-12-07T10:02:10.300709+0000","last_fullsized":"2023-12-07T10:02:10.300709+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:08.169490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.515596+0000","last_change":"2023-12-07T10:02:07.537062+0000","last_active":"2023-12-07T10:02:08.515596+0000","last_peered":"2023-12-07T10:02:08.515596+0000","last_clean":"2023-12-07T10:02:08.515596+0000","last_became_active":"2023-12-07T10:02:07.536557+0000","last_became_peered":"2023-12-07T10:02:07.536557+0000","last_unstale":"2023-12-07T10:02:08.515596+0000","last_undegraded":"2023-12-07T10:02:08.515596+0000","last_fullsized":"2023-12-07T10:02:08.515596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:32.986757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.517673+0000","last_change":"2023-12-07T10:01:51.322653+0000","last_active":"2023-12-07T10:02:07.517673+0000","last_peered":"2023-12-07T10:02:07.517673+0000","last_clean":"2023-12-07T10:02:07.517673+0000","last_became_active":"2023-12-07T10:01:51.322160+0000","last_became_peered":"2023-12-07T10:01:51.322160+0000","last_unstale":"2023-12-07T10:02:07.517673+0000","last_undegraded":"2023-12-07T10:02:07.517673+0000","last_fullsized":"2023-12-07T10:02:07.517673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:57.285100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521465+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:02:07.521465+0000","last_peered":"2023-12-07T10:02:07.521465+0000","last_clean":"2023-12-07T10:02:07.521465+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:02:07.521465+0000","last_undegraded":"2023-12-07T10:02:07.521465+0000","last_fullsized":"2023-12-07T10:02:07.521465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:20.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533353+0000","last_change":"2023-12-07T10:02:08.551906+0000","last_active":"2023-12-07T10:02:09.533353+0000","last_peered":"2023-12-07T10:02:09.533353+0000","last_clean":"2023-12-07T10:02:09.533353+0000","last_became_active":"2023-12-07T10:02:08.551654+0000","last_became_peered":"2023-12-07T10:02:08.551654+0000","last_unstale":"2023-12-07T10:02:09.533353+0000","last_undegraded":"2023-12-07T10:02:09.533353+0000","last_fullsized":"2023-12-07T10:02:09.533353+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:36.438330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297283+0000","last_change":"2023-12-07T10:02:07.535595+0000","last_active":"2023-12-07T10:02:10.297283+0000","last_peered":"2023-12-07T10:02:10.297283+0000","last_clean":"2023-12-07T10:02:10.297283+0000","last_became_active":"2023-12-07T10:02:07.535313+0000","last_became_peered":"2023-12-07T10:02:07.535313+0000","last_unstale":"2023-12-07T10:02:10.297283+0000","last_undegraded":"2023-12-07T10:02:10.297283+0000","last_fullsized":"2023-12-07T10:02:10.297283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:22:47.645966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525252+0000","last_change":"2023-12-07T10:01:51.328470+0000","last_active":"2023-12-07T10:02:08.525252+0000","last_peered":"2023-12-07T10:02:08.525252+0000","last_clean":"2023-12-07T10:02:08.525252+0000","last_became_active":"2023-12-07T10:01:51.328195+0000","last_became_peered":"2023-12-07T10:01:51.328195+0000","last_unstale":"2023-12-07T10:02:08.525252+0000","last_undegraded":"2023-12-07T10:02:08.525252+0000","last_fullsized":"2023-12-07T10:02:08.525252+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.520994+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:02:08.520994+0000","last_peered":"2023-12-07T10:02:08.520994+0000","last_clean":"2023-12-07T10:02:08.520994+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:02:08.520994+0000","last_undegraded":"2023-12-07T10:02:08.520994+0000","last_fullsized":"2023-12-07T10:02:08.520994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556782+0000","last_change":"2023-12-07T10:02:08.552542+0000","last_active":"2023-12-07T10:02:08.556782+0000","last_peered":"2023-12-07T10:02:08.556782+0000","last_clean":"2023-12-07T10:02:08.556782+0000","last_became_active":"2023-12-07T10:02:08.552084+0000","last_became_peered":"2023-12-07T10:02:08.552084+0000","last_unstale":"2023-12-07T10:02:08.556782+0000","last_undegraded":"2023-12-07T10:02:08.556782+0000","last_fullsized":"2023-12-07T10:02:08.556782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:42.831455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.530658+0000","last_change":"2023-12-07T10:02:07.531486+0000","last_active":"2023-12-07T10:02:08.530658+0000","last_peered":"2023-12-07T10:02:08.530658+0000","last_clean":"2023-12-07T10:02:08.530658+0000","last_became_active":"2023-12-07T10:02:07.531164+0000","last_became_peered":"2023-12-07T10:02:07.531164+0000","last_unstale":"2023-12-07T10:02:08.530658+0000","last_undegraded":"2023-12-07T10:02:08.530658+0000","last_fullsized":"2023-12-07T10:02:08.530658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:10.726346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522482+0000","last_change":"2023-12-07T10:01:51.330147+0000","last_active":"2023-12-07T10:02:08.522482+0000","last_peered":"2023-12-07T10:02:08.522482+0000","last_clean":"2023-12-07T10:02:08.522482+0000","last_became_active":"2023-12-07T10:01:51.329786+0000","last_became_peered":"2023-12-07T10:01:51.329786+0000","last_unstale":"2023-12-07T10:02:08.522482+0000","last_undegraded":"2023-12-07T10:02:08.522482+0000","last_fullsized":"2023-12-07T10:02:08.522482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:16.697908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"67'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517670+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:02:08.517670+0000","last_peered":"2023-12-07T10:02:08.517670+0000","last_clean":"2023-12-07T10:02:08.517670+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:02:08.517670+0000","last_undegraded":"2023-12-07T10:02:08.517670+0000","last_fullsized":"2023-12-07T10:02:08.517670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297195+0000","last_change":"2023-12-07T10:02:08.541678+0000","last_active":"2023-12-07T10:02:10.297195+0000","last_peered":"2023-12-07T10:02:10.297195+0000","last_clean":"2023-12-07T10:02:10.297195+0000","last_became_active":"2023-12-07T10:02:08.541390+0000","last_became_peered":"2023-12-07T10:02:08.541390+0000","last_unstale":"2023-12-07T10:02:10.297195+0000","last_undegraded":"2023-12-07T10:02:10.297195+0000","last_fullsized":"2023-12-07T10:02:10.297195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:57:31.987419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"70'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.555375+0000","last_change":"2023-12-07T10:02:07.527154+0000","last_active":"2023-12-07T10:02:08.555375+0000","last_peered":"2023-12-07T10:02:08.555375+0000","last_clean":"2023-12-07T10:02:08.555375+0000","last_became_active":"2023-12-07T10:02:07.526872+0000","last_became_peered":"2023-12-07T10:02:07.526872+0000","last_unstale":"2023-12-07T10:02:08.555375+0000","last_undegraded":"2023-12-07T10:02:08.555375+0000","last_fullsized":"2023-12-07T10:02:08.555375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:46:44.215275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.528368+0000","last_change":"2023-12-07T10:01:51.331632+0000","last_active":"2023-12-07T10:02:07.528368+0000","last_peered":"2023-12-07T10:02:07.528368+0000","last_clean":"2023-12-07T10:02:07.528368+0000","last_became_active":"2023-12-07T10:01:51.331353+0000","last_became_peered":"2023-12-07T10:01:51.331353+0000","last_unstale":"2023-12-07T10:02:07.528368+0000","last_undegraded":"2023-12-07T10:02:07.528368+0000","last_fullsized":"2023-12-07T10:02:07.528368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526124+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:02:07.526124+0000","last_peered":"2023-12-07T10:02:07.526124+0000","last_clean":"2023-12-07T10:02:07.526124+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:02:07.526124+0000","last_undegraded":"2023-12-07T10:02:07.526124+0000","last_fullsized":"2023-12-07T10:02:07.526124+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533610+0000","last_change":"2023-12-07T10:02:08.534380+0000","last_active":"2023-12-07T10:02:09.533610+0000","last_peered":"2023-12-07T10:02:09.533610+0000","last_clean":"2023-12-07T10:02:09.533610+0000","last_became_active":"2023-12-07T10:02:08.534118+0000","last_became_peered":"2023-12-07T10:02:08.534118+0000","last_unstale":"2023-12-07T10:02:09.533610+0000","last_undegraded":"2023-12-07T10:02:09.533610+0000","last_fullsized":"2023-12-07T10:02:09.533610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:37.146908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.299283+0000","last_change":"2023-12-07T10:02:07.538917+0000","last_active":"2023-12-07T10:02:10.299283+0000","last_peered":"2023-12-07T10:02:10.299283+0000","last_clean":"2023-12-07T10:02:10.299283+0000","last_became_active":"2023-12-07T10:02:07.538361+0000","last_became_peered":"2023-12-07T10:02:07.538361+0000","last_unstale":"2023-12-07T10:02:10.299283+0000","last_undegraded":"2023-12-07T10:02:10.299283+0000","last_fullsized":"2023-12-07T10:02:10.299283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:18:30.354345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524809+0000","last_change":"2023-12-07T10:01:51.319139+0000","last_active":"2023-12-07T10:02:08.524809+0000","last_peered":"2023-12-07T10:02:08.524809+0000","last_clean":"2023-12-07T10:02:08.524809+0000","last_became_active":"2023-12-07T10:01:51.318844+0000","last_became_peered":"2023-12-07T10:01:51.318844+0000","last_unstale":"2023-12-07T10:02:08.524809+0000","last_undegraded":"2023-12-07T10:02:08.524809+0000","last_fullsized":"2023-12-07T10:02:08.524809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527227+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:02:07.527227+0000","last_peered":"2023-12-07T10:02:07.527227+0000","last_clean":"2023-12-07T10:02:07.527227+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:02:07.527227+0000","last_undegraded":"2023-12-07T10:02:07.527227+0000","last_fullsized":"2023-12-07T10:02:07.527227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300140+0000","last_change":"2023-12-07T10:02:08.530268+0000","last_active":"2023-12-07T10:02:10.300140+0000","last_peered":"2023-12-07T10:02:10.300140+0000","last_clean":"2023-12-07T10:02:10.300140+0000","last_became_active":"2023-12-07T10:02:08.529975+0000","last_became_peered":"2023-12-07T10:02:08.529975+0000","last_unstale":"2023-12-07T10:02:10.300140+0000","last_undegraded":"2023-12-07T10:02:10.300140+0000","last_fullsized":"2023-12-07T10:02:10.300140+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:53.709475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518490+0000","last_change":"2023-12-07T10:02:07.537807+0000","last_active":"2023-12-07T10:02:08.518490+0000","last_peered":"2023-12-07T10:02:08.518490+0000","last_clean":"2023-12-07T10:02:08.518490+0000","last_became_active":"2023-12-07T10:02:07.537081+0000","last_became_peered":"2023-12-07T10:02:07.537081+0000","last_unstale":"2023-12-07T10:02:08.518490+0000","last_undegraded":"2023-12-07T10:02:08.518490+0000","last_fullsized":"2023-12-07T10:02:08.518490+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:05:39.294446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.519150+0000","last_change":"2023-12-07T10:01:51.329016+0000","last_active":"2023-12-07T10:02:07.519150+0000","last_peered":"2023-12-07T10:02:07.519150+0000","last_clean":"2023-12-07T10:02:07.519150+0000","last_became_active":"2023-12-07T10:01:51.327629+0000","last_became_peered":"2023-12-07T10:01:51.327629+0000","last_unstale":"2023-12-07T10:02:07.519150+0000","last_undegraded":"2023-12-07T10:02:07.519150+0000","last_fullsized":"2023-12-07T10:02:07.519150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518954+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:02:08.518954+0000","last_peered":"2023-12-07T10:02:08.518954+0000","last_clean":"2023-12-07T10:02:08.518954+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:02:08.518954+0000","last_undegraded":"2023-12-07T10:02:08.518954+0000","last_fullsized":"2023-12-07T10:02:08.518954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:07.169353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.553604+0000","last_change":"2023-12-07T10:02:08.542525+0000","last_active":"2023-12-07T10:02:08.553604+0000","last_peered":"2023-12-07T10:02:08.553604+0000","last_clean":"2023-12-07T10:02:08.553604+0000","last_became_active":"2023-12-07T10:02:08.540704+0000","last_became_peered":"2023-12-07T10:02:08.540704+0000","last_unstale":"2023-12-07T10:02:08.553604+0000","last_undegraded":"2023-12-07T10:02:08.553604+0000","last_fullsized":"2023-12-07T10:02:08.553604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:55:20.203037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300193+0000","last_change":"2023-12-07T10:02:07.535372+0000","last_active":"2023-12-07T10:02:10.300193+0000","last_peered":"2023-12-07T10:02:10.300193+0000","last_clean":"2023-12-07T10:02:10.300193+0000","last_became_active":"2023-12-07T10:02:07.534814+0000","last_became_peered":"2023-12-07T10:02:07.534814+0000","last_unstale":"2023-12-07T10:02:10.300193+0000","last_undegraded":"2023-12-07T10:02:10.300193+0000","last_fullsized":"2023-12-07T10:02:10.300193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:45:13.756472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518675+0000","last_change":"2023-12-07T10:01:51.329122+0000","last_active":"2023-12-07T10:02:08.518675+0000","last_peered":"2023-12-07T10:02:08.518675+0000","last_clean":"2023-12-07T10:02:08.518675+0000","last_became_active":"2023-12-07T10:01:51.328758+0000","last_became_peered":"2023-12-07T10:01:51.328758+0000","last_unstale":"2023-12-07T10:02:08.518675+0000","last_undegraded":"2023-12-07T10:02:08.518675+0000","last_fullsized":"2023-12-07T10:02:08.518675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522300+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:02:08.522300+0000","last_peered":"2023-12-07T10:02:08.522300+0000","last_clean":"2023-12-07T10:02:08.522300+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:02:08.522300+0000","last_undegraded":"2023-12-07T10:02:08.522300+0000","last_fullsized":"2023-12-07T10:02:08.522300+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300513+0000","last_change":"2023-12-07T10:02:08.529904+0000","last_active":"2023-12-07T10:02:10.300513+0000","last_peered":"2023-12-07T10:02:10.300513+0000","last_clean":"2023-12-07T10:02:10.300513+0000","last_became_active":"2023-12-07T10:02:08.529510+0000","last_became_peered":"2023-12-07T10:02:08.529510+0000","last_unstale":"2023-12-07T10:02:10.300513+0000","last_undegraded":"2023-12-07T10:02:10.300513+0000","last_fullsized":"2023-12-07T10:02:10.300513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:46:12.848901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296676+0000","last_change":"2023-12-07T10:02:07.528409+0000","last_active":"2023-12-07T10:02:10.296676+0000","last_peered":"2023-12-07T10:02:10.296676+0000","last_clean":"2023-12-07T10:02:10.296676+0000","last_became_active":"2023-12-07T10:02:07.528101+0000","last_became_peered":"2023-12-07T10:02:07.528101+0000","last_unstale":"2023-12-07T10:02:10.296676+0000","last_undegraded":"2023-12-07T10:02:10.296676+0000","last_fullsized":"2023-12-07T10:02:10.296676+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:05:39.294446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518989+0000","last_change":"2023-12-07T10:01:51.322885+0000","last_active":"2023-12-07T10:02:08.518989+0000","last_peered":"2023-12-07T10:02:08.518989+0000","last_clean":"2023-12-07T10:02:08.518989+0000","last_became_active":"2023-12-07T10:01:51.322135+0000","last_became_peered":"2023-12-07T10:01:51.322135+0000","last_unstale":"2023-12-07T10:02:08.518989+0000","last_undegraded":"2023-12-07T10:02:08.518989+0000","last_fullsized":"2023-12-07T10:02:08.518989+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525352+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:02:07.525352+0000","last_peered":"2023-12-07T10:02:07.525352+0000","last_clean":"2023-12-07T10:02:07.525352+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:02:07.525352+0000","last_undegraded":"2023-12-07T10:02:07.525352+0000","last_fullsized":"2023-12-07T10:02:07.525352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:56.460325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536105+0000","last_change":"2023-12-07T10:02:08.552603+0000","last_active":"2023-12-07T10:02:09.536105+0000","last_peered":"2023-12-07T10:02:09.536105+0000","last_clean":"2023-12-07T10:02:09.536105+0000","last_became_active":"2023-12-07T10:02:08.552268+0000","last_became_peered":"2023-12-07T10:02:08.552268+0000","last_unstale":"2023-12-07T10:02:09.536105+0000","last_undegraded":"2023-12-07T10:02:09.536105+0000","last_fullsized":"2023-12-07T10:02:09.536105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:27:45.419988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.529030+0000","last_change":"2023-12-07T10:02:07.536981+0000","last_active":"2023-12-07T10:02:08.529030+0000","last_peered":"2023-12-07T10:02:08.529030+0000","last_clean":"2023-12-07T10:02:08.529030+0000","last_became_active":"2023-12-07T10:02:07.536636+0000","last_became_peered":"2023-12-07T10:02:07.536636+0000","last_unstale":"2023-12-07T10:02:08.529030+0000","last_undegraded":"2023-12-07T10:02:08.529030+0000","last_fullsized":"2023-12-07T10:02:08.529030+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:00:25.353016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525239+0000","last_change":"2023-12-07T10:01:51.332156+0000","last_active":"2023-12-07T10:02:07.525239+0000","last_peered":"2023-12-07T10:02:07.525239+0000","last_clean":"2023-12-07T10:02:07.525239+0000","last_became_active":"2023-12-07T10:01:51.331807+0000","last_became_peered":"2023-12-07T10:01:51.331807+0000","last_unstale":"2023-12-07T10:02:07.525239+0000","last_undegraded":"2023-12-07T10:02:07.525239+0000","last_fullsized":"2023-12-07T10:02:07.525239+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522705+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:02:08.522705+0000","last_peered":"2023-12-07T10:02:08.522705+0000","last_clean":"2023-12-07T10:02:08.522705+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:02:08.522705+0000","last_undegraded":"2023-12-07T10:02:08.522705+0000","last_fullsized":"2023-12-07T10:02:08.522705+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.301116+0000","last_change":"2023-12-07T10:02:08.536976+0000","last_active":"2023-12-07T10:02:10.301116+0000","last_peered":"2023-12-07T10:02:10.301116+0000","last_clean":"2023-12-07T10:02:10.301116+0000","last_became_active":"2023-12-07T10:02:08.536682+0000","last_became_peered":"2023-12-07T10:02:08.536682+0000","last_unstale":"2023-12-07T10:02:10.301116+0000","last_undegraded":"2023-12-07T10:02:10.301116+0000","last_fullsized":"2023-12-07T10:02:10.301116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:27.833431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536620+0000","last_change":"2023-12-07T10:02:07.527665+0000","last_active":"2023-12-07T10:02:09.536620+0000","last_peered":"2023-12-07T10:02:09.536620+0000","last_clean":"2023-12-07T10:02:09.536620+0000","last_became_active":"2023-12-07T10:02:07.527361+0000","last_became_peered":"2023-12-07T10:02:07.527361+0000","last_unstale":"2023-12-07T10:02:09.536620+0000","last_undegraded":"2023-12-07T10:02:09.536620+0000","last_fullsized":"2023-12-07T10:02:09.536620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:18.708323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517345+0000","last_change":"2023-12-07T10:01:51.330158+0000","last_active":"2023-12-07T10:02:08.517345+0000","last_peered":"2023-12-07T10:02:08.517345+0000","last_clean":"2023-12-07T10:02:08.517345+0000","last_became_active":"2023-12-07T10:01:51.329812+0000","last_became_peered":"2023-12-07T10:01:51.329812+0000","last_unstale":"2023-12-07T10:02:08.517345+0000","last_undegraded":"2023-12-07T10:02:08.517345+0000","last_fullsized":"2023-12-07T10:02:08.517345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:08:38.276890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522108+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:02:08.522108+0000","last_peered":"2023-12-07T10:02:08.522108+0000","last_clean":"2023-12-07T10:02:08.522108+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:02:08.522108+0000","last_undegraded":"2023-12-07T10:02:08.522108+0000","last_fullsized":"2023-12-07T10:02:08.522108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519076+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:02:08.519076+0000","last_peered":"2023-12-07T10:02:08.519076+0000","last_clean":"2023-12-07T10:02:08.519076+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:08.519076+0000","last_undegraded":"2023-12-07T10:02:08.519076+0000","last_fullsized":"2023-12-07T10:02:08.519076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1478656,"data_stored":978091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77600000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.77600000000000002,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.74099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82099999999999995,"5min":1.008,"15min":1.008},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.753},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.75,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0229999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.84199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.161,"15min":1.161},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.79800000000000004,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.81999999999999995,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":381730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.75},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.879}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":383583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":0.88,"15min":0.88},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.438,"15min":0.438},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53300000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.751}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":1.248,"15min":1.248},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.621},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":389277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.91300000000000003,"5min":1.091,"15min":1.091},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94999999999999996,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.079,"15min":1.079},"last":0.87}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":1.274,"15min":1.274},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":1.306,"15min":1.306},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72999999999999998,"15min":0.77200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.80900000000000005},"min":{"1min":0.56000000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":385125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.56000000000000005,"15min":0.63800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69699999999999995,"5min":5.516,"15min":5.516},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50900000000000001,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":1.464,"15min":1.464},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.488,"15min":1.488},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57099999999999995,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.435},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61399999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.599,"15min":1.599},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.84599999999999997},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1020000000000001,"5min":4.617,"15min":4.617},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.077,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.046,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.94299999999999995,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.81899999999999995,"15min":0.85599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.012,"5min":3.468,"15min":3.468},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57899999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":1.841,"15min":1.841},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":381000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.55600000000000005,"15min":0.624},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71599999999999997,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.81399999999999995,"15min":0.97999999999999998},"min":{"1min":0.31900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.171,"5min":13.016,"15min":13.016},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.85399999999999998},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6760000000000002,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92600000000000005,"15min":1.1120000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.915,"5min":13.166,"15min":13.166},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90100000000000002,"15min":0.999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":8.5660000000000007,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.89300000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.714,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.84699999999999998,"15min":0.92300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96799999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":1.0069999999999999,"15min":1.131},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.0489999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.97099999999999997,"15min":1.0760000000000001},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.3599999999999999,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89600000000000002,"15min":0.94199999999999995},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.7519999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":1.0429999999999999,"15min":1.1879999999999999},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.417,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.002,"15min":1.103},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.3969999999999998,"5min":5.75,"15min":5.75},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":1.0649999999999999,"15min":1.2190000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2130000000000001,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0209999999999999,"15min":1.0980000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5110000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":387735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.65800000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.45300000000000001,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.437},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61599999999999999,"5min":0.87,"15min":0.87},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":1.01,"15min":1.01},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.083,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.002,"5min":1.012,"15min":1.012},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":971368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.47499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70999999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.66400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79400000000000004,"5min":4.173,"15min":4.173},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.52600000000000002,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.73599999999999999,"15min":0.83899999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":6.048,"15min":6.048},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":1.266,"15min":1.266},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2110000000000001,"5min":2.456,"15min":2.456},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.83499999999999996},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.90000000000000002,"15min":0.96999999999999997},"min":{"1min":0.57399999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.133,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1679999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:12.609 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:02:12.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.771+0000 7f7bfa7a1640 1 Processor -- start 2023-12-07T10:02:12.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.771+0000 7f7bfa7a1640 1 -- start start 2023-12-07T10:02:12.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bfa7a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40aacd0 0x7f7bf4154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bfa7a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bf40700a0 0x7f7bf41546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bfa7a1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7bf40ab7a0 0x7f7bf406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bfa7a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf4072780 con 0x7f7bf40700a0 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bfa7a1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40ac160 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bfa7a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40abe80 con 0x7f7bf40aacd0 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bf40700a0 0x7f7bf41546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bf40700a0 0x7f7bf41546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48132/0 (socket says 172.21.15.89:48132) 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 -- 172.21.15.89:0/3124843575 learned_addr learned my addr 172.21.15.89:0/3124843575 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf3fff640 1 --2- 172.21.15.89:0/3124843575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40aacd0 0x7f7bf4154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf8d3e640 1 --2- 172.21.15.89:0/3124843575 >> v2:172.21.15.97:3300/0 conn(0x7f7bf40ab7a0 0x7f7bf406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 -- 172.21.15.89:0/3124843575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40aacd0 msgr2=0x7f7bf4154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 --2- 172.21.15.89:0/3124843575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40aacd0 0x7f7bf4154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 -- 172.21.15.89:0/3124843575 >> v2:172.21.15.97:3300/0 conn(0x7f7bf40ab7a0 msgr2=0x7f7bf406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:12.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 --2- 172.21.15.89:0/3124843575 >> v2:172.21.15.97:3300/0 conn(0x7f7bf40ab7a0 0x7f7bf406c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf37fe640 1 -- 172.21.15.89:0/3124843575 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4154cf0 con 0x7f7bf40700a0 2023-12-07T10:02:12.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.775+0000 7f7bf8d3e640 1 --2- 172.21.15.89:0/3124843575 >> v2:172.21.15.97:3300/0 conn(0x7f7bf40ab7a0 0x7f7bf406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:12.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bf37fe640 1 --2- 172.21.15.89:0/3124843575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40700a0 0x7f7bf41546a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40c03e0 tx=0x7f7be801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e554d0aeb1cf87 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bf2ffd640 1 -- 172.21.15.89:0/3124843575 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80ad680 con 0x7f7bf40700a0 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bf2ffd640 1 -- 172.21.15.89:0/3124843575 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80ad7e0 con 0x7f7bf40700a0 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bf2ffd640 1 -- 172.21.15.89:0/3124843575 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80adb70 con 0x7f7bf40700a0 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3124843575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40700a0 msgr2=0x7f7bf41546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3124843575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40700a0 0x7f7bf41546a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40c03e0 tx=0x7f7be801c440 comp rx=0 tx=0).stop 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3124843575 shutdown_connections 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3124843575 >> v2:172.21.15.97:3300/0 conn(0x7f7bf40ab7a0 0x7f7bf406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3124843575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40700a0 0x7f7bf41546a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3124843575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40aacd0 0x7f7bf4154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3124843575 >> 172.21.15.89:0/3124843575 conn(0x7f7bf40c2ad0 msgr2=0x7f7bf40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3124843575 shutdown_connections 2023-12-07T10:02:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3124843575 wait complete. 2023-12-07T10:02:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 Processor -- start 2023-12-07T10:02:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.779+0000 7f7bfa7a1640 1 -- start start 2023-12-07T10:02:12.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40700a0 0x7f7bf41ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf40aacd0 0x7f7bf40c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 0x7f7bf4153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40c51b0 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4143c70 con 0x7f7bf40aacd0 2023-12-07T10:02:12.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41436b0 con 0x7f7bf40700a0 2023-12-07T10:02:12.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 0x7f7bf4153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 0x7f7bf4153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48138/0 (socket says 172.21.15.89:48138) 2023-12-07T10:02:12.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 -- 172.21.15.89:0/3786706338 learned_addr learned my addr 172.21.15.89:0/3786706338 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:12.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf3fff640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40700a0 0x7f7bf41ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf37fe640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf40aacd0 0x7f7bf40c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 -- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40700a0 msgr2=0x7f7bf41ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40700a0 0x7f7bf41ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 -- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf40aacd0 msgr2=0x7f7bf40c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf40aacd0 0x7f7bf40c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 -- 172.21.15.89:0/3786706338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80094d0 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf37fe640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf40aacd0 0x7f7bf40c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:12.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf8d3e640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 0x7f7bf4153af0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00cef0 tx=0x7f7bec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00d840 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00d9c0 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4143990 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00dd70 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4148f80 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404e890 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.783+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7bec01e3b0 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.787+0000 7f7bf0ff9640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7be00668d0 0x7f7be0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:12.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.787+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7bec085110 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.787+0000 7f7bf3fff640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7be00668d0 0x7f7be0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:12.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.787+0000 7f7bf3fff640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7be00668d0 0x7f7be0068d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40ac3d0 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:12.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.787+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7bec0521f0 con 0x7f7bf40ab7a0 2023-12-07T10:02:12.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.935+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7bf40a9650 con 0x7f7be00668d0 2023-12-07T10:02:12.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.947+0000 7f7bf0ff9640 1 -- 172.21.15.89:0/3786706338 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527627 (secure 0 0 0) 0x7f7bf40a9650 con 0x7f7be00668d0 2023-12-07T10:02:12.959 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:12.963 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7be00668d0 msgr2=0x7f7be0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7be00668d0 0x7f7be0068d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40ac3d0 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 msgr2=0x7f7bf4153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 0x7f7bf4153af0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00cef0 tx=0x7f7bec00a710 comp rx=0 tx=0).stop 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 shutdown_connections 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bf40ab7a0 0x7f7bf4153af0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf40aacd0 0x7f7bf40c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7be00668d0 0x7f7be0068d90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 --2- 172.21.15.89:0/3786706338 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bf40700a0 0x7f7bf41ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 >> 172.21.15.89:0/3786706338 conn(0x7f7bf40c2ad0 msgr2=0x7f7bf4071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:12.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 shutdown_connections 2023-12-07T10:02:12.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:12.955+0000 7f7bfa7a1640 1 -- 172.21.15.89:0/3786706338 wait complete. 2023-12-07T10:02:12.979 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-12-07T10:02:12.378446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":318,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253352,"kb_used_data":8044,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721368,"statfs":{"total":773094113280,"available":772834680832,"internally_reserved":0,"allocated":8237056,"data_stored":4257909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875620"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533487+0000","last_change":"2023-12-07T10:02:08.542836+0000","last_active":"2023-12-07T10:02:09.533487+0000","last_peered":"2023-12-07T10:02:09.533487+0000","last_clean":"2023-12-07T10:02:09.533487+0000","last_became_active":"2023-12-07T10:02:08.539149+0000","last_became_peered":"2023-12-07T10:02:08.539149+0000","last_unstale":"2023-12-07T10:02:09.533487+0000","last_undegraded":"2023-12-07T10:02:09.533487+0000","last_fullsized":"2023-12-07T10:02:09.533487+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:26.703544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526751+0000","last_change":"2023-12-07T10:01:51.334457+0000","last_active":"2023-12-07T10:02:07.526751+0000","last_peered":"2023-12-07T10:02:07.526751+0000","last_clean":"2023-12-07T10:02:07.526751+0000","last_became_active":"2023-12-07T10:01:51.333891+0000","last_became_peered":"2023-12-07T10:01:51.333891+0000","last_unstale":"2023-12-07T10:02:07.526751+0000","last_undegraded":"2023-12-07T10:02:07.526751+0000","last_fullsized":"2023-12-07T10:02:07.526751+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:50.606836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544994+0000","last_change":"2023-12-07T10:02:08.533544+0000","last_active":"2023-12-07T10:02:08.544994+0000","last_peered":"2023-12-07T10:02:08.544994+0000","last_clean":"2023-12-07T10:02:08.544994+0000","last_became_active":"2023-12-07T10:02:08.533273+0000","last_became_peered":"2023-12-07T10:02:08.533273+0000","last_unstale":"2023-12-07T10:02:08.544994+0000","last_undegraded":"2023-12-07T10:02:08.544994+0000","last_fullsized":"2023-12-07T10:02:08.544994+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:24:19.313304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517561+0000","last_change":"2023-12-07T10:01:51.330897+0000","last_active":"2023-12-07T10:02:08.517561+0000","last_peered":"2023-12-07T10:02:08.517561+0000","last_clean":"2023-12-07T10:02:08.517561+0000","last_became_active":"2023-12-07T10:01:51.330640+0000","last_became_peered":"2023-12-07T10:01:51.330640+0000","last_unstale":"2023-12-07T10:02:08.517561+0000","last_undegraded":"2023-12-07T10:02:08.517561+0000","last_fullsized":"2023-12-07T10:02:08.517561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:57.467622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533486+0000","last_change":"2023-12-07T10:02:08.546790+0000","last_active":"2023-12-07T10:02:09.533486+0000","last_peered":"2023-12-07T10:02:09.533486+0000","last_clean":"2023-12-07T10:02:09.533486+0000","last_became_active":"2023-12-07T10:02:08.545914+0000","last_became_peered":"2023-12-07T10:02:08.545914+0000","last_unstale":"2023-12-07T10:02:09.533486+0000","last_undegraded":"2023-12-07T10:02:09.533486+0000","last_fullsized":"2023-12-07T10:02:09.533486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:28.172152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521349+0000","last_change":"2023-12-07T10:01:51.328745+0000","last_active":"2023-12-07T10:02:08.521349+0000","last_peered":"2023-12-07T10:02:08.521349+0000","last_clean":"2023-12-07T10:02:08.521349+0000","last_became_active":"2023-12-07T10:01:51.328404+0000","last_became_peered":"2023-12-07T10:01:51.328404+0000","last_unstale":"2023-12-07T10:02:08.521349+0000","last_undegraded":"2023-12-07T10:02:08.521349+0000","last_fullsized":"2023-12-07T10:02:08.521349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:35:05.845534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297356+0000","last_change":"2023-12-07T10:02:08.541569+0000","last_active":"2023-12-07T10:02:10.297356+0000","last_peered":"2023-12-07T10:02:10.297356+0000","last_clean":"2023-12-07T10:02:10.297356+0000","last_became_active":"2023-12-07T10:02:08.541306+0000","last_became_peered":"2023-12-07T10:02:08.541306+0000","last_unstale":"2023-12-07T10:02:10.297356+0000","last_undegraded":"2023-12-07T10:02:10.297356+0000","last_fullsized":"2023-12-07T10:02:10.297356+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:51:26.657472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523851+0000","last_change":"2023-12-07T10:01:51.237718+0000","last_active":"2023-12-07T10:02:08.523851+0000","last_peered":"2023-12-07T10:02:08.523851+0000","last_clean":"2023-12-07T10:02:08.523851+0000","last_became_active":"2023-12-07T10:01:51.237319+0000","last_became_peered":"2023-12-07T10:01:51.237319+0000","last_unstale":"2023-12-07T10:02:08.523851+0000","last_undegraded":"2023-12-07T10:02:08.523851+0000","last_fullsized":"2023-12-07T10:02:08.523851+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:33:39.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.535395+0000","last_change":"2023-12-07T10:02:08.537741+0000","last_active":"2023-12-07T10:02:09.535395+0000","last_peered":"2023-12-07T10:02:09.535395+0000","last_clean":"2023-12-07T10:02:09.535395+0000","last_became_active":"2023-12-07T10:02:08.537442+0000","last_became_peered":"2023-12-07T10:02:08.537442+0000","last_unstale":"2023-12-07T10:02:09.535395+0000","last_undegraded":"2023-12-07T10:02:09.535395+0000","last_fullsized":"2023-12-07T10:02:09.535395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:22:48.653437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521386+0000","last_change":"2023-12-07T10:01:51.319209+0000","last_active":"2023-12-07T10:02:08.521386+0000","last_peered":"2023-12-07T10:02:08.521386+0000","last_clean":"2023-12-07T10:02:08.521386+0000","last_became_active":"2023-12-07T10:01:51.318902+0000","last_became_peered":"2023-12-07T10:01:51.318902+0000","last_unstale":"2023-12-07T10:02:08.521386+0000","last_undegraded":"2023-12-07T10:02:08.521386+0000","last_fullsized":"2023-12-07T10:02:08.521386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296478+0000","last_change":"2023-12-07T10:02:08.539017+0000","last_active":"2023-12-07T10:02:10.296478+0000","last_peered":"2023-12-07T10:02:10.296478+0000","last_clean":"2023-12-07T10:02:10.296478+0000","last_became_active":"2023-12-07T10:02:08.537056+0000","last_became_peered":"2023-12-07T10:02:08.537056+0000","last_unstale":"2023-12-07T10:02:10.296478+0000","last_undegraded":"2023-12-07T10:02:10.296478+0000","last_fullsized":"2023-12-07T10:02:10.296478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:34:30.272183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.519085+0000","last_change":"2023-12-07T10:01:51.328543+0000","last_active":"2023-12-07T10:02:07.519085+0000","last_peered":"2023-12-07T10:02:07.519085+0000","last_clean":"2023-12-07T10:02:07.519085+0000","last_became_active":"2023-12-07T10:01:51.327329+0000","last_became_peered":"2023-12-07T10:01:51.327329+0000","last_unstale":"2023-12-07T10:02:07.519085+0000","last_undegraded":"2023-12-07T10:02:07.519085+0000","last_fullsized":"2023-12-07T10:02:07.519085+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556900+0000","last_change":"2023-12-07T10:02:08.552886+0000","last_active":"2023-12-07T10:02:08.556900+0000","last_peered":"2023-12-07T10:02:08.556900+0000","last_clean":"2023-12-07T10:02:08.556900+0000","last_became_active":"2023-12-07T10:02:08.552400+0000","last_became_peered":"2023-12-07T10:02:08.552400+0000","last_unstale":"2023-12-07T10:02:08.556900+0000","last_undegraded":"2023-12-07T10:02:08.556900+0000","last_fullsized":"2023-12-07T10:02:08.556900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:27:45.419988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523477+0000","last_change":"2023-12-07T10:01:51.320165+0000","last_active":"2023-12-07T10:02:08.523477+0000","last_peered":"2023-12-07T10:02:08.523477+0000","last_clean":"2023-12-07T10:02:08.523477+0000","last_became_active":"2023-12-07T10:01:51.319902+0000","last_became_peered":"2023-12-07T10:01:51.319902+0000","last_unstale":"2023-12-07T10:02:08.523477+0000","last_undegraded":"2023-12-07T10:02:08.523477+0000","last_fullsized":"2023-12-07T10:02:08.523477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:42:42.457874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536522+0000","last_change":"2023-12-07T10:02:08.537760+0000","last_active":"2023-12-07T10:02:09.536522+0000","last_peered":"2023-12-07T10:02:09.536522+0000","last_clean":"2023-12-07T10:02:09.536522+0000","last_became_active":"2023-12-07T10:02:08.537488+0000","last_became_peered":"2023-12-07T10:02:08.537488+0000","last_unstale":"2023-12-07T10:02:09.536522+0000","last_undegraded":"2023-12-07T10:02:09.536522+0000","last_fullsized":"2023-12-07T10:02:09.536522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:18:31.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518430+0000","last_change":"2023-12-07T10:01:51.329061+0000","last_active":"2023-12-07T10:02:07.518430+0000","last_peered":"2023-12-07T10:02:07.518430+0000","last_clean":"2023-12-07T10:02:07.518430+0000","last_became_active":"2023-12-07T10:01:51.326242+0000","last_became_peered":"2023-12-07T10:01:51.326242+0000","last_unstale":"2023-12-07T10:02:07.518430+0000","last_undegraded":"2023-12-07T10:02:07.518430+0000","last_fullsized":"2023-12-07T10:02:07.518430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:55.552580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536169+0000","last_change":"2023-12-07T10:02:08.532517+0000","last_active":"2023-12-07T10:02:09.536169+0000","last_peered":"2023-12-07T10:02:09.536169+0000","last_clean":"2023-12-07T10:02:09.536169+0000","last_became_active":"2023-12-07T10:02:08.532243+0000","last_became_peered":"2023-12-07T10:02:08.532243+0000","last_unstale":"2023-12-07T10:02:09.536169+0000","last_undegraded":"2023-12-07T10:02:09.536169+0000","last_fullsized":"2023-12-07T10:02:09.536169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:50:18.299699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.517675+0000","last_change":"2023-12-07T10:01:51.325239+0000","last_active":"2023-12-07T10:02:07.517675+0000","last_peered":"2023-12-07T10:02:07.517675+0000","last_clean":"2023-12-07T10:02:07.517675+0000","last_became_active":"2023-12-07T10:01:51.324925+0000","last_became_peered":"2023-12-07T10:01:51.324925+0000","last_unstale":"2023-12-07T10:02:07.517675+0000","last_undegraded":"2023-12-07T10:02:07.517675+0000","last_fullsized":"2023-12-07T10:02:07.517675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536165+0000","last_change":"2023-12-07T10:02:08.533695+0000","last_active":"2023-12-07T10:02:09.536165+0000","last_peered":"2023-12-07T10:02:09.536165+0000","last_clean":"2023-12-07T10:02:09.536165+0000","last_became_active":"2023-12-07T10:02:08.531720+0000","last_became_peered":"2023-12-07T10:02:08.531720+0000","last_unstale":"2023-12-07T10:02:09.536165+0000","last_undegraded":"2023-12-07T10:02:09.536165+0000","last_fullsized":"2023-12-07T10:02:09.536165+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:22:32.843134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.528898+0000","last_change":"2023-12-07T10:01:51.330222+0000","last_active":"2023-12-07T10:02:07.528898+0000","last_peered":"2023-12-07T10:02:07.528898+0000","last_clean":"2023-12-07T10:02:07.528898+0000","last_became_active":"2023-12-07T10:01:51.329871+0000","last_became_peered":"2023-12-07T10:01:51.329871+0000","last_unstale":"2023-12-07T10:02:07.528898+0000","last_undegraded":"2023-12-07T10:02:07.528898+0000","last_fullsized":"2023-12-07T10:02:07.528898+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.537206+0000","last_change":"2023-12-07T10:02:08.541680+0000","last_active":"2023-12-07T10:02:09.537206+0000","last_peered":"2023-12-07T10:02:09.537206+0000","last_clean":"2023-12-07T10:02:09.537206+0000","last_became_active":"2023-12-07T10:02:08.541414+0000","last_became_peered":"2023-12-07T10:02:08.541414+0000","last_unstale":"2023-12-07T10:02:09.537206+0000","last_undegraded":"2023-12-07T10:02:09.537206+0000","last_fullsized":"2023-12-07T10:02:09.537206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:24:19.313304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519214+0000","last_change":"2023-12-07T10:01:51.321607+0000","last_active":"2023-12-07T10:02:08.519214+0000","last_peered":"2023-12-07T10:02:08.519214+0000","last_clean":"2023-12-07T10:02:08.519214+0000","last_became_active":"2023-12-07T10:01:51.321331+0000","last_became_peered":"2023-12-07T10:01:51.321331+0000","last_unstale":"2023-12-07T10:02:08.519214+0000","last_undegraded":"2023-12-07T10:02:08.519214+0000","last_fullsized":"2023-12-07T10:02:08.519214+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:50.912945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556368+0000","last_change":"2023-12-07T10:02:08.550834+0000","last_active":"2023-12-07T10:02:08.556368+0000","last_peered":"2023-12-07T10:02:08.556368+0000","last_clean":"2023-12-07T10:02:08.556368+0000","last_became_active":"2023-12-07T10:02:08.550503+0000","last_became_peered":"2023-12-07T10:02:08.550503+0000","last_unstale":"2023-12-07T10:02:08.556368+0000","last_undegraded":"2023-12-07T10:02:08.556368+0000","last_fullsized":"2023-12-07T10:02:08.556368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:20:38.300429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526432+0000","last_change":"2023-12-07T10:01:51.332752+0000","last_active":"2023-12-07T10:02:07.526432+0000","last_peered":"2023-12-07T10:02:07.526432+0000","last_clean":"2023-12-07T10:02:07.526432+0000","last_became_active":"2023-12-07T10:01:51.332452+0000","last_became_peered":"2023-12-07T10:01:51.332452+0000","last_unstale":"2023-12-07T10:02:07.526432+0000","last_undegraded":"2023-12-07T10:02:07.526432+0000","last_fullsized":"2023-12-07T10:02:07.526432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.540012+0000","last_change":"2023-12-07T10:02:08.527867+0000","last_active":"2023-12-07T10:02:08.540012+0000","last_peered":"2023-12-07T10:02:08.540012+0000","last_clean":"2023-12-07T10:02:08.540012+0000","last_became_active":"2023-12-07T10:02:08.527565+0000","last_became_peered":"2023-12-07T10:02:08.527565+0000","last_unstale":"2023-12-07T10:02:08.540012+0000","last_undegraded":"2023-12-07T10:02:08.540012+0000","last_fullsized":"2023-12-07T10:02:08.540012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:19.715794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518044+0000","last_change":"2023-12-07T10:01:51.331204+0000","last_active":"2023-12-07T10:02:08.518044+0000","last_peered":"2023-12-07T10:02:08.518044+0000","last_clean":"2023-12-07T10:02:08.518044+0000","last_became_active":"2023-12-07T10:01:51.330895+0000","last_became_peered":"2023-12-07T10:01:51.330895+0000","last_unstale":"2023-12-07T10:02:08.518044+0000","last_undegraded":"2023-12-07T10:02:08.518044+0000","last_fullsized":"2023-12-07T10:02:08.518044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536286+0000","last_change":"2023-12-07T10:02:08.538242+0000","last_active":"2023-12-07T10:02:09.536286+0000","last_peered":"2023-12-07T10:02:09.536286+0000","last_clean":"2023-12-07T10:02:09.536286+0000","last_became_active":"2023-12-07T10:02:08.537956+0000","last_became_peered":"2023-12-07T10:02:08.537956+0000","last_unstale":"2023-12-07T10:02:09.536286+0000","last_undegraded":"2023-12-07T10:02:09.536286+0000","last_fullsized":"2023-12-07T10:02:09.536286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:43:16.614570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522581+0000","last_change":"2023-12-07T10:01:51.244162+0000","last_active":"2023-12-07T10:02:08.522581+0000","last_peered":"2023-12-07T10:02:08.522581+0000","last_clean":"2023-12-07T10:02:08.522581+0000","last_became_active":"2023-12-07T10:01:51.243875+0000","last_became_peered":"2023-12-07T10:01:51.243875+0000","last_unstale":"2023-12-07T10:02:08.522581+0000","last_undegraded":"2023-12-07T10:02:08.522581+0000","last_fullsized":"2023-12-07T10:02:08.522581+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:04:07.590726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.545041+0000","last_change":"2023-12-07T10:02:08.536957+0000","last_active":"2023-12-07T10:02:08.545041+0000","last_peered":"2023-12-07T10:02:08.545041+0000","last_clean":"2023-12-07T10:02:08.545041+0000","last_became_active":"2023-12-07T10:02:08.536656+0000","last_became_peered":"2023-12-07T10:02:08.536656+0000","last_unstale":"2023-12-07T10:02:08.545041+0000","last_undegraded":"2023-12-07T10:02:08.545041+0000","last_fullsized":"2023-12-07T10:02:08.545041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:23.102199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521709+0000","last_change":"2023-12-07T10:01:51.319891+0000","last_active":"2023-12-07T10:02:07.521709+0000","last_peered":"2023-12-07T10:02:07.521709+0000","last_clean":"2023-12-07T10:02:07.521709+0000","last_became_active":"2023-12-07T10:01:51.319557+0000","last_became_peered":"2023-12-07T10:01:51.319557+0000","last_unstale":"2023-12-07T10:02:07.521709+0000","last_undegraded":"2023-12-07T10:02:07.521709+0000","last_fullsized":"2023-12-07T10:02:07.521709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:20:21.004108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300363+0000","last_change":"2023-12-07T10:02:08.551850+0000","last_active":"2023-12-07T10:02:10.300363+0000","last_peered":"2023-12-07T10:02:10.300363+0000","last_clean":"2023-12-07T10:02:10.300363+0000","last_became_active":"2023-12-07T10:02:08.551529+0000","last_became_peered":"2023-12-07T10:02:08.551529+0000","last_unstale":"2023-12-07T10:02:10.300363+0000","last_undegraded":"2023-12-07T10:02:10.300363+0000","last_fullsized":"2023-12-07T10:02:10.300363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:52.656550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519550+0000","last_change":"2023-12-07T10:01:51.331122+0000","last_active":"2023-12-07T10:02:08.519550+0000","last_peered":"2023-12-07T10:02:08.519550+0000","last_clean":"2023-12-07T10:02:08.519550+0000","last_became_active":"2023-12-07T10:01:51.330385+0000","last_became_peered":"2023-12-07T10:01:51.330385+0000","last_unstale":"2023-12-07T10:02:08.519550+0000","last_undegraded":"2023-12-07T10:02:08.519550+0000","last_fullsized":"2023-12-07T10:02:08.519550+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300977+0000","last_change":"2023-12-07T10:02:08.531810+0000","last_active":"2023-12-07T10:02:10.300977+0000","last_peered":"2023-12-07T10:02:10.300977+0000","last_clean":"2023-12-07T10:02:10.300977+0000","last_became_active":"2023-12-07T10:02:08.531458+0000","last_became_peered":"2023-12-07T10:02:08.531458+0000","last_unstale":"2023-12-07T10:02:10.300977+0000","last_undegraded":"2023-12-07T10:02:10.300977+0000","last_fullsized":"2023-12-07T10:02:10.300977+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:43:11.799328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.528369+0000","last_change":"2023-12-07T10:01:51.326514+0000","last_active":"2023-12-07T10:02:08.528369+0000","last_peered":"2023-12-07T10:02:08.528369+0000","last_clean":"2023-12-07T10:02:08.528369+0000","last_became_active":"2023-12-07T10:01:51.326126+0000","last_became_peered":"2023-12-07T10:01:51.326126+0000","last_unstale":"2023-12-07T10:02:08.528369+0000","last_undegraded":"2023-12-07T10:02:08.528369+0000","last_fullsized":"2023-12-07T10:02:08.528369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:10.489814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536315+0000","last_change":"2023-12-07T10:02:08.543190+0000","last_active":"2023-12-07T10:02:09.536315+0000","last_peered":"2023-12-07T10:02:09.536315+0000","last_clean":"2023-12-07T10:02:09.536315+0000","last_became_active":"2023-12-07T10:02:08.542895+0000","last_became_peered":"2023-12-07T10:02:08.542895+0000","last_unstale":"2023-12-07T10:02:09.536315+0000","last_undegraded":"2023-12-07T10:02:09.536315+0000","last_fullsized":"2023-12-07T10:02:09.536315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:48:01.340980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522719+0000","last_change":"2023-12-07T10:01:51.322531+0000","last_active":"2023-12-07T10:02:08.522719+0000","last_peered":"2023-12-07T10:02:08.522719+0000","last_clean":"2023-12-07T10:02:08.522719+0000","last_became_active":"2023-12-07T10:01:51.322236+0000","last_became_peered":"2023-12-07T10:01:51.322236+0000","last_unstale":"2023-12-07T10:02:08.522719+0000","last_undegraded":"2023-12-07T10:02:08.522719+0000","last_fullsized":"2023-12-07T10:02:08.522719+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:58:49.154793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297603+0000","last_change":"2023-12-07T10:02:08.535406+0000","last_active":"2023-12-07T10:02:10.297603+0000","last_peered":"2023-12-07T10:02:10.297603+0000","last_clean":"2023-12-07T10:02:10.297603+0000","last_became_active":"2023-12-07T10:02:08.535125+0000","last_became_peered":"2023-12-07T10:02:08.535125+0000","last_unstale":"2023-12-07T10:02:10.297603+0000","last_undegraded":"2023-12-07T10:02:10.297603+0000","last_fullsized":"2023-12-07T10:02:10.297603+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:23:09.906720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.526377+0000","last_change":"2023-12-07T10:01:51.246838+0000","last_active":"2023-12-07T10:02:08.526377+0000","last_peered":"2023-12-07T10:02:08.526377+0000","last_clean":"2023-12-07T10:02:08.526377+0000","last_became_active":"2023-12-07T10:01:51.246542+0000","last_became_peered":"2023-12-07T10:01:51.246542+0000","last_unstale":"2023-12-07T10:02:08.526377+0000","last_undegraded":"2023-12-07T10:02:08.526377+0000","last_fullsized":"2023-12-07T10:02:08.526377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544957+0000","last_change":"2023-12-07T10:02:08.532730+0000","last_active":"2023-12-07T10:02:08.544957+0000","last_peered":"2023-12-07T10:02:08.544957+0000","last_clean":"2023-12-07T10:02:08.544957+0000","last_became_active":"2023-12-07T10:02:08.532461+0000","last_became_peered":"2023-12-07T10:02:08.532461+0000","last_unstale":"2023-12-07T10:02:08.544957+0000","last_undegraded":"2023-12-07T10:02:08.544957+0000","last_fullsized":"2023-12-07T10:02:08.544957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:22:48.653437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523930+0000","last_change":"2023-12-07T10:01:51.238206+0000","last_active":"2023-12-07T10:02:08.523930+0000","last_peered":"2023-12-07T10:02:08.523930+0000","last_clean":"2023-12-07T10:02:08.523930+0000","last_became_active":"2023-12-07T10:01:51.237896+0000","last_became_peered":"2023-12-07T10:01:51.237896+0000","last_unstale":"2023-12-07T10:02:08.523930+0000","last_undegraded":"2023-12-07T10:02:08.523930+0000","last_fullsized":"2023-12-07T10:02:08.523930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:48:05.717307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296595+0000","last_change":"2023-12-07T10:02:08.539141+0000","last_active":"2023-12-07T10:02:10.296595+0000","last_peered":"2023-12-07T10:02:10.296595+0000","last_clean":"2023-12-07T10:02:10.296595+0000","last_became_active":"2023-12-07T10:02:08.538794+0000","last_became_peered":"2023-12-07T10:02:08.538794+0000","last_unstale":"2023-12-07T10:02:10.296595+0000","last_undegraded":"2023-12-07T10:02:10.296595+0000","last_fullsized":"2023-12-07T10:02:10.296595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:11:58.615209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523020+0000","last_change":"2023-12-07T10:01:51.239605+0000","last_active":"2023-12-07T10:02:08.523020+0000","last_peered":"2023-12-07T10:02:08.523020+0000","last_clean":"2023-12-07T10:02:08.523020+0000","last_became_active":"2023-12-07T10:01:51.238681+0000","last_became_peered":"2023-12-07T10:01:51.238681+0000","last_unstale":"2023-12-07T10:02:08.523020+0000","last_undegraded":"2023-12-07T10:02:08.523020+0000","last_fullsized":"2023-12-07T10:02:08.523020+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:49.151421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.535630+0000","last_change":"2023-12-07T10:02:08.530307+0000","last_active":"2023-12-07T10:02:09.535630+0000","last_peered":"2023-12-07T10:02:09.535630+0000","last_clean":"2023-12-07T10:02:09.535630+0000","last_became_active":"2023-12-07T10:02:08.530020+0000","last_became_peered":"2023-12-07T10:02:08.530020+0000","last_unstale":"2023-12-07T10:02:09.535630+0000","last_undegraded":"2023-12-07T10:02:09.535630+0000","last_fullsized":"2023-12-07T10:02:09.535630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:10:00.973402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518190+0000","last_change":"2023-12-07T10:01:51.239133+0000","last_active":"2023-12-07T10:02:08.518190+0000","last_peered":"2023-12-07T10:02:08.518190+0000","last_clean":"2023-12-07T10:02:08.518190+0000","last_became_active":"2023-12-07T10:01:51.238847+0000","last_became_peered":"2023-12-07T10:01:51.238847+0000","last_unstale":"2023-12-07T10:02:08.518190+0000","last_undegraded":"2023-12-07T10:02:08.518190+0000","last_fullsized":"2023-12-07T10:02:08.518190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:05:01.049212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300574+0000","last_change":"2023-12-07T10:02:08.540803+0000","last_active":"2023-12-07T10:02:10.300574+0000","last_peered":"2023-12-07T10:02:10.300574+0000","last_clean":"2023-12-07T10:02:10.300574+0000","last_became_active":"2023-12-07T10:02:08.539276+0000","last_became_peered":"2023-12-07T10:02:08.539276+0000","last_unstale":"2023-12-07T10:02:10.300574+0000","last_undegraded":"2023-12-07T10:02:10.300574+0000","last_fullsized":"2023-12-07T10:02:10.300574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:18:14.581421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525220+0000","last_change":"2023-12-07T10:01:51.326936+0000","last_active":"2023-12-07T10:02:07.525220+0000","last_peered":"2023-12-07T10:02:07.525220+0000","last_clean":"2023-12-07T10:02:07.525220+0000","last_became_active":"2023-12-07T10:01:51.326411+0000","last_became_peered":"2023-12-07T10:01:51.326411+0000","last_unstale":"2023-12-07T10:02:07.525220+0000","last_undegraded":"2023-12-07T10:02:07.525220+0000","last_fullsized":"2023-12-07T10:02:07.525220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296769+0000","last_change":"2023-12-07T10:02:08.536160+0000","last_active":"2023-12-07T10:02:10.296769+0000","last_peered":"2023-12-07T10:02:10.296769+0000","last_clean":"2023-12-07T10:02:10.296769+0000","last_became_active":"2023-12-07T10:02:08.535914+0000","last_became_peered":"2023-12-07T10:02:08.535914+0000","last_unstale":"2023-12-07T10:02:10.296769+0000","last_undegraded":"2023-12-07T10:02:10.296769+0000","last_fullsized":"2023-12-07T10:02:10.296769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:39:01.187656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519928+0000","last_change":"2023-12-07T10:01:51.238711+0000","last_active":"2023-12-07T10:02:08.519928+0000","last_peered":"2023-12-07T10:02:08.519928+0000","last_clean":"2023-12-07T10:02:08.519928+0000","last_became_active":"2023-12-07T10:01:51.238406+0000","last_became_peered":"2023-12-07T10:01:51.238406+0000","last_unstale":"2023-12-07T10:02:08.519928+0000","last_undegraded":"2023-12-07T10:02:08.519928+0000","last_fullsized":"2023-12-07T10:02:08.519928+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:28:37.893685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536691+0000","last_change":"2023-12-07T10:02:08.533110+0000","last_active":"2023-12-07T10:02:09.536691+0000","last_peered":"2023-12-07T10:02:09.536691+0000","last_clean":"2023-12-07T10:02:09.536691+0000","last_became_active":"2023-12-07T10:02:08.532849+0000","last_became_peered":"2023-12-07T10:02:08.532849+0000","last_unstale":"2023-12-07T10:02:09.536691+0000","last_undegraded":"2023-12-07T10:02:09.536691+0000","last_fullsized":"2023-12-07T10:02:09.536691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:41:17.569813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522674+0000","last_change":"2023-12-07T10:01:51.331406+0000","last_active":"2023-12-07T10:02:08.522674+0000","last_peered":"2023-12-07T10:02:08.522674+0000","last_clean":"2023-12-07T10:02:08.522674+0000","last_became_active":"2023-12-07T10:01:51.330583+0000","last_became_peered":"2023-12-07T10:01:51.330583+0000","last_unstale":"2023-12-07T10:02:08.522674+0000","last_undegraded":"2023-12-07T10:02:08.522674+0000","last_fullsized":"2023-12-07T10:02:08.522674+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:30:45.174048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.553517+0000","last_change":"2023-12-07T10:02:08.541439+0000","last_active":"2023-12-07T10:02:08.553517+0000","last_peered":"2023-12-07T10:02:08.553517+0000","last_clean":"2023-12-07T10:02:08.553517+0000","last_became_active":"2023-12-07T10:02:08.540964+0000","last_became_peered":"2023-12-07T10:02:08.540964+0000","last_unstale":"2023-12-07T10:02:08.553517+0000","last_undegraded":"2023-12-07T10:02:08.553517+0000","last_fullsized":"2023-12-07T10:02:08.553517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:28:33.184580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522921+0000","last_change":"2023-12-07T10:01:51.315626+0000","last_active":"2023-12-07T10:02:08.522921+0000","last_peered":"2023-12-07T10:02:08.522921+0000","last_clean":"2023-12-07T10:02:08.522921+0000","last_became_active":"2023-12-07T10:01:51.315331+0000","last_became_peered":"2023-12-07T10:01:51.315331+0000","last_unstale":"2023-12-07T10:02:08.522921+0000","last_undegraded":"2023-12-07T10:02:08.522921+0000","last_fullsized":"2023-12-07T10:02:08.522921+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:26:18.178418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556378+0000","last_change":"2023-12-07T10:02:08.550921+0000","last_active":"2023-12-07T10:02:08.556378+0000","last_peered":"2023-12-07T10:02:08.556378+0000","last_clean":"2023-12-07T10:02:08.556378+0000","last_became_active":"2023-12-07T10:02:08.549941+0000","last_became_peered":"2023-12-07T10:02:08.549941+0000","last_unstale":"2023-12-07T10:02:08.556378+0000","last_undegraded":"2023-12-07T10:02:08.556378+0000","last_fullsized":"2023-12-07T10:02:08.556378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:10:05.358920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524487+0000","last_change":"2023-12-07T10:01:51.321708+0000","last_active":"2023-12-07T10:02:08.524487+0000","last_peered":"2023-12-07T10:02:08.524487+0000","last_clean":"2023-12-07T10:02:08.524487+0000","last_became_active":"2023-12-07T10:01:51.321404+0000","last_became_peered":"2023-12-07T10:01:51.321404+0000","last_unstale":"2023-12-07T10:02:08.524487+0000","last_undegraded":"2023-12-07T10:02:08.524487+0000","last_fullsized":"2023-12-07T10:02:08.524487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297528+0000","last_change":"2023-12-07T10:02:08.537308+0000","last_active":"2023-12-07T10:02:10.297528+0000","last_peered":"2023-12-07T10:02:10.297528+0000","last_clean":"2023-12-07T10:02:10.297528+0000","last_became_active":"2023-12-07T10:02:08.535323+0000","last_became_peered":"2023-12-07T10:02:08.535323+0000","last_unstale":"2023-12-07T10:02:10.297528+0000","last_undegraded":"2023-12-07T10:02:10.297528+0000","last_fullsized":"2023-12-07T10:02:10.297528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:14:04.978124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526524+0000","last_change":"2023-12-07T10:01:51.335138+0000","last_active":"2023-12-07T10:02:07.526524+0000","last_peered":"2023-12-07T10:02:07.526524+0000","last_clean":"2023-12-07T10:02:07.526524+0000","last_became_active":"2023-12-07T10:01:51.334865+0000","last_became_peered":"2023-12-07T10:01:51.334865+0000","last_unstale":"2023-12-07T10:02:07.526524+0000","last_undegraded":"2023-12-07T10:02:07.526524+0000","last_fullsized":"2023-12-07T10:02:07.526524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544885+0000","last_change":"2023-12-07T10:02:08.536025+0000","last_active":"2023-12-07T10:02:08.544885+0000","last_peered":"2023-12-07T10:02:08.544885+0000","last_clean":"2023-12-07T10:02:08.544885+0000","last_became_active":"2023-12-07T10:02:08.535408+0000","last_became_peered":"2023-12-07T10:02:08.535408+0000","last_unstale":"2023-12-07T10:02:08.544885+0000","last_undegraded":"2023-12-07T10:02:08.544885+0000","last_fullsized":"2023-12-07T10:02:08.544885+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:19:19.272138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519371+0000","last_change":"2023-12-07T10:01:51.249276+0000","last_active":"2023-12-07T10:02:08.519371+0000","last_peered":"2023-12-07T10:02:08.519371+0000","last_clean":"2023-12-07T10:02:08.519371+0000","last_became_active":"2023-12-07T10:01:51.247885+0000","last_became_peered":"2023-12-07T10:01:51.247885+0000","last_unstale":"2023-12-07T10:02:08.519371+0000","last_undegraded":"2023-12-07T10:02:08.519371+0000","last_fullsized":"2023-12-07T10:02:08.519371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:56:58.975561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.532715+0000","last_change":"2023-12-07T10:02:08.539870+0000","last_active":"2023-12-07T10:02:09.532715+0000","last_peered":"2023-12-07T10:02:09.532715+0000","last_clean":"2023-12-07T10:02:09.532715+0000","last_became_active":"2023-12-07T10:02:08.539615+0000","last_became_peered":"2023-12-07T10:02:08.539615+0000","last_unstale":"2023-12-07T10:02:09.532715+0000","last_undegraded":"2023-12-07T10:02:09.532715+0000","last_fullsized":"2023-12-07T10:02:09.532715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:28.530425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518258+0000","last_change":"2023-12-07T10:01:51.239757+0000","last_active":"2023-12-07T10:02:08.518258+0000","last_peered":"2023-12-07T10:02:08.518258+0000","last_clean":"2023-12-07T10:02:08.518258+0000","last_became_active":"2023-12-07T10:01:51.239432+0000","last_became_peered":"2023-12-07T10:01:51.239432+0000","last_unstale":"2023-12-07T10:02:08.518258+0000","last_undegraded":"2023-12-07T10:02:08.518258+0000","last_fullsized":"2023-12-07T10:02:08.518258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:18.739518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296996+0000","last_change":"2023-12-07T10:02:08.534038+0000","last_active":"2023-12-07T10:02:10.296996+0000","last_peered":"2023-12-07T10:02:10.296996+0000","last_clean":"2023-12-07T10:02:10.296996+0000","last_became_active":"2023-12-07T10:02:08.530522+0000","last_became_peered":"2023-12-07T10:02:08.530522+0000","last_unstale":"2023-12-07T10:02:10.296996+0000","last_undegraded":"2023-12-07T10:02:10.296996+0000","last_fullsized":"2023-12-07T10:02:10.296996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:42:28.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521044+0000","last_change":"2023-12-07T10:01:51.319253+0000","last_active":"2023-12-07T10:02:08.521044+0000","last_peered":"2023-12-07T10:02:08.521044+0000","last_clean":"2023-12-07T10:02:08.521044+0000","last_became_active":"2023-12-07T10:01:51.318371+0000","last_became_peered":"2023-12-07T10:01:51.318371+0000","last_unstale":"2023-12-07T10:02:08.521044+0000","last_undegraded":"2023-12-07T10:02:08.521044+0000","last_fullsized":"2023-12-07T10:02:08.521044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:42:54.503007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.301170+0000","last_change":"2023-12-07T10:02:08.532149+0000","last_active":"2023-12-07T10:02:10.301170+0000","last_peered":"2023-12-07T10:02:10.301170+0000","last_clean":"2023-12-07T10:02:10.301170+0000","last_became_active":"2023-12-07T10:02:08.531793+0000","last_became_peered":"2023-12-07T10:02:08.531793+0000","last_unstale":"2023-12-07T10:02:10.301170+0000","last_undegraded":"2023-12-07T10:02:10.301170+0000","last_fullsized":"2023-12-07T10:02:10.301170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:57.512346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525134+0000","last_change":"2023-12-07T10:01:51.335614+0000","last_active":"2023-12-07T10:02:07.525134+0000","last_peered":"2023-12-07T10:02:07.525134+0000","last_clean":"2023-12-07T10:02:07.525134+0000","last_became_active":"2023-12-07T10:01:51.335261+0000","last_became_peered":"2023-12-07T10:01:51.335261+0000","last_unstale":"2023-12-07T10:02:07.525134+0000","last_undegraded":"2023-12-07T10:02:07.525134+0000","last_fullsized":"2023-12-07T10:02:07.525134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.534224+0000","last_change":"2023-12-07T10:02:08.536998+0000","last_active":"2023-12-07T10:02:09.534224+0000","last_peered":"2023-12-07T10:02:09.534224+0000","last_clean":"2023-12-07T10:02:09.534224+0000","last_became_active":"2023-12-07T10:02:08.536693+0000","last_became_peered":"2023-12-07T10:02:08.536693+0000","last_unstale":"2023-12-07T10:02:09.534224+0000","last_undegraded":"2023-12-07T10:02:09.534224+0000","last_fullsized":"2023-12-07T10:02:09.534224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:35:23.141855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297429+0000","last_change":"2023-12-07T10:02:07.536272+0000","last_active":"2023-12-07T10:02:10.297429+0000","last_peered":"2023-12-07T10:02:10.297429+0000","last_clean":"2023-12-07T10:02:10.297429+0000","last_became_active":"2023-12-07T10:02:07.536011+0000","last_became_peered":"2023-12-07T10:02:07.536011+0000","last_unstale":"2023-12-07T10:02:10.297429+0000","last_undegraded":"2023-12-07T10:02:10.297429+0000","last_fullsized":"2023-12-07T10:02:10.297429+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:45:31.923825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525169+0000","last_change":"2023-12-07T10:01:51.334037+0000","last_active":"2023-12-07T10:02:08.525169+0000","last_peered":"2023-12-07T10:02:08.525169+0000","last_clean":"2023-12-07T10:02:08.525169+0000","last_became_active":"2023-12-07T10:01:51.333727+0000","last_became_peered":"2023-12-07T10:01:51.333727+0000","last_unstale":"2023-12-07T10:02:08.525169+0000","last_undegraded":"2023-12-07T10:02:08.525169+0000","last_fullsized":"2023-12-07T10:02:08.525169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:08.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"66'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527009+0000","last_change":"2023-12-07T10:01:50.246200+0000","last_active":"2023-12-07T10:02:07.527009+0000","last_peered":"2023-12-07T10:02:07.527009+0000","last_clean":"2023-12-07T10:02:07.527009+0000","last_became_active":"2023-12-07T10:01:50.245894+0000","last_became_peered":"2023-12-07T10:01:50.245894+0000","last_unstale":"2023-12-07T10:02:07.527009+0000","last_undegraded":"2023-12-07T10:02:07.527009+0000","last_fullsized":"2023-12-07T10:02:07.527009+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536560+0000","last_change":"2023-12-07T10:02:08.547268+0000","last_active":"2023-12-07T10:02:09.536560+0000","last_peered":"2023-12-07T10:02:09.536560+0000","last_clean":"2023-12-07T10:02:09.536560+0000","last_became_active":"2023-12-07T10:02:08.546931+0000","last_became_peered":"2023-12-07T10:02:08.546931+0000","last_unstale":"2023-12-07T10:02:09.536560+0000","last_undegraded":"2023-12-07T10:02:09.536560+0000","last_fullsized":"2023-12-07T10:02:09.536560+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:11.733817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296828+0000","last_change":"2023-12-07T10:02:07.532285+0000","last_active":"2023-12-07T10:02:10.296828+0000","last_peered":"2023-12-07T10:02:10.296828+0000","last_clean":"2023-12-07T10:02:10.296828+0000","last_became_active":"2023-12-07T10:02:07.531881+0000","last_became_peered":"2023-12-07T10:02:07.531881+0000","last_unstale":"2023-12-07T10:02:10.296828+0000","last_undegraded":"2023-12-07T10:02:10.296828+0000","last_fullsized":"2023-12-07T10:02:10.296828+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:10.726346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526835+0000","last_change":"2023-12-07T10:01:51.328667+0000","last_active":"2023-12-07T10:02:07.526835+0000","last_peered":"2023-12-07T10:02:07.526835+0000","last_clean":"2023-12-07T10:02:07.526835+0000","last_became_active":"2023-12-07T10:01:51.328402+0000","last_became_peered":"2023-12-07T10:01:51.328402+0000","last_unstale":"2023-12-07T10:02:07.526835+0000","last_undegraded":"2023-12-07T10:02:07.526835+0000","last_fullsized":"2023-12-07T10:02:07.526835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:11.234105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525370+0000","last_change":"2023-12-07T10:01:50.234450+0000","last_active":"2023-12-07T10:02:08.525370+0000","last_peered":"2023-12-07T10:02:08.525370+0000","last_clean":"2023-12-07T10:02:08.525370+0000","last_became_active":"2023-12-07T10:01:50.234000+0000","last_became_peered":"2023-12-07T10:01:50.234000+0000","last_unstale":"2023-12-07T10:02:08.525370+0000","last_undegraded":"2023-12-07T10:02:08.525370+0000","last_fullsized":"2023-12-07T10:02:08.525370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.301048+0000","last_change":"2023-12-07T10:02:08.532963+0000","last_active":"2023-12-07T10:02:10.301048+0000","last_peered":"2023-12-07T10:02:10.301048+0000","last_clean":"2023-12-07T10:02:10.301048+0000","last_became_active":"2023-12-07T10:02:08.532684+0000","last_became_peered":"2023-12-07T10:02:08.532684+0000","last_unstale":"2023-12-07T10:02:10.301048+0000","last_undegraded":"2023-12-07T10:02:10.301048+0000","last_fullsized":"2023-12-07T10:02:10.301048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:09:14.620225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"70'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297393+0000","last_change":"2023-12-07T10:02:07.539988+0000","last_active":"2023-12-07T10:02:10.297393+0000","last_peered":"2023-12-07T10:02:10.297393+0000","last_clean":"2023-12-07T10:02:10.297393+0000","last_became_active":"2023-12-07T10:02:07.539712+0000","last_became_peered":"2023-12-07T10:02:07.539712+0000","last_unstale":"2023-12-07T10:02:10.297393+0000","last_undegraded":"2023-12-07T10:02:10.297393+0000","last_fullsized":"2023-12-07T10:02:10.297393+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:22.094728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526632+0000","last_change":"2023-12-07T10:01:51.331609+0000","last_active":"2023-12-07T10:02:07.526632+0000","last_peered":"2023-12-07T10:02:07.526632+0000","last_clean":"2023-12-07T10:02:07.526632+0000","last_became_active":"2023-12-07T10:01:51.331052+0000","last_became_peered":"2023-12-07T10:01:51.331052+0000","last_unstale":"2023-12-07T10:02:07.526632+0000","last_undegraded":"2023-12-07T10:02:07.526632+0000","last_fullsized":"2023-12-07T10:02:07.526632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.526472+0000","last_change":"2023-12-07T10:01:50.235677+0000","last_active":"2023-12-07T10:02:08.526472+0000","last_peered":"2023-12-07T10:02:08.526472+0000","last_clean":"2023-12-07T10:02:08.526472+0000","last_became_active":"2023-12-07T10:01:50.233710+0000","last_became_peered":"2023-12-07T10:01:50.233710+0000","last_unstale":"2023-12-07T10:02:08.526472+0000","last_undegraded":"2023-12-07T10:02:08.526472+0000","last_fullsized":"2023-12-07T10:02:08.526472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:05.118061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.554988+0000","last_change":"2023-12-07T10:02:08.551307+0000","last_active":"2023-12-07T10:02:08.554988+0000","last_peered":"2023-12-07T10:02:08.554988+0000","last_clean":"2023-12-07T10:02:08.554988+0000","last_became_active":"2023-12-07T10:02:08.551023+0000","last_became_peered":"2023-12-07T10:02:08.551023+0000","last_unstale":"2023-12-07T10:02:08.554988+0000","last_undegraded":"2023-12-07T10:02:08.554988+0000","last_fullsized":"2023-12-07T10:02:08.554988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:50:18.299699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536774+0000","last_change":"2023-12-07T10:02:07.536961+0000","last_active":"2023-12-07T10:02:09.536774+0000","last_peered":"2023-12-07T10:02:09.536774+0000","last_clean":"2023-12-07T10:02:09.536774+0000","last_became_active":"2023-12-07T10:02:07.536653+0000","last_became_peered":"2023-12-07T10:02:07.536653+0000","last_unstale":"2023-12-07T10:02:09.536774+0000","last_undegraded":"2023-12-07T10:02:09.536774+0000","last_fullsized":"2023-12-07T10:02:09.536774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:05:39.294446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521892+0000","last_change":"2023-12-07T10:01:51.321279+0000","last_active":"2023-12-07T10:02:08.521892+0000","last_peered":"2023-12-07T10:02:08.521892+0000","last_clean":"2023-12-07T10:02:08.521892+0000","last_became_active":"2023-12-07T10:01:51.320929+0000","last_became_peered":"2023-12-07T10:01:51.320929+0000","last_unstale":"2023-12-07T10:02:08.521892+0000","last_undegraded":"2023-12-07T10:02:08.521892+0000","last_fullsized":"2023-12-07T10:02:08.521892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:27.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518215+0000","last_change":"2023-12-07T10:01:50.235943+0000","last_active":"2023-12-07T10:02:08.518215+0000","last_peered":"2023-12-07T10:02:08.518215+0000","last_clean":"2023-12-07T10:02:08.518215+0000","last_became_active":"2023-12-07T10:01:50.235507+0000","last_became_peered":"2023-12-07T10:01:50.235507+0000","last_unstale":"2023-12-07T10:02:08.518215+0000","last_undegraded":"2023-12-07T10:02:08.518215+0000","last_fullsized":"2023-12-07T10:02:08.518215+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.539345+0000","last_change":"2023-12-07T10:02:08.528563+0000","last_active":"2023-12-07T10:02:08.539345+0000","last_peered":"2023-12-07T10:02:08.539345+0000","last_clean":"2023-12-07T10:02:08.539345+0000","last_became_active":"2023-12-07T10:02:08.528212+0000","last_became_peered":"2023-12-07T10:02:08.528212+0000","last_unstale":"2023-12-07T10:02:08.539345+0000","last_undegraded":"2023-12-07T10:02:08.539345+0000","last_fullsized":"2023-12-07T10:02:08.539345+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:59:32.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.529494+0000","last_change":"2023-12-07T10:02:07.539065+0000","last_active":"2023-12-07T10:02:08.529494+0000","last_peered":"2023-12-07T10:02:08.529494+0000","last_clean":"2023-12-07T10:02:08.529494+0000","last_became_active":"2023-12-07T10:02:07.538787+0000","last_became_peered":"2023-12-07T10:02:07.538787+0000","last_unstale":"2023-12-07T10:02:08.529494+0000","last_undegraded":"2023-12-07T10:02:08.529494+0000","last_fullsized":"2023-12-07T10:02:08.529494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:22:31.835663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518328+0000","last_change":"2023-12-07T10:01:51.237367+0000","last_active":"2023-12-07T10:02:08.518328+0000","last_peered":"2023-12-07T10:02:08.518328+0000","last_clean":"2023-12-07T10:02:08.518328+0000","last_became_active":"2023-12-07T10:01:51.237071+0000","last_became_peered":"2023-12-07T10:01:51.237071+0000","last_unstale":"2023-12-07T10:02:08.518328+0000","last_undegraded":"2023-12-07T10:02:08.518328+0000","last_fullsized":"2023-12-07T10:02:08.518328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:19:49.846073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521654+0000","last_change":"2023-12-07T10:01:50.234848+0000","last_active":"2023-12-07T10:02:08.521654+0000","last_peered":"2023-12-07T10:02:08.521654+0000","last_clean":"2023-12-07T10:02:08.521654+0000","last_became_active":"2023-12-07T10:01:50.234573+0000","last_became_peered":"2023-12-07T10:01:50.234573+0000","last_unstale":"2023-12-07T10:02:08.521654+0000","last_undegraded":"2023-12-07T10:02:08.521654+0000","last_fullsized":"2023-12-07T10:02:08.521654+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536141+0000","last_change":"2023-12-07T10:02:08.547292+0000","last_active":"2023-12-07T10:02:09.536141+0000","last_peered":"2023-12-07T10:02:09.536141+0000","last_clean":"2023-12-07T10:02:09.536141+0000","last_became_active":"2023-12-07T10:02:08.546829+0000","last_became_peered":"2023-12-07T10:02:08.546829+0000","last_unstale":"2023-12-07T10:02:09.536141+0000","last_undegraded":"2023-12-07T10:02:09.536141+0000","last_fullsized":"2023-12-07T10:02:09.536141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:00:26.360487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.532700+0000","last_change":"2023-12-07T10:02:07.534696+0000","last_active":"2023-12-07T10:02:09.532700+0000","last_peered":"2023-12-07T10:02:09.532700+0000","last_clean":"2023-12-07T10:02:09.532700+0000","last_became_active":"2023-12-07T10:02:07.534413+0000","last_became_peered":"2023-12-07T10:02:07.534413+0000","last_unstale":"2023-12-07T10:02:09.532700+0000","last_undegraded":"2023-12-07T10:02:09.532700+0000","last_fullsized":"2023-12-07T10:02:09.532700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:22.414208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.521487+0000","last_change":"2023-12-07T10:01:51.318661+0000","last_active":"2023-12-07T10:02:08.521487+0000","last_peered":"2023-12-07T10:02:08.521487+0000","last_clean":"2023-12-07T10:02:08.521487+0000","last_became_active":"2023-12-07T10:01:51.318360+0000","last_became_peered":"2023-12-07T10:01:51.318360+0000","last_unstale":"2023-12-07T10:02:08.521487+0000","last_undegraded":"2023-12-07T10:02:08.521487+0000","last_fullsized":"2023-12-07T10:02:08.521487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:10.537110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522277+0000","last_change":"2023-12-07T10:01:50.232687+0000","last_active":"2023-12-07T10:02:08.522277+0000","last_peered":"2023-12-07T10:02:08.522277+0000","last_clean":"2023-12-07T10:02:08.522277+0000","last_became_active":"2023-12-07T10:01:50.232344+0000","last_became_peered":"2023-12-07T10:01:50.232344+0000","last_unstale":"2023-12-07T10:02:08.522277+0000","last_undegraded":"2023-12-07T10:02:08.522277+0000","last_fullsized":"2023-12-07T10:02:08.522277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.540564+0000","last_change":"2023-12-07T10:02:08.532617+0000","last_active":"2023-12-07T10:02:08.540564+0000","last_peered":"2023-12-07T10:02:08.540564+0000","last_clean":"2023-12-07T10:02:08.540564+0000","last_became_active":"2023-12-07T10:02:08.532334+0000","last_became_peered":"2023-12-07T10:02:08.532334+0000","last_unstale":"2023-12-07T10:02:08.540564+0000","last_undegraded":"2023-12-07T10:02:08.540564+0000","last_fullsized":"2023-12-07T10:02:08.540564+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:26:35.474739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533108+0000","last_change":"2023-12-07T10:02:07.533906+0000","last_active":"2023-12-07T10:02:09.533108+0000","last_peered":"2023-12-07T10:02:09.533108+0000","last_clean":"2023-12-07T10:02:09.533108+0000","last_became_active":"2023-12-07T10:02:07.532695+0000","last_became_peered":"2023-12-07T10:02:07.532695+0000","last_unstale":"2023-12-07T10:02:09.533108+0000","last_undegraded":"2023-12-07T10:02:09.533108+0000","last_fullsized":"2023-12-07T10:02:09.533108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:26.825960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518524+0000","last_change":"2023-12-07T10:01:51.322420+0000","last_active":"2023-12-07T10:02:08.518524+0000","last_peered":"2023-12-07T10:02:08.518524+0000","last_clean":"2023-12-07T10:02:08.518524+0000","last_became_active":"2023-12-07T10:01:51.322145+0000","last_became_peered":"2023-12-07T10:01:51.322145+0000","last_unstale":"2023-12-07T10:02:08.518524+0000","last_undegraded":"2023-12-07T10:02:08.518524+0000","last_fullsized":"2023-12-07T10:02:08.518524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517903+0000","last_change":"2023-12-07T10:01:50.236502+0000","last_active":"2023-12-07T10:02:08.517903+0000","last_peered":"2023-12-07T10:02:08.517903+0000","last_clean":"2023-12-07T10:02:08.517903+0000","last_became_active":"2023-12-07T10:01:50.236208+0000","last_became_peered":"2023-12-07T10:01:50.236208+0000","last_unstale":"2023-12-07T10:02:08.517903+0000","last_undegraded":"2023-12-07T10:02:08.517903+0000","last_fullsized":"2023-12-07T10:02:08.517903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:34.570378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.535755+0000","last_change":"2023-12-07T10:02:08.540425+0000","last_active":"2023-12-07T10:02:09.535755+0000","last_peered":"2023-12-07T10:02:09.535755+0000","last_clean":"2023-12-07T10:02:09.535755+0000","last_became_active":"2023-12-07T10:02:08.539727+0000","last_became_peered":"2023-12-07T10:02:08.539727+0000","last_unstale":"2023-12-07T10:02:09.535755+0000","last_undegraded":"2023-12-07T10:02:09.535755+0000","last_fullsized":"2023-12-07T10:02:09.535755+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:51:23.102199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296643+0000","last_change":"2023-12-07T10:02:07.541158+0000","last_active":"2023-12-07T10:02:10.296643+0000","last_peered":"2023-12-07T10:02:10.296643+0000","last_clean":"2023-12-07T10:02:10.296643+0000","last_became_active":"2023-12-07T10:02:07.537239+0000","last_became_peered":"2023-12-07T10:02:07.537239+0000","last_unstale":"2023-12-07T10:02:10.296643+0000","last_undegraded":"2023-12-07T10:02:10.296643+0000","last_fullsized":"2023-12-07T10:02:10.296643+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:40:11.476049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521788+0000","last_change":"2023-12-07T10:01:51.320957+0000","last_active":"2023-12-07T10:02:07.521788+0000","last_peered":"2023-12-07T10:02:07.521788+0000","last_clean":"2023-12-07T10:02:07.521788+0000","last_became_active":"2023-12-07T10:01:51.320671+0000","last_became_peered":"2023-12-07T10:01:51.320671+0000","last_unstale":"2023-12-07T10:02:07.521788+0000","last_undegraded":"2023-12-07T10:02:07.521788+0000","last_fullsized":"2023-12-07T10:02:07.521788+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:10:48.731402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518723+0000","last_change":"2023-12-07T10:01:50.234750+0000","last_active":"2023-12-07T10:02:08.518723+0000","last_peered":"2023-12-07T10:02:08.518723+0000","last_clean":"2023-12-07T10:02:08.518723+0000","last_became_active":"2023-12-07T10:01:50.234490+0000","last_became_peered":"2023-12-07T10:01:50.234490+0000","last_unstale":"2023-12-07T10:02:08.518723+0000","last_undegraded":"2023-12-07T10:02:08.518723+0000","last_fullsized":"2023-12-07T10:02:08.518723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:52:49.235834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556405+0000","last_change":"2023-12-07T10:02:08.550919+0000","last_active":"2023-12-07T10:02:08.556405+0000","last_peered":"2023-12-07T10:02:08.556405+0000","last_clean":"2023-12-07T10:02:08.556405+0000","last_became_active":"2023-12-07T10:02:08.549994+0000","last_became_peered":"2023-12-07T10:02:08.549994+0000","last_unstale":"2023-12-07T10:02:08.556405+0000","last_undegraded":"2023-12-07T10:02:08.556405+0000","last_fullsized":"2023-12-07T10:02:08.556405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:11:06.027723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"70'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536905+0000","last_change":"2023-12-07T10:02:07.526138+0000","last_active":"2023-12-07T10:02:09.536905+0000","last_peered":"2023-12-07T10:02:09.536905+0000","last_clean":"2023-12-07T10:02:09.536905+0000","last_became_active":"2023-12-07T10:02:07.525735+0000","last_became_peered":"2023-12-07T10:02:07.525735+0000","last_unstale":"2023-12-07T10:02:09.536905+0000","last_undegraded":"2023-12-07T10:02:09.536905+0000","last_fullsized":"2023-12-07T10:02:09.536905+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:59:31.761516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.522935+0000","last_change":"2023-12-07T10:01:51.237604+0000","last_active":"2023-12-07T10:02:07.522935+0000","last_peered":"2023-12-07T10:02:07.522935+0000","last_clean":"2023-12-07T10:02:07.522935+0000","last_became_active":"2023-12-07T10:01:51.237282+0000","last_became_peered":"2023-12-07T10:01:51.237282+0000","last_unstale":"2023-12-07T10:02:07.522935+0000","last_undegraded":"2023-12-07T10:02:07.522935+0000","last_fullsized":"2023-12-07T10:02:07.522935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:25.535134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527116+0000","last_change":"2023-12-07T10:01:50.244303+0000","last_active":"2023-12-07T10:02:07.527116+0000","last_peered":"2023-12-07T10:02:07.527116+0000","last_clean":"2023-12-07T10:02:07.527116+0000","last_became_active":"2023-12-07T10:01:50.243963+0000","last_became_peered":"2023-12-07T10:01:50.243963+0000","last_unstale":"2023-12-07T10:02:07.527116+0000","last_undegraded":"2023-12-07T10:02:07.527116+0000","last_fullsized":"2023-12-07T10:02:07.527116+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:45:54.545283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536320+0000","last_change":"2023-12-07T10:02:08.537317+0000","last_active":"2023-12-07T10:02:09.536320+0000","last_peered":"2023-12-07T10:02:09.536320+0000","last_clean":"2023-12-07T10:02:09.536320+0000","last_became_active":"2023-12-07T10:02:08.536736+0000","last_became_peered":"2023-12-07T10:02:08.536736+0000","last_unstale":"2023-12-07T10:02:09.536320+0000","last_undegraded":"2023-12-07T10:02:09.536320+0000","last_fullsized":"2023-12-07T10:02:09.536320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:15:51.076271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"70'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536435+0000","last_change":"2023-12-07T10:02:07.524380+0000","last_active":"2023-12-07T10:02:09.536435+0000","last_peered":"2023-12-07T10:02:09.536435+0000","last_clean":"2023-12-07T10:02:09.536435+0000","last_became_active":"2023-12-07T10:02:07.523889+0000","last_became_peered":"2023-12-07T10:02:07.523889+0000","last_unstale":"2023-12-07T10:02:09.536435+0000","last_undegraded":"2023-12-07T10:02:09.536435+0000","last_fullsized":"2023-12-07T10:02:09.536435+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:11:05.020252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518803+0000","last_change":"2023-12-07T10:01:51.329179+0000","last_active":"2023-12-07T10:02:07.518803+0000","last_peered":"2023-12-07T10:02:07.518803+0000","last_clean":"2023-12-07T10:02:07.518803+0000","last_became_active":"2023-12-07T10:01:51.328872+0000","last_became_peered":"2023-12-07T10:01:51.328872+0000","last_unstale":"2023-12-07T10:02:07.518803+0000","last_undegraded":"2023-12-07T10:02:07.518803+0000","last_fullsized":"2023-12-07T10:02:07.518803+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:30:40.216025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.528260+0000","last_change":"2023-12-07T10:01:50.244300+0000","last_active":"2023-12-07T10:02:07.528260+0000","last_peered":"2023-12-07T10:02:07.528260+0000","last_clean":"2023-12-07T10:02:07.528260+0000","last_became_active":"2023-12-07T10:01:50.243929+0000","last_became_peered":"2023-12-07T10:01:50.243929+0000","last_unstale":"2023-12-07T10:02:07.528260+0000","last_undegraded":"2023-12-07T10:02:07.528260+0000","last_fullsized":"2023-12-07T10:02:07.528260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297076+0000","last_change":"2023-12-07T10:02:08.544653+0000","last_active":"2023-12-07T10:02:10.297076+0000","last_peered":"2023-12-07T10:02:10.297076+0000","last_clean":"2023-12-07T10:02:10.297076+0000","last_became_active":"2023-12-07T10:02:08.543664+0000","last_became_peered":"2023-12-07T10:02:08.543664+0000","last_unstale":"2023-12-07T10:02:10.297076+0000","last_undegraded":"2023-12-07T10:02:10.297076+0000","last_fullsized":"2023-12-07T10:02:10.297076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:22:29.647336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533595+0000","last_change":"2023-12-07T10:02:07.532518+0000","last_active":"2023-12-07T10:02:09.533595+0000","last_peered":"2023-12-07T10:02:09.533595+0000","last_clean":"2023-12-07T10:02:09.533595+0000","last_became_active":"2023-12-07T10:02:07.532245+0000","last_became_peered":"2023-12-07T10:02:07.532245+0000","last_unstale":"2023-12-07T10:02:09.533595+0000","last_undegraded":"2023-12-07T10:02:09.533595+0000","last_fullsized":"2023-12-07T10:02:09.533595+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:26.778663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518123+0000","last_change":"2023-12-07T10:01:51.335097+0000","last_active":"2023-12-07T10:02:08.518123+0000","last_peered":"2023-12-07T10:02:08.518123+0000","last_clean":"2023-12-07T10:02:08.518123+0000","last_became_active":"2023-12-07T10:01:51.334754+0000","last_became_peered":"2023-12-07T10:01:51.334754+0000","last_unstale":"2023-12-07T10:02:08.518123+0000","last_undegraded":"2023-12-07T10:02:08.518123+0000","last_fullsized":"2023-12-07T10:02:08.518123+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:31:09.407223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"66'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526217+0000","last_change":"2023-12-07T10:01:50.242994+0000","last_active":"2023-12-07T10:02:07.526217+0000","last_peered":"2023-12-07T10:02:07.526217+0000","last_clean":"2023-12-07T10:02:07.526217+0000","last_became_active":"2023-12-07T10:01:50.242572+0000","last_became_peered":"2023-12-07T10:01:50.242572+0000","last_unstale":"2023-12-07T10:02:07.526217+0000","last_undegraded":"2023-12-07T10:02:07.526217+0000","last_fullsized":"2023-12-07T10:02:07.526217+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.537417+0000","last_change":"2023-12-07T10:02:08.547934+0000","last_active":"2023-12-07T10:02:09.537417+0000","last_peered":"2023-12-07T10:02:09.537417+0000","last_clean":"2023-12-07T10:02:09.537417+0000","last_became_active":"2023-12-07T10:02:08.547575+0000","last_became_peered":"2023-12-07T10:02:08.547575+0000","last_unstale":"2023-12-07T10:02:09.537417+0000","last_undegraded":"2023-12-07T10:02:09.537417+0000","last_fullsized":"2023-12-07T10:02:09.537417+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:19:19.272138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.520231+0000","last_change":"2023-12-07T10:02:07.539679+0000","last_active":"2023-12-07T10:02:08.520231+0000","last_peered":"2023-12-07T10:02:08.520231+0000","last_clean":"2023-12-07T10:02:08.520231+0000","last_became_active":"2023-12-07T10:02:07.539373+0000","last_became_peered":"2023-12-07T10:02:07.539373+0000","last_unstale":"2023-12-07T10:02:08.520231+0000","last_undegraded":"2023-12-07T10:02:08.520231+0000","last_fullsized":"2023-12-07T10:02:08.520231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:09:59.965931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524648+0000","last_change":"2023-12-07T10:01:51.321371+0000","last_active":"2023-12-07T10:02:08.524648+0000","last_peered":"2023-12-07T10:02:08.524648+0000","last_clean":"2023-12-07T10:02:08.524648+0000","last_became_active":"2023-12-07T10:01:51.321032+0000","last_became_peered":"2023-12-07T10:01:51.321032+0000","last_unstale":"2023-12-07T10:02:08.524648+0000","last_undegraded":"2023-12-07T10:02:08.524648+0000","last_fullsized":"2023-12-07T10:02:08.524648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:22:06.125358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518924+0000","last_change":"2023-12-07T10:01:50.231793+0000","last_active":"2023-12-07T10:02:07.518924+0000","last_peered":"2023-12-07T10:02:07.518924+0000","last_clean":"2023-12-07T10:02:07.518924+0000","last_became_active":"2023-12-07T10:01:50.231380+0000","last_became_peered":"2023-12-07T10:01:50.231380+0000","last_unstale":"2023-12-07T10:02:07.518924+0000","last_undegraded":"2023-12-07T10:02:07.518924+0000","last_fullsized":"2023-12-07T10:02:07.518924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.537126+0000","last_change":"2023-12-07T10:02:08.539546+0000","last_active":"2023-12-07T10:02:09.537126+0000","last_peered":"2023-12-07T10:02:09.537126+0000","last_clean":"2023-12-07T10:02:09.537126+0000","last_became_active":"2023-12-07T10:02:08.538222+0000","last_became_peered":"2023-12-07T10:02:08.538222+0000","last_unstale":"2023-12-07T10:02:09.537126+0000","last_undegraded":"2023-12-07T10:02:09.537126+0000","last_fullsized":"2023-12-07T10:02:09.537126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:40:12.483520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536251+0000","last_change":"2023-12-07T10:02:07.525714+0000","last_active":"2023-12-07T10:02:09.536251+0000","last_peered":"2023-12-07T10:02:09.536251+0000","last_clean":"2023-12-07T10:02:09.536251+0000","last_became_active":"2023-12-07T10:02:07.525399+0000","last_became_peered":"2023-12-07T10:02:07.525399+0000","last_unstale":"2023-12-07T10:02:09.536251+0000","last_undegraded":"2023-12-07T10:02:09.536251+0000","last_fullsized":"2023-12-07T10:02:09.536251+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:37.525343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517097+0000","last_change":"2023-12-07T10:01:51.329045+0000","last_active":"2023-12-07T10:02:08.517097+0000","last_peered":"2023-12-07T10:02:08.517097+0000","last_clean":"2023-12-07T10:02:08.517097+0000","last_became_active":"2023-12-07T10:01:51.328657+0000","last_became_peered":"2023-12-07T10:01:51.328657+0000","last_unstale":"2023-12-07T10:02:08.517097+0000","last_undegraded":"2023-12-07T10:02:08.517097+0000","last_fullsized":"2023-12-07T10:02:08.517097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:19.142009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519534+0000","last_change":"2023-12-07T10:01:50.229673+0000","last_active":"2023-12-07T10:02:08.519534+0000","last_peered":"2023-12-07T10:02:08.519534+0000","last_clean":"2023-12-07T10:02:08.519534+0000","last_became_active":"2023-12-07T10:01:50.229412+0000","last_became_peered":"2023-12-07T10:01:50.229412+0000","last_unstale":"2023-12-07T10:02:08.519534+0000","last_undegraded":"2023-12-07T10:02:08.519534+0000","last_fullsized":"2023-12-07T10:02:08.519534+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:03:29.842171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300253+0000","last_change":"2023-12-07T10:02:08.529038+0000","last_active":"2023-12-07T10:02:10.300253+0000","last_peered":"2023-12-07T10:02:10.300253+0000","last_clean":"2023-12-07T10:02:10.300253+0000","last_became_active":"2023-12-07T10:02:08.528773+0000","last_became_peered":"2023-12-07T10:02:08.528773+0000","last_unstale":"2023-12-07T10:02:10.300253+0000","last_undegraded":"2023-12-07T10:02:10.300253+0000","last_fullsized":"2023-12-07T10:02:10.300253+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:55.462521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"70'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.532803+0000","last_change":"2023-12-07T10:02:07.533776+0000","last_active":"2023-12-07T10:02:09.532803+0000","last_peered":"2023-12-07T10:02:09.532803+0000","last_clean":"2023-12-07T10:02:09.532803+0000","last_became_active":"2023-12-07T10:02:07.533499+0000","last_became_peered":"2023-12-07T10:02:07.533499+0000","last_unstale":"2023-12-07T10:02:09.532803+0000","last_undegraded":"2023-12-07T10:02:09.532803+0000","last_fullsized":"2023-12-07T10:02:09.532803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:51.866525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518072+0000","last_change":"2023-12-07T10:01:51.321900+0000","last_active":"2023-12-07T10:02:08.518072+0000","last_peered":"2023-12-07T10:02:08.518072+0000","last_clean":"2023-12-07T10:02:08.518072+0000","last_became_active":"2023-12-07T10:01:51.321602+0000","last_became_peered":"2023-12-07T10:01:51.321602+0000","last_unstale":"2023-12-07T10:02:08.518072+0000","last_undegraded":"2023-12-07T10:02:08.518072+0000","last_fullsized":"2023-12-07T10:02:08.518072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:19.850587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521957+0000","last_change":"2023-12-07T10:01:50.228963+0000","last_active":"2023-12-07T10:02:07.521957+0000","last_peered":"2023-12-07T10:02:07.521957+0000","last_clean":"2023-12-07T10:02:07.521957+0000","last_became_active":"2023-12-07T10:01:50.228673+0000","last_became_peered":"2023-12-07T10:01:50.228673+0000","last_unstale":"2023-12-07T10:02:07.521957+0000","last_undegraded":"2023-12-07T10:02:07.521957+0000","last_fullsized":"2023-12-07T10:02:07.521957+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:04:12.916038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.540188+0000","last_change":"2023-12-07T10:02:08.527958+0000","last_active":"2023-12-07T10:02:08.540188+0000","last_peered":"2023-12-07T10:02:08.540188+0000","last_clean":"2023-12-07T10:02:08.540188+0000","last_became_active":"2023-12-07T10:02:08.527618+0000","last_became_peered":"2023-12-07T10:02:08.527618+0000","last_unstale":"2023-12-07T10:02:08.540188+0000","last_undegraded":"2023-12-07T10:02:08.540188+0000","last_fullsized":"2023-12-07T10:02:08.540188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:22:03.899321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300857+0000","last_change":"2023-12-07T10:02:07.521386+0000","last_active":"2023-12-07T10:02:10.300857+0000","last_peered":"2023-12-07T10:02:10.300857+0000","last_clean":"2023-12-07T10:02:10.300857+0000","last_became_active":"2023-12-07T10:02:07.521026+0000","last_became_peered":"2023-12-07T10:02:07.521026+0000","last_unstale":"2023-12-07T10:02:10.300857+0000","last_undegraded":"2023-12-07T10:02:10.300857+0000","last_fullsized":"2023-12-07T10:02:10.300857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:36:07.305738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518618+0000","last_change":"2023-12-07T10:01:51.235277+0000","last_active":"2023-12-07T10:02:08.518618+0000","last_peered":"2023-12-07T10:02:08.518618+0000","last_clean":"2023-12-07T10:02:08.518618+0000","last_became_active":"2023-12-07T10:01:51.234826+0000","last_became_peered":"2023-12-07T10:01:51.234826+0000","last_unstale":"2023-12-07T10:02:08.518618+0000","last_undegraded":"2023-12-07T10:02:08.518618+0000","last_fullsized":"2023-12-07T10:02:08.518618+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:32.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.517756+0000","last_change":"2023-12-07T10:01:50.237689+0000","last_active":"2023-12-07T10:02:07.517756+0000","last_peered":"2023-12-07T10:02:07.517756+0000","last_clean":"2023-12-07T10:02:07.517756+0000","last_became_active":"2023-12-07T10:01:50.237183+0000","last_became_peered":"2023-12-07T10:01:50.237183+0000","last_unstale":"2023-12-07T10:02:07.517756+0000","last_undegraded":"2023-12-07T10:02:07.517756+0000","last_fullsized":"2023-12-07T10:02:07.517756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:06.809206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533195+0000","last_change":"2023-12-07T10:02:08.534924+0000","last_active":"2023-12-07T10:02:09.533195+0000","last_peered":"2023-12-07T10:02:09.533195+0000","last_clean":"2023-12-07T10:02:09.533195+0000","last_became_active":"2023-12-07T10:02:08.533633+0000","last_became_peered":"2023-12-07T10:02:08.533633+0000","last_unstale":"2023-12-07T10:02:09.533195+0000","last_undegraded":"2023-12-07T10:02:09.533195+0000","last_fullsized":"2023-12-07T10:02:09.533195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:24:38.631021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300507+0000","last_change":"2023-12-07T10:02:07.534098+0000","last_active":"2023-12-07T10:02:10.300507+0000","last_peered":"2023-12-07T10:02:10.300507+0000","last_clean":"2023-12-07T10:02:10.300507+0000","last_became_active":"2023-12-07T10:02:07.533836+0000","last_became_peered":"2023-12-07T10:02:07.533836+0000","last_unstale":"2023-12-07T10:02:10.300507+0000","last_undegraded":"2023-12-07T10:02:10.300507+0000","last_fullsized":"2023-12-07T10:02:10.300507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:05.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517620+0000","last_change":"2023-12-07T10:01:51.329007+0000","last_active":"2023-12-07T10:02:08.517620+0000","last_peered":"2023-12-07T10:02:08.517620+0000","last_clean":"2023-12-07T10:02:08.517620+0000","last_became_active":"2023-12-07T10:01:51.328735+0000","last_became_peered":"2023-12-07T10:01:51.328735+0000","last_unstale":"2023-12-07T10:02:08.517620+0000","last_undegraded":"2023-12-07T10:02:08.517620+0000","last_fullsized":"2023-12-07T10:02:08.517620+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:46:03.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"66'8","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523916+0000","last_change":"2023-12-07T10:01:50.233660+0000","last_active":"2023-12-07T10:02:08.523916+0000","last_peered":"2023-12-07T10:02:08.523916+0000","last_clean":"2023-12-07T10:02:08.523916+0000","last_became_active":"2023-12-07T10:01:50.233357+0000","last_became_peered":"2023-12-07T10:01:50.233357+0000","last_unstale":"2023-12-07T10:02:08.523916+0000","last_undegraded":"2023-12-07T10:02:08.523916+0000","last_fullsized":"2023-12-07T10:02:08.523916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:09.482517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.544541+0000","last_change":"2023-12-07T10:02:08.540326+0000","last_active":"2023-12-07T10:02:08.544541+0000","last_peered":"2023-12-07T10:02:08.544541+0000","last_clean":"2023-12-07T10:02:08.544541+0000","last_became_active":"2023-12-07T10:02:08.540002+0000","last_became_peered":"2023-12-07T10:02:08.540002+0000","last_unstale":"2023-12-07T10:02:08.544541+0000","last_undegraded":"2023-12-07T10:02:08.544541+0000","last_fullsized":"2023-12-07T10:02:08.544541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:22.247933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556730+0000","last_change":"2023-12-07T10:02:07.530974+0000","last_active":"2023-12-07T10:02:08.556730+0000","last_peered":"2023-12-07T10:02:08.556730+0000","last_clean":"2023-12-07T10:02:08.556730+0000","last_became_active":"2023-12-07T10:02:07.530598+0000","last_became_peered":"2023-12-07T10:02:07.530598+0000","last_unstale":"2023-12-07T10:02:08.556730+0000","last_undegraded":"2023-12-07T10:02:08.556730+0000","last_fullsized":"2023-12-07T10:02:08.556730+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:48:00.333509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525605+0000","last_change":"2023-12-07T10:01:51.327799+0000","last_active":"2023-12-07T10:02:08.525605+0000","last_peered":"2023-12-07T10:02:08.525605+0000","last_clean":"2023-12-07T10:02:08.525605+0000","last_became_active":"2023-12-07T10:01:51.326731+0000","last_became_peered":"2023-12-07T10:01:51.326731+0000","last_unstale":"2023-12-07T10:02:08.525605+0000","last_undegraded":"2023-12-07T10:02:08.525605+0000","last_fullsized":"2023-12-07T10:02:08.525605+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:37:04.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"66'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527278+0000","last_change":"2023-12-07T10:01:50.243001+0000","last_active":"2023-12-07T10:02:07.527278+0000","last_peered":"2023-12-07T10:02:07.527278+0000","last_clean":"2023-12-07T10:02:07.527278+0000","last_became_active":"2023-12-07T10:01:50.242701+0000","last_became_peered":"2023-12-07T10:01:50.242701+0000","last_unstale":"2023-12-07T10:02:07.527278+0000","last_undegraded":"2023-12-07T10:02:07.527278+0000","last_fullsized":"2023-12-07T10:02:07.527278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:56.277803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536456+0000","last_change":"2023-12-07T10:02:08.544284+0000","last_active":"2023-12-07T10:02:09.536456+0000","last_peered":"2023-12-07T10:02:09.536456+0000","last_clean":"2023-12-07T10:02:09.536456+0000","last_became_active":"2023-12-07T10:02:08.543927+0000","last_became_peered":"2023-12-07T10:02:08.543927+0000","last_unstale":"2023-12-07T10:02:09.536456+0000","last_undegraded":"2023-12-07T10:02:09.536456+0000","last_fullsized":"2023-12-07T10:02:09.536456+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:00:55.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296962+0000","last_change":"2023-12-07T10:02:07.529093+0000","last_active":"2023-12-07T10:02:10.296962+0000","last_peered":"2023-12-07T10:02:10.296962+0000","last_clean":"2023-12-07T10:02:10.296962+0000","last_became_active":"2023-12-07T10:02:07.528797+0000","last_became_peered":"2023-12-07T10:02:07.528797+0000","last_unstale":"2023-12-07T10:02:10.296962+0000","last_undegraded":"2023-12-07T10:02:10.296962+0000","last_fullsized":"2023-12-07T10:02:10.296962+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:19:18.264667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526913+0000","last_change":"2023-12-07T10:01:51.328493+0000","last_active":"2023-12-07T10:02:07.526913+0000","last_peered":"2023-12-07T10:02:07.526913+0000","last_clean":"2023-12-07T10:02:07.526913+0000","last_became_active":"2023-12-07T10:01:51.328019+0000","last_became_peered":"2023-12-07T10:01:51.328019+0000","last_unstale":"2023-12-07T10:02:07.526913+0000","last_undegraded":"2023-12-07T10:02:07.526913+0000","last_fullsized":"2023-12-07T10:02:07.526913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:24:21.334700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525870+0000","last_change":"2023-12-07T10:01:50.239001+0000","last_active":"2023-12-07T10:02:08.525870+0000","last_peered":"2023-12-07T10:02:08.525870+0000","last_clean":"2023-12-07T10:02:08.525870+0000","last_became_active":"2023-12-07T10:01:50.238327+0000","last_became_peered":"2023-12-07T10:01:50.238327+0000","last_unstale":"2023-12-07T10:02:08.525870+0000","last_undegraded":"2023-12-07T10:02:08.525870+0000","last_fullsized":"2023-12-07T10:02:08.525870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:56.735390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556458+0000","last_change":"2023-12-07T10:02:08.551105+0000","last_active":"2023-12-07T10:02:08.556458+0000","last_peered":"2023-12-07T10:02:08.556458+0000","last_clean":"2023-12-07T10:02:08.556458+0000","last_became_active":"2023-12-07T10:02:08.550488+0000","last_became_peered":"2023-12-07T10:02:08.550488+0000","last_unstale":"2023-12-07T10:02:08.556458+0000","last_undegraded":"2023-12-07T10:02:08.556458+0000","last_fullsized":"2023-12-07T10:02:08.556458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:38.532814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536370+0000","last_change":"2023-12-07T10:02:07.529491+0000","last_active":"2023-12-07T10:02:09.536370+0000","last_peered":"2023-12-07T10:02:09.536370+0000","last_clean":"2023-12-07T10:02:09.536370+0000","last_became_active":"2023-12-07T10:02:07.529155+0000","last_became_peered":"2023-12-07T10:02:07.529155+0000","last_unstale":"2023-12-07T10:02:09.536370+0000","last_undegraded":"2023-12-07T10:02:09.536370+0000","last_fullsized":"2023-12-07T10:02:09.536370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:41.823984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524729+0000","last_change":"2023-12-07T10:01:51.327301+0000","last_active":"2023-12-07T10:02:08.524729+0000","last_peered":"2023-12-07T10:02:08.524729+0000","last_clean":"2023-12-07T10:02:08.524729+0000","last_became_active":"2023-12-07T10:01:51.325806+0000","last_became_peered":"2023-12-07T10:01:51.325806+0000","last_unstale":"2023-12-07T10:02:08.524729+0000","last_undegraded":"2023-12-07T10:02:08.524729+0000","last_fullsized":"2023-12-07T10:02:08.524729+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:18:35.577675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518349+0000","last_change":"2023-12-07T10:01:50.236316+0000","last_active":"2023-12-07T10:02:08.518349+0000","last_peered":"2023-12-07T10:02:08.518349+0000","last_clean":"2023-12-07T10:02:08.518349+0000","last_became_active":"2023-12-07T10:01:50.236073+0000","last_became_peered":"2023-12-07T10:01:50.236073+0000","last_unstale":"2023-12-07T10:02:08.518349+0000","last_undegraded":"2023-12-07T10:02:08.518349+0000","last_fullsized":"2023-12-07T10:02:08.518349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:48:10.226808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300106+0000","last_change":"2023-12-07T10:02:08.542491+0000","last_active":"2023-12-07T10:02:10.300106+0000","last_peered":"2023-12-07T10:02:10.300106+0000","last_clean":"2023-12-07T10:02:10.300106+0000","last_became_active":"2023-12-07T10:02:08.537786+0000","last_became_peered":"2023-12-07T10:02:08.537786+0000","last_unstale":"2023-12-07T10:02:10.300106+0000","last_undegraded":"2023-12-07T10:02:10.300106+0000","last_fullsized":"2023-12-07T10:02:10.300106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:44:58.860252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.514882+0000","last_change":"2023-12-07T10:02:07.527440+0000","last_active":"2023-12-07T10:02:08.514882+0000","last_peered":"2023-12-07T10:02:08.514882+0000","last_clean":"2023-12-07T10:02:08.514882+0000","last_became_active":"2023-12-07T10:02:07.527158+0000","last_became_peered":"2023-12-07T10:02:07.527158+0000","last_unstale":"2023-12-07T10:02:08.514882+0000","last_undegraded":"2023-12-07T10:02:08.514882+0000","last_fullsized":"2023-12-07T10:02:08.514882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:12:43.402734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.526176+0000","last_change":"2023-12-07T10:01:51.239742+0000","last_active":"2023-12-07T10:02:08.526176+0000","last_peered":"2023-12-07T10:02:08.526176+0000","last_clean":"2023-12-07T10:02:08.526176+0000","last_became_active":"2023-12-07T10:01:51.239468+0000","last_became_peered":"2023-12-07T10:01:51.239468+0000","last_unstale":"2023-12-07T10:02:08.526176+0000","last_undegraded":"2023-12-07T10:02:08.526176+0000","last_fullsized":"2023-12-07T10:02:08.526176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:16.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"66'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.523040+0000","last_change":"2023-12-07T10:01:50.235726+0000","last_active":"2023-12-07T10:02:07.523040+0000","last_peered":"2023-12-07T10:02:07.523040+0000","last_clean":"2023-12-07T10:02:07.523040+0000","last_became_active":"2023-12-07T10:01:50.235447+0000","last_became_peered":"2023-12-07T10:01:50.235447+0000","last_unstale":"2023-12-07T10:02:07.523040+0000","last_undegraded":"2023-12-07T10:02:07.523040+0000","last_fullsized":"2023-12-07T10:02:07.523040+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:47.055302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.553584+0000","last_change":"2023-12-07T10:02:08.540355+0000","last_active":"2023-12-07T10:02:08.553584+0000","last_peered":"2023-12-07T10:02:08.553584+0000","last_clean":"2023-12-07T10:02:08.553584+0000","last_became_active":"2023-12-07T10:02:08.539525+0000","last_became_peered":"2023-12-07T10:02:08.539525+0000","last_unstale":"2023-12-07T10:02:08.553584+0000","last_undegraded":"2023-12-07T10:02:08.553584+0000","last_fullsized":"2023-12-07T10:02:08.553584+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:04:31.219655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296447+0000","last_change":"2023-12-07T10:02:07.537226+0000","last_active":"2023-12-07T10:02:10.296447+0000","last_peered":"2023-12-07T10:02:10.296447+0000","last_clean":"2023-12-07T10:02:10.296447+0000","last_became_active":"2023-12-07T10:02:07.536944+0000","last_became_peered":"2023-12-07T10:02:07.536944+0000","last_unstale":"2023-12-07T10:02:10.296447+0000","last_undegraded":"2023-12-07T10:02:10.296447+0000","last_fullsized":"2023-12-07T10:02:10.296447+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:41:16.562342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.518618+0000","last_change":"2023-12-07T10:01:51.323608+0000","last_active":"2023-12-07T10:02:07.518618+0000","last_peered":"2023-12-07T10:02:07.518618+0000","last_clean":"2023-12-07T10:02:07.518618+0000","last_became_active":"2023-12-07T10:01:51.323254+0000","last_became_peered":"2023-12-07T10:01:51.323254+0000","last_unstale":"2023-12-07T10:02:07.518618+0000","last_undegraded":"2023-12-07T10:02:07.518618+0000","last_fullsized":"2023-12-07T10:02:07.518618+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:02:50.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522849+0000","last_change":"2023-12-07T10:01:50.232448+0000","last_active":"2023-12-07T10:02:08.522849+0000","last_peered":"2023-12-07T10:02:08.522849+0000","last_clean":"2023-12-07T10:02:08.522849+0000","last_became_active":"2023-12-07T10:01:50.232090+0000","last_became_peered":"2023-12-07T10:01:50.232090+0000","last_unstale":"2023-12-07T10:02:08.522849+0000","last_undegraded":"2023-12-07T10:02:08.522849+0000","last_fullsized":"2023-12-07T10:02:08.522849+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:23:55.751747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300328+0000","last_change":"2023-12-07T10:02:08.536795+0000","last_active":"2023-12-07T10:02:10.300328+0000","last_peered":"2023-12-07T10:02:10.300328+0000","last_clean":"2023-12-07T10:02:10.300328+0000","last_became_active":"2023-12-07T10:02:08.536526+0000","last_became_peered":"2023-12-07T10:02:08.536526+0000","last_unstale":"2023-12-07T10:02:10.300328+0000","last_undegraded":"2023-12-07T10:02:10.300328+0000","last_fullsized":"2023-12-07T10:02:10.300328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:46:25.112824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"70'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297012+0000","last_change":"2023-12-07T10:02:07.532823+0000","last_active":"2023-12-07T10:02:10.297012+0000","last_peered":"2023-12-07T10:02:10.297012+0000","last_clean":"2023-12-07T10:02:10.297012+0000","last_became_active":"2023-12-07T10:02:07.532506+0000","last_became_peered":"2023-12-07T10:02:07.532506+0000","last_unstale":"2023-12-07T10:02:10.297012+0000","last_undegraded":"2023-12-07T10:02:10.297012+0000","last_fullsized":"2023-12-07T10:02:10.297012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:22:02.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.520051+0000","last_change":"2023-12-07T10:01:51.327531+0000","last_active":"2023-12-07T10:02:08.520051+0000","last_peered":"2023-12-07T10:02:08.520051+0000","last_clean":"2023-12-07T10:02:08.520051+0000","last_became_active":"2023-12-07T10:01:51.326982+0000","last_became_peered":"2023-12-07T10:01:51.326982+0000","last_unstale":"2023-12-07T10:02:08.520051+0000","last_undegraded":"2023-12-07T10:02:08.520051+0000","last_fullsized":"2023-12-07T10:02:08.520051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:09:37.353658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.523552+0000","last_change":"2023-12-07T10:01:50.244246+0000","last_active":"2023-12-07T10:02:08.523552+0000","last_peered":"2023-12-07T10:02:08.523552+0000","last_clean":"2023-12-07T10:02:08.523552+0000","last_became_active":"2023-12-07T10:01:50.243915+0000","last_became_peered":"2023-12-07T10:01:50.243915+0000","last_unstale":"2023-12-07T10:02:08.523552+0000","last_undegraded":"2023-12-07T10:02:08.523552+0000","last_fullsized":"2023-12-07T10:02:08.523552+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:19.396813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300709+0000","last_change":"2023-12-07T10:02:08.538379+0000","last_active":"2023-12-07T10:02:10.300709+0000","last_peered":"2023-12-07T10:02:10.300709+0000","last_clean":"2023-12-07T10:02:10.300709+0000","last_became_active":"2023-12-07T10:02:08.537973+0000","last_became_peered":"2023-12-07T10:02:08.537973+0000","last_unstale":"2023-12-07T10:02:10.300709+0000","last_undegraded":"2023-12-07T10:02:10.300709+0000","last_fullsized":"2023-12-07T10:02:10.300709+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:03:08.169490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.515596+0000","last_change":"2023-12-07T10:02:07.537062+0000","last_active":"2023-12-07T10:02:08.515596+0000","last_peered":"2023-12-07T10:02:08.515596+0000","last_clean":"2023-12-07T10:02:08.515596+0000","last_became_active":"2023-12-07T10:02:07.536557+0000","last_became_peered":"2023-12-07T10:02:07.536557+0000","last_unstale":"2023-12-07T10:02:08.515596+0000","last_undegraded":"2023-12-07T10:02:08.515596+0000","last_fullsized":"2023-12-07T10:02:08.515596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:32.986757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.517673+0000","last_change":"2023-12-07T10:01:51.322653+0000","last_active":"2023-12-07T10:02:07.517673+0000","last_peered":"2023-12-07T10:02:07.517673+0000","last_clean":"2023-12-07T10:02:07.517673+0000","last_became_active":"2023-12-07T10:01:51.322160+0000","last_became_peered":"2023-12-07T10:01:51.322160+0000","last_unstale":"2023-12-07T10:02:07.517673+0000","last_undegraded":"2023-12-07T10:02:07.517673+0000","last_fullsized":"2023-12-07T10:02:07.517673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:17:57.285100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.521465+0000","last_change":"2023-12-07T10:01:50.233405+0000","last_active":"2023-12-07T10:02:07.521465+0000","last_peered":"2023-12-07T10:02:07.521465+0000","last_clean":"2023-12-07T10:02:07.521465+0000","last_became_active":"2023-12-07T10:01:50.233160+0000","last_became_peered":"2023-12-07T10:01:50.233160+0000","last_unstale":"2023-12-07T10:02:07.521465+0000","last_undegraded":"2023-12-07T10:02:07.521465+0000","last_fullsized":"2023-12-07T10:02:07.521465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:12:20.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533353+0000","last_change":"2023-12-07T10:02:08.551906+0000","last_active":"2023-12-07T10:02:09.533353+0000","last_peered":"2023-12-07T10:02:09.533353+0000","last_clean":"2023-12-07T10:02:09.533353+0000","last_became_active":"2023-12-07T10:02:08.551654+0000","last_became_peered":"2023-12-07T10:02:08.551654+0000","last_unstale":"2023-12-07T10:02:09.533353+0000","last_undegraded":"2023-12-07T10:02:09.533353+0000","last_fullsized":"2023-12-07T10:02:09.533353+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:08:36.438330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297283+0000","last_change":"2023-12-07T10:02:07.535595+0000","last_active":"2023-12-07T10:02:10.297283+0000","last_peered":"2023-12-07T10:02:10.297283+0000","last_clean":"2023-12-07T10:02:10.297283+0000","last_became_active":"2023-12-07T10:02:07.535313+0000","last_became_peered":"2023-12-07T10:02:07.535313+0000","last_unstale":"2023-12-07T10:02:10.297283+0000","last_undegraded":"2023-12-07T10:02:10.297283+0000","last_fullsized":"2023-12-07T10:02:10.297283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:22:47.645966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.525252+0000","last_change":"2023-12-07T10:01:51.328470+0000","last_active":"2023-12-07T10:02:08.525252+0000","last_peered":"2023-12-07T10:02:08.525252+0000","last_clean":"2023-12-07T10:02:08.525252+0000","last_became_active":"2023-12-07T10:01:51.328195+0000","last_became_peered":"2023-12-07T10:01:51.328195+0000","last_unstale":"2023-12-07T10:02:08.525252+0000","last_undegraded":"2023-12-07T10:02:08.525252+0000","last_fullsized":"2023-12-07T10:02:08.525252+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"66'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.520994+0000","last_change":"2023-12-07T10:01:50.230385+0000","last_active":"2023-12-07T10:02:08.520994+0000","last_peered":"2023-12-07T10:02:08.520994+0000","last_clean":"2023-12-07T10:02:08.520994+0000","last_became_active":"2023-12-07T10:01:50.229509+0000","last_became_peered":"2023-12-07T10:01:50.229509+0000","last_unstale":"2023-12-07T10:02:08.520994+0000","last_undegraded":"2023-12-07T10:02:08.520994+0000","last_fullsized":"2023-12-07T10:02:08.520994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:17:51.248361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.556782+0000","last_change":"2023-12-07T10:02:08.552542+0000","last_active":"2023-12-07T10:02:08.556782+0000","last_peered":"2023-12-07T10:02:08.556782+0000","last_clean":"2023-12-07T10:02:08.556782+0000","last_became_active":"2023-12-07T10:02:08.552084+0000","last_became_peered":"2023-12-07T10:02:08.552084+0000","last_unstale":"2023-12-07T10:02:08.556782+0000","last_undegraded":"2023-12-07T10:02:08.556782+0000","last_fullsized":"2023-12-07T10:02:08.556782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:53:42.831455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.530658+0000","last_change":"2023-12-07T10:02:07.531486+0000","last_active":"2023-12-07T10:02:08.530658+0000","last_peered":"2023-12-07T10:02:08.530658+0000","last_clean":"2023-12-07T10:02:08.530658+0000","last_became_active":"2023-12-07T10:02:07.531164+0000","last_became_peered":"2023-12-07T10:02:07.531164+0000","last_unstale":"2023-12-07T10:02:08.530658+0000","last_undegraded":"2023-12-07T10:02:08.530658+0000","last_fullsized":"2023-12-07T10:02:08.530658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:17:10.726346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522482+0000","last_change":"2023-12-07T10:01:51.330147+0000","last_active":"2023-12-07T10:02:08.522482+0000","last_peered":"2023-12-07T10:02:08.522482+0000","last_clean":"2023-12-07T10:02:08.522482+0000","last_became_active":"2023-12-07T10:01:51.329786+0000","last_became_peered":"2023-12-07T10:01:51.329786+0000","last_unstale":"2023-12-07T10:02:08.522482+0000","last_undegraded":"2023-12-07T10:02:08.522482+0000","last_fullsized":"2023-12-07T10:02:08.522482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:27:16.697908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"67'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517670+0000","last_change":"2023-12-07T10:01:50.236657+0000","last_active":"2023-12-07T10:02:08.517670+0000","last_peered":"2023-12-07T10:02:08.517670+0000","last_clean":"2023-12-07T10:02:08.517670+0000","last_became_active":"2023-12-07T10:01:50.236406+0000","last_became_peered":"2023-12-07T10:01:50.236406+0000","last_unstale":"2023-12-07T10:02:08.517670+0000","last_undegraded":"2023-12-07T10:02:08.517670+0000","last_fullsized":"2023-12-07T10:02:08.517670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T14:47:11.362061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.297195+0000","last_change":"2023-12-07T10:02:08.541678+0000","last_active":"2023-12-07T10:02:10.297195+0000","last_peered":"2023-12-07T10:02:10.297195+0000","last_clean":"2023-12-07T10:02:10.297195+0000","last_became_active":"2023-12-07T10:02:08.541390+0000","last_became_peered":"2023-12-07T10:02:08.541390+0000","last_unstale":"2023-12-07T10:02:10.297195+0000","last_undegraded":"2023-12-07T10:02:10.297195+0000","last_fullsized":"2023-12-07T10:02:10.297195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:57:31.987419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"70'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.555375+0000","last_change":"2023-12-07T10:02:07.527154+0000","last_active":"2023-12-07T10:02:08.555375+0000","last_peered":"2023-12-07T10:02:08.555375+0000","last_clean":"2023-12-07T10:02:08.555375+0000","last_became_active":"2023-12-07T10:02:07.526872+0000","last_became_peered":"2023-12-07T10:02:07.526872+0000","last_unstale":"2023-12-07T10:02:08.555375+0000","last_undegraded":"2023-12-07T10:02:08.555375+0000","last_fullsized":"2023-12-07T10:02:08.555375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:46:44.215275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.528368+0000","last_change":"2023-12-07T10:01:51.331632+0000","last_active":"2023-12-07T10:02:07.528368+0000","last_peered":"2023-12-07T10:02:07.528368+0000","last_clean":"2023-12-07T10:02:07.528368+0000","last_became_active":"2023-12-07T10:01:51.331353+0000","last_became_peered":"2023-12-07T10:01:51.331353+0000","last_unstale":"2023-12-07T10:02:07.528368+0000","last_undegraded":"2023-12-07T10:02:07.528368+0000","last_fullsized":"2023-12-07T10:02:07.528368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.526124+0000","last_change":"2023-12-07T10:01:50.243491+0000","last_active":"2023-12-07T10:02:07.526124+0000","last_peered":"2023-12-07T10:02:07.526124+0000","last_clean":"2023-12-07T10:02:07.526124+0000","last_became_active":"2023-12-07T10:01:50.242956+0000","last_became_peered":"2023-12-07T10:01:50.242956+0000","last_unstale":"2023-12-07T10:02:07.526124+0000","last_undegraded":"2023-12-07T10:02:07.526124+0000","last_fullsized":"2023-12-07T10:02:07.526124+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:35.405857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.533610+0000","last_change":"2023-12-07T10:02:08.534380+0000","last_active":"2023-12-07T10:02:09.533610+0000","last_peered":"2023-12-07T10:02:09.533610+0000","last_clean":"2023-12-07T10:02:09.533610+0000","last_became_active":"2023-12-07T10:02:08.534118+0000","last_became_peered":"2023-12-07T10:02:08.534118+0000","last_unstale":"2023-12-07T10:02:09.533610+0000","last_undegraded":"2023-12-07T10:02:09.533610+0000","last_fullsized":"2023-12-07T10:02:09.533610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:29:37.146908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.299283+0000","last_change":"2023-12-07T10:02:07.538917+0000","last_active":"2023-12-07T10:02:10.299283+0000","last_peered":"2023-12-07T10:02:10.299283+0000","last_clean":"2023-12-07T10:02:10.299283+0000","last_became_active":"2023-12-07T10:02:07.538361+0000","last_became_peered":"2023-12-07T10:02:07.538361+0000","last_unstale":"2023-12-07T10:02:10.299283+0000","last_undegraded":"2023-12-07T10:02:10.299283+0000","last_fullsized":"2023-12-07T10:02:10.299283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:18:30.354345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.524809+0000","last_change":"2023-12-07T10:01:51.319139+0000","last_active":"2023-12-07T10:02:08.524809+0000","last_peered":"2023-12-07T10:02:08.524809+0000","last_clean":"2023-12-07T10:02:08.524809+0000","last_became_active":"2023-12-07T10:01:51.318844+0000","last_became_peered":"2023-12-07T10:01:51.318844+0000","last_unstale":"2023-12-07T10:02:08.524809+0000","last_undegraded":"2023-12-07T10:02:08.524809+0000","last_fullsized":"2023-12-07T10:02:08.524809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T13:19:29.844711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.527227+0000","last_change":"2023-12-07T10:01:50.243110+0000","last_active":"2023-12-07T10:02:07.527227+0000","last_peered":"2023-12-07T10:02:07.527227+0000","last_clean":"2023-12-07T10:02:07.527227+0000","last_became_active":"2023-12-07T10:01:50.242780+0000","last_became_peered":"2023-12-07T10:01:50.242780+0000","last_unstale":"2023-12-07T10:02:07.527227+0000","last_undegraded":"2023-12-07T10:02:07.527227+0000","last_fullsized":"2023-12-07T10:02:07.527227+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:56.316608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300140+0000","last_change":"2023-12-07T10:02:08.530268+0000","last_active":"2023-12-07T10:02:10.300140+0000","last_peered":"2023-12-07T10:02:10.300140+0000","last_clean":"2023-12-07T10:02:10.300140+0000","last_became_active":"2023-12-07T10:02:08.529975+0000","last_became_peered":"2023-12-07T10:02:08.529975+0000","last_unstale":"2023-12-07T10:02:10.300140+0000","last_undegraded":"2023-12-07T10:02:10.300140+0000","last_fullsized":"2023-12-07T10:02:10.300140+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:29:53.709475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518490+0000","last_change":"2023-12-07T10:02:07.537807+0000","last_active":"2023-12-07T10:02:08.518490+0000","last_peered":"2023-12-07T10:02:08.518490+0000","last_clean":"2023-12-07T10:02:08.518490+0000","last_became_active":"2023-12-07T10:02:07.537081+0000","last_became_peered":"2023-12-07T10:02:07.537081+0000","last_unstale":"2023-12-07T10:02:08.518490+0000","last_undegraded":"2023-12-07T10:02:08.518490+0000","last_fullsized":"2023-12-07T10:02:08.518490+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:05:39.294446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.519150+0000","last_change":"2023-12-07T10:01:51.329016+0000","last_active":"2023-12-07T10:02:07.519150+0000","last_peered":"2023-12-07T10:02:07.519150+0000","last_clean":"2023-12-07T10:02:07.519150+0000","last_became_active":"2023-12-07T10:01:51.327629+0000","last_became_peered":"2023-12-07T10:01:51.327629+0000","last_unstale":"2023-12-07T10:02:07.519150+0000","last_undegraded":"2023-12-07T10:02:07.519150+0000","last_fullsized":"2023-12-07T10:02:07.519150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:08:57.323905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518954+0000","last_change":"2023-12-07T10:01:50.233063+0000","last_active":"2023-12-07T10:02:08.518954+0000","last_peered":"2023-12-07T10:02:08.518954+0000","last_clean":"2023-12-07T10:02:08.518954+0000","last_became_active":"2023-12-07T10:01:50.232775+0000","last_became_peered":"2023-12-07T10:01:50.232775+0000","last_unstale":"2023-12-07T10:02:08.518954+0000","last_undegraded":"2023-12-07T10:02:08.518954+0000","last_fullsized":"2023-12-07T10:02:08.518954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:38:07.169353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.553604+0000","last_change":"2023-12-07T10:02:08.542525+0000","last_active":"2023-12-07T10:02:08.553604+0000","last_peered":"2023-12-07T10:02:08.553604+0000","last_clean":"2023-12-07T10:02:08.553604+0000","last_became_active":"2023-12-07T10:02:08.540704+0000","last_became_peered":"2023-12-07T10:02:08.540704+0000","last_unstale":"2023-12-07T10:02:08.553604+0000","last_undegraded":"2023-12-07T10:02:08.553604+0000","last_fullsized":"2023-12-07T10:02:08.553604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:55:20.203037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300193+0000","last_change":"2023-12-07T10:02:07.535372+0000","last_active":"2023-12-07T10:02:10.300193+0000","last_peered":"2023-12-07T10:02:10.300193+0000","last_clean":"2023-12-07T10:02:10.300193+0000","last_became_active":"2023-12-07T10:02:07.534814+0000","last_became_peered":"2023-12-07T10:02:07.534814+0000","last_unstale":"2023-12-07T10:02:10.300193+0000","last_undegraded":"2023-12-07T10:02:10.300193+0000","last_fullsized":"2023-12-07T10:02:10.300193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:45:13.756472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518675+0000","last_change":"2023-12-07T10:01:51.329122+0000","last_active":"2023-12-07T10:02:08.518675+0000","last_peered":"2023-12-07T10:02:08.518675+0000","last_clean":"2023-12-07T10:02:08.518675+0000","last_became_active":"2023-12-07T10:01:51.328758+0000","last_became_peered":"2023-12-07T10:01:51.328758+0000","last_unstale":"2023-12-07T10:02:08.518675+0000","last_undegraded":"2023-12-07T10:02:08.518675+0000","last_fullsized":"2023-12-07T10:02:08.518675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522300+0000","last_change":"2023-12-07T10:01:50.231608+0000","last_active":"2023-12-07T10:02:08.522300+0000","last_peered":"2023-12-07T10:02:08.522300+0000","last_clean":"2023-12-07T10:02:08.522300+0000","last_became_active":"2023-12-07T10:01:50.231260+0000","last_became_peered":"2023-12-07T10:01:50.231260+0000","last_unstale":"2023-12-07T10:02:08.522300+0000","last_undegraded":"2023-12-07T10:02:08.522300+0000","last_fullsized":"2023-12-07T10:02:08.522300+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:43:37.158903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.300513+0000","last_change":"2023-12-07T10:02:08.529904+0000","last_active":"2023-12-07T10:02:10.300513+0000","last_peered":"2023-12-07T10:02:10.300513+0000","last_clean":"2023-12-07T10:02:10.300513+0000","last_became_active":"2023-12-07T10:02:08.529510+0000","last_became_peered":"2023-12-07T10:02:08.529510+0000","last_unstale":"2023-12-07T10:02:10.300513+0000","last_undegraded":"2023-12-07T10:02:10.300513+0000","last_fullsized":"2023-12-07T10:02:10.300513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:46:12.848901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.296676+0000","last_change":"2023-12-07T10:02:07.528409+0000","last_active":"2023-12-07T10:02:10.296676+0000","last_peered":"2023-12-07T10:02:10.296676+0000","last_clean":"2023-12-07T10:02:10.296676+0000","last_became_active":"2023-12-07T10:02:07.528101+0000","last_became_peered":"2023-12-07T10:02:07.528101+0000","last_unstale":"2023-12-07T10:02:10.296676+0000","last_undegraded":"2023-12-07T10:02:10.296676+0000","last_fullsized":"2023-12-07T10:02:10.296676+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T16:05:39.294446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.518989+0000","last_change":"2023-12-07T10:01:51.322885+0000","last_active":"2023-12-07T10:02:08.518989+0000","last_peered":"2023-12-07T10:02:08.518989+0000","last_clean":"2023-12-07T10:02:08.518989+0000","last_became_active":"2023-12-07T10:01:51.322135+0000","last_became_peered":"2023-12-07T10:01:51.322135+0000","last_unstale":"2023-12-07T10:02:08.518989+0000","last_undegraded":"2023-12-07T10:02:08.518989+0000","last_fullsized":"2023-12-07T10:02:08.518989+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:06:10.875832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525352+0000","last_change":"2023-12-07T10:01:50.243487+0000","last_active":"2023-12-07T10:02:07.525352+0000","last_peered":"2023-12-07T10:02:07.525352+0000","last_clean":"2023-12-07T10:02:07.525352+0000","last_became_active":"2023-12-07T10:01:50.243161+0000","last_became_peered":"2023-12-07T10:01:50.243161+0000","last_unstale":"2023-12-07T10:02:07.525352+0000","last_undegraded":"2023-12-07T10:02:07.525352+0000","last_fullsized":"2023-12-07T10:02:07.525352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:44:56.460325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536105+0000","last_change":"2023-12-07T10:02:08.552603+0000","last_active":"2023-12-07T10:02:09.536105+0000","last_peered":"2023-12-07T10:02:09.536105+0000","last_clean":"2023-12-07T10:02:09.536105+0000","last_became_active":"2023-12-07T10:02:08.552268+0000","last_became_peered":"2023-12-07T10:02:08.552268+0000","last_unstale":"2023-12-07T10:02:09.536105+0000","last_undegraded":"2023-12-07T10:02:09.536105+0000","last_fullsized":"2023-12-07T10:02:09.536105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:27:45.419988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.529030+0000","last_change":"2023-12-07T10:02:07.536981+0000","last_active":"2023-12-07T10:02:08.529030+0000","last_peered":"2023-12-07T10:02:08.529030+0000","last_clean":"2023-12-07T10:02:08.529030+0000","last_became_active":"2023-12-07T10:02:07.536636+0000","last_became_peered":"2023-12-07T10:02:07.536636+0000","last_unstale":"2023-12-07T10:02:08.529030+0000","last_undegraded":"2023-12-07T10:02:08.529030+0000","last_fullsized":"2023-12-07T10:02:08.529030+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:00:25.353016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-07T10:02:07.525239+0000","last_change":"2023-12-07T10:01:51.332156+0000","last_active":"2023-12-07T10:02:07.525239+0000","last_peered":"2023-12-07T10:02:07.525239+0000","last_clean":"2023-12-07T10:02:07.525239+0000","last_became_active":"2023-12-07T10:01:51.331807+0000","last_became_peered":"2023-12-07T10:01:51.331807+0000","last_unstale":"2023-12-07T10:02:07.525239+0000","last_undegraded":"2023-12-07T10:02:07.525239+0000","last_fullsized":"2023-12-07T10:02:07.525239+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T18:03:57.742687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522705+0000","last_change":"2023-12-07T10:01:50.246509+0000","last_active":"2023-12-07T10:02:08.522705+0000","last_peered":"2023-12-07T10:02:08.522705+0000","last_clean":"2023-12-07T10:02:08.522705+0000","last_became_active":"2023-12-07T10:01:50.246091+0000","last_became_peered":"2023-12-07T10:01:50.246091+0000","last_unstale":"2023-12-07T10:02:08.522705+0000","last_undegraded":"2023-12-07T10:02:08.522705+0000","last_fullsized":"2023-12-07T10:02:08.522705+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:16:34.352932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:10.301116+0000","last_change":"2023-12-07T10:02:08.536976+0000","last_active":"2023-12-07T10:02:10.301116+0000","last_peered":"2023-12-07T10:02:10.301116+0000","last_clean":"2023-12-07T10:02:10.301116+0000","last_became_active":"2023-12-07T10:02:08.536682+0000","last_became_peered":"2023-12-07T10:02:08.536682+0000","last_unstale":"2023-12-07T10:02:10.301116+0000","last_undegraded":"2023-12-07T10:02:10.301116+0000","last_fullsized":"2023-12-07T10:02:10.301116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:07.500667+0000","last_clean_scrub_stamp":"2023-12-07T10:02:07.500667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:51:27.833431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"70'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-07T10:02:09.536620+0000","last_change":"2023-12-07T10:02:07.527665+0000","last_active":"2023-12-07T10:02:09.536620+0000","last_peered":"2023-12-07T10:02:09.536620+0000","last_clean":"2023-12-07T10:02:09.536620+0000","last_became_active":"2023-12-07T10:02:07.527361+0000","last_became_peered":"2023-12-07T10:02:07.527361+0000","last_unstale":"2023-12-07T10:02:09.536620+0000","last_undegraded":"2023-12-07T10:02:09.536620+0000","last_fullsized":"2023-12-07T10:02:09.536620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:02:06.493196+0000","last_clean_scrub_stamp":"2023-12-07T10:02:06.493196+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T19:16:18.708323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.517345+0000","last_change":"2023-12-07T10:01:51.330158+0000","last_active":"2023-12-07T10:02:08.517345+0000","last_peered":"2023-12-07T10:02:08.517345+0000","last_clean":"2023-12-07T10:02:08.517345+0000","last_became_active":"2023-12-07T10:01:51.329812+0000","last_became_peered":"2023-12-07T10:01:51.329812+0000","last_unstale":"2023-12-07T10:02:08.517345+0000","last_undegraded":"2023-12-07T10:02:08.517345+0000","last_fullsized":"2023-12-07T10:02:08.517345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:50.204346+0000","last_clean_scrub_stamp":"2023-12-07T10:01:50.204346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T20:08:38.276890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"66'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.522108+0000","last_change":"2023-12-07T10:01:50.238879+0000","last_active":"2023-12-07T10:02:08.522108+0000","last_peered":"2023-12-07T10:02:08.522108+0000","last_clean":"2023-12-07T10:02:08.522108+0000","last_became_active":"2023-12-07T10:01:50.238422+0000","last_became_peered":"2023-12-07T10:01:50.238422+0000","last_unstale":"2023-12-07T10:02:08.522108+0000","last_undegraded":"2023-12-07T10:02:08.522108+0000","last_fullsized":"2023-12-07T10:02:08.522108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T10:01:49.197049+0000","last_clean_scrub_stamp":"2023-12-07T10:01:49.197049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:53:49.599540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-07T10:02:08.519076+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:02:08.519076+0000","last_peered":"2023-12-07T10:02:08.519076+0000","last_clean":"2023-12-07T10:02:08.519076+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:08.519076+0000","last_undegraded":"2023-12-07T10:02:08.519076+0000","last_fullsized":"2023-12-07T10:02:08.519076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1478656,"data_stored":978091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77600000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.77600000000000002,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.74099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82099999999999995,"5min":1.008,"15min":1.008},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.753},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.75,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0229999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.84199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.161,"15min":1.161},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.79800000000000004,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.81999999999999995,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":381730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.75},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.879}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":880640,"data_stored":383583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":0.88,"15min":0.88},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.438,"15min":0.438},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53300000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.751}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":1.248,"15min":1.248},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.621},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":389277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.91300000000000003,"5min":1.091,"15min":1.091},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94999999999999996,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.079,"15min":1.079},"last":0.87}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":1.274,"15min":1.274},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":1.306,"15min":1.306},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72999999999999998,"15min":0.77200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.80900000000000005},"min":{"1min":0.56000000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":385125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.56000000000000005,"15min":0.63800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69699999999999995,"5min":5.516,"15min":5.516},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50900000000000001,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":1.464,"15min":1.464},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.488,"15min":1.488},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57099999999999995,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.435},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61399999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.599,"15min":1.599},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.84599999999999997},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1020000000000001,"5min":4.617,"15min":4.617},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.077,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.046,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.94299999999999995,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.81899999999999995,"15min":0.85599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.012,"5min":3.468,"15min":3.468},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57899999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":1.841,"15min":1.841},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":381000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.55600000000000005,"15min":0.624},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71599999999999997,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.81399999999999995,"15min":0.97999999999999998},"min":{"1min":0.31900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.171,"5min":13.016,"15min":13.016},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.85399999999999998},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6760000000000002,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92600000000000005,"15min":1.1120000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.915,"5min":13.166,"15min":13.166},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90100000000000002,"15min":0.999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":8.5660000000000007,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.89300000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.714,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.84699999999999998,"15min":0.92300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96799999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":1.0069999999999999,"15min":1.131},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.0489999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.97099999999999997,"15min":1.0760000000000001},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.3599999999999999,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89600000000000002,"15min":0.94199999999999995},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.7519999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":1.0429999999999999,"15min":1.1879999999999999},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.417,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.002,"15min":1.103},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.3969999999999998,"5min":5.75,"15min":5.75},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":1.0649999999999999,"15min":1.2190000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2130000000000001,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0209999999999999,"15min":1.0980000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5110000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":387735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.65800000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.45300000000000001,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.437},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61599999999999999,"5min":0.87,"15min":0.87},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":1.01,"15min":1.01},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.083,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.002,"5min":1.012,"15min":1.012},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":971368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.47499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70999999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.66400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79400000000000004,"5min":4.173,"15min":4.173},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.52600000000000002,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.73599999999999999,"15min":0.83899999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":6.048,"15min":6.048},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":1.266,"15min":1.266},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2110000000000001,"5min":2.456,"15min":2.456},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.83499999999999996},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.90000000000000002,"15min":0.96999999999999997},"min":{"1min":0.57399999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.133,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1679999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:13.035 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T10:02:13.036 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-07T10:02:13.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 Processor -- start 2023-12-07T10:02:13.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 -- start start 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc770151d80 0x7fc7700c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7700c8430 0x7fc77006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77006cf70 con 0x7fc7700c7f20 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc770152160 con 0x7fc7700c8430 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc777cfe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7700c6a30 con 0x7fc770151d80 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7700c8430 0x7fc77006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7700c8430 0x7fc77006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48148/0 (socket says 172.21.15.89:48148) 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 -- 172.21.15.89:0/4131417727 learned_addr learned my addr 172.21.15.89:0/4131417727 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775a9a640 1 --2- 172.21.15.89:0/4131417727 >> v2:172.21.15.97:3300/0 conn(0x7fc770151d80 0x7fc7700c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 -- 172.21.15.89:0/4131417727 >> v2:172.21.15.97:3300/0 conn(0x7fc770151d80 msgr2=0x7fc7700c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:13.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 --2- 172.21.15.89:0/4131417727 >> v2:172.21.15.97:3300/0 conn(0x7fc770151d80 0x7fc7700c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 -- 172.21.15.89:0/4131417727 >> v1:172.21.15.97:6789/0 conn(0x7fc7700c7f20 legacy=0x7fc77006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.175+0000 7fc775299640 1 -- 172.21.15.89:0/4131417727 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7700c72d0 con 0x7fc7700c8430 2023-12-07T10:02:13.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc775299640 1 --2- 172.21.15.89:0/4131417727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc77006b720 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc77008b3e0 tx=0x7fc76001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fabc1742ba4fbba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc774a98640 1 -- 172.21.15.89:0/4131417727 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600ab640 con 0x7fc7700c8430 2023-12-07T10:02:13.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc774a98640 1 -- 172.21.15.89:0/4131417727 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600a7070 con 0x7fc7700c8430 2023-12-07T10:02:13.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc774a98640 1 -- 172.21.15.89:0/4131417727 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600ab9c0 con 0x7fc7700c8430 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 -- 172.21.15.89:0/4131417727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 msgr2=0x7fc77006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 --2- 172.21.15.89:0/4131417727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc77006b720 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc77008b3e0 tx=0x7fc76001c440 comp rx=0 tx=0).stop 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 -- 172.21.15.89:0/4131417727 shutdown_connections 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 --2- 172.21.15.89:0/4131417727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc77006b720 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 --2- 172.21.15.89:0/4131417727 >> v2:172.21.15.97:3300/0 conn(0x7fc770151d80 0x7fc7700c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 -- 172.21.15.89:0/4131417727 >> 172.21.15.89:0/4131417727 conn(0x7fc7700abd00 msgr2=0x7fc7700ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 -- 172.21.15.89:0/4131417727 shutdown_connections 2023-12-07T10:02:13.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 -- 172.21.15.89:0/4131417727 wait complete. 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 Processor -- start 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.179+0000 7fc777cfe640 1 -- start start 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7700c7f20 0x7fc770146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc7700aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc770151d80 0x7fc7701432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700aae00 con 0x7fc7700c8430 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7701ece90 con 0x7fc770151d80 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7701ed130 con 0x7fc7700c7f20 2023-12-07T10:02:13.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc7700aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc7700aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48164/0 (socket says 172.21.15.89:48164) 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 -- 172.21.15.89:0/999204526 learned_addr learned my addr 172.21.15.89:0/999204526 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 -- 172.21.15.89:0/999204526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7700c7f20 msgr2=0x7fc770146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7700c7f20 0x7fc770146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 -- 172.21.15.89:0/999204526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc770151d80 msgr2=0x7fc7701432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc770151d80 0x7fc7701432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 -- 172.21.15.89:0/999204526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600094d0 con 0x7fc7700c8430 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc775299640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc7700aa3b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc760019050 tx=0x7fc76001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600be3f0 con 0x7fc7700c8430 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600be550 con 0x7fc7700c8430 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7701ed410 con 0x7fc7700c8430 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600be900 con 0x7fc7700c8430 2023-12-07T10:02:13.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7701ed9d0 con 0x7fc7700c8430 2023-12-07T10:02:13.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77004e890 con 0x7fc7700c8430 2023-12-07T10:02:13.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.183+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7600b43f0 con 0x7fc7700c8430 2023-12-07T10:02:13.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.187+0000 7fc7667fc640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7540668d0 0x7fc754068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.187+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc76011f0d0 con 0x7fc7700c8430 2023-12-07T10:02:13.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.187+0000 7fc775a9a640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7540668d0 0x7fc754068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.187+0000 7fc775a9a640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7540668d0 0x7fc754068d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b850 tx=0x7fc76c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.191+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7600ebf10 con 0x7fc7700c8430 2023-12-07T10:02:13.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.391+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fc7700c76a0 con 0x7fc7700c8430 2023-12-07T10:02:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.395+0000 7fc7667fc640 1 -- 172.21.15.89:0/999204526 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7fc7600ef530 con 0x7fc7700c8430 2023-12-07T10:02:13.402 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-12-07T10:02:13.402 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1l3FlYoyQGRAAgo7sxCyQ4bzt9Lrg6DtScA== 2023-12-07T10:02:13.402 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-12-07T10:02:13.402 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:02:13.402 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-07T10:02:13.402 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.1 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7540668d0 msgr2=0x7fc754068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7540668d0 0x7fc754068d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b850 tx=0x7fc76c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 msgr2=0x7fc7700aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc7700aa3b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc760019050 tx=0x7fc76001ac80 comp rx=0 tx=0).stop 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 shutdown_connections 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc770151d80 0x7fc7701432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7700c8430 0x7fc7700aa3b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc7540668d0 0x7fc754068d90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 --2- 172.21.15.89:0/999204526 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc7700c7f20 0x7fc770146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 >> 172.21.15.89:0/999204526 conn(0x7fc7700abd00 msgr2=0x7fc77014fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:13.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 shutdown_connections 2023-12-07T10:02:13.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.399+0000 7fc777cfe640 1 -- 172.21.15.89:0/999204526 wait complete. 2023-12-07T10:02:13.423 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:13.423 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:13.433 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:13.433 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:13.489 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:13.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa050157640 1 Processor -- start 2023-12-07T10:02:13.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa050157640 1 -- start start 2023-12-07T10:02:13.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa050157640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa04806cd90 0x7fa048160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa050157640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa048155790 con 0x7fa0480ca610 2023-12-07T10:02:13.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa050157640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480c4b00 con 0x7fa0480bd720 2023-12-07T10:02:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa050157640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480c4de0 con 0x7fa04806cd90 2023-12-07T10:02:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04def3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa0480ca610 0x7fa0480c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35130/0 (socket says 172.21.15.89:35130) 2023-12-07T10:02:13.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04def3640 1 -- 172.21.15.89:0/2731797768 learned_addr learned my addr 172.21.15.89:0/2731797768 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:13.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/2731797768 >> v2:172.21.15.97:3300/0 conn(0x7fa04806cd90 0x7fa048160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552914674 0 0) 0x7fa048155790 con 0x7fa0480ca610 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa034003530 con 0x7fa0480ca610 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498568665 0 0) 0x7fa034003530 con 0x7fa0480ca610 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 >> v2:172.21.15.97:3300/0 conn(0x7fa04806cd90 msgr2=0x7fa048160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 --2- 172.21.15.89:0/2731797768 >> v2:172.21.15.97:3300/0 conn(0x7fa04806cd90 0x7fa048160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 >> v1:172.21.15.97:6789/0 conn(0x7fa0480bd720 legacy=0x7fa048158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048157e30 con 0x7fa0480ca610 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fa044001680 con 0x7fa0480ca610 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 >> v1:172.21.15.89:6789/0 conn(0x7fa0480ca610 legacy=0x7fa0480c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa034003980 0x7fa034003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340047d0 0x7fa034004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0340051e0 0x7fa03400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c4de0 con 0x7fa0340051e0 2023-12-07T10:02:13.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03400c130 con 0x7fa0340047d0 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03400c2f0 con 0x7fa034003980 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0340051e0 0x7fa03400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04def3640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa034003980 0x7fa034003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04d6f2640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340047d0 0x7fa034004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 -- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa034003980 msgr2=0x7fa034003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa034003980 0x7fa034003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 -- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340047d0 msgr2=0x7fa034004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340047d0 0x7fa034004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.623+0000 7fa04e6f4640 1 -- 172.21.15.89:0/2731797768 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034003530 con 0x7fa0340051e0 2023-12-07T10:02:13.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa04e6f4640 1 -- 172.21.15.89:0/2731797768 reap_dead start 2023-12-07T10:02:13.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0340051e0 0x7fa03400b990 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa040009fc0 tx=0x7fa04001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85db62cbf4fb47d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400a5cb0 con 0x7fa0340051e0 2023-12-07T10:02:13.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000f040 con 0x7fa0340051e0 2023-12-07T10:02:13.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa04cef1640 1 -- 172.21.15.89:0/2731797768 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040003be0 con 0x7fa0340051e0 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 -- 172.21.15.89:0/2731797768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0340051e0 msgr2=0x7fa03400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0340051e0 0x7fa03400b990 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa040009fc0 tx=0x7fa04001cca0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 -- 172.21.15.89:0/2731797768 shutdown_connections 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 --2- 172.21.15.89:0/2731797768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0340051e0 0x7fa03400b990 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 -- 172.21.15.89:0/2731797768 >> 172.21.15.89:0/2731797768 conn(0x7fa048071ea0 msgr2=0x7fa0480722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 -- 172.21.15.89:0/2731797768 shutdown_connections 2023-12-07T10:02:13.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.627+0000 7fa050157640 1 -- 172.21.15.89:0/2731797768 wait complete. 2023-12-07T10:02:13.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 Processor -- start 2023-12-07T10:02:13.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 -- start start 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340051e0 0x7fa04814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0481503b0 0x7fa048156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 0x7fa0480bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480bf680 con 0x7fa048156660 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c0960 con 0x7fa0340051e0 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c0bb0 con 0x7fa0481503b0 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 0x7fa0480bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 0x7fa0480bfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48170/0 (socket says 172.21.15.89:48170) 2023-12-07T10:02:13.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 -- 172.21.15.89:0/1227560662 learned_addr learned my addr 172.21.15.89:0/1227560662 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:13.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 -- 172.21.15.89:0/1227560662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0481503b0 msgr2=0x7fa048156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0481503b0 0x7fa048156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 -- 172.21.15.89:0/1227560662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340051e0 msgr2=0x7fa04814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340051e0 0x7fa04814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 -- 172.21.15.89:0/1227560662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480c0e90 con 0x7fa048156660 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa04e6f4640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 0x7fa0480bfaf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa0400987d0 tx=0x7fa040009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400aed30 con 0x7fa048156660 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0400aeeb0 con 0x7fa048156660 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040003be0 con 0x7fa048156660 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0480bdbc0 con 0x7fa048156660 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.631+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0481ecec0 con 0x7fa048156660 2023-12-07T10:02:13.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.635+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0480bf7f0 con 0x7fa048156660 2023-12-07T10:02:13.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.635+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa040003d40 con 0x7fa048156660 2023-12-07T10:02:13.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.635+0000 7fa03e7fc640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa02c066900 0x7fa02c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.635+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa0400a6e40 con 0x7fa048156660 2023-12-07T10:02:13.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.635+0000 7fa04def3640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa02c066900 0x7fa02c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.635+0000 7fa04def3640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa02c066900 0x7fa02c068dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa044001bf0 tx=0x7fa044001a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.639+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0400ec8a0 con 0x7fa048156660 2023-12-07T10:02:13.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa04804e890 con 0x7fa048156660 2023-12-07T10:02:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa03e7fc640 1 -- 172.21.15.89:0/1227560662 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7fa0400be090 con 0x7fa048156660 2023-12-07T10:02:13.796 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:13.797 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa02c066900 msgr2=0x7fa02c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa02c066900 0x7fa02c068dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa044001bf0 tx=0x7fa044001a80 comp rx=0 tx=0).stop 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 msgr2=0x7fa0480bfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 0x7fa0480bfaf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa0400987d0 tx=0x7fa040009750 comp rx=0 tx=0).stop 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 shutdown_connections 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa048156660 0x7fa0480bfaf0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa02c066900 0x7fa02c068dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa0481503b0 0x7fa048156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 --2- 172.21.15.89:0/1227560662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0340051e0 0x7fa04814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 >> 172.21.15.89:0/1227560662 conn(0x7fa048071ea0 msgr2=0x7fa0480aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 shutdown_connections 2023-12-07T10:02:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.791+0000 7fa050157640 1 -- 172.21.15.89:0/1227560662 wait complete. 2023-12-07T10:02:13.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:13.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:13.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.951+0000 7fe962417640 1 Processor -- start 2023-12-07T10:02:13.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.951+0000 7fe962417640 1 -- start start 2023-12-07T10:02:13.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe962417640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe95c151df0 0x7fe95c0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe962417640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c7de0 0x7fe95c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe962417640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c157ca0 con 0x7fe95c0c4da0 2023-12-07T10:02:13.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe962417640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c1521d0 con 0x7fe95c151df0 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe962417640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c55f0 con 0x7fe95c0c7de0 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961415640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe95c151df0 0x7fe95c0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961c16640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe95c0c4da0 0x7fe95c154bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35142/0 (socket says 172.21.15.89:35142) 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961c16640 1 -- 172.21.15.89:0/1472744992 learned_addr learned my addr 172.21.15.89:0/1472744992 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe960c14640 1 --2- 172.21.15.89:0/1472744992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c7de0 0x7fe95c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961415640 1 -- 172.21.15.89:0/1472744992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c7de0 msgr2=0x7fe95c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961415640 1 --2- 172.21.15.89:0/1472744992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c7de0 0x7fe95c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961415640 1 -- 172.21.15.89:0/1472744992 >> v1:172.21.15.89:6789/0 conn(0x7fe95c0c4da0 legacy=0x7fe95c154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe961415640 1 -- 172.21.15.89:0/1472744992 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c155300 con 0x7fe95c151df0 2023-12-07T10:02:13.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.955+0000 7fe953fff640 1 -- 172.21.15.89:0/1472744992 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871545900 0 0) 0x7fe95c157ca0 con 0x7fe95c0c4da0 2023-12-07T10:02:13.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe961415640 1 --2- 172.21.15.89:0/1472744992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c0c4860 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097c0 tx=0x7fe95801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacb6dbdf7f9b5e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe953fff640 1 -- 172.21.15.89:0/1472744992 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580ab600 con 0x7fe95c151df0 2023-12-07T10:02:13.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe953fff640 1 -- 172.21.15.89:0/1472744992 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9580a7050 con 0x7fe95c151df0 2023-12-07T10:02:13.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe953fff640 1 -- 172.21.15.89:0/1472744992 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580ab980 con 0x7fe95c151df0 2023-12-07T10:02:13.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 -- 172.21.15.89:0/1472744992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 msgr2=0x7fe95c0c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 --2- 172.21.15.89:0/1472744992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c0c4860 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097c0 tx=0x7fe95801c3f0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 -- 172.21.15.89:0/1472744992 shutdown_connections 2023-12-07T10:02:13.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 --2- 172.21.15.89:0/1472744992 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c7de0 0x7fe95c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 --2- 172.21.15.89:0/1472744992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c0c4860 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 -- 172.21.15.89:0/1472744992 >> 172.21.15.89:0/1472744992 conn(0x7fe95c0abab0 msgr2=0x7fe95c0abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:13.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 -- 172.21.15.89:0/1472744992 shutdown_connections 2023-12-07T10:02:13.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 -- 172.21.15.89:0/1472744992 wait complete. 2023-12-07T10:02:13.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 Processor -- start 2023-12-07T10:02:13.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.959+0000 7fe962417640 1 -- start start 2023-12-07T10:02:13.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c4da0 0x7fe95c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe95c0c7de0 0x7fe95c153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c1ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0bfe90 con 0x7fe95c151df0 2023-12-07T10:02:13.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1569f0 con 0x7fe95c0c7de0 2023-12-07T10:02:13.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1ee960 con 0x7fe95c0c4da0 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c1ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c1ef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48200/0 (socket says 172.21.15.89:48200) 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 -- 172.21.15.89:0/1296744767 learned_addr learned my addr 172.21.15.89:0/1296744767 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961415640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c4da0 0x7fe95c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe960c14640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe95c0c7de0 0x7fe95c153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 -- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c4da0 msgr2=0x7fe95c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c4da0 0x7fe95c1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 -- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe95c0c7de0 msgr2=0x7fe95c153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe95c0c7de0 0x7fe95c153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 -- 172.21.15.89:0/1296744767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009420 con 0x7fe95c151df0 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961415640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c4da0 0x7fe95c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe960c14640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe95c0c7de0 0x7fe95c153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe961c16640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c1ef420 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe954001570 tx=0x7fe95400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400a640 con 0x7fe95c151df0 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95400a7c0 con 0x7fe95c151df0 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400ab70 con 0x7fe95c151df0 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c157390 con 0x7fe95c151df0 2023-12-07T10:02:13.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c157950 con 0x7fe95c151df0 2023-12-07T10:02:13.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c067a40 con 0x7fe95c151df0 2023-12-07T10:02:13.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.963+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe95400acd0 con 0x7fe95c151df0 2023-12-07T10:02:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.967+0000 7fe951ffb640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe9400668d0 0x7fe940068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.967+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe954083e10 con 0x7fe95c151df0 2023-12-07T10:02:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.967+0000 7fe961415640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe9400668d0 0x7fe940068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:13.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.967+0000 7fe961415640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe9400668d0 0x7fe940068d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ad000 tx=0x7fe9580a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:13.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:13.971+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe954087030 con 0x7fe95c151df0 2023-12-07T10:02:14.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe95c074970 con 0x7fe95c151df0 2023-12-07T10:02:14.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe951ffb640 1 -- 172.21.15.89:0/1296744767 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe954018070 con 0x7fe95c151df0 2023-12-07T10:02:14.125 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:14.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe9400668d0 msgr2=0x7fe940068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe9400668d0 0x7fe940068d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ad000 tx=0x7fe9580a6000 comp rx=0 tx=0).stop 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 msgr2=0x7fe95c1ef420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c1ef420 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe954001570 tx=0x7fe95400cca0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 shutdown_connections 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95c151df0 0x7fe95c1ef420 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe95c0c7de0 0x7fe95c153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe9400668d0 0x7fe940068d90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 --2- 172.21.15.89:0/1296744767 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe95c0c4da0 0x7fe95c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 >> 172.21.15.89:0/1296744767 conn(0x7fe95c0abab0 msgr2=0x7fe95c1508e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 shutdown_connections 2023-12-07T10:02:14.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.119+0000 7fe962417640 1 -- 172.21.15.89:0/1296744767 wait complete. 2023-12-07T10:02:14.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:14.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.283+0000 7f67a8b1e640 1 Processor -- start 2023-12-07T10:02:14.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.283+0000 7f67a8b1e640 1 -- start start 2023-12-07T10:02:14.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a8b1e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a4151df0 0x7f67a40c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a8b1e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f67a40c4da0 0x7f67a4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a8b1e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a4157ca0 con 0x7f67a40c7de0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a8b1e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a41521d0 con 0x7f67a40c4da0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a8b1e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40c55f0 con 0x7f67a4151df0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f67a40c7de0 0x7f67a41546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35154/0 (socket says 172.21.15.89:35154) 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a2ffd640 1 -- 172.21.15.89:0/1048294674 learned_addr learned my addr 172.21.15.89:0/1048294674 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a3fff640 1 --2- 172.21.15.89:0/1048294674 >> v2:172.21.15.97:3300/0 conn(0x7f67a40c4da0 0x7f67a4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a37fe640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a4151df0 0x7f67a40c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a27fc640 1 -- 172.21.15.89:0/1048294674 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192872274 0 0) 0x7f67a4157ca0 con 0x7f67a40c7de0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a27fc640 1 -- 172.21.15.89:0/1048294674 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f678c003530 con 0x7f67a40c7de0 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a3fff640 1 -- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a4151df0 msgr2=0x7f67a40c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a3fff640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a4151df0 0x7f67a40c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a3fff640 1 -- 172.21.15.89:0/1048294674 >> v1:172.21.15.89:6789/0 conn(0x7f67a40c7de0 legacy=0x7f67a41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a27fc640 1 -- 172.21.15.89:0/1048294674 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3934704730 0 0) 0x7f678c003530 con 0x7f67a40c7de0 2023-12-07T10:02:14.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a3fff640 1 -- 172.21.15.89:0/1048294674 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4155300 con 0x7f67a40c4da0 2023-12-07T10:02:14.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.287+0000 7f67a37fe640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a4151df0 0x7f67a40c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:14.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a3fff640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a4154dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f679c009d90 tx=0x7f679c01c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840580697a4f6df6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a27fc640 1 -- 172.21.15.89:0/1048294674 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798001680 con 0x7f67a40c4da0 2023-12-07T10:02:14.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a27fc640 1 -- 172.21.15.89:0/1048294674 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c0a8450 con 0x7f67a40c4da0 2023-12-07T10:02:14.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a27fc640 1 -- 172.21.15.89:0/1048294674 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0a87e0 con 0x7f67a40c4da0 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 -- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 msgr2=0x7f67a4154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a4154dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f679c009d90 tx=0x7f679c01c7e0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 -- 172.21.15.89:0/1048294674 shutdown_connections 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a4154dc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/1048294674 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a4151df0 0x7f67a40c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 -- 172.21.15.89:0/1048294674 >> 172.21.15.89:0/1048294674 conn(0x7f67a40abab0 msgr2=0x7f67a40abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 -- 172.21.15.89:0/1048294674 shutdown_connections 2023-12-07T10:02:14.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 -- 172.21.15.89:0/1048294674 wait complete. 2023-12-07T10:02:14.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 Processor -- start 2023-12-07T10:02:14.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.291+0000 7f67a8b1e640 1 -- start start 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a41f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a40c7de0 0x7f67a41ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 0x7f67a40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41f09e0 con 0x7f67a4151df0 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a414ecb0 con 0x7f67a40c4da0 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41577e0 con 0x7f67a40c7de0 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 0x7f67a40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 0x7f67a40c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48202/0 (socket says 172.21.15.89:48202) 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 -- 172.21.15.89:0/4207769209 learned_addr learned my addr 172.21.15.89:0/4207769209 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a37fe640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a41f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a2ffd640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a40c7de0 0x7f67a41ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 -- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a40c7de0 msgr2=0x7f67a41ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a40c7de0 0x7f67a41ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 -- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 msgr2=0x7f67a41f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a41f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 -- 172.21.15.89:0/4207769209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794009420 con 0x7f67a4151df0 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a2ffd640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a40c7de0 0x7f67a41ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a3fff640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 0x7f67a40c2750 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f679c01ae90 tx=0x7f679c019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b0600 con 0x7f67a4151df0 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c0b6040 con 0x7f67a4151df0 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b0980 con 0x7f67a4151df0 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c009a70 con 0x7f67a4151df0 2023-12-07T10:02:14.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a414e4a0 con 0x7f67a4151df0 2023-12-07T10:02:14.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4067a40 con 0x7f67a4151df0 2023-12-07T10:02:14.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.295+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f679c0b0ae0 con 0x7f67a4151df0 2023-12-07T10:02:14.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.299+0000 7f678bfff640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f67900668d0 0x7f6790068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.299+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f679c11fb50 con 0x7f67a4151df0 2023-12-07T10:02:14.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.299+0000 7f67a37fe640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f67900668d0 0x7f6790068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.299+0000 7f67a37fe640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f67900668d0 0x7f6790068d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6794009c50 tx=0x7f6794009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.303+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f679c0f0670 con 0x7f67a4151df0 2023-12-07T10:02:14.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.451+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67a40c3ce0 con 0x7f67a4151df0 2023-12-07T10:02:14.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.451+0000 7f678bfff640 1 -- 172.21.15.89:0/4207769209 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f679c0a8e60 con 0x7f67a4151df0 2023-12-07T10:02:14.458 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f67900668d0 msgr2=0x7f6790068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f67900668d0 0x7f6790068d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6794009c50 tx=0x7f6794009190 comp rx=0 tx=0).stop 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 msgr2=0x7f67a40c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 0x7f67a40c2750 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f679c01ae90 tx=0x7f679c019580 comp rx=0 tx=0).stop 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 shutdown_connections 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67a4151df0 0x7f67a40c2750 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f67900668d0 0x7f6790068d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67a40c7de0 0x7f67a41ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 --2- 172.21.15.89:0/4207769209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67a40c4da0 0x7f67a41f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 >> 172.21.15.89:0/4207769209 conn(0x7f67a40abab0 msgr2=0x7f67a414f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:14.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 shutdown_connections 2023-12-07T10:02:14.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.455+0000 7f67a8b1e640 1 -- 172.21.15.89:0/4207769209 wait complete. 2023-12-07T10:02:14.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:14.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.611+0000 7f80ffbaa640 1 Processor -- start 2023-12-07T10:02:14.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80ffbaa640 1 -- start start 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80ffbaa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80f8156600 0x7f80f814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80ffbaa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f8152d90 con 0x7f80f80a86d0 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80ffbaa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f8152480 con 0x7f80f814fb30 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80ffbaa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f814ffa0 con 0x7f80f8156600 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd145640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80f8156600 0x7f80f814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd946640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f80f80a86d0 0x7f80f80a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35164/0 (socket says 172.21.15.89:35164) 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd946640 1 -- 172.21.15.89:0/1320259742 learned_addr learned my addr 172.21.15.89:0/1320259742 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd145640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80f8156600 0x7f80f814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48204/0 (socket says 172.21.15.89:48204) 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd145640 1 -- 172.21.15.89:0/1320259742 >> v1:172.21.15.97:6789/0 conn(0x7f80f814fb30 legacy=0x7f80f80aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd145640 1 -- 172.21.15.89:0/1320259742 >> v1:172.21.15.89:6789/0 conn(0x7f80f80a86d0 legacy=0x7f80f80a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.615+0000 7f80fd145640 1 -- 172.21.15.89:0/1320259742 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80a9760 con 0x7f80f8156600 2023-12-07T10:02:14.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80fd145640 1 --2- 172.21.15.89:0/1320259742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f814f5f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f80e80097f0 tx=0x7f80e801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ce6521b4f13 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80fc944640 1 -- 172.21.15.89:0/1320259742 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80ab600 con 0x7f80f8156600 2023-12-07T10:02:14.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80fc944640 1 -- 172.21.15.89:0/1320259742 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80a7050 con 0x7f80f8156600 2023-12-07T10:02:14.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80fc944640 1 -- 172.21.15.89:0/1320259742 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80ab980 con 0x7f80f8156600 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 -- 172.21.15.89:0/1320259742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 msgr2=0x7f80f814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/1320259742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f814f5f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f80e80097f0 tx=0x7f80e801c480 comp rx=0 tx=0).stop 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 -- 172.21.15.89:0/1320259742 shutdown_connections 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/1320259742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f814f5f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 -- 172.21.15.89:0/1320259742 >> 172.21.15.89:0/1320259742 conn(0x7f80f80c2a60 msgr2=0x7f80f80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 -- 172.21.15.89:0/1320259742 shutdown_connections 2023-12-07T10:02:14.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 -- 172.21.15.89:0/1320259742 wait complete. 2023-12-07T10:02:14.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 Processor -- start 2023-12-07T10:02:14.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.619+0000 7f80ffbaa640 1 -- start start 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80f80a86d0 0x7f80f8148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80f814fb30 0x7f80f80c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f81f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f814aa90 con 0x7f80f8156600 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81f0dd0 con 0x7f80f80a86d0 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8147460 con 0x7f80f814fb30 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f81f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f81f11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48214/0 (socket says 172.21.15.89:48214) 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 -- 172.21.15.89:0/3008542162 learned_addr learned my addr 172.21.15.89:0/3008542162 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fd946640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80f80a86d0 0x7f80f8148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fd145640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80f814fb30 0x7f80f80c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 -- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80f814fb30 msgr2=0x7f80f80c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80f814fb30 0x7f80f80c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 -- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80f80a86d0 msgr2=0x7f80f8148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80f80a86d0 0x7f80f8148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 -- 172.21.15.89:0/3008542162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009420 con 0x7f80f8156600 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80fe147640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f81f11f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c760 tx=0x7f80f000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0003b80 con 0x7f80f8156600 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0003ce0 con 0x7f80f8156600 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000aa30 con 0x7f80f8156600 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80c1f20 con 0x7f80f8156600 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f814e5d0 con 0x7f80f8156600 2023-12-07T10:02:14.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.623+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f81f0f10 con 0x7f80f8156600 2023-12-07T10:02:14.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.627+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f80f000ab90 con 0x7f80f8156600 2023-12-07T10:02:14.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.627+0000 7f80ee7fc640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f80dc066900 0x7f80dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.627+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f80f0084380 con 0x7f80f8156600 2023-12-07T10:02:14.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.627+0000 7f80fd946640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f80dc066900 0x7f80dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.627+0000 7f80fd946640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f80dc066900 0x7f80dc068dc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f80f4005890 tx=0x7f80f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.631+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80f81f0f10 con 0x7f80f8156600 2023-12-07T10:02:14.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80f81f0f10 con 0x7f80f8156600 2023-12-07T10:02:14.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ee7fc640 1 -- 172.21.15.89:0/3008542162 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80f81f0f10 con 0x7f80f8156600 2023-12-07T10:02:14.784 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:14.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f80dc066900 msgr2=0x7f80dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f80dc066900 0x7f80dc068dc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f80f4005890 tx=0x7f80f4009040 comp rx=0 tx=0).stop 2023-12-07T10:02:14.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 msgr2=0x7f80f81f11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f81f11f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c760 tx=0x7f80f000cc20 comp rx=0 tx=0).stop 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 shutdown_connections 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f8156600 0x7f80f81f11f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f80dc066900 0x7f80dc068dc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f80f814fb30 0x7f80f80c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 --2- 172.21.15.89:0/3008542162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f80f80a86d0 0x7f80f8148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 >> 172.21.15.89:0/3008542162 conn(0x7f80f80c2a60 msgr2=0x7f80f80c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 shutdown_connections 2023-12-07T10:02:14.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.779+0000 7f80ffbaa640 1 -- 172.21.15.89:0/3008542162 wait complete. 2023-12-07T10:02:14.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:14.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 Processor -- start 2023-12-07T10:02:14.944 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 -- start start 2023-12-07T10:02:14.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f012c0c8430 0x7f012c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c06cf70 con 0x7f012c151d80 2023-12-07T10:02:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c152160 con 0x7f012c0c8430 2023-12-07T10:02:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f01337f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0c6a30 con 0x7f012c0c7f20 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f0131d92640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f0131d92640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:33962/0 (socket says 172.21.15.89:33962) 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f0131d92640 1 -- 172.21.15.89:0/1002608433 learned_addr learned my addr 172.21.15.89:0/1002608433 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f0130d90640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f012c0c8430 0x7f012c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.939+0000 7f0131591640 1 --1- 172.21.15.89:0/1002608433 >> v1:172.21.15.97:6789/0 conn(0x7f012c151d80 0x7f012c0c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:43646/0 (socket says 172.21.15.89:43646) 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0123fff640 1 -- 172.21.15.89:0/1002608433 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772376650 0 0) 0x7f012c06cf70 con 0x7f012c151d80 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0130d90640 1 -- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 msgr2=0x7f012c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0130d90640 1 --2- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0130d90640 1 -- 172.21.15.89:0/1002608433 >> v1:172.21.15.97:6789/0 conn(0x7f012c151d80 legacy=0x7f012c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0130d90640 1 -- 172.21.15.89:0/1002608433 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0c72d0 con 0x7f012c0c8430 2023-12-07T10:02:14.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0131d92640 1 --2- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:14.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0130d90640 1 --2- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c06b720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f011c0097c0 tx=0x7f011c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0bba8ccfdbcce2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0123fff640 1 -- 172.21.15.89:0/1002608433 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0ac620 con 0x7f012c0c8430 2023-12-07T10:02:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0123fff640 1 -- 172.21.15.89:0/1002608433 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c0ac780 con 0x7f012c0c8430 2023-12-07T10:02:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f0123fff640 1 -- 172.21.15.89:0/1002608433 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0acb10 con 0x7f012c0c8430 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f01337f5640 1 -- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 msgr2=0x7f012c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f01337f5640 1 --2- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c06b720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f011c0097c0 tx=0x7f011c01c3c0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f01337f5640 1 -- 172.21.15.89:0/1002608433 shutdown_connections 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f01337f5640 1 --2- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f01337f5640 1 --2- 172.21.15.89:0/1002608433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c06b720 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.943+0000 7f01337f5640 1 -- 172.21.15.89:0/1002608433 >> 172.21.15.89:0/1002608433 conn(0x7f012c0abd00 msgr2=0x7f012c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 -- 172.21.15.89:0/1002608433 shutdown_connections 2023-12-07T10:02:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 -- 172.21.15.89:0/1002608433 wait complete. 2023-12-07T10:02:14.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 Processor -- start 2023-12-07T10:02:14.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 -- start start 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c1ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 0x7f012c14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c14ba80 con 0x7f012c151d80 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c145c40 con 0x7f012c0c8430 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f01337f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1ed930 con 0x7f012c0c7f20 2023-12-07T10:02:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 0x7f012c14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 0x7f012c14a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48226/0 (socket says 172.21.15.89:48226) 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 -- 172.21.15.89:0/3309727019 learned_addr learned my addr 172.21.15.89:0/3309727019 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0130d90640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c1ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131591640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 -- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 msgr2=0x7f012c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c0c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 -- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 msgr2=0x7f012c1ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:14.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c1ed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:14.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 -- 172.21.15.89:0/3309727019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124009b30 con 0x7f012c151d80 2023-12-07T10:02:14.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0130d90640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c1ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:14.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0131d92640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 0x7f012c14a860 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f012400efc0 tx=0x7f012400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.947+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124018070 con 0x7f012c151d80 2023-12-07T10:02:14.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012400f040 con 0x7f012c151d80 2023-12-07T10:02:14.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012400cd40 con 0x7f012c151d80 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c009420 con 0x7f012c151d80 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c1453a0 con 0x7f012c151d80 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c04e890 con 0x7f012c151d80 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0124014480 con 0x7f012c151d80 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f0121ffb640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01100668d0 0x7f0110068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f01240849a0 con 0x7f012c151d80 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.951+0000 7f0131591640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01100668d0 0x7f0110068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:14.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.955+0000 7f0131591640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01100668d0 0x7f0110068d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0128000f70 tx=0x7f0128007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:14.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:14.955+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0124051870 con 0x7f012c151d80 2023-12-07T10:02:15.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.103+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f012c143e80 con 0x7f012c151d80 2023-12-07T10:02:15.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.103+0000 7f0121ffb640 1 -- 172.21.15.89:0/3309727019 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v71) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0124054e90 con 0x7f012c151d80 2023-12-07T10:02:15.111 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01100668d0 msgr2=0x7f0110068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01100668d0 0x7f0110068d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0128000f70 tx=0x7f0128007c10 comp rx=0 tx=0).stop 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 msgr2=0x7f012c14a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 0x7f012c14a860 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f012400efc0 tx=0x7f012400c490 comp rx=0 tx=0).stop 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 shutdown_connections 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f012c151d80 0x7f012c14a860 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f012c0c8430 0x7f012c1ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f01100668d0 0x7f0110068d90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 --2- 172.21.15.89:0/3309727019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f012c0c7f20 0x7f012c0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 >> 172.21.15.89:0/3309727019 conn(0x7f012c0abd00 msgr2=0x7f012c0c7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 shutdown_connections 2023-12-07T10:02:15.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.107+0000 7f01337f5640 1 -- 172.21.15.89:0/3309727019 wait complete. 2023-12-07T10:02:15.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:15.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.267+0000 7fea4ca32640 1 Processor -- start 2023-12-07T10:02:15.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.267+0000 7fea4ca32640 1 -- start start 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea4ca32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea480c2750 0x7fea480bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea4ca32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea480c0460 0x7fea480bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea4ca32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480c1410 con 0x7fea48071f30 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea4ca32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480c0e90 con 0x7fea480c0460 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea4ca32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea480c1130 con 0x7fea480c2750 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea480c0460 0x7fea480bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea480c0460 0x7fea480bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48230/0 (socket says 172.21.15.89:48230) 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 -- 172.21.15.89:0/1066234926 learned_addr learned my addr 172.21.15.89:0/1066234926 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea477fe640 1 --2- 172.21.15.89:0/1066234926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea480c2750 0x7fea480bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 -- 172.21.15.89:0/1066234926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea480c2750 msgr2=0x7fea480bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:15.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 --2- 172.21.15.89:0/1066234926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea480c2750 0x7fea480bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 -- 172.21.15.89:0/1066234926 >> v1:172.21.15.97:6789/0 conn(0x7fea48071f30 legacy=0x7fea480c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 -- 172.21.15.89:0/1066234926 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4806da20 con 0x7fea480c0460 2023-12-07T10:02:15.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.271+0000 7fea46ffd640 1 --2- 172.21.15.89:0/1066234926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c0460 0x7fea480bc8b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009870 tx=0x7fea3c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e084bfb8d49624f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:15.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea467fc640 1 -- 172.21.15.89:0/1066234926 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0ab610 con 0x7fea480c0460 2023-12-07T10:02:15.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea467fc640 1 -- 172.21.15.89:0/1066234926 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea480c4020 con 0x7fea480c0460 2023-12-07T10:02:15.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea467fc640 1 -- 172.21.15.89:0/1066234926 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0ab990 con 0x7fea480c0460 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- 172.21.15.89:0/1066234926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c0460 msgr2=0x7fea480bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 --2- 172.21.15.89:0/1066234926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c0460 0x7fea480bc8b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009870 tx=0x7fea3c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- 172.21.15.89:0/1066234926 shutdown_connections 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 --2- 172.21.15.89:0/1066234926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c0460 0x7fea480bc8b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 --2- 172.21.15.89:0/1066234926 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea480c2750 0x7fea480bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- 172.21.15.89:0/1066234926 >> 172.21.15.89:0/1066234926 conn(0x7fea480c5a60 msgr2=0x7fea480c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- 172.21.15.89:0/1066234926 shutdown_connections 2023-12-07T10:02:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- 172.21.15.89:0/1066234926 wait complete. 2023-12-07T10:02:15.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 Processor -- start 2023-12-07T10:02:15.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- start start 2023-12-07T10:02:15.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea48071f30 0x7fea481ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea480c0460 0x7fea480a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 0x7fea481f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea481edbb0 con 0x7fea480c2750 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea481f0180 con 0x7fea480c0460 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea4ca32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea48071050 con 0x7fea48071f30 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea47fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 0x7fea481f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea47fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 0x7fea481f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48246/0 (socket says 172.21.15.89:48246) 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea47fff640 1 -- 172.21.15.89:0/2710544154 learned_addr learned my addr 172.21.15.89:0/2710544154 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.275+0000 7fea46ffd640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea480c0460 0x7fea480a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea477fe640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea48071f30 0x7fea481ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea47fff640 1 -- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea48071f30 msgr2=0x7fea481ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea47fff640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea48071f30 0x7fea481ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea47fff640 1 -- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea480c0460 msgr2=0x7fea480a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea47fff640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea480c0460 0x7fea480a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea47fff640 1 -- 172.21.15.89:0/2710544154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0094d0 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea47fff640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 0x7fea481f0610 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c760 tx=0x7fea4000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40003b80 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40003ce0 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000aa30 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea48148b10 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea480715a0 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea480680c0 con 0x7fea480c2750 2023-12-07T10:02:15.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea4000ab90 con 0x7fea480c2750 2023-12-07T10:02:15.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea2ffff640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fea340668d0 0x7fea34068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.279+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fea40084490 con 0x7fea480c2750 2023-12-07T10:02:15.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.283+0000 7fea477fe640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fea340668d0 0x7fea34068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.283+0000 7fea477fe640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fea340668d0 0x7fea34068d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fea38009b60 tx=0x7fea38009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.283+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea40051380 con 0x7fea480c2750 2023-12-07T10:02:15.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fea481f0330 con 0x7fea480c2750 2023-12-07T10:02:15.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea2ffff640 1 -- 172.21.15.89:0/2710544154 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v71) v1 ==== 101+0+11 (secure 0 0 0) 0x7fea481f0330 con 0x7fea480c2750 2023-12-07T10:02:15.445 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fea340668d0 msgr2=0x7fea34068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fea340668d0 0x7fea34068d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fea38009b60 tx=0x7fea38009190 comp rx=0 tx=0).stop 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 msgr2=0x7fea481f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 0x7fea481f0610 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c760 tx=0x7fea4000cc20 comp rx=0 tx=0).stop 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 shutdown_connections 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea480c2750 0x7fea481f0610 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea480c0460 0x7fea480a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fea340668d0 0x7fea34068d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.439+0000 7fea4ca32640 1 --2- 172.21.15.89:0/2710544154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fea48071f30 0x7fea481ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.443+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 >> 172.21.15.89:0/2710544154 conn(0x7fea480c5a60 msgr2=0x7fea4814e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.443+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 shutdown_connections 2023-12-07T10:02:15.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.443+0000 7fea4ca32640 1 -- 172.21.15.89:0/2710544154 wait complete. 2023-12-07T10:02:15.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:02:15.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 Processor -- start 2023-12-07T10:02:15.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 -- start start 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95b4070b80 0x7f95b4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f95b40a8470 0x7f95b406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b406d320 con 0x7f95b414e9d0 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40721b0 con 0x7f95b4070b80 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95ba52a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40c2830 con 0x7f95b40a8470 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f95b414e9d0 0x7f95b40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35178/0 (socket says 172.21.15.89:35178) 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b3fff640 1 -- 172.21.15.89:0/2734133155 learned_addr learned my addr 172.21.15.89:0/2734133155 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b37fe640 1 --2- 172.21.15.89:0/2734133155 >> v2:172.21.15.89:3300/0 conn(0x7f95b4070b80 0x7f95b4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b8ac7640 1 --2- 172.21.15.89:0/2734133155 >> v2:172.21.15.97:3300/0 conn(0x7f95b40a8470 0x7f95b406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b2ffd640 1 -- 172.21.15.89:0/2734133155 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383211223 0 0) 0x7f95b406d320 con 0x7f95b414e9d0 2023-12-07T10:02:15.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b2ffd640 1 -- 172.21.15.89:0/2734133155 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c003530 con 0x7f95b414e9d0 2023-12-07T10:02:15.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b37fe640 1 -- 172.21.15.89:0/2734133155 >> v2:172.21.15.97:3300/0 conn(0x7f95b40a8470 msgr2=0x7f95b406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:15.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b37fe640 1 --2- 172.21.15.89:0/2734133155 >> v2:172.21.15.97:3300/0 conn(0x7f95b40a8470 0x7f95b406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b37fe640 1 -- 172.21.15.89:0/2734133155 >> v1:172.21.15.89:6789/0 conn(0x7f95b414e9d0 legacy=0x7f95b40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.603+0000 7f95b37fe640 1 -- 172.21.15.89:0/2734133155 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4072450 con 0x7f95b4070b80 2023-12-07T10:02:15.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95b37fe640 1 --2- 172.21.15.89:0/2734133155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b4070b80 0x7f95b4151e60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f95b40c3b30 tx=0x7f95a801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4415dca0e240dc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:15.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95b2ffd640 1 -- 172.21.15.89:0/2734133155 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80ab600 con 0x7f95b4070b80 2023-12-07T10:02:15.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95b2ffd640 1 -- 172.21.15.89:0/2734133155 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a80a7050 con 0x7f95b4070b80 2023-12-07T10:02:15.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95b2ffd640 1 -- 172.21.15.89:0/2734133155 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80ab980 con 0x7f95b4070b80 2023-12-07T10:02:15.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 -- 172.21.15.89:0/2734133155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b4070b80 msgr2=0x7f95b4151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 --2- 172.21.15.89:0/2734133155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b4070b80 0x7f95b4151e60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f95b40c3b30 tx=0x7f95a801c3d0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 -- 172.21.15.89:0/2734133155 shutdown_connections 2023-12-07T10:02:15.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 --2- 172.21.15.89:0/2734133155 >> v2:172.21.15.97:3300/0 conn(0x7f95b40a8470 0x7f95b406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 --2- 172.21.15.89:0/2734133155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b4070b80 0x7f95b4151e60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 -- 172.21.15.89:0/2734133155 >> 172.21.15.89:0/2734133155 conn(0x7f95b40c2ad0 msgr2=0x7f95b40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:15.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 -- 172.21.15.89:0/2734133155 shutdown_connections 2023-12-07T10:02:15.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.607+0000 7f95ba52a640 1 -- 172.21.15.89:0/2734133155 wait complete. 2023-12-07T10:02:15.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 Processor -- start 2023-12-07T10:02:15.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- start start 2023-12-07T10:02:15.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95b4070b80 0x7f95b41529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95b40a8470 0x7f95b40aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 0x7f95b414a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41ecfe0 con 0x7f95b414e9d0 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41f0970 con 0x7f95b4070b80 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41ecd00 con 0x7f95b40a8470 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 0x7f95b414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 0x7f95b414a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48260/0 (socket says 172.21.15.89:48260) 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 -- 172.21.15.89:0/898104665 learned_addr learned my addr 172.21.15.89:0/898104665 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b3fff640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95b4070b80 0x7f95b41529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b37fe640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95b40a8470 0x7f95b40aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 -- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95b40a8470 msgr2=0x7f95b40aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95b40a8470 0x7f95b40aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 -- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95b4070b80 msgr2=0x7f95b41529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95b4070b80 0x7f95b41529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 -- 172.21.15.89:0/898104665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009420 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b8ac7640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 0x7f95b414a250 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009e30 tx=0x7f95ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac009ca0 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00f040 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b41f0320 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0146c0 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b4152f20 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.611+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b41f0180 con 0x7f95b414e9d0 2023-12-07T10:02:15.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.615+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95ac014820 con 0x7f95b414e9d0 2023-12-07T10:02:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.615+0000 7f95b0ff9640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95a00668d0 0x7f95a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.615+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f95ac0854d0 con 0x7f95b414e9d0 2023-12-07T10:02:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.615+0000 7f95b3fff640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95a00668d0 0x7f95a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:15.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.615+0000 7f95b3fff640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95a00668d0 0x7f95a0068d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f95a40011f0 tx=0x7f95a4007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:15.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.619+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95b41f0180 con 0x7f95b414e9d0 2023-12-07T10:02:15.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.779+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f95b41f0180 con 0x7f95b414e9d0 2023-12-07T10:02:15.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.779+0000 7f95b0ff9640 1 -- 172.21.15.89:0/898104665 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7f95b41f0180 con 0x7f95b414e9d0 2023-12-07T10:02:15.786 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:02:15.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95a00668d0 msgr2=0x7f95a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95a00668d0 0x7f95a0068d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f95a40011f0 tx=0x7f95a4007d40 comp rx=0 tx=0).stop 2023-12-07T10:02:15.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 msgr2=0x7f95b414a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:15.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 0x7f95b414a250 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009e30 tx=0x7f95ac00c490 comp rx=0 tx=0).stop 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 shutdown_connections 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95b414e9d0 0x7f95b414a250 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f95a00668d0 0x7f95a0068d90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95b40a8470 0x7f95b40aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 --2- 172.21.15.89:0/898104665 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95b4070b80 0x7f95b41529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 >> 172.21.15.89:0/898104665 conn(0x7f95b40c2ad0 msgr2=0x7f95b40c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:15.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 shutdown_connections 2023-12-07T10:02:15.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:15.783+0000 7f95ba52a640 1 -- 172.21.15.89:0/898104665 wait complete. 2023-12-07T10:02:15.807 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T10:02:15.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:15.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:15.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:02:15.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:15.839 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:02:15.890 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:15.890 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:15.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:02:15.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:02:16.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.071+0000 7fd4a5f2a640 1 Processor -- start 2023-12-07T10:02:16.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.071+0000 7fd4a5f2a640 1 -- start start 2023-12-07T10:02:16.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd4a5f2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd4a0070b80 0x7fd4a0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd4a5f2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4a00a8470 0x7fd4a006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd4a5f2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a006d320 con 0x7fd4a014e9d0 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd4a5f2a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00721b0 con 0x7fd4a00a8470 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd4a5f2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00c2830 con 0x7fd4a0070b80 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4a00a8470 0x7fd4a006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4a00a8470 0x7fd4a006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48270/0 (socket says 172.21.15.89:48270) 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 -- 172.21.15.89:0/2316970234 learned_addr learned my addr 172.21.15.89:0/2316970234 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49effd640 1 --2- 172.21.15.89:0/2316970234 >> v2:172.21.15.97:3300/0 conn(0x7fd4a0070b80 0x7fd4a0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 -- 172.21.15.89:0/2316970234 >> v2:172.21.15.97:3300/0 conn(0x7fd4a0070b80 msgr2=0x7fd4a0151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 --2- 172.21.15.89:0/2316970234 >> v2:172.21.15.97:3300/0 conn(0x7fd4a0070b80 0x7fd4a0151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 -- 172.21.15.89:0/2316970234 >> v1:172.21.15.97:6789/0 conn(0x7fd4a014e9d0 legacy=0x7fd4a00c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:16.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 -- 172.21.15.89:0/2316970234 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0072450 con 0x7fd4a00a8470 2023-12-07T10:02:16.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.075+0000 7fd49ffff640 1 --2- 172.21.15.89:0/2316970234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00a8470 0x7fd4a006d7b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006e420 tx=0x7fd49801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4159237b824394 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:16.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd49e7fc640 1 -- 172.21.15.89:0/2316970234 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980ad680 con 0x7fd4a00a8470 2023-12-07T10:02:16.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd49e7fc640 1 -- 172.21.15.89:0/2316970234 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980ad7e0 con 0x7fd4a00a8470 2023-12-07T10:02:16.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd49e7fc640 1 -- 172.21.15.89:0/2316970234 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980adb70 con 0x7fd4a00a8470 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/2316970234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00a8470 msgr2=0x7fd4a006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/2316970234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00a8470 0x7fd4a006d7b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006e420 tx=0x7fd49801c470 comp rx=0 tx=0).stop 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/2316970234 shutdown_connections 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/2316970234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00a8470 0x7fd4a006d7b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/2316970234 >> v2:172.21.15.97:3300/0 conn(0x7fd4a0070b80 0x7fd4a0151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/2316970234 >> 172.21.15.89:0/2316970234 conn(0x7fd4a00c2ad0 msgr2=0x7fd4a00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/2316970234 shutdown_connections 2023-12-07T10:02:16.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/2316970234 wait complete. 2023-12-07T10:02:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 Processor -- start 2023-12-07T10:02:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- start start 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 0x7fd4a013fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4a00a8470 0x7fd4a0143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4a014e9d0 0x7fd4a0144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0141280 con 0x7fd4a0070b80 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01540d0 con 0x7fd4a014e9d0 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd4a5f2a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0142cb0 con 0x7fd4a00a8470 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd49f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 0x7fd4a013fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd49f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 0x7fd4a013fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48286/0 (socket says 172.21.15.89:48286) 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.079+0000 7fd49f7fe640 1 -- 172.21.15.89:0/3530977656 learned_addr learned my addr 172.21.15.89:0/3530977656 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49ffff640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4a014e9d0 0x7fd4a0144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49effd640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4a00a8470 0x7fd4a0143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49f7fe640 1 -- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4a00a8470 msgr2=0x7fd4a0143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49f7fe640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4a00a8470 0x7fd4a0143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49f7fe640 1 -- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4a014e9d0 msgr2=0x7fd4a0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49f7fe640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4a014e9d0 0x7fd4a0144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49f7fe640 1 -- 172.21.15.89:0/3530977656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980094d0 con 0x7fd4a0070b80 2023-12-07T10:02:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49f7fe640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 0x7fd4a013fe80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c7d0 tx=0x7fd49000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490003b80 con 0x7fd4a0070b80 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490003ce0 con 0x7fd4a0070b80 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000aa90 con 0x7fd4a0070b80 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a01403c0 con 0x7fd4a0070b80 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0153df0 con 0x7fd4a0070b80 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a004e890 con 0x7fd4a0070b80 2023-12-07T10:02:16.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd49000abf0 con 0x7fd4a0070b80 2023-12-07T10:02:16.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd487fff640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd48c066900 0x7fd48c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:16.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd490084470 con 0x7fd4a0070b80 2023-12-07T10:02:16.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.083+0000 7fd49effd640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd48c066900 0x7fd48c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:16.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.087+0000 7fd49effd640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd48c066900 0x7fd48c068dc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd4a01e8890 tx=0x7fd494008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:16.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.087+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd490051400 con 0x7fd4a0070b80 2023-12-07T10:02:16.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4a014e200 con 0x7fd4a0070b80 2023-12-07T10:02:16.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd487fff640 1 -- 172.21.15.89:0/3530977656 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd490054a20 con 0x7fd4a0070b80 2023-12-07T10:02:16.276 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:02:16.276 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:02:16.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd48c066900 msgr2=0x7fd48c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:16.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd48c066900 0x7fd48c068dc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd4a01e8890 tx=0x7fd494008040 comp rx=0 tx=0).stop 2023-12-07T10:02:16.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 msgr2=0x7fd4a013fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 0x7fd4a013fe80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c7d0 tx=0x7fd49000cc90 comp rx=0 tx=0).stop 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 shutdown_connections 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd4a014e9d0 0x7fd4a0144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd48c066900 0x7fd48c068dc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd4a00a8470 0x7fd4a0143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 --2- 172.21.15.89:0/3530977656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a0070b80 0x7fd4a013fe80 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 >> 172.21.15.89:0/3530977656 conn(0x7fd4a00c2ad0 msgr2=0x7fd4a006be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 shutdown_connections 2023-12-07T10:02:16.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:16.271+0000 7fd4a5f2a640 1 -- 172.21.15.89:0/3530977656 wait complete. 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T10:02:16.298 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:16.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.299 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:02:16.308 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:02:16.308 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:02:16.309 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42239sec preferred_lft 42239sec 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.310 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:02:16.311 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:02:16.311 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:02:16.311 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:16.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.312 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:02:16.375 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:02:16.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.378 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:02:16.431 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:02:16.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.433 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:02:16.433 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:02:16.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:02:16.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:02:16.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:02:16.433 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:02:16.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.530 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:02:16.540 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:02:16.541 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:16.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:02:16.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:16.604 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:16.656 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:16.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:16.657 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:16.707 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-07T10:02:16.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.708 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:16.797 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:16.797 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:16.810 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:16.811 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:16.811 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:02:16.811 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 1@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs2=/ 2023-12-07T10:02:16.811 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:02:16.815 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:02:16.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.815 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:16.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.837 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:02:16.903 INFO:teuthology.orchestra.run.smithi097.stdout:client6502 2023-12-07T10:02:16.903 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:16.903 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:16.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:16.952 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-07T10:02:16.969 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:16.970 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-07T10:02:17.026 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:17.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:17.026 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-07T10:02:17.043 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:17.043 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-07T10:02:17.097 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:17.098 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-07T10:02:17.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 Processor -- start 2023-12-07T10:02:17.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 -- start start 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe810151d80 0x7fe8100c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8100c7f20 0x7fe81006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81006cf70 con 0x7fe8100c8430 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe810152160 con 0x7fe8100c7f20 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe817ff8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8100c6a30 con 0x7fe810151d80 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe815593640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe8100c8430 0x7fe81006b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35182/0 (socket says 172.21.15.89:35182) 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe815593640 1 -- 172.21.15.89:0/1117716319 learned_addr learned my addr 172.21.15.89:0/1117716319 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe816595640 1 --2- 172.21.15.89:0/1117716319 >> v2:172.21.15.89:3300/0 conn(0x7fe8100c7f20 0x7fe81006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.239+0000 7fe815d94640 1 --2- 172.21.15.89:0/1117716319 >> v2:172.21.15.97:3300/0 conn(0x7fe810151d80 0x7fe8100c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe815d94640 1 -- 172.21.15.89:0/1117716319 >> v2:172.21.15.89:3300/0 conn(0x7fe8100c7f20 msgr2=0x7fe81006be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe815d94640 1 --2- 172.21.15.89:0/1117716319 >> v2:172.21.15.89:3300/0 conn(0x7fe8100c7f20 0x7fe81006be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe815d94640 1 -- 172.21.15.89:0/1117716319 >> v1:172.21.15.89:6789/0 conn(0x7fe8100c8430 legacy=0x7fe81006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe815d94640 1 -- 172.21.15.89:0/1117716319 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100c72d0 con 0x7fe810151d80 2023-12-07T10:02:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe815d94640 1 --2- 172.21.15.89:0/1117716319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe810151d80 0x7fe8100c49a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe81008b3e0 tx=0x7fe80c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d6014cc88780c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe814d92640 1 -- 172.21.15.89:0/1117716319 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0ac600 con 0x7fe810151d80 2023-12-07T10:02:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe814d92640 1 -- 172.21.15.89:0/1117716319 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0a8050 con 0x7fe810151d80 2023-12-07T10:02:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.243+0000 7fe814d92640 1 -- 172.21.15.89:0/1117716319 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0ac980 con 0x7fe810151d80 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- 172.21.15.89:0/1117716319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe810151d80 msgr2=0x7fe8100c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 --2- 172.21.15.89:0/1117716319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe810151d80 0x7fe8100c49a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe81008b3e0 tx=0x7fe80c01c3a0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- 172.21.15.89:0/1117716319 shutdown_connections 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 --2- 172.21.15.89:0/1117716319 >> v2:172.21.15.89:3300/0 conn(0x7fe8100c7f20 0x7fe81006be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 --2- 172.21.15.89:0/1117716319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe810151d80 0x7fe8100c49a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- 172.21.15.89:0/1117716319 >> 172.21.15.89:0/1117716319 conn(0x7fe8100abd00 msgr2=0x7fe8100ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- 172.21.15.89:0/1117716319 shutdown_connections 2023-12-07T10:02:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- 172.21.15.89:0/1117716319 wait complete. 2023-12-07T10:02:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 Processor -- start 2023-12-07T10:02:17.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- start start 2023-12-07T10:02:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100c7f20 0x7fe810146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 0x7fe8101434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe810151d80 0x7fe810143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100b0050 con 0x7fe8100c8430 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100a9f60 con 0x7fe8100c7f20 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe817ff8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101f10e0 con 0x7fe810151d80 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 0x7fe8101434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 0x7fe8101434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48304/0 (socket says 172.21.15.89:48304) 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 -- 172.21.15.89:0/2257873511 learned_addr learned my addr 172.21.15.89:0/2257873511 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 -- 172.21.15.89:0/2257873511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe810151d80 msgr2=0x7fe810143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe810151d80 0x7fe810143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 -- 172.21.15.89:0/2257873511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100c7f20 msgr2=0x7fe810146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100c7f20 0x7fe810146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.247+0000 7fe815593640 1 -- 172.21.15.89:0/2257873511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c009420 con 0x7fe8100c8430 2023-12-07T10:02:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe815593640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 0x7fe8101434f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe800007fd0 tx=0x7fe80000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800005cf0 con 0x7fe8100c8430 2023-12-07T10:02:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800005e70 con 0x7fe8100c8430 2023-12-07T10:02:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8101f1570 con 0x7fe8100c8430 2023-12-07T10:02:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000072f0 con 0x7fe8100c8430 2023-12-07T10:02:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8101f0a90 con 0x7fe8100c8430 2023-12-07T10:02:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81004e890 con 0x7fe8100c8430 2023-12-07T10:02:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe800007450 con 0x7fe8100c8430 2023-12-07T10:02:17.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe8067fc640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7f40668d0 0x7fe7f4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe800083be0 con 0x7fe8100c8430 2023-12-07T10:02:17.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.251+0000 7fe815d94640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7f40668d0 0x7fe7f4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.255+0000 7fe815d94640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7f40668d0 0x7fe7f4068d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0ae000 tx=0x7fe80c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:17.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.259+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe800050b50 con 0x7fe8100c8430 2023-12-07T10:02:17.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.463+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7fe8101f1250 con 0x7fe8100c8430 2023-12-07T10:02:17.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.463+0000 7fe8067fc640 1 -- 172.21.15.89:0/2257873511 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7fe8101f1250 con 0x7fe8100c8430 2023-12-07T10:02:17.469 INFO:teuthology.orchestra.run.smithi089.stderr:added key for client.testuser 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7f40668d0 msgr2=0x7fe7f4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7f40668d0 0x7fe7f4068d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0ae000 tx=0x7fe80c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 msgr2=0x7fe8101434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 0x7fe8101434f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe800007fd0 tx=0x7fe80000c890 comp rx=0 tx=0).stop 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 shutdown_connections 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe7f40668d0 0x7fe7f4068d90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe810151d80 0x7fe810143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8100c8430 0x7fe8101434f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 --2- 172.21.15.89:0/2257873511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8100c7f20 0x7fe810146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 >> 172.21.15.89:0/2257873511 conn(0x7fe8100abd00 msgr2=0x7fe81014c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 shutdown_connections 2023-12-07T10:02:17.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.467+0000 7fe817ff8640 1 -- 172.21.15.89:0/2257873511 wait complete. 2023-12-07T10:02:17.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-07T10:02:17.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.623+0000 7f9f6ac94640 1 Processor -- start 2023-12-07T10:02:17.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.623+0000 7f9f6ac94640 1 -- start start 2023-12-07T10:02:17.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f6ac94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9f6414ea60 0x7f9f64155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f6ac94640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6406c440 con 0x7f9f6406bd00 2023-12-07T10:02:17.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f6ac94640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f64154790 con 0x7f9f640bf400 2023-12-07T10:02:17.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f6ac94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6406c6e0 con 0x7f9f6414ea60 2023-12-07T10:02:17.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f5bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9f6406bd00 0x7f9f640700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35192/0 (socket says 172.21.15.89:35192) 2023-12-07T10:02:17.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f5bfff640 1 -- 172.21.15.89:0/3421539022 learned_addr learned my addr 172.21.15.89:0/3421539022 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:17.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f68a30640 1 --2- 172.21.15.89:0/3421539022 >> v2:172.21.15.97:3300/0 conn(0x7f9f6414ea60 0x7f9f64155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426366366 0 0) 0x7f9f6406c440 con 0x7f9f6406bd00 2023-12-07T10:02:17.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c003530 con 0x7f9f6406bd00 2023-12-07T10:02:17.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346909297 0 0) 0x7f9f64154790 con 0x7f9f640bf400 2023-12-07T10:02:17.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f6406c440 con 0x7f9f640bf400 2023-12-07T10:02:17.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f68a30640 1 -- 172.21.15.89:0/3421539022 >> v1:172.21.15.97:6789/0 conn(0x7f9f640bf400 legacy=0x7f9f640c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f68a30640 1 -- 172.21.15.89:0/3421539022 >> v1:172.21.15.89:6789/0 conn(0x7f9f6406bd00 legacy=0x7f9f640700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.627+0000 7f9f68a30640 1 -- 172.21.15.89:0/3421539022 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64154a50 con 0x7f9f6414ea60 2023-12-07T10:02:17.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f68a30640 1 --2- 172.21.15.89:0/3421539022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6414ea60 0x7f9f64155250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097c0 tx=0x7f9f6001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cba5137c56b91b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:17.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60004230 con 0x7f9f6414ea60 2023-12-07T10:02:17.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f600a7050 con 0x7f9f6414ea60 2023-12-07T10:02:17.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f5b7fe640 1 -- 172.21.15.89:0/3421539022 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60003620 con 0x7f9f6414ea60 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 -- 172.21.15.89:0/3421539022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6414ea60 msgr2=0x7f9f64155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/3421539022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6414ea60 0x7f9f64155250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097c0 tx=0x7f9f6001c330 comp rx=0 tx=0).stop 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 -- 172.21.15.89:0/3421539022 shutdown_connections 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/3421539022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6414ea60 0x7f9f64155250 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 -- 172.21.15.89:0/3421539022 >> 172.21.15.89:0/3421539022 conn(0x7f9f640c2ad0 msgr2=0x7f9f640c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 -- 172.21.15.89:0/3421539022 shutdown_connections 2023-12-07T10:02:17.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 -- 172.21.15.89:0/3421539022 wait complete. 2023-12-07T10:02:17.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 Processor -- start 2023-12-07T10:02:17.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.631+0000 7f9f6ac94640 1 -- start start 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6406bd00 0x7f9f64146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9f640bf400 0x7f9f64148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 0x7f9f6413c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64143360 con 0x7f9f6414ea60 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64147210 con 0x7f9f6406bd00 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641ede50 con 0x7f9f640bf400 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 0x7f9f6413c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 0x7f9f6413c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48308/0 (socket says 172.21.15.89:48308) 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 -- 172.21.15.89:0/1985562294 learned_addr learned my addr 172.21.15.89:0/1985562294 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f68a30640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6406bd00 0x7f9f64146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f5bfff640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9f640bf400 0x7f9f64148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 -- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9f640bf400 msgr2=0x7f9f64148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9f640bf400 0x7f9f64148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 -- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6406bd00 msgr2=0x7f9f64146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6406bd00 0x7f9f64146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 -- 172.21.15.89:0/1985562294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009420 con 0x7f9f6414ea60 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f68a30640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6406bd00 0x7f9f64146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f69231640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 0x7f9f6413c320 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00c760 tx=0x7f9f5c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c003b80 con 0x7f9f6414ea60 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c003ce0 con 0x7f9f6414ea60 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00aa90 con 0x7f9f6414ea60 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6413d100 con 0x7f9f6414ea60 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f641ed8d0 con 0x7f9f6414ea60 2023-12-07T10:02:17.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f641524e0 con 0x7f9f6414ea60 2023-12-07T10:02:17.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.635+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9f5c00abf0 con 0x7f9f6414ea60 2023-12-07T10:02:17.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.639+0000 7f9f597fa640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9f500668d0 0x7f9f50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:17.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.639+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f5c084460 con 0x7f9f6414ea60 2023-12-07T10:02:17.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.639+0000 7f9f68a30640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9f500668d0 0x7f9f50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:17.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.639+0000 7f9f68a30640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9f500668d0 0x7f9f50068d90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f600ad000 tx=0x7f9f60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:17.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.643+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f641524e0 con 0x7f9f6414ea60 2023-12-07T10:02:17.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f9f641524e0 con 0x7f9f6414ea60 2023-12-07T10:02:17.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f597fa640 1 -- 172.21.15.89:0/1985562294 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7f9f641524e0 con 0x7f9f6414ea60 2023-12-07T10:02:17.849 INFO:teuthology.orchestra.run.smithi089.stdout:[client.testuser] 2023-12-07T10:02:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA== 2023-12-07T10:02:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-07T10:02:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-12-07T10:02:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-07T10:02:17.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9f500668d0 msgr2=0x7f9f50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9f500668d0 0x7f9f50068d90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f600ad000 tx=0x7f9f60008040 comp rx=0 tx=0).stop 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 msgr2=0x7f9f6413c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 0x7f9f6413c320 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00c760 tx=0x7f9f5c00cc20 comp rx=0 tx=0).stop 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 shutdown_connections 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f6414ea60 0x7f9f6413c320 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9f500668d0 0x7f9f50068d90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9f640bf400 0x7f9f64148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 --2- 172.21.15.89:0/1985562294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f6406bd00 0x7f9f64146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 >> 172.21.15.89:0/1985562294 conn(0x7f9f640c2ad0 msgr2=0x7f9f640c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 shutdown_connections 2023-12-07T10:02:17.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:17.843+0000 7f9f6ac94640 1 -- 172.21.15.89:0/1985562294 wait complete. 2023-12-07T10:02:17.869 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-07T10:02:17.869 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:02:17.878 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.1MHbLzQ9OJ 2023-12-07T10:02:17.879 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:17.879 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/tmp/tmp.1MHbLzQ9OJ 2023-12-07T10:02:17.932 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:17.932 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:17.983 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:17.983 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:18.037 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:18.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 Processor -- start 2023-12-07T10:02:18.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 -- start start 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c0c0c4890 0x7f4c0c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c0c0bd5a0 0x7f4c0c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c06b7d0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c155160 con 0x7f4c0c0bd5a0 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c10e59640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c06b180 con 0x7f4c0c0ca620 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c0c0c4890 0x7f4c0c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c0c0c4890 0x7f4c0c0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48322/0 (socket says 172.21.15.89:48322) 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 -- 172.21.15.89:0/1373089731 learned_addr learned my addr 172.21.15.89:0/1373089731 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0bfff640 1 --2- 172.21.15.89:0/1373089731 >> v2:172.21.15.97:3300/0 conn(0x7f4c0c0bd5a0 0x7f4c0c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0b7fe640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 -- 172.21.15.89:0/1373089731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 msgr2=0x7f4c0c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:18.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 -- 172.21.15.89:0/1373089731 >> v2:172.21.15.97:3300/0 conn(0x7f4c0c0bd5a0 msgr2=0x7f4c0c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:18.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 --2- 172.21.15.89:0/1373089731 >> v2:172.21.15.97:3300/0 conn(0x7f4c0c0bd5a0 0x7f4c0c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0affd640 1 -- 172.21.15.89:0/1373089731 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c06b460 con 0x7f4c0c0c4890 2023-12-07T10:02:18.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0bfff640 1 --2- 172.21.15.89:0/1373089731 >> v2:172.21.15.97:3300/0 conn(0x7f4c0c0bd5a0 0x7f4c0c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:18.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.211+0000 7f4c0b7fe640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:18.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c0affd640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c0c7f10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0c98b0 tx=0x7f4c0001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77c5c71ad43d85b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c0a7fc640 1 -- 172.21.15.89:0/1373089731 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000ab600 con 0x7f4c0c0c4890 2023-12-07T10:02:18.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c0a7fc640 1 -- 172.21.15.89:0/1373089731 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c000a7050 con 0x7f4c0c0c4890 2023-12-07T10:02:18.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c0a7fc640 1 -- 172.21.15.89:0/1373089731 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000ab980 con 0x7f4c0c0c4890 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 -- 172.21.15.89:0/1373089731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 msgr2=0x7f4c0c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c0c7f10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0c98b0 tx=0x7f4c0001c3e0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 -- 172.21.15.89:0/1373089731 shutdown_connections 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 --2- 172.21.15.89:0/1373089731 >> v2:172.21.15.97:3300/0 conn(0x7f4c0c0bd5a0 0x7f4c0c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c0c7f10 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 --2- 172.21.15.89:0/1373089731 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 -- 172.21.15.89:0/1373089731 >> 172.21.15.89:0/1373089731 conn(0x7f4c0c0ac0a0 msgr2=0x7f4c0c0c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 -- 172.21.15.89:0/1373089731 shutdown_connections 2023-12-07T10:02:18.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 -- 172.21.15.89:0/1373089731 wait complete. 2023-12-07T10:02:18.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 Processor -- start 2023-12-07T10:02:18.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.215+0000 7f4c10e59640 1 -- start start 2023-12-07T10:02:18.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0c0bd5a0 0x7f4c0c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c1ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c14bcb0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1ed370 con 0x7f4c0c0bd5a0 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c14a910 con 0x7f4c0c0ca620 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c14b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48328/0 (socket says 172.21.15.89:48328) 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 -- 172.21.15.89:0/35373336 learned_addr learned my addr 172.21.15.89:0/35373336 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0b7fe640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0c0bd5a0 0x7f4c0c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0bfff640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c1ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 -- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 msgr2=0x7f4c0c1ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c1ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 -- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0c0bd5a0 msgr2=0x7f4c0c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0c0bd5a0 0x7f4c0c14e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 -- 172.21.15.89:0/35373336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000094d0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c0affd640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c14b470 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4c000ae040 tx=0x7f4c0001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000b6620 con 0x7f4c0c0c4890 2023-12-07T10:02:18.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c000b67a0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000b6b50 con 0x7f4c0c0c4890 2023-12-07T10:02:18.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c14abf0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c1ecfd0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.219+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c1ed1c0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.223+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c000b2040 con 0x7f4c0c0c4890 2023-12-07T10:02:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.223+0000 7f4bf3fff640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4bf80668d0 0x7f4bf8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.223+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c0011ecb0 con 0x7f4c0c0c4890 2023-12-07T10:02:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.223+0000 7f4c0b7fe640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4bf80668d0 0x7f4bf8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.223+0000 7f4c0b7fe640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4bf80668d0 0x7f4bf8068d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc006fd0 tx=0x7f4bfc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.227+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c000ebc70 con 0x7f4c0c0c4890 2023-12-07T10:02:18.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.379+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c0c04e890 con 0x7f4c0c0c4890 2023-12-07T10:02:18.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.379+0000 7f4bf3fff640 1 -- 172.21.15.89:0/35373336 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7f4c000ef290 con 0x7f4c0c0c4890 2023-12-07T10:02:18.386 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:18.386 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4bf80668d0 msgr2=0x7f4bf8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4bf80668d0 0x7f4bf8068d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc006fd0 tx=0x7f4bfc008040 comp rx=0 tx=0).stop 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 msgr2=0x7f4c0c14b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c14b470 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4c000ae040 tx=0x7f4c0001ac20 comp rx=0 tx=0).stop 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 shutdown_connections 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4bf80668d0 0x7f4bf8068d90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c0c0ca620 0x7f4c0c1ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0c0c4890 0x7f4c0c14b470 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 --2- 172.21.15.89:0/35373336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0c0bd5a0 0x7f4c0c14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 >> 172.21.15.89:0/35373336 conn(0x7f4c0c0ac0a0 msgr2=0x7f4c0c0aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 shutdown_connections 2023-12-07T10:02:18.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.383+0000 7f4c10e59640 1 -- 172.21.15.89:0/35373336 wait complete. 2023-12-07T10:02:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:18.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:18.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 Processor -- start 2023-12-07T10:02:18.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 -- start start 2023-12-07T10:02:18.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcc4151d80 0x7fbcc40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcc40c8430 0x7fbcc406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc406cf70 con 0x7fbcc40c7f20 2023-12-07T10:02:18.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc4152160 con 0x7fbcc4151d80 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbccc380640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc40c6a30 con 0x7fbcc40c8430 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbcca11c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcc4151d80 0x7fbcc40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbcca91d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbcc40c7f20 0x7fbcc406bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35196/0 (socket says 172.21.15.89:35196) 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbcca91d640 1 -- 172.21.15.89:0/3898227173 learned_addr learned my addr 172.21.15.89:0/3898227173 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.543+0000 7fbcc991b640 1 --2- 172.21.15.89:0/3898227173 >> v2:172.21.15.97:3300/0 conn(0x7fbcc40c8430 0x7fbcc406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcca11c640 1 -- 172.21.15.89:0/3898227173 >> v2:172.21.15.97:3300/0 conn(0x7fbcc40c8430 msgr2=0x7fbcc406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcca11c640 1 --2- 172.21.15.89:0/3898227173 >> v2:172.21.15.97:3300/0 conn(0x7fbcc40c8430 0x7fbcc406b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcca11c640 1 -- 172.21.15.89:0/3898227173 >> v1:172.21.15.89:6789/0 conn(0x7fbcc40c7f20 legacy=0x7fbcc406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcca11c640 1 -- 172.21.15.89:0/3898227173 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40c72d0 con 0x7fbcc4151d80 2023-12-07T10:02:18.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcc911a640 1 -- 172.21.15.89:0/3898227173 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942373310 0 0) 0x7fbcc406cf70 con 0x7fbcc40c7f20 2023-12-07T10:02:18.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcca11c640 1 --2- 172.21.15.89:0/3898227173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc40c49a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40c7a40 tx=0x7fbcc001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71350190592121a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcc911a640 1 -- 172.21.15.89:0/3898227173 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00ac600 con 0x7fbcc4151d80 2023-12-07T10:02:18.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcc911a640 1 -- 172.21.15.89:0/3898227173 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc00a8050 con 0x7fbcc4151d80 2023-12-07T10:02:18.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbcc911a640 1 -- 172.21.15.89:0/3898227173 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00ac980 con 0x7fbcc4151d80 2023-12-07T10:02:18.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbccc380640 1 -- 172.21.15.89:0/3898227173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 msgr2=0x7fbcc40c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.547+0000 7fbccc380640 1 --2- 172.21.15.89:0/3898227173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc40c49a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40c7a40 tx=0x7fbcc001c3a0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- 172.21.15.89:0/3898227173 shutdown_connections 2023-12-07T10:02:18.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 --2- 172.21.15.89:0/3898227173 >> v2:172.21.15.97:3300/0 conn(0x7fbcc40c8430 0x7fbcc406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 --2- 172.21.15.89:0/3898227173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc40c49a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- 172.21.15.89:0/3898227173 >> 172.21.15.89:0/3898227173 conn(0x7fbcc40abd00 msgr2=0x7fbcc40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:18.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- 172.21.15.89:0/3898227173 shutdown_connections 2023-12-07T10:02:18.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- 172.21.15.89:0/3898227173 wait complete. 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 Processor -- start 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- start start 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc40c7f20 0x7fbcc41435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc40c8430 0x7fbcc41e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc4145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40aaed0 con 0x7fbcc4151d80 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc4147730 con 0x7fbcc40c7f20 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbccc380640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc414c3a0 con 0x7fbcc40c8430 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc4145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc4145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48346/0 (socket says 172.21.15.89:48346) 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 -- 172.21.15.89:0/4293369479 learned_addr learned my addr 172.21.15.89:0/4293369479 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcc991b640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc40c8430 0x7fbcc41e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca11c640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc40c7f20 0x7fbcc41435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 -- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc40c8430 msgr2=0x7fbcc41e6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc40c8430 0x7fbcc41e6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 -- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc40c7f20 msgr2=0x7fbcc41435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc40c7f20 0x7fbcc41435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 -- 172.21.15.89:0/4293369479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0009420 con 0x7fbcc4151d80 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca11c640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc40c7f20 0x7fbcc41435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.551+0000 7fbcca91d640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc4145ea0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00caf0 tx=0x7fbcbc002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00ab70 con 0x7fbcc4151d80 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00acd0 con 0x7fbcc4151d80 2023-12-07T10:02:18.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc40aa090 con 0x7fbcc4151d80 2023-12-07T10:02:18.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc012620 con 0x7fbcc4151d80 2023-12-07T10:02:18.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc40aa650 con 0x7fbcc4151d80 2023-12-07T10:02:18.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc414c530 con 0x7fbcc4151d80 2023-12-07T10:02:18.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbcbc007070 con 0x7fbcc4151d80 2023-12-07T10:02:18.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcbaffd640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbca80668d0 0x7fbca8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbcbc084530 con 0x7fbcc4151d80 2023-12-07T10:02:18.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcca11c640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbca80668d0 0x7fbca8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.555+0000 7fbcca11c640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbca80668d0 0x7fbca8068d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00ae000 tx=0x7fbcc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.559+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcbc0514b0 con 0x7fbcc4151d80 2023-12-07T10:02:18.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcc404e890 con 0x7fbcc4151d80 2023-12-07T10:02:18.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbcbaffd640 1 -- 172.21.15.89:0/4293369479 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcbc054ad0 con 0x7fbcc4151d80 2023-12-07T10:02:18.716 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbca80668d0 msgr2=0x7fbca8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbca80668d0 0x7fbca8068d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00ae000 tx=0x7fbcc0008040 comp rx=0 tx=0).stop 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 msgr2=0x7fbcc4145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc4145ea0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00caf0 tx=0x7fbcbc002190 comp rx=0 tx=0).stop 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 shutdown_connections 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc4151d80 0x7fbcc4145ea0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbca80668d0 0x7fbca8068d90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbcc40c8430 0x7fbcc41e6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 --2- 172.21.15.89:0/4293369479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcc40c7f20 0x7fbcc41435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 >> 172.21.15.89:0/4293369479 conn(0x7fbcc40abd00 msgr2=0x7fbcc414f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 shutdown_connections 2023-12-07T10:02:18.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.711+0000 7fbccc380640 1 -- 172.21.15.89:0/4293369479 wait complete. 2023-12-07T10:02:18.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:18.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 Processor -- start 2023-12-07T10:02:18.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 -- start start 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e340a86d0 0x7f8e340a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e34156600 0x7f8e3414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8e3414fb30 0x7f8e340aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e34152d90 con 0x7f8e340a86d0 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e34152480 con 0x7f8e3414fb30 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3c4fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e340a9760 con 0x7f8e34156600 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e340a86d0 0x7f8e340a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e340a86d0 0x7f8e340a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48358/0 (socket says 172.21.15.89:48358) 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 -- 172.21.15.89:0/3122743205 learned_addr learned my addr 172.21.15.89:0/3122743205 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3aa9b640 1 --2- 172.21.15.89:0/3122743205 >> v2:172.21.15.97:3300/0 conn(0x7f8e3414fb30 0x7f8e340aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e39a99640 1 --2- 172.21.15.89:0/3122743205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e34156600 0x7f8e3414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 -- 172.21.15.89:0/3122743205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e34156600 msgr2=0x7f8e3414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 --2- 172.21.15.89:0/3122743205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e34156600 0x7f8e3414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 -- 172.21.15.89:0/3122743205 >> v2:172.21.15.97:3300/0 conn(0x7f8e3414fb30 msgr2=0x7f8e340aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:18.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 --2- 172.21.15.89:0/3122743205 >> v2:172.21.15.97:3300/0 conn(0x7f8e3414fb30 0x7f8e340aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.871+0000 7f8e3a29a640 1 -- 172.21.15.89:0/3122743205 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e34152740 con 0x7f8e340a86d0 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3a29a640 1 --2- 172.21.15.89:0/3122743205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e340a86d0 0x7f8e340a8f30 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8e34074300 tx=0x7f8e3001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdea416dc569542 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e39298640 1 -- 172.21.15.89:0/3122743205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300a5650 con 0x7f8e340a86d0 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e39298640 1 -- 172.21.15.89:0/3122743205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e300a57b0 con 0x7f8e340a86d0 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e39298640 1 -- 172.21.15.89:0/3122743205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300a5b40 con 0x7f8e340a86d0 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/3122743205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e340a86d0 msgr2=0x7f8e340a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/3122743205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e340a86d0 0x7f8e340a8f30 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8e34074300 tx=0x7f8e3001c9d0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/3122743205 shutdown_connections 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/3122743205 >> v2:172.21.15.97:3300/0 conn(0x7f8e3414fb30 0x7f8e340aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/3122743205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e34156600 0x7f8e3414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/3122743205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e340a86d0 0x7f8e340a8f30 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/3122743205 >> 172.21.15.89:0/3122743205 conn(0x7f8e340c2a60 msgr2=0x7f8e340c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:18.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/3122743205 shutdown_connections 2023-12-07T10:02:18.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/3122743205 wait complete. 2023-12-07T10:02:18.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 Processor -- start 2023-12-07T10:02:18.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.875+0000 7f8e3c4fe640 1 -- start start 2023-12-07T10:02:18.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e340a86d0 0x7f8e3414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3414fb30 0x7f8e34143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 0x7f8e34144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3414ce20 con 0x7f8e34156600 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34149e90 con 0x7f8e3414fb30 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3414c610 con 0x7f8e340a86d0 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 0x7f8e34144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 0x7f8e34144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48370/0 (socket says 172.21.15.89:48370) 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 -- 172.21.15.89:0/504051245 learned_addr learned my addr 172.21.15.89:0/504051245 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3a29a640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e340a86d0 0x7f8e3414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e39a99640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3414fb30 0x7f8e34143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 -- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e340a86d0 msgr2=0x7f8e3414ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e340a86d0 0x7f8e3414ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 -- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3414fb30 msgr2=0x7f8e34143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3414fb30 0x7f8e34143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 -- 172.21.15.89:0/504051245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e30009b30 con 0x7f8e34156600 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3aa9b640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 0x7f8e34144070 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00e7f0 tx=0x7f8e2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c009530 con 0x7f8e34156600 2023-12-07T10:02:18.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00eea0 con 0x7f8e34156600 2023-12-07T10:02:18.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e341533a0 con 0x7f8e34156600 2023-12-07T10:02:18.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00cb00 con 0x7f8e34156600 2023-12-07T10:02:18.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3414c860 con 0x7f8e34156600 2023-12-07T10:02:18.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e34153200 con 0x7f8e34156600 2023-12-07T10:02:18.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.879+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8e2c00cc60 con 0x7f8e34156600 2023-12-07T10:02:18.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.883+0000 7f8e2affd640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8e180668d0 0x7f8e18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:18.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.883+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8e2c084720 con 0x7f8e34156600 2023-12-07T10:02:18.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.883+0000 7f8e3a29a640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8e180668d0 0x7f8e18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:18.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.883+0000 7f8e3a29a640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8e180668d0 0x7f8e18068d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8e300ae000 tx=0x7f8e300a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:18.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:18.887+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e34153200 con 0x7f8e34156600 2023-12-07T10:02:19.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.031+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e34153200 con 0x7f8e34156600 2023-12-07T10:02:19.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e2affd640 1 -- 172.21.15.89:0/504051245 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e34153200 con 0x7f8e34156600 2023-12-07T10:02:19.039 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8e180668d0 msgr2=0x7f8e18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8e180668d0 0x7f8e18068d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8e300ae000 tx=0x7f8e300a7070 comp rx=0 tx=0).stop 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 msgr2=0x7f8e34144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 0x7f8e34144070 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00e7f0 tx=0x7f8e2c00ecb0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 shutdown_connections 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e34156600 0x7f8e34144070 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e3414fb30 0x7f8e34143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8e180668d0 0x7f8e18068d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 --2- 172.21.15.89:0/504051245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8e340a86d0 0x7f8e3414ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 >> 172.21.15.89:0/504051245 conn(0x7f8e340c2a60 msgr2=0x7f8e340c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 shutdown_connections 2023-12-07T10:02:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.035+0000 7f8e3c4fe640 1 -- 172.21.15.89:0/504051245 wait complete. 2023-12-07T10:02:19.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 Processor -- start 2023-12-07T10:02:19.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 -- start start 2023-12-07T10:02:19.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d30151d80 0x7f7d300c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c8430 0x7f7d3006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3006cf70 con 0x7f7d300c7f20 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d30152160 con 0x7f7d30151d80 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d352bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300c6a30 con 0x7f7d300c8430 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d30151d80 0x7f7d300c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d30151d80 0x7f7d300c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:33724/0 (socket says 172.21.15.89:33724) 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 -- 172.21.15.89:0/2135776169 learned_addr learned my addr 172.21.15.89:0/2135776169 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2f7fe640 1 --1- 172.21.15.89:0/2135776169 >> v1:172.21.15.97:6789/0 conn(0x7f7d300c7f20 0x7f7d3006bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:43690/0 (socket says 172.21.15.89:43690) 2023-12-07T10:02:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2e7fc640 1 --2- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c8430 0x7f7d3006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 -- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c8430 msgr2=0x7f7d3006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 --2- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c8430 0x7f7d3006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 -- 172.21.15.89:0/2135776169 >> v1:172.21.15.97:6789/0 conn(0x7f7d300c7f20 legacy=0x7f7d3006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.195+0000 7f7d2effd640 1 -- 172.21.15.89:0/2135776169 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300c72d0 con 0x7f7d30151d80 2023-12-07T10:02:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d2effd640 1 --2- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d300c49a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009870 tx=0x7f7d2001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d318d374bc1eec server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d2dffb640 1 -- 172.21.15.89:0/2135776169 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200ab680 con 0x7f7d30151d80 2023-12-07T10:02:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d2dffb640 1 -- 172.21.15.89:0/2135776169 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d200ab7e0 con 0x7f7d30151d80 2023-12-07T10:02:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d2dffb640 1 -- 172.21.15.89:0/2135776169 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200abb70 con 0x7f7d30151d80 2023-12-07T10:02:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 -- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 msgr2=0x7f7d300c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 --2- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d300c49a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009870 tx=0x7f7d2001c480 comp rx=0 tx=0).stop 2023-12-07T10:02:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 -- 172.21.15.89:0/2135776169 shutdown_connections 2023-12-07T10:02:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 --2- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c8430 0x7f7d3006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 --2- 172.21.15.89:0/2135776169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d300c49a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 -- 172.21.15.89:0/2135776169 >> 172.21.15.89:0/2135776169 conn(0x7f7d300abd00 msgr2=0x7f7d300ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:19.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 -- 172.21.15.89:0/2135776169 shutdown_connections 2023-12-07T10:02:19.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.199+0000 7f7d352bb640 1 -- 172.21.15.89:0/2135776169 wait complete. 2023-12-07T10:02:19.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 Processor -- start 2023-12-07T10:02:19.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 -- start start 2023-12-07T10:02:19.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c7f20 0x7f7d30148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 0x7f7d300c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d30153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300aac30 con 0x7f7d300c8430 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30152a60 con 0x7f7d30151d80 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301491f0 con 0x7f7d300c7f20 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 0x7f7d300c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 0x7f7d300c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48382/0 (socket says 172.21.15.89:48382) 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 -- 172.21.15.89:0/4251242176 learned_addr learned my addr 172.21.15.89:0/4251242176 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2effd640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c7f20 0x7f7d30148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2f7fe640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d30153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 -- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c7f20 msgr2=0x7f7d30148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c7f20 0x7f7d30148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 -- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 msgr2=0x7f7d30153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d30153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 -- 172.21.15.89:0/4251242176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200094d0 con 0x7f7d300c8430 2023-12-07T10:02:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2f7fe640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d30153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:19.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d2e7fc640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 0x7f7d300c8d20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400e930 tx=0x7f7d2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24009690 con 0x7f7d300c8430 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2400ca00 con 0x7f7d300c8430 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2400cd70 con 0x7f7d300c8430 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d300aa3b0 con 0x7f7d300c8430 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.203+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d300aa950 con 0x7f7d300c8430 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.207+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3004e890 con 0x7f7d300c8430 2023-12-07T10:02:19.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.207+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7d24013470 con 0x7f7d300c8430 2023-12-07T10:02:19.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.207+0000 7f7d177fe640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d1c0668d0 0x7f7d1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.207+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d240848b0 con 0x7f7d300c8430 2023-12-07T10:02:19.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.207+0000 7f7d2effd640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d1c0668d0 0x7f7d1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.207+0000 7f7d2effd640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d1c0668d0 0x7f7d1c068d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7d200af000 tx=0x7f7d200b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.211+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d24051990 con 0x7f7d300c8430 2023-12-07T10:02:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d300c7630 con 0x7f7d300c8430 2023-12-07T10:02:19.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d177fe640 1 -- 172.21.15.89:0/4251242176 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d24054fb0 con 0x7f7d300c8430 2023-12-07T10:02:19.367 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d1c0668d0 msgr2=0x7f7d1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d1c0668d0 0x7f7d1c068d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7d200af000 tx=0x7f7d200b6040 comp rx=0 tx=0).stop 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 msgr2=0x7f7d300c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 0x7f7d300c8d20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400e930 tx=0x7f7d2400edf0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 shutdown_connections 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d30151d80 0x7f7d30153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d300c8430 0x7f7d300c8d20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7d1c0668d0 0x7f7d1c068d90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 --2- 172.21.15.89:0/4251242176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7d300c7f20 0x7f7d30148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 >> 172.21.15.89:0/4251242176 conn(0x7f7d300abd00 msgr2=0x7f7d30150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:19.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 shutdown_connections 2023-12-07T10:02:19.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.363+0000 7f7d352bb640 1 -- 172.21.15.89:0/4251242176 wait complete. 2023-12-07T10:02:19.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:19.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c68817640 1 Processor -- start 2023-12-07T10:02:19.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c68817640 1 -- start start 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c68817640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c640c0370 0x7f6c6406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c68817640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6406de00 con 0x7f6c640a8470 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c68817640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c64070390 con 0x7f6c6414eaf0 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c68817640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6414eed0 con 0x7f6c640c0370 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c62d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6c640a8470 0x7f6c6406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54768/0 (socket says 172.21.15.89:54768) 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c62d9d640 1 -- 172.21.15.89:0/866231642 learned_addr learned my addr 172.21.15.89:0/866231642 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:19.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.523+0000 7f6c59d9b640 1 --2- 172.21.15.89:0/866231642 >> v2:172.21.15.97:3300/0 conn(0x7f6c640c0370 0x7f6c6406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c61d9b640 1 -- 172.21.15.89:0/866231642 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113343384 0 0) 0x7f6c6406de00 con 0x7f6c640a8470 2023-12-07T10:02:19.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c61d9b640 1 -- 172.21.15.89:0/866231642 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c50003530 con 0x7f6c640a8470 2023-12-07T10:02:19.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c59d9b640 1 -- 172.21.15.89:0/866231642 >> v1:172.21.15.97:6789/0 conn(0x7f6c6414eaf0 legacy=0x7f6c64151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c59d9b640 1 -- 172.21.15.89:0/866231642 >> v1:172.21.15.89:6789/0 conn(0x7f6c640a8470 legacy=0x7f6c6406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c59d9b640 1 -- 172.21.15.89:0/866231642 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64151270 con 0x7f6c640c0370 2023-12-07T10:02:19.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c59d9b640 1 --2- 172.21.15.89:0/866231642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c6406d110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097c0 tx=0x7f6c4c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24a9d50f8165b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c61d9b640 1 -- 172.21.15.89:0/866231642 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0ad660 con 0x7f6c640c0370 2023-12-07T10:02:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c61d9b640 1 -- 172.21.15.89:0/866231642 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0ad7c0 con 0x7f6c640c0370 2023-12-07T10:02:19.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.527+0000 7f6c61d9b640 1 -- 172.21.15.89:0/866231642 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0adb50 con 0x7f6c640c0370 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- 172.21.15.89:0/866231642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 msgr2=0x7f6c6406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 --2- 172.21.15.89:0/866231642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c6406d110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097c0 tx=0x7f6c4c01c360 comp rx=0 tx=0).stop 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- 172.21.15.89:0/866231642 shutdown_connections 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 --2- 172.21.15.89:0/866231642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c6406d110 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- 172.21.15.89:0/866231642 >> 172.21.15.89:0/866231642 conn(0x7f6c640c2a60 msgr2=0x7f6c640c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- 172.21.15.89:0/866231642 shutdown_connections 2023-12-07T10:02:19.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- 172.21.15.89:0/866231642 wait complete. 2023-12-07T10:02:19.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 Processor -- start 2023-12-07T10:02:19.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- start start 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 0x7f6c640c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c640bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c6414eaf0 0x7f6c640c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6413e720 con 0x7f6c640a8470 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6413d280 con 0x7f6c640c0370 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c68817640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6413cc10 con 0x7f6c6414eaf0 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 0x7f6c640c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 0x7f6c640c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36286/0 (socket says 172.21.15.89:36286) 2023-12-07T10:02:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 -- 172.21.15.89:0/1416706619 learned_addr learned my addr 172.21.15.89:0/1416706619 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c59d9b640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c640bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c62d9d640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c6414eaf0 0x7f6c640c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 -- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c6414eaf0 msgr2=0x7f6c640c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c6414eaf0 0x7f6c640c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 -- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 msgr2=0x7f6c640bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c640bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.531+0000 7f6c6259c640 1 -- 172.21.15.89:0/1416706619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009420 con 0x7f6c640a8470 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c6259c640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 0x7f6c640c0ab0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400c3c0 tx=0x7f6c5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540052d0 con 0x7f6c640a8470 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54005430 con 0x7f6c640a8470 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54003840 con 0x7f6c640a8470 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640c0ff0 con 0x7f6c640a8470 2023-12-07T10:02:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6413dcc0 con 0x7f6c640a8470 2023-12-07T10:02:19.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c640c1f20 con 0x7f6c640a8470 2023-12-07T10:02:19.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c540039a0 con 0x7f6c640a8470 2023-12-07T10:02:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c5b7fe640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c440668d0 0x7f6c44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c54083c60 con 0x7f6c640a8470 2023-12-07T10:02:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.535+0000 7f6c59d9b640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c440668d0 0x7f6c44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.539+0000 7f6c59d9b640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c440668d0 0x7f6c44068d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0af000 tx=0x7f6c4c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.539+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c640c1f20 con 0x7f6c640a8470 2023-12-07T10:02:19.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c640c1f20 con 0x7f6c640a8470 2023-12-07T10:02:19.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c5b7fe640 1 -- 172.21.15.89:0/1416706619 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v71) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6c640c1f20 con 0x7f6c640a8470 2023-12-07T10:02:19.695 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c440668d0 msgr2=0x7f6c44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c440668d0 0x7f6c44068d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0af000 tx=0x7f6c4c0a7000 comp rx=0 tx=0).stop 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 msgr2=0x7f6c640c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 0x7f6c640c0ab0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400c3c0 tx=0x7f6c5400c880 comp rx=0 tx=0).stop 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 shutdown_connections 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6c440668d0 0x7f6c44068d90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6c6414eaf0 0x7f6c640c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c640c0370 0x7f6c640bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 --2- 172.21.15.89:0/1416706619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c640a8470 0x7f6c640c0ab0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 >> 172.21.15.89:0/1416706619 conn(0x7f6c640c2a60 msgr2=0x7f6c64150590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 shutdown_connections 2023-12-07T10:02:19.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.691+0000 7f6c68817640 1 -- 172.21.15.89:0/1416706619 wait complete. 2023-12-07T10:02:19.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 Processor -- start 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 -- start start 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbf40c0370 0x7fdbf406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdbf40a8470 0x7fdbf406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf406de00 con 0x7fdbf414eaf0 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf4070390 con 0x7fdbf40c0370 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf91aa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf406db90 con 0x7fdbf40a8470 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbf40c0370 0x7fdbf406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf2d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdbf414eaf0 0x7fdbf4151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54782/0 (socket says 172.21.15.89:54782) 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf2d9d640 1 -- 172.21.15.89:0/1156722552 learned_addr learned my addr 172.21.15.89:0/1156722552 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf359e640 1 --2- 172.21.15.89:0/1156722552 >> v2:172.21.15.97:3300/0 conn(0x7fdbf40a8470 0x7fdbf406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf259c640 1 -- 172.21.15.89:0/1156722552 >> v2:172.21.15.97:3300/0 conn(0x7fdbf40a8470 msgr2=0x7fdbf406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf259c640 1 --2- 172.21.15.89:0/1156722552 >> v2:172.21.15.97:3300/0 conn(0x7fdbf40a8470 0x7fdbf406d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf259c640 1 -- 172.21.15.89:0/1156722552 >> v1:172.21.15.89:6789/0 conn(0x7fdbf414eaf0 legacy=0x7fdbf4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf259c640 1 -- 172.21.15.89:0/1156722552 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf414eed0 con 0x7fdbf40c0370 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf1d9b640 1 -- 172.21.15.89:0/1156722552 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342372565 0 0) 0x7fdbf406de00 con 0x7fdbf414eaf0 2023-12-07T10:02:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.851+0000 7fdbf359e640 1 --2- 172.21.15.89:0/1156722552 >> v2:172.21.15.97:3300/0 conn(0x7fdbf40a8470 0x7fdbf406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf259c640 1 --2- 172.21.15.89:0/1156722552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf40c0370 0x7fdbf406d110 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40c3910 tx=0x7fdbe801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f568b8f788b2be server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf1d9b640 1 -- 172.21.15.89:0/1156722552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80ad660 con 0x7fdbf40c0370 2023-12-07T10:02:19.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf1d9b640 1 -- 172.21.15.89:0/1156722552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe80ad7c0 con 0x7fdbf40c0370 2023-12-07T10:02:19.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf1d9b640 1 -- 172.21.15.89:0/1156722552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80adb50 con 0x7fdbf40c0370 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 -- 172.21.15.89:0/1156722552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf40c0370 msgr2=0x7fdbf406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/1156722552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf40c0370 0x7fdbf406d110 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40c3910 tx=0x7fdbe801c340 comp rx=0 tx=0).stop 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 -- 172.21.15.89:0/1156722552 shutdown_connections 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/1156722552 >> v2:172.21.15.97:3300/0 conn(0x7fdbf40a8470 0x7fdbf406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/1156722552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf40c0370 0x7fdbf406d110 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 -- 172.21.15.89:0/1156722552 >> 172.21.15.89:0/1156722552 conn(0x7fdbf40c2a60 msgr2=0x7fdbf40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 -- 172.21.15.89:0/1156722552 shutdown_connections 2023-12-07T10:02:19.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 -- 172.21.15.89:0/1156722552 wait complete. 2023-12-07T10:02:19.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.855+0000 7fdbf91aa640 1 Processor -- start 2023-12-07T10:02:19.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- start start 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf40a8470 0x7fdbf40c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf40c0370 0x7fdbf40c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 0x7fdbf41436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40c4090 con 0x7fdbf414eaf0 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40c5d80 con 0x7fdbf40c0370 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41eff50 con 0x7fdbf40a8470 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 0x7fdbf41436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 0x7fdbf41436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36310/0 (socket says 172.21.15.89:36310) 2023-12-07T10:02:19.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 -- 172.21.15.89:0/2181299154 learned_addr learned my addr 172.21.15.89:0/2181299154 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf2d9d640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf40a8470 0x7fdbf40c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf259c640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf40c0370 0x7fdbf40c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 -- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf40a8470 msgr2=0x7fdbf40c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf40a8470 0x7fdbf40c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 -- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf40c0370 msgr2=0x7fdbf40c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf40c0370 0x7fdbf40c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 -- 172.21.15.89:0/2181299154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8009420 con 0x7fdbf414eaf0 2023-12-07T10:02:19.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf359e640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 0x7fdbf41436e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdbec007e70 tx=0x7fdbec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec015600 con 0x7fdbf414eaf0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00f040 con 0x7fdbf414eaf0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf41f0230 con 0x7fdbf414eaf0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0159a0 con 0x7fdbf414eaf0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf41f07f0 con 0x7fdbf414eaf0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.859+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf404e890 con 0x7fdbf414eaf0 2023-12-07T10:02:19.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.863+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdbec01e3b0 con 0x7fdbf414eaf0 2023-12-07T10:02:19.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.863+0000 7fdbdb7fe640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdbe00668d0 0x7fdbe0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:19.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.863+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdbec084b70 con 0x7fdbf414eaf0 2023-12-07T10:02:19.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.863+0000 7fdbf2d9d640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdbe00668d0 0x7fdbe0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:19.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.863+0000 7fdbf2d9d640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdbe00668d0 0x7fdbe0068d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000f70 tx=0x7fdbe4007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:19.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:19.867+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbec051a40 con 0x7fdbf414eaf0 2023-12-07T10:02:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.015+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fdbf415cbc0 con 0x7fdbf414eaf0 2023-12-07T10:02:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.015+0000 7fdbdb7fe640 1 -- 172.21.15.89:0/2181299154 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v71) v1 ==== 101+0+11 (secure 0 0 0) 0x7fdbec01a0a0 con 0x7fdbf414eaf0 2023-12-07T10:02:20.022 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdbe00668d0 msgr2=0x7fdbe0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdbe00668d0 0x7fdbe0068d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000f70 tx=0x7fdbe4007c10 comp rx=0 tx=0).stop 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 msgr2=0x7fdbf41436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 0x7fdbf41436e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdbec007e70 tx=0x7fdbec00d4a0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 shutdown_connections 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf414eaf0 0x7fdbf41436e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf40c0370 0x7fdbf40c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fdbe00668d0 0x7fdbe0068d90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 --2- 172.21.15.89:0/2181299154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdbf40a8470 0x7fdbf40c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 >> 172.21.15.89:0/2181299154 conn(0x7fdbf40c2a60 msgr2=0x7fdbf40bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 shutdown_connections 2023-12-07T10:02:20.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.019+0000 7fdbf91aa640 1 -- 172.21.15.89:0/2181299154 wait complete. 2023-12-07T10:02:20.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:02:20.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.175+0000 7f0242ac9640 1 Processor -- start 2023-12-07T10:02:20.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.175+0000 7f0242ac9640 1 -- start start 2023-12-07T10:02:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0242ac9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f023c14e9d0 0x7f023c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0242ac9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f023c070b80 0x7f023c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0242ac9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c06d320 con 0x7f023c0c1f20 2023-12-07T10:02:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0242ac9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c0721b0 con 0x7f023c14e9d0 2023-12-07T10:02:20.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0242ac9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c0c2830 con 0x7f023c070b80 2023-12-07T10:02:20.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0241066640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f023c0c1f20 0x7f023c06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54786/0 (socket says 172.21.15.89:54786) 2023-12-07T10:02:20.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0241066640 1 -- 172.21.15.89:0/1415589976 learned_addr learned my addr 172.21.15.89:0/1415589976 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:20.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0240865640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f023c14e9d0 0x7f023c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0240865640 1 -- 172.21.15.89:0/1415589976 >> v2:172.21.15.97:3300/0 conn(0x7f023c070b80 msgr2=0x7f023c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:20.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0233fff640 1 --2- 172.21.15.89:0/1415589976 >> v2:172.21.15.97:3300/0 conn(0x7f023c070b80 0x7f023c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0240865640 1 --2- 172.21.15.89:0/1415589976 >> v2:172.21.15.97:3300/0 conn(0x7f023c070b80 0x7f023c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0240865640 1 -- 172.21.15.89:0/1415589976 >> v1:172.21.15.89:6789/0 conn(0x7f023c0c1f20 legacy=0x7f023c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0240865640 1 -- 172.21.15.89:0/1415589976 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c072450 con 0x7f023c14e9d0 2023-12-07T10:02:20.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f0233fff640 1 --2- 172.21.15.89:0/1415589976 >> v2:172.21.15.97:3300/0 conn(0x7f023c070b80 0x7f023c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:20.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.179+0000 7f02337fe640 1 -- 172.21.15.89:0/1415589976 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711954653 0 0) 0x7f023c06d320 con 0x7f023c0c1f20 2023-12-07T10:02:20.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0240865640 1 --2- 172.21.15.89:0/1415589976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c151e60 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f023c06e420 tx=0x7f023801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95699655b875dbaa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:20.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f02337fe640 1 -- 172.21.15.89:0/1415589976 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380ab600 con 0x7f023c14e9d0 2023-12-07T10:02:20.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f02337fe640 1 -- 172.21.15.89:0/1415589976 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380a7050 con 0x7f023c14e9d0 2023-12-07T10:02:20.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f02337fe640 1 -- 172.21.15.89:0/1415589976 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380ab980 con 0x7f023c14e9d0 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- 172.21.15.89:0/1415589976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 msgr2=0x7f023c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 --2- 172.21.15.89:0/1415589976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c151e60 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f023c06e420 tx=0x7f023801c3d0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- 172.21.15.89:0/1415589976 shutdown_connections 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 --2- 172.21.15.89:0/1415589976 >> v2:172.21.15.97:3300/0 conn(0x7f023c070b80 0x7f023c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 --2- 172.21.15.89:0/1415589976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c151e60 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- 172.21.15.89:0/1415589976 >> 172.21.15.89:0/1415589976 conn(0x7f023c0c2ad0 msgr2=0x7f023c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- 172.21.15.89:0/1415589976 shutdown_connections 2023-12-07T10:02:20.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- 172.21.15.89:0/1415589976 wait complete. 2023-12-07T10:02:20.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 Processor -- start 2023-12-07T10:02:20.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- start start 2023-12-07T10:02:20.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023c070b80 0x7f023c071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f023c0c1f20 0x7f023c1eae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c1eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1ee400 con 0x7f023c14e9d0 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1eeca0 con 0x7f023c0c1f20 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.183+0000 7f0242ac9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1558f0 con 0x7f023c070b80 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c1eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c1eb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36338/0 (socket says 172.21.15.89:36338) 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 -- 172.21.15.89:0/480128427 learned_addr learned my addr 172.21.15.89:0/480128427 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0240865640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023c070b80 0x7f023c071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0233fff640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f023c0c1f20 0x7f023c1eae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 -- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023c070b80 msgr2=0x7f023c071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023c070b80 0x7f023c071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 -- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f023c0c1f20 msgr2=0x7f023c1eae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f023c0c1f20 0x7f023c1eae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 -- 172.21.15.89:0/480128427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0238009420 con 0x7f023c14e9d0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0240865640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023c070b80 0x7f023c071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0241066640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c1eb3d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f023400c810 tx=0x7f023400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400a640 con 0x7f023c14e9d0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400a7c0 con 0x7f023c14e9d0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c14ab80 con 0x7f023c14e9d0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400ab70 con 0x7f023c14e9d0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c1ee650 con 0x7f023c14e9d0 2023-12-07T10:02:20.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c148ab0 con 0x7f023c14e9d0 2023-12-07T10:02:20.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f023400acd0 con 0x7f023c14e9d0 2023-12-07T10:02:20.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f02317fa640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f02280668d0 0x7f0228068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0234083f40 con 0x7f023c14e9d0 2023-12-07T10:02:20.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.187+0000 7f0240865640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f02280668d0 0x7f0228068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.191+0000 7f0240865640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f02280668d0 0x7f0228068d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f02380ad000 tx=0x7f02380a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:20.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.191+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0234050f40 con 0x7f023c14e9d0 2023-12-07T10:02:20.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f023c04e890 con 0x7f023c14e9d0 2023-12-07T10:02:20.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f02317fa640 1 -- 172.21.15.89:0/480128427 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0234018020 con 0x7f023c14e9d0 2023-12-07T10:02:20.365 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:02:20.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f02280668d0 msgr2=0x7f0228068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f02280668d0 0x7f0228068d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f02380ad000 tx=0x7f02380a6000 comp rx=0 tx=0).stop 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 msgr2=0x7f023c1eb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c1eb3d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f023400c810 tx=0x7f023400ccd0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 shutdown_connections 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c14e9d0 0x7f023c1eb3d0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f023c0c1f20 0x7f023c1eae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f02280668d0 0x7f0228068d90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 --2- 172.21.15.89:0/480128427 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f023c070b80 0x7f023c071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 >> 172.21.15.89:0/480128427 conn(0x7f023c0c2ad0 msgr2=0x7f023c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 shutdown_connections 2023-12-07T10:02:20.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.359+0000 7f0242ac9640 1 -- 172.21.15.89:0/480128427 wait complete. 2023-12-07T10:02:20.386 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T10:02:20.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:20.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:20.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:02:20.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:20.447 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T10:02:20.467 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:20.467 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:20.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:02:20.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:02:20.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.691+0000 7f1949cfe640 1 Processor -- start 2023-12-07T10:02:20.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.691+0000 7f1949cfe640 1 -- start start 2023-12-07T10:02:20.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1949cfe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f19440700a0 0x7f194406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1949cfe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1944072780 con 0x7f19440aacd0 2023-12-07T10:02:20.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1949cfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440ac160 con 0x7f1944154870 2023-12-07T10:02:20.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1949cfe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19440abe80 con 0x7f19440700a0 2023-12-07T10:02:20.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f19437fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f19440aacd0 0x7f1944154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54788/0 (socket says 172.21.15.89:54788) 2023-12-07T10:02:20.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f19437fe640 1 -- 172.21.15.89:0/3185459516 learned_addr learned my addr 172.21.15.89:0/3185459516 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:20.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 --2- 172.21.15.89:0/3185459516 >> v2:172.21.15.97:3300/0 conn(0x7f19440700a0 0x7f194406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48731333 0 0) 0x7f1944072780 con 0x7f19440aacd0 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1930003450 con 0x7f19440aacd0 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547376235 0 0) 0x7f1930003450 con 0x7f19440aacd0 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 >> v2:172.21.15.97:3300/0 conn(0x7f19440700a0 msgr2=0x7f194406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 --2- 172.21.15.89:0/3185459516 >> v2:172.21.15.97:3300/0 conn(0x7f19440700a0 0x7f194406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 >> v1:172.21.15.97:6789/0 conn(0x7f1944154870 legacy=0x7f194406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944154cf0 con 0x7f19440aacd0 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f1934001680 con 0x7f19440aacd0 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 >> v1:172.21.15.89:6789/0 conn(0x7f19440aacd0 legacy=0x7f1944154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1930003a70 0x7f1930003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1930008860 0x7f193000ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193000b530 0x7f193000d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19440abe80 con 0x7f193000b530 2023-12-07T10:02:20.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193000e2d0 con 0x7f1930003a70 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193000e490 con 0x7f1930008860 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193000b530 0x7f193000d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f19437fe640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1930003a70 0x7f1930003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f193bfff640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1930008860 0x7f193000ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 -- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1930008860 msgr2=0x7f193000ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1930008860 0x7f193000ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 -- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1930003a70 msgr2=0x7f1930003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1930003a70 0x7f1930003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.695+0000 7f1943fff640 1 -- 172.21.15.89:0/3185459516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930003450 con 0x7f193000b530 2023-12-07T10:02:20.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1943fff640 1 -- 172.21.15.89:0/3185459516 reap_dead start 2023-12-07T10:02:20.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1943fff640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193000b530 0x7f193000d9f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f193c009fc0 tx=0x7f193c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f02f72d7b5a2a4d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:20.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a5bb0 con 0x7f193000b530 2023-12-07T10:02:20.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00f040 con 0x7f193000b530 2023-12-07T10:02:20.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1942ffd640 1 -- 172.21.15.89:0/3185459516 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0039a0 con 0x7f193000b530 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 -- 172.21.15.89:0/3185459516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193000b530 msgr2=0x7f193000d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193000b530 0x7f193000d9f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f193c009fc0 tx=0x7f193c01cca0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 -- 172.21.15.89:0/3185459516 shutdown_connections 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3185459516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f193000b530 0x7f193000d9f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 -- 172.21.15.89:0/3185459516 >> 172.21.15.89:0/3185459516 conn(0x7f19440c2ad0 msgr2=0x7f19440c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 -- 172.21.15.89:0/3185459516 shutdown_connections 2023-12-07T10:02:20.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 -- 172.21.15.89:0/3185459516 wait complete. 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 Processor -- start 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.699+0000 7f1949cfe640 1 -- start start 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f193000b530 0x7f19441ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f194414ea30 0x7f1944149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 0x7f194414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441540d0 con 0x7f194414a3b0 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944153d30 con 0x7f194414ea30 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19441eda30 con 0x7f193000b530 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 0x7f194414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 0x7f194414f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36350/0 (socket says 172.21.15.89:36350) 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 -- 172.21.15.89:0/3419512888 learned_addr learned my addr 172.21.15.89:0/3419512888 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f193bfff640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f194414ea30 0x7f1944149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f19437fe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f193000b530 0x7f19441ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 -- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f193000b530 msgr2=0x7f19441ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f193000b530 0x7f19441ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 -- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f194414ea30 msgr2=0x7f1944149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f194414ea30 0x7f1944149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 -- 172.21.15.89:0/3419512888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19441edd10 con 0x7f194414a3b0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1943fff640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 0x7f194414f550 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f193c0987d0 tx=0x7f193c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a5dc0 con 0x7f194414a3b0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c0039a0 con 0x7f194414a3b0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c003d90 con 0x7f194414a3b0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19440c4e90 con 0x7f194414a3b0 2023-12-07T10:02:20.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19441ed620 con 0x7f194414a3b0 2023-12-07T10:02:20.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.703+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944154210 con 0x7f194414a3b0 2023-12-07T10:02:20.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.707+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f193c0ae930 con 0x7f194414a3b0 2023-12-07T10:02:20.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.707+0000 7f1940ff9640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19240668d0 0x7f1924068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:20.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.707+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f193c11f3d0 con 0x7f194414a3b0 2023-12-07T10:02:20.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.707+0000 7f19437fe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19240668d0 0x7f1924068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:20.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.707+0000 7f19437fe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19240668d0 0x7f1924068d90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1934001ca0 tx=0x7f1934001c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:20.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.711+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1944154210 con 0x7f194414a3b0 2023-12-07T10:02:20.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1944154210 con 0x7f194414a3b0 2023-12-07T10:02:20.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1940ff9640 1 -- 172.21.15.89:0/3419512888 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f1944154210 con 0x7f194414a3b0 2023-12-07T10:02:20.897 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:02:20.897 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19240668d0 msgr2=0x7f1924068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19240668d0 0x7f1924068d90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1934001ca0 tx=0x7f1934001c10 comp rx=0 tx=0).stop 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 msgr2=0x7f194414f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 0x7f194414f550 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f193c0987d0 tx=0x7f193c009750 comp rx=0 tx=0).stop 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 shutdown_connections 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194414a3b0 0x7f194414f550 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f194414ea30 0x7f1944149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f19240668d0 0x7f1924068d90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.891+0000 7f1949cfe640 1 --2- 172.21.15.89:0/3419512888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f193000b530 0x7f19441ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.895+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 >> 172.21.15.89:0/3419512888 conn(0x7f19440c2ad0 msgr2=0x7f19440bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.895+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 shutdown_connections 2023-12-07T10:02:20.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:20.895+0000 7f1949cfe640 1 -- 172.21.15.89:0/3419512888 wait complete. 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:02:20.918 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.1MHbLzQ9OJ 2023-12-07T10:02:20.918 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:02:20.927 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.DCsl4cA3xP 2023-12-07T10:02:20.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /tmp/tmp.1MHbLzQ9OJ /tmp/tmp.DCsl4cA3xP 2023-12-07T10:02:20.995 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.DCsl4cA3xP 2023-12-07T10:02:21.115 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.DCsl4cA3xP is 226B 2023-12-07T10:02:21.131 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.DCsl4cA3xP 2023-12-07T10:02:21.139 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-07T10:02:21.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:02:21.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.140 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-07T10:02:21.191 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-07T10:02:21.192 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:8a:8a:56:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:02:21.193 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:21.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.194 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:02:21.253 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-07T10:02:21.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.255 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-07T10:02:21.309 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-07T10:02:21.309 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:02:21.309 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:02:21.309 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:02:21.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.310 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-07T10:02:21.310 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-07T10:02:21.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:02:21.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:02:21.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:02:21.311 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-07T10:02:21.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.405 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:02:21.413 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:02:21.414 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:02:21.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-07T10:02:21.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:21.479 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:21.531 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T10:02:21.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:21.531 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:21.582 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:21.582 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/tmp/tmp.1MHbLzQ9OJ of=/dev/stdout 2023-12-07T10:02:21.634 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-07T10:02:21.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:21.728 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,secret=AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:21.728 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:21.728 INFO:teuthology.orchestra.run.smithi089.stdout:keyring.get_secret failed 2023-12-07T10:02:21.743 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,secret=AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:21.743 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:21.743 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:02:21.743 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: testuser@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs=/ 2023-12-07T10:02:21.743 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:02:21.747 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:02:21.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:21.765 INFO:teuthology.orchestra.run.smithi089.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-07T10:02:21.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T10:02:21.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:21.767 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:02:21.825 INFO:teuthology.orchestra.run.smithi089.stdout:client5987 2023-12-07T10:02:21.825 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:21.825 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:21.875 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-07T10:02:21.885 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.SVNH4EjNHT 2023-12-07T10:02:21.885 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:21.885 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/tmp/tmp.SVNH4EjNHT 2023-12-07T10:02:21.940 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:21.941 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:21.997 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:21.997 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:22.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.183+0000 7f9a126fe640 1 Processor -- start 2023-12-07T10:02:22.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.183+0000 7f9a126fe640 1 -- start start 2023-12-07T10:02:22.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a126fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f9a0c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a126fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c072780 con 0x7f9a0c0aacd0 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a126fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0ac160 con 0x7f9a0c154870 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a126fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0abe80 con 0x7f9a0c0700a0 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9a0c0aacd0 0x7f9a0c154160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54794/0 (socket says 172.21.15.89:54794) 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0bfff640 1 -- 172.21.15.89:0/3537618168 learned_addr learned my addr 172.21.15.89:0/3537618168 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f9a0c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110282837 0 0) 0x7f9a0c072780 con 0x7f9a0c0aacd0 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003530 con 0x7f9a0c0aacd0 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823583468 0 0) 0x7f99f4003530 con 0x7f9a0c0aacd0 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 msgr2=0x7f9a0c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f9a0c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 >> v1:172.21.15.97:6789/0 conn(0x7f9a0c154870 legacy=0x7f9a0c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c154cf0 con 0x7f9a0c0aacd0 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f99fc001680 con 0x7f9a0c0aacd0 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 >> v1:172.21.15.89:6789/0 conn(0x7f9a0c0aacd0 legacy=0x7f9a0c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f99f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99f4003f80 0x7f99f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f99f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0abe80 con 0x7f99f4004d10 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f400dd90 con 0x7f99f4003f80 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f400df50 con 0x7f9a0c0700a0 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f99f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0bfff640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f99f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0b7fe640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99f4003f80 0x7f99f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 -- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 msgr2=0x7f99f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:22.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f99f40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 -- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99f4003f80 msgr2=0x7f99f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:22.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99f4003f80 0x7f99f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a10c9b640 1 -- 172.21.15.89:0/3537618168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4003530 con 0x7f99f4004d10 2023-12-07T10:02:22.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.187+0000 7f9a0bfff640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c0700a0 0x7f99f40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a10c9b640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f99f4005190 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009fc0 tx=0x7f9a0401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa68e1398d955a1d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040a5b60 con 0x7f99f4004d10 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400f040 con 0x7f99f4004d10 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a0affd640 1 -- 172.21.15.89:0/3537618168 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040ad440 con 0x7f99f4004d10 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a126fe640 1 -- 172.21.15.89:0/3537618168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 msgr2=0x7f99f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3537618168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f99f4005190 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009fc0 tx=0x7f9a0401cc60 comp rx=0 tx=0).stop 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a10c9b640 1 -- 172.21.15.89:0/3537618168 reap_dead start 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a126fe640 1 -- 172.21.15.89:0/3537618168 shutdown_connections 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a126fe640 1 -- 172.21.15.89:0/3537618168 >> 172.21.15.89:0/3537618168 conn(0x7f9a0c0c2ad0 msgr2=0x7f9a0c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a126fe640 1 -- 172.21.15.89:0/3537618168 shutdown_connections 2023-12-07T10:02:22.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.191+0000 7f9a126fe640 1 -- 172.21.15.89:0/3537618168 wait complete. 2023-12-07T10:02:22.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 Processor -- start 2023-12-07T10:02:22.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- start start 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f9a0c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c14ea30 0x7f9a0c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a0c152850 0x7f9a0c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1523c0 con 0x7f99f4004d10 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1542d0 con 0x7f9a0c152850 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1545b0 con 0x7f9a0c14ea30 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f9a0c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f9a0c150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36370/0 (socket says 172.21.15.89:36370) 2023-12-07T10:02:22.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 -- 172.21.15.89:0/3317772109 learned_addr learned my addr 172.21.15.89:0/3317772109 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a10c9b640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a0c152850 0x7f9a0c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0b7fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c14ea30 0x7f9a0c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 -- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c14ea30 msgr2=0x7f9a0c150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c14ea30 0x7f9a0c150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 -- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a0c152850 msgr2=0x7f9a0c152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a0c152850 0x7f9a0c152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 -- 172.21.15.89:0/3317772109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c152050 con 0x7f99f4004d10 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0b7fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c14ea30 0x7f9a0c150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a0bfff640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f9a0c150a00 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0118e0 tx=0x7f99fc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00fb60 con 0x7f99f4004d10 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00fcc0 con 0x7f99f4004d10 2023-12-07T10:02:22.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c14b5b0 con 0x7f99f4004d10 2023-12-07T10:02:22.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc015610 con 0x7f99f4004d10 2023-12-07T10:02:22.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c153410 con 0x7f99f4004d10 2023-12-07T10:02:22.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.195+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c1521e0 con 0x7f99f4004d10 2023-12-07T10:02:22.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.199+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f99fc015770 con 0x7f99f4004d10 2023-12-07T10:02:22.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.199+0000 7f9a08ff9640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f99f8066900 0x7f99f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.199+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99fc087d40 con 0x7f99f4004d10 2023-12-07T10:02:22.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.199+0000 7f9a0b7fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f99f8066900 0x7f99f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.199+0000 7f9a0b7fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f99f8066900 0x7f99f8068dc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9a00007fd0 tx=0x7f9a00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.203+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99fc054c10 con 0x7f99f4004d10 2023-12-07T10:02:22.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.359+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a0c04e890 con 0x7f99f4004d10 2023-12-07T10:02:22.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.359+0000 7f9a08ff9640 1 -- 172.21.15.89:0/3317772109 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7f99fc058230 con 0x7f99f4004d10 2023-12-07T10:02:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:22.366 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f99f8066900 msgr2=0x7f99f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f99f8066900 0x7f99f8068dc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9a00007fd0 tx=0x7f9a00009040 comp rx=0 tx=0).stop 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 msgr2=0x7f9a0c150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f9a0c150a00 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0118e0 tx=0x7f99fc011da0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 shutdown_connections 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a0c152850 0x7f9a0c152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f99f8066900 0x7f99f8068dc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9a0c14ea30 0x7f9a0c150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 --2- 172.21.15.89:0/3317772109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f4004d10 0x7f9a0c150a00 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 >> 172.21.15.89:0/3317772109 conn(0x7f9a0c0c2ad0 msgr2=0x7f9a0c0aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 shutdown_connections 2023-12-07T10:02:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.363+0000 7f9a126fe640 1 -- 172.21.15.89:0/3317772109 wait complete. 2023-12-07T10:02:22.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:22.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:22.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 Processor -- start 2023-12-07T10:02:22.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 -- start start 2023-12-07T10:02:22.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b0151d80 0x7fb8b00c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8b00c8430 0x7fb8b006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb8b00c7f20 0x7fb8b006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b006cf70 con 0x7fb8b00c8430 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b0152160 con 0x7fb8b00c7f20 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8b4dd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00c6a30 con 0x7fb8b0151d80 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8b00c8430 0x7fb8b006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8b00c8430 0x7fb8b006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36382/0 (socket says 172.21.15.89:36382) 2023-12-07T10:02:22.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 -- 172.21.15.89:0/4292086170 learned_addr learned my addr 172.21.15.89:0/4292086170 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8aed9d640 1 --2- 172.21.15.89:0/4292086170 >> v2:172.21.15.97:3300/0 conn(0x7fb8b00c7f20 0x7fb8b006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8ae59c640 1 --2- 172.21.15.89:0/4292086170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b0151d80 0x7fb8b00c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 -- 172.21.15.89:0/4292086170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b0151d80 msgr2=0x7fb8b00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 --2- 172.21.15.89:0/4292086170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b0151d80 0x7fb8b00c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 -- 172.21.15.89:0/4292086170 >> v2:172.21.15.97:3300/0 conn(0x7fb8b00c7f20 msgr2=0x7fb8b006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 --2- 172.21.15.89:0/4292086170 >> v2:172.21.15.97:3300/0 conn(0x7fb8b00c7f20 0x7fb8b006bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.523+0000 7fb8a5d9b640 1 -- 172.21.15.89:0/4292086170 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00c72d0 con 0x7fb8b00c8430 2023-12-07T10:02:22.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8a5d9b640 1 --2- 172.21.15.89:0/4292086170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b00c8430 0x7fb8b006b720 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00bdb20 tx=0x7fb89801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1428e8d342f7ddf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8add9b640 1 -- 172.21.15.89:0/4292086170 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980ab600 con 0x7fb8b00c8430 2023-12-07T10:02:22.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8add9b640 1 -- 172.21.15.89:0/4292086170 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8980ab760 con 0x7fb8b00c8430 2023-12-07T10:02:22.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8add9b640 1 -- 172.21.15.89:0/4292086170 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980abaf0 con 0x7fb8b00c8430 2023-12-07T10:02:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/4292086170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b00c8430 msgr2=0x7fb8b006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/4292086170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b00c8430 0x7fb8b006b720 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00bdb20 tx=0x7fb89801c440 comp rx=0 tx=0).stop 2023-12-07T10:02:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/4292086170 shutdown_connections 2023-12-07T10:02:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/4292086170 >> v2:172.21.15.97:3300/0 conn(0x7fb8b00c7f20 0x7fb8b006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/4292086170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b00c8430 0x7fb8b006b720 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/4292086170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b0151d80 0x7fb8b00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/4292086170 >> 172.21.15.89:0/4292086170 conn(0x7fb8b00abd00 msgr2=0x7fb8b00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/4292086170 shutdown_connections 2023-12-07T10:02:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.527+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/4292086170 wait complete. 2023-12-07T10:02:22.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 Processor -- start 2023-12-07T10:02:22.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 -- start start 2023-12-07T10:02:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b00c7f20 0x7fb8b00ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8b00c8430 0x7fb8b00c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 0x7fb8b01ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b01548c0 con 0x7fb8b0151d80 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0153640 con 0x7fb8b00c8430 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8b4dd1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0152530 con 0x7fb8b00c7f20 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 0x7fb8b01ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 0x7fb8b01ed250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36386/0 (socket says 172.21.15.89:36386) 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 -- 172.21.15.89:0/750062069 learned_addr learned my addr 172.21.15.89:0/750062069 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8ae59c640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b00c7f20 0x7fb8b00ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8a5d9b640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8b00c8430 0x7fb8b00c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 -- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b00c7f20 msgr2=0x7fb8b00ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b00c7f20 0x7fb8b00ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 -- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8b00c8430 msgr2=0x7fb8b00c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8b00c8430 0x7fb8b00c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 -- 172.21.15.89:0/750062069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980094d0 con 0x7fb8b0151d80 2023-12-07T10:02:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8aed9d640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 0x7fb8b01ed250 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8007d10 tx=0x7fb8a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.531+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8014420 con 0x7fb8b0151d80 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80145a0 con 0x7fb8b0151d80 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b01527d0 con 0x7fb8b0151d80 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8014950 con 0x7fb8b0151d80 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b01544e0 con 0x7fb8b0151d80 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b0154a00 con 0x7fb8b0151d80 2023-12-07T10:02:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb8a8014ab0 con 0x7fb8b0151d80 2023-12-07T10:02:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8a77fe640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb8900668d0 0x7fb890068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb8a8084ef0 con 0x7fb8b0151d80 2023-12-07T10:02:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8ae59c640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb8900668d0 0x7fb890068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.535+0000 7fb8ae59c640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb8900668d0 0x7fb890068d90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00c5c40 tx=0x7fb8a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.539+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8b0154a00 con 0x7fb8b0151d80 2023-12-07T10:02:22.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8b0154a00 con 0x7fb8b0151d80 2023-12-07T10:02:22.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8a77fe640 1 -- 172.21.15.89:0/750062069 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8b0154a00 con 0x7fb8b0151d80 2023-12-07T10:02:22.697 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb8900668d0 msgr2=0x7fb890068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb8900668d0 0x7fb890068d90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00c5c40 tx=0x7fb8a0008040 comp rx=0 tx=0).stop 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 msgr2=0x7fb8b01ed250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 0x7fb8b01ed250 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8007d10 tx=0x7fb8a800e4b0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 shutdown_connections 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b0151d80 0x7fb8b01ed250 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8b00c8430 0x7fb8b00c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb8900668d0 0x7fb890068d90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 --2- 172.21.15.89:0/750062069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb8b00c7f20 0x7fb8b00ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 >> 172.21.15.89:0/750062069 conn(0x7fb8b00abd00 msgr2=0x7fb8b00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 shutdown_connections 2023-12-07T10:02:22.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.691+0000 7fb8b4dd1640 1 -- 172.21.15.89:0/750062069 wait complete. 2023-12-07T10:02:22.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:22.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.851+0000 7f035458d640 1 Processor -- start 2023-12-07T10:02:22.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.851+0000 7f035458d640 1 -- start start 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f035458d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f034c0a86d0 0x7f034c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f035458d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f034c14fd00 0x7f034c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f035458d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c152d90 con 0x7f034c156600 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f035458d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c152480 con 0x7f034c14fd00 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f035458d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0a9760 con 0x7f034c0a86d0 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f034c14fd00 0x7f034c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f034c14fd00 0x7f034c0aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36396/0 (socket says 172.21.15.89:36396) 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 -- 172.21.15.89:0/768542578 learned_addr learned my addr 172.21.15.89:0/768542578 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:22.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352329640 1 --2- 172.21.15.89:0/768542578 >> v2:172.21.15.97:3300/0 conn(0x7f034c0a86d0 0x7f034c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 -- 172.21.15.89:0/768542578 >> v2:172.21.15.97:3300/0 conn(0x7f034c0a86d0 msgr2=0x7f034c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:22.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 --2- 172.21.15.89:0/768542578 >> v2:172.21.15.97:3300/0 conn(0x7f034c0a86d0 0x7f034c0a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 -- 172.21.15.89:0/768542578 >> v1:172.21.15.97:6789/0 conn(0x7f034c156600 legacy=0x7f034c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.855+0000 7f0352b2a640 1 -- 172.21.15.89:0/768542578 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c152740 con 0x7f034c14fd00 2023-12-07T10:02:22.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f0352b2a640 1 --2- 172.21.15.89:0/768542578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c14fd00 0x7f034c0aae40 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0344009e50 tx=0x7f034401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4e5ddf7eb3f28c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f0351327640 1 -- 172.21.15.89:0/768542578 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440a5780 con 0x7f034c14fd00 2023-12-07T10:02:22.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f0351327640 1 -- 172.21.15.89:0/768542578 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03440a58e0 con 0x7f034c14fd00 2023-12-07T10:02:22.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f0351327640 1 -- 172.21.15.89:0/768542578 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440a5c70 con 0x7f034c14fd00 2023-12-07T10:02:22.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 -- 172.21.15.89:0/768542578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c14fd00 msgr2=0x7f034c0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 --2- 172.21.15.89:0/768542578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c14fd00 0x7f034c0aae40 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0344009e50 tx=0x7f034401c9d0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 -- 172.21.15.89:0/768542578 shutdown_connections 2023-12-07T10:02:22.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 --2- 172.21.15.89:0/768542578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c14fd00 0x7f034c0aae40 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 --2- 172.21.15.89:0/768542578 >> v2:172.21.15.97:3300/0 conn(0x7f034c0a86d0 0x7f034c0a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 -- 172.21.15.89:0/768542578 >> 172.21.15.89:0/768542578 conn(0x7f034c0c2a60 msgr2=0x7f034c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:22.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 -- 172.21.15.89:0/768542578 shutdown_connections 2023-12-07T10:02:22.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 -- 172.21.15.89:0/768542578 wait complete. 2023-12-07T10:02:22.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 Processor -- start 2023-12-07T10:02:22.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.859+0000 7f035458d640 1 -- start start 2023-12-07T10:02:22.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 0x7f034c1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f034c14fd00 0x7f034c06cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f034c156600 0x7f034c147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c13e6b0 con 0x7f034c0a86d0 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c149970 con 0x7f034c156600 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1475e0 con 0x7f034c14fd00 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 0x7f034c1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 0x7f034c1470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36404/0 (socket says 172.21.15.89:36404) 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 -- 172.21.15.89:0/4254281501 learned_addr learned my addr 172.21.15.89:0/4254281501 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352b2a640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f034c156600 0x7f034c147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0351b28640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f034c14fd00 0x7f034c06cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 -- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f034c14fd00 msgr2=0x7f034c06cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f034c14fd00 0x7f034c06cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 -- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f034c156600 msgr2=0x7f034c147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:22.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f034c156600 0x7f034c147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:22.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 -- 172.21.15.89:0/4254281501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009b30 con 0x7f034c0a86d0 2023-12-07T10:02:22.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352b2a640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f034c156600 0x7f034c147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:22.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0351b28640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f034c14fd00 0x7f034c06cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:22.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0352329640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 0x7f034c1470a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f034800e870 tx=0x7f034800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348009510 con 0x7f034c0a86d0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800eec0 con 0x7f034c0a86d0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034800cb40 con 0x7f034c0a86d0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c149620 con 0x7f034c0a86d0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c1eb860 con 0x7f034c0a86d0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c1eba50 con 0x7f034c0a86d0 2023-12-07T10:02:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.863+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f034800cca0 con 0x7f034c0a86d0 2023-12-07T10:02:22.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.867+0000 7f0342ffd640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03300668d0 0x7f0330068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:22.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.867+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0348084c90 con 0x7f034c0a86d0 2023-12-07T10:02:22.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.867+0000 7f0351b28640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03300668d0 0x7f0330068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:22.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.867+0000 7f0351b28640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03300668d0 0x7f0330068d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f034c1442c0 tx=0x7f033c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:22.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:22.871+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0348051b60 con 0x7f034c0a86d0 2023-12-07T10:02:23.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.015+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f034c04e890 con 0x7f034c0a86d0 2023-12-07T10:02:23.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f0342ffd640 1 -- 172.21.15.89:0/4254281501 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0348017020 con 0x7f034c0a86d0 2023-12-07T10:02:23.023 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03300668d0 msgr2=0x7f0330068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03300668d0 0x7f0330068d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f034c1442c0 tx=0x7f033c009040 comp rx=0 tx=0).stop 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 msgr2=0x7f034c1470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 0x7f034c1470a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f034800e870 tx=0x7f034800ec70 comp rx=0 tx=0).stop 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 shutdown_connections 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f034c156600 0x7f034c147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03300668d0 0x7f0330068d90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f034c14fd00 0x7f034c06cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 --2- 172.21.15.89:0/4254281501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f034c0a86d0 0x7f034c1470a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 >> 172.21.15.89:0/4254281501 conn(0x7f034c0c2a60 msgr2=0x7f034c0c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:23.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 shutdown_connections 2023-12-07T10:02:23.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.019+0000 7f035458d640 1 -- 172.21.15.89:0/4254281501 wait complete. 2023-12-07T10:02:23.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:23.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413ccd6640 1 Processor -- start 2023-12-07T10:02:23.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413ccd6640 1 -- start start 2023-12-07T10:02:23.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413ccd6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4138151d60 0x7f41380c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413ccd6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4138157db0 con 0x7f4138155240 2023-12-07T10:02:23.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413ccd6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4138158090 con 0x7f41380c4980 2023-12-07T10:02:23.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413ccd6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4138152140 con 0x7f4138151d60 2023-12-07T10:02:23.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f412dd9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4138155240 0x7f4138158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54804/0 (socket says 172.21.15.89:54804) 2023-12-07T10:02:23.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f412dd9b640 1 -- 172.21.15.89:0/3573709575 learned_addr learned my addr 172.21.15.89:0/3573709575 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413659c640 1 --2- 172.21.15.89:0/3573709575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4138151d60 0x7f41380c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812232595 0 0) 0x7f4138157db0 con 0x7f4138155240 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4124003530 con 0x7f4138155240 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956812629 0 0) 0x7f4138158090 con 0x7f41380c4980 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4138157db0 con 0x7f41380c4980 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413659c640 1 -- 172.21.15.89:0/3573709575 >> v1:172.21.15.97:6789/0 conn(0x7f41380c4980 legacy=0x7f413815f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413659c640 1 -- 172.21.15.89:0/3573709575 >> v1:172.21.15.89:6789/0 conn(0x7f4138155240 legacy=0x7f4138158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754304326 0 0) 0x7f4124003530 con 0x7f4138155240 2023-12-07T10:02:23.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.179+0000 7f413659c640 1 -- 172.21.15.89:0/3573709575 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41380ca500 con 0x7f4138151d60 2023-12-07T10:02:23.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413659c640 1 --2- 172.21.15.89:0/3573709575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4138151d60 0x7f41380c8050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41280097f0 tx=0x7f412801c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63007d16de2859cc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120001a00 con 0x7f4138151d60 2023-12-07T10:02:23.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41280a7050 con 0x7f4138151d60 2023-12-07T10:02:23.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f4135d9b640 1 -- 172.21.15.89:0/3573709575 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280ab600 con 0x7f4138151d60 2023-12-07T10:02:23.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 -- 172.21.15.89:0/3573709575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4138151d60 msgr2=0x7f41380c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3573709575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4138151d60 0x7f41380c8050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41280097f0 tx=0x7f412801c320 comp rx=0 tx=0).stop 2023-12-07T10:02:23.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 -- 172.21.15.89:0/3573709575 shutdown_connections 2023-12-07T10:02:23.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3573709575 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4138151d60 0x7f41380c8050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 -- 172.21.15.89:0/3573709575 >> 172.21.15.89:0/3573709575 conn(0x7f4138071ea0 msgr2=0x7f41380722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:23.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 -- 172.21.15.89:0/3573709575 shutdown_connections 2023-12-07T10:02:23.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.183+0000 7f413ccd6640 1 -- 172.21.15.89:0/3573709575 wait complete. 2023-12-07T10:02:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 Processor -- start 2023-12-07T10:02:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 -- start start 2023-12-07T10:02:23.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41380c4980 0x7f4138144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 0x7f4138144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4138155240 0x7f413814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4138149060 con 0x7f4138151d60 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41381ede80 con 0x7f4138155240 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4138149300 con 0x7f41380c4980 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 0x7f4138144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 0x7f4138144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36418/0 (socket says 172.21.15.89:36418) 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 -- 172.21.15.89:0/3705972137 learned_addr learned my addr 172.21.15.89:0/3705972137 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413659c640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41380c4980 0x7f4138144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f4136d9d640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4138155240 0x7f413814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 -- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41380c4980 msgr2=0x7f4138144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41380c4980 0x7f4138144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 -- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4138155240 msgr2=0x7f413814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4138155240 0x7f413814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 -- 172.21.15.89:0/3705972137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128009420 con 0x7f4138151d60 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412dd9b640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 0x7f4138144990 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4120002010 tx=0x7f412000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120012400 con 0x7f4138151d60 2023-12-07T10:02:23.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120012560 con 0x7f4138151d60 2023-12-07T10:02:23.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120012950 con 0x7f4138151d60 2023-12-07T10:02:23.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.187+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41381495e0 con 0x7f4138151d60 2023-12-07T10:02:23.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41380c9510 con 0x7f4138151d60 2023-12-07T10:02:23.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138149800 con 0x7f4138151d60 2023-12-07T10:02:23.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4120012ab0 con 0x7f4138151d60 2023-12-07T10:02:23.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f412f7fe640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4120084ee0 con 0x7f4138151d60 2023-12-07T10:02:23.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f413659c640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.191+0000 7f413659c640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f41280ad000 tx=0x7f4128008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.195+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4120051e60 con 0x7f4138151d60 2023-12-07T10:02:23.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.351+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4138074970 con 0x7f4138151d60 2023-12-07T10:02:23.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.351+0000 7f412f7fe640 1 -- 172.21.15.89:0/3705972137 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4120055480 con 0x7f4138151d60 2023-12-07T10:02:23.358 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:23.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 msgr2=0x7f4118068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f41280ad000 tx=0x7f4128008040 comp rx=0 tx=0).stop 2023-12-07T10:02:23.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 msgr2=0x7f4138144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 0x7f4138144990 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4120002010 tx=0x7f412000a430 comp rx=0 tx=0).stop 2023-12-07T10:02:23.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 shutdown_connections 2023-12-07T10:02:23.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4138155240 0x7f413814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4138151d60 0x7f4138144990 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f41180668d0 0x7f4118068d90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 --2- 172.21.15.89:0/3705972137 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f41380c4980 0x7f4138144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 >> 172.21.15.89:0/3705972137 conn(0x7f4138071ea0 msgr2=0x7f4138072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:23.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 shutdown_connections 2023-12-07T10:02:23.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.355+0000 7f413ccd6640 1 -- 172.21.15.89:0/3705972137 wait complete. 2023-12-07T10:02:23.379 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:23.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 Processor -- start 2023-12-07T10:02:23.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 -- start start 2023-12-07T10:02:23.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e80c0370 0x7f69e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e806de00 con 0x7f69e814eaf0 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e8070390 con 0x7f69e80c0370 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ef565640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e806db90 con 0x7f69e80a8470 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e80c0370 0x7f69e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e80c0370 0x7f69e806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36426/0 (socket says 172.21.15.89:36426) 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 -- 172.21.15.89:0/1446739066 learned_addr learned my addr 172.21.15.89:0/1446739066 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69edb02640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 -- 172.21.15.89:0/1446739066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 msgr2=0x7f69e806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 -- 172.21.15.89:0/1446739066 >> v1:172.21.15.97:6789/0 conn(0x7f69e814eaf0 legacy=0x7f69e8151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69ecb00640 1 -- 172.21.15.89:0/1446739066 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e814eed0 con 0x7f69e80c0370 2023-12-07T10:02:23.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.515+0000 7f69edb02640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ecb00640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e80c0370 0x7f69e806d110 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009870 tx=0x7f69d801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a847b95758a9d29 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69dffff640 1 -- 172.21.15.89:0/1446739066 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80ab640 con 0x7f69e80c0370 2023-12-07T10:02:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69dffff640 1 -- 172.21.15.89:0/1446739066 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d80a7070 con 0x7f69e80c0370 2023-12-07T10:02:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69dffff640 1 -- 172.21.15.89:0/1446739066 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80ab9c0 con 0x7f69e80c0370 2023-12-07T10:02:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 -- 172.21.15.89:0/1446739066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e80c0370 msgr2=0x7f69e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e80c0370 0x7f69e806d110 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009870 tx=0x7f69d801c420 comp rx=0 tx=0).stop 2023-12-07T10:02:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 -- 172.21.15.89:0/1446739066 shutdown_connections 2023-12-07T10:02:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 --2- 172.21.15.89:0/1446739066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e80c0370 0x7f69e806d110 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 -- 172.21.15.89:0/1446739066 >> 172.21.15.89:0/1446739066 conn(0x7f69e80c2a60 msgr2=0x7f69e80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 -- 172.21.15.89:0/1446739066 shutdown_connections 2023-12-07T10:02:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.519+0000 7f69ef565640 1 -- 172.21.15.89:0/1446739066 wait complete. 2023-12-07T10:02:23.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 Processor -- start 2023-12-07T10:02:23.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 -- start start 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e80c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e80c0370 0x7f69e8149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 0x7f69e81ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81427f0 con 0x7f69e814eaf0 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80c4b40 con 0x7f69e80c0370 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80c4fd0 con 0x7f69e80a8470 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 0x7f69e81ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 0x7f69e81ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36434/0 (socket says 172.21.15.89:36434) 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 -- 172.21.15.89:0/3882294353 learned_addr learned my addr 172.21.15.89:0/3882294353 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ecb00640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e80c0370 0x7f69e8149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ed301640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e80c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 -- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 msgr2=0x7f69e80c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e80c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 -- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e80c0370 msgr2=0x7f69e8149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e80c0370 0x7f69e8149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 -- 172.21.15.89:0/3882294353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80094d0 con 0x7f69e814eaf0 2023-12-07T10:02:23.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ecb00640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e80c0370 0x7f69e8149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:23.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69edb02640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 0x7f69e81ed440 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f69e0007df0 tx=0x7f69e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00039a0 con 0x7f69e814eaf0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000f040 con 0x7f69e814eaf0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e80c5380 con 0x7f69e814eaf0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0003d40 con 0x7f69e814eaf0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.523+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e80c44f0 con 0x7f69e814eaf0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.527+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e80c4cf0 con 0x7f69e814eaf0 2023-12-07T10:02:23.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.527+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f69e0004030 con 0x7f69e814eaf0 2023-12-07T10:02:23.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.527+0000 7f69ddffb640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69cc0668d0 0x7f69cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.527+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f69e0084a90 con 0x7f69e814eaf0 2023-12-07T10:02:23.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.527+0000 7f69ed301640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69cc0668d0 0x7f69cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.527+0000 7f69ed301640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69cc0668d0 0x7f69cc068d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f69e80ac250 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.531+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69e80c4cf0 con 0x7f69e814eaf0 2023-12-07T10:02:23.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.679+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69e80c4cf0 con 0x7f69e814eaf0 2023-12-07T10:02:23.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.679+0000 7f69ddffb640 1 -- 172.21.15.89:0/3882294353 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v71) v1 ==== 105+0+11 (secure 0 0 0) 0x7f69e001a020 con 0x7f69e814eaf0 2023-12-07T10:02:23.685 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69cc0668d0 msgr2=0x7f69cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69cc0668d0 0x7f69cc068d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f69e80ac250 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 msgr2=0x7f69e81ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 0x7f69e81ed440 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f69e0007df0 tx=0x7f69e000d4a0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 shutdown_connections 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e814eaf0 0x7f69e81ed440 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69e80c0370 0x7f69e8149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f69cc0668d0 0x7f69cc068d90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 --2- 172.21.15.89:0/3882294353 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f69e80a8470 0x7f69e80c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 >> 172.21.15.89:0/3882294353 conn(0x7f69e80c2a60 msgr2=0x7f69e814f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:23.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 shutdown_connections 2023-12-07T10:02:23.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.683+0000 7f69ef565640 1 -- 172.21.15.89:0/3882294353 wait complete. 2023-12-07T10:02:23.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:23.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 Processor -- start 2023-12-07T10:02:23.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 -- start start 2023-12-07T10:02:23.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7ee81561d0 0x7f7ee80701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee8070760 0x7f7ee806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7ee806df20 0x7f7ee8158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee8071020 con 0x7f7ee806df20 2023-12-07T10:02:23.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee8071300 con 0x7f7ee81561d0 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.839+0000 7f7eef901640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80715e0 con 0x7f7ee8070760 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7ee806df20 0x7f7ee8158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7ee806df20 0x7f7ee8158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36436/0 (socket says 172.21.15.89:36436) 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 -- 172.21.15.89:0/2962562722 learned_addr learned my addr 172.21.15.89:0/2962562722 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eed69d640 1 --2- 172.21.15.89:0/2962562722 >> v2:172.21.15.97:3300/0 conn(0x7f7ee81561d0 0x7f7ee80701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eece9c640 1 --2- 172.21.15.89:0/2962562722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee8070760 0x7f7ee806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 -- 172.21.15.89:0/2962562722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee8070760 msgr2=0x7f7ee806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 --2- 172.21.15.89:0/2962562722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee8070760 0x7f7ee806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 -- 172.21.15.89:0/2962562722 >> v2:172.21.15.97:3300/0 conn(0x7f7ee81561d0 msgr2=0x7f7ee80701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 --2- 172.21.15.89:0/2962562722 >> v2:172.21.15.97:3300/0 conn(0x7f7ee81561d0 0x7f7ee80701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 -- 172.21.15.89:0/2962562722 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80718c0 con 0x7f7ee806df20 2023-12-07T10:02:23.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7eede9e640 1 --2- 172.21.15.89:0/2962562722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee806df20 0x7f7ee8158ff0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80c6f00 tx=0x7f7ee001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c090ebcb52905fb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7edffff640 1 -- 172.21.15.89:0/2962562722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00a56d0 con 0x7f7ee806df20 2023-12-07T10:02:23.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7edffff640 1 -- 172.21.15.89:0/2962562722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee00a5830 con 0x7f7ee806df20 2023-12-07T10:02:23.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.843+0000 7f7edffff640 1 -- 172.21.15.89:0/2962562722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00a5bc0 con 0x7f7ee806df20 2023-12-07T10:02:23.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- 172.21.15.89:0/2962562722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee806df20 msgr2=0x7f7ee8158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- 172.21.15.89:0/2962562722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee806df20 0x7f7ee8158ff0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80c6f00 tx=0x7f7ee001d3a0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- 172.21.15.89:0/2962562722 shutdown_connections 2023-12-07T10:02:23.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- 172.21.15.89:0/2962562722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee806df20 0x7f7ee8158ff0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- 172.21.15.89:0/2962562722 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee8070760 0x7f7ee806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- 172.21.15.89:0/2962562722 >> v2:172.21.15.97:3300/0 conn(0x7f7ee81561d0 0x7f7ee80701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- 172.21.15.89:0/2962562722 >> 172.21.15.89:0/2962562722 conn(0x7f7ee80c2a60 msgr2=0x7f7ee80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- 172.21.15.89:0/2962562722 shutdown_connections 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- 172.21.15.89:0/2962562722 wait complete. 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 Processor -- start 2023-12-07T10:02:23.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- start start 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ee806df20 0x7f7ee8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 0x7f7ee815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee81561d0 0x7f7ee815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81f57a0 con 0x7f7ee8070760 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee814f630 con 0x7f7ee806df20 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eef901640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee815be70 con 0x7f7ee81561d0 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 0x7f7ee815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 0x7f7ee815a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36448/0 (socket says 172.21.15.89:36448) 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 -- 172.21.15.89:0/3893363559 learned_addr learned my addr 172.21.15.89:0/3893363559 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eed69d640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ee806df20 0x7f7ee8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eede9e640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee81561d0 0x7f7ee815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 -- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee81561d0 msgr2=0x7f7ee815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee81561d0 0x7f7ee815a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 -- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ee806df20 msgr2=0x7f7ee8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ee806df20 0x7f7ee8157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eece9c640 1 -- 172.21.15.89:0/3893363559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009b30 con 0x7f7ee8070760 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.847+0000 7f7eede9e640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee81561d0 0x7f7ee815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eece9c640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 0x7f7ee815a170 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e960 tx=0x7f7ed800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8009690 con 0x7f7ee8070760 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800ca00 con 0x7f7ee8070760 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800cd70 con 0x7f7ee8070760 2023-12-07T10:02:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee815abf0 con 0x7f7ee8070760 2023-12-07T10:02:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee815b8b0 con 0x7f7ee8070760 2023-12-07T10:02:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee804e890 con 0x7f7ee8070760 2023-12-07T10:02:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7ed8013470 con 0x7f7ee8070760 2023-12-07T10:02:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eddffb640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7ecc0668d0 0x7f7ecc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ed80848f0 con 0x7f7ee8070760 2023-12-07T10:02:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.851+0000 7f7eed69d640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7ecc0668d0 0x7f7ecc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:23.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.855+0000 7f7eed69d640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7ecc0668d0 0x7f7ecc068d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009a40 tx=0x7f7ee4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:23.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:23.855+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ed8051880 con 0x7f7ee8070760 2023-12-07T10:02:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.003+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7ee80c1800 con 0x7f7ee8070760 2023-12-07T10:02:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.003+0000 7f7eddffb640 1 -- 172.21.15.89:0/3893363559 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v71) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7ed8054ea0 con 0x7f7ee8070760 2023-12-07T10:02:24.009 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:24.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.003+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7ecc0668d0 msgr2=0x7f7ecc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.003+0000 7f7eef901640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7ecc0668d0 0x7f7ecc068d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009a40 tx=0x7f7ee4009190 comp rx=0 tx=0).stop 2023-12-07T10:02:24.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.003+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 msgr2=0x7f7ee815a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.003+0000 7f7eef901640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 0x7f7ee815a170 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e960 tx=0x7f7ed800ee20 comp rx=0 tx=0).stop 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 shutdown_connections 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7ecc0668d0 0x7f7ecc068d90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7ee81561d0 0x7f7ee815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee8070760 0x7f7ee815a170 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 --2- 172.21.15.89:0/3893363559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ee806df20 0x7f7ee8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 >> 172.21.15.89:0/3893363559 conn(0x7f7ee80c2a60 msgr2=0x7f7ee8156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:24.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 shutdown_connections 2023-12-07T10:02:24.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.007+0000 7f7eef901640 1 -- 172.21.15.89:0/3893363559 wait complete. 2023-12-07T10:02:24.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:02:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 Processor -- start 2023-12-07T10:02:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 -- start start 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f914c14e9d0 0x7f914c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f914c070b80 0x7f914c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c06d320 con 0x7f914c0c1f20 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0721b0 con 0x7f914c14e9d0 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f9152a32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0c2830 con 0x7f914c070b80 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f914c14e9d0 0x7f914c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f914c14e9d0 0x7f914c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36454/0 (socket says 172.21.15.89:36454) 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 -- 172.21.15.89:0/1918691321 learned_addr learned my addr 172.21.15.89:0/1918691321 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914b7fe640 1 --2- 172.21.15.89:0/1918691321 >> v2:172.21.15.97:3300/0 conn(0x7f914c070b80 0x7f914c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 -- 172.21.15.89:0/1918691321 >> v2:172.21.15.97:3300/0 conn(0x7f914c070b80 msgr2=0x7f914c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 --2- 172.21.15.89:0/1918691321 >> v2:172.21.15.97:3300/0 conn(0x7f914c070b80 0x7f914c0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 -- 172.21.15.89:0/1918691321 >> v1:172.21.15.89:6789/0 conn(0x7f914c0c1f20 legacy=0x7f914c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.163+0000 7f914bfff640 1 -- 172.21.15.89:0/1918691321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c072450 con 0x7f914c14e9d0 2023-12-07T10:02:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f914bfff640 1 --2- 172.21.15.89:0/1918691321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c14e9d0 0x7f914c151e60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f914c06e420 tx=0x7f913c01e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3e2be36471dfc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f914affd640 1 -- 172.21.15.89:0/1918691321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0a8040 con 0x7f914c14e9d0 2023-12-07T10:02:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f914affd640 1 -- 172.21.15.89:0/1918691321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0ac600 con 0x7f914c14e9d0 2023-12-07T10:02:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f914affd640 1 -- 172.21.15.89:0/1918691321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ac990 con 0x7f914c14e9d0 2023-12-07T10:02:24.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 -- 172.21.15.89:0/1918691321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c14e9d0 msgr2=0x7f914c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 --2- 172.21.15.89:0/1918691321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c14e9d0 0x7f914c151e60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f914c06e420 tx=0x7f913c01e680 comp rx=0 tx=0).stop 2023-12-07T10:02:24.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 -- 172.21.15.89:0/1918691321 shutdown_connections 2023-12-07T10:02:24.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 --2- 172.21.15.89:0/1918691321 >> v2:172.21.15.97:3300/0 conn(0x7f914c070b80 0x7f914c0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 --2- 172.21.15.89:0/1918691321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c14e9d0 0x7f914c151e60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 -- 172.21.15.89:0/1918691321 >> 172.21.15.89:0/1918691321 conn(0x7f914c0c2ad0 msgr2=0x7f914c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:24.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 -- 172.21.15.89:0/1918691321 shutdown_connections 2023-12-07T10:02:24.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.167+0000 7f9152a32640 1 -- 172.21.15.89:0/1918691321 wait complete. 2023-12-07T10:02:24.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 Processor -- start 2023-12-07T10:02:24.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- start start 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f914c070b80 0x7f914c14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 0x7f914c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f914c14e9d0 0x7f914c1edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c150310 con 0x7f914c0c1f20 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c141a60 con 0x7f914c14e9d0 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c150de0 con 0x7f914c070b80 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 0x7f914c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 0x7f914c1479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36466/0 (socket says 172.21.15.89:36466) 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 -- 172.21.15.89:0/469320556 learned_addr learned my addr 172.21.15.89:0/469320556 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9150fcf640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f914c14e9d0 0x7f914c1edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914bfff640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f914c070b80 0x7f914c14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 -- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f914c070b80 msgr2=0x7f914c14f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f914c070b80 0x7f914c14f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 -- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f914c14e9d0 msgr2=0x7f914c1edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f914c14e9d0 0x7f914c1edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 -- 172.21.15.89:0/469320556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0094d0 con 0x7f914c0c1f20 2023-12-07T10:02:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f914b7fe640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 0x7f914c1479a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f914000e900 tx=0x7f914000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140009690 con 0x7f914c0c1f20 2023-12-07T10:02:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914000ca00 con 0x7f914c0c1f20 2023-12-07T10:02:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c150820 con 0x7f914c0c1f20 2023-12-07T10:02:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914000cdb0 con 0x7f914c0c1f20 2023-12-07T10:02:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c1ed380 con 0x7f914c0c1f20 2023-12-07T10:02:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.171+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c04e890 con 0x7f914c0c1f20 2023-12-07T10:02:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.175+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9140013470 con 0x7f914c0c1f20 2023-12-07T10:02:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.175+0000 7f9148ff9640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91380668d0 0x7f9138068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.175+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9140084960 con 0x7f914c0c1f20 2023-12-07T10:02:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.175+0000 7f914bfff640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91380668d0 0x7f9138068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.175+0000 7f914bfff640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91380668d0 0x7f9138068d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f913c0b0000 tx=0x7f913c0a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.179+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9140051830 con 0x7f914c0c1f20 2023-12-07T10:02:24.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f914c0700a0 con 0x7f914c0c1f20 2023-12-07T10:02:24.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9148ff9640 1 -- 172.21.15.89:0/469320556 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9140054e50 con 0x7f914c0c1f20 2023-12-07T10:02:24.348 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:02:24.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91380668d0 msgr2=0x7f9138068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91380668d0 0x7f9138068d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f913c0b0000 tx=0x7f913c0a9000 comp rx=0 tx=0).stop 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 msgr2=0x7f914c1479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 0x7f914c1479a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f914000e900 tx=0x7f914000edc0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 shutdown_connections 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f914c14e9d0 0x7f914c1edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f914c0c1f20 0x7f914c1479a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f91380668d0 0x7f9138068d90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 --2- 172.21.15.89:0/469320556 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f914c070b80 0x7f914c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.343+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 >> 172.21.15.89:0/469320556 conn(0x7f914c0c2ad0 msgr2=0x7f914c06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.347+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 shutdown_connections 2023-12-07T10:02:24.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.347+0000 7f9152a32640 1 -- 172.21.15.89:0/469320556 wait complete. 2023-12-07T10:02:24.370 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T10:02:24.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:24.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:24.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:02:24.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:24.427 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:02:24.449 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:24.449 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:24.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:02:24.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T10:02:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.635+0000 7fab5e217640 1 Processor -- start 2023-12-07T10:02:24.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.635+0000 7fab5e217640 1 -- start start 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab5e217640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab580aacd0 0x7fab58154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab5e217640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab580700a0 0x7fab581546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab5e217640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab58072780 con 0x7fab580ab7a0 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab5e217640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab580ac160 con 0x7fab580700a0 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab5e217640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab580abe80 con 0x7fab580aacd0 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab580700a0 0x7fab581546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab580700a0 0x7fab581546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36480/0 (socket says 172.21.15.89:36480) 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 -- 172.21.15.89:0/2348009673 learned_addr learned my addr 172.21.15.89:0/2348009673 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab577fe640 1 --2- 172.21.15.89:0/2348009673 >> v2:172.21.15.97:3300/0 conn(0x7fab580aacd0 0x7fab58154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 -- 172.21.15.89:0/2348009673 >> v2:172.21.15.97:3300/0 conn(0x7fab580aacd0 msgr2=0x7fab58154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:24.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 --2- 172.21.15.89:0/2348009673 >> v2:172.21.15.97:3300/0 conn(0x7fab580aacd0 0x7fab58154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 -- 172.21.15.89:0/2348009673 >> v1:172.21.15.97:6789/0 conn(0x7fab580ab7a0 legacy=0x7fab5806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.639+0000 7fab56ffd640 1 -- 172.21.15.89:0/2348009673 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58154cf0 con 0x7fab580700a0 2023-12-07T10:02:24.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab56ffd640 1 --2- 172.21.15.89:0/2348009673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580700a0 0x7fab581546a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fab5806b3f0 tx=0x7fab4c01e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f570a5a61757a1e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:24.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab567fc640 1 -- 172.21.15.89:0/2348009673 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004230 con 0x7fab580700a0 2023-12-07T10:02:24.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab567fc640 1 -- 172.21.15.89:0/2348009673 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0ab070 con 0x7fab580700a0 2023-12-07T10:02:24.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab567fc640 1 -- 172.21.15.89:0/2348009673 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0a77c0 con 0x7fab580700a0 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- 172.21.15.89:0/2348009673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580700a0 msgr2=0x7fab581546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 --2- 172.21.15.89:0/2348009673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580700a0 0x7fab581546a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fab5806b3f0 tx=0x7fab4c01e8f0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- 172.21.15.89:0/2348009673 shutdown_connections 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 --2- 172.21.15.89:0/2348009673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580700a0 0x7fab581546a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 --2- 172.21.15.89:0/2348009673 >> v2:172.21.15.97:3300/0 conn(0x7fab580aacd0 0x7fab58154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- 172.21.15.89:0/2348009673 >> 172.21.15.89:0/2348009673 conn(0x7fab580c2ad0 msgr2=0x7fab580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- 172.21.15.89:0/2348009673 shutdown_connections 2023-12-07T10:02:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- 172.21.15.89:0/2348009673 wait complete. 2023-12-07T10:02:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 Processor -- start 2023-12-07T10:02:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- start start 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab580700a0 0x7fab5814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 0x7fab58143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab580ab7a0 0x7fab581444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5814fae0 con 0x7fab580aacd0 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58144f90 con 0x7fab580700a0 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.643+0000 7fab5e217640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5814f650 con 0x7fab580ab7a0 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 0x7fab58143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 0x7fab58143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36484/0 (socket says 172.21.15.89:36484) 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 -- 172.21.15.89:0/4237004504 learned_addr learned my addr 172.21.15.89:0/4237004504 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab577fe640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab580700a0 0x7fab5814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab57fff640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab580ab7a0 0x7fab581444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 -- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab580ab7a0 msgr2=0x7fab581444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab580ab7a0 0x7fab581444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 -- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab580700a0 msgr2=0x7fab5814ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab580700a0 0x7fab5814ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 -- 172.21.15.89:0/4237004504 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c00b780 con 0x7fab580aacd0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab56ffd640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 0x7fab58143f60 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fab4c024ee0 tx=0x7fab4c01b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0a7ad0 con 0x7fab580aacd0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0a7c30 con 0x7fab580aacd0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5814eb60 con 0x7fab580aacd0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c003620 con 0x7fab580aacd0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5814f2e0 con 0x7fab580aacd0 2023-12-07T10:02:24.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5804e890 con 0x7fab580aacd0 2023-12-07T10:02:24.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.647+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fab4c0037a0 con 0x7fab580aacd0 2023-12-07T10:02:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.651+0000 7fab3ffff640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab440668d0 0x7fab44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.651+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fab4c11ee10 con 0x7fab580aacd0 2023-12-07T10:02:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.651+0000 7fab577fe640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab440668d0 0x7fab44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.651+0000 7fab577fe640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab440668d0 0x7fab44068d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab480079c0 tx=0x7fab48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.655+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab4c122030 con 0x7fab580aacd0 2023-12-07T10:02:24.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.835+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab581449e0 con 0x7fab580aacd0 2023-12-07T10:02:24.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.835+0000 7fab3ffff640 1 -- 172.21.15.89:0/4237004504 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fab4c0ebd90 con 0x7fab580aacd0 2023-12-07T10:02:24.842 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T10:02:24.842 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-07T10:02:24.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab440668d0 msgr2=0x7fab44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab440668d0 0x7fab44068d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab480079c0 tx=0x7fab48008040 comp rx=0 tx=0).stop 2023-12-07T10:02:24.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 msgr2=0x7fab58143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:24.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 0x7fab58143f60 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fab4c024ee0 tx=0x7fab4c01b690 comp rx=0 tx=0).stop 2023-12-07T10:02:24.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 shutdown_connections 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fab440668d0 0x7fab44068d90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fab580ab7a0 0x7fab581444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab580aacd0 0x7fab58143f60 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 --2- 172.21.15.89:0/4237004504 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab580700a0 0x7fab5814ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 >> 172.21.15.89:0/4237004504 conn(0x7fab580c2ad0 msgr2=0x7fab580bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 shutdown_connections 2023-12-07T10:02:24.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:24.839+0000 7fab5e217640 1 -- 172.21.15.89:0/4237004504 wait complete. 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T10:02:24.863 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.SVNH4EjNHT 2023-12-07T10:02:24.864 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-07T10:02:24.875 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.2pUpX1n7Kx 2023-12-07T10:02:24.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /tmp/tmp.SVNH4EjNHT /tmp/tmp.2pUpX1n7Kx 2023-12-07T10:02:24.937 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.2pUpX1n7Kx 2023-12-07T10:02:25.057 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.2pUpX1n7Kx is 226B 2023-12-07T10:02:25.074 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.2pUpX1n7Kx 2023-12-07T10:02:25.082 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-07T10:02:25.082 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:25.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.083 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.133 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42231sec preferred_lft 42231sec 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-07T10:02:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:3b:72:83:2d brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-07T10:02:25.135 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-07T10:02:25.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.136 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T10:02:25.194 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-07T10:02:25.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.197 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-07T10:02:25.250 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T10:02:25.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.252 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-07T10:02:25.252 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-07T10:02:25.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T10:02:25.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T10:02:25.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T10:02:25.252 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-07T10:02:25.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.347 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:02:25.356 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:02:25.356 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:25.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-07T10:02:25.420 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:25.420 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:25.472 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T10:02:25.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T10:02:25.472 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:25.523 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:25.523 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/tmp/tmp.SVNH4EjNHT of=/dev/stdout 2023-12-07T10:02:25.572 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-07T10:02:25.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.572 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:25.666 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:25.666 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:25.666 INFO:teuthology.orchestra.run.smithi097.stdout:keyring.get_secret failed 2023-12-07T10:02:25.677 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQApmHFl6yrKGxAAdACGfU2Y+fXVUkWKeGFkRA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T10:02:25.677 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T10:02:25.678 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.97:3300,172.21.15.97:3301" 2023-12-07T10:02:25.678 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: testuser@06923b89-f6c6-4736-b27e-9e03456ddc01.cephfs2=/ 2023-12-07T10:02:25.678 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.89:3300/172.21.15.97:3300/172.21.15.97:3301" will pass to kernel 2023-12-07T10:02:25.681 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T10:02:25.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:25.699 INFO:teuthology.orchestra.run.smithi097.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-07T10:02:25.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T10:02:25.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.702 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T10:02:25.755 INFO:teuthology.orchestra.run.smithi097.stdout:client6026 2023-12-07T10:02:25.755 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:25.755 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:25.808 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-07T10:02:25.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:25.840 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-07T10:02:25.851 INFO:teuthology.orchestra.run.smithi089.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-07T10:02:25.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T10:02:25.852 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:25.852 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:25.907 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:25.907 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:25.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.135+0000 7f443e380640 1 Processor -- start 2023-12-07T10:02:26.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.135+0000 7f443e380640 1 -- start start 2023-12-07T10:02:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f443e380640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380aacd0 0x7f4438154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f443e380640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44380700a0 0x7f44381546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f443e380640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4438072780 con 0x7f44380ab7a0 2023-12-07T10:02:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f443e380640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380ac160 con 0x7f44380700a0 2023-12-07T10:02:26.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f443e380640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380abe80 con 0x7f44380aacd0 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44380700a0 0x7f44381546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44380700a0 0x7f44381546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36488/0 (socket says 172.21.15.89:36488) 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 -- 172.21.15.89:0/1893201791 learned_addr learned my addr 172.21.15.89:0/1893201791 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 -- 172.21.15.89:0/1893201791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380aacd0 msgr2=0x7f4438154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f4437fff640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380aacd0 0x7f4438154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380aacd0 0x7f4438154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 -- 172.21.15.89:0/1893201791 >> v1:172.21.15.97:6789/0 conn(0x7f44380ab7a0 legacy=0x7f443806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f44377fe640 1 -- 172.21.15.89:0/1893201791 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438154cf0 con 0x7f44380700a0 2023-12-07T10:02:26.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.139+0000 7f4437fff640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380aacd0 0x7f4438154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:26.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f44377fe640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f44381546a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f442c009870 tx=0x7f442c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de98248c32c7b71 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f4436ffd640 1 -- 172.21.15.89:0/1893201791 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c0ab600 con 0x7f44380700a0 2023-12-07T10:02:26.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f4436ffd640 1 -- 172.21.15.89:0/1893201791 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c0a7050 con 0x7f44380700a0 2023-12-07T10:02:26.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f4436ffd640 1 -- 172.21.15.89:0/1893201791 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c0ab980 con 0x7f44380700a0 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- 172.21.15.89:0/1893201791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 msgr2=0x7f44381546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f44381546a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f442c009870 tx=0x7f442c01c480 comp rx=0 tx=0).stop 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- 172.21.15.89:0/1893201791 shutdown_connections 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f44381546a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 --2- 172.21.15.89:0/1893201791 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380aacd0 0x7f4438154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- 172.21.15.89:0/1893201791 >> 172.21.15.89:0/1893201791 conn(0x7f44380c2ad0 msgr2=0x7f44380c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- 172.21.15.89:0/1893201791 shutdown_connections 2023-12-07T10:02:26.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- 172.21.15.89:0/1893201791 wait complete. 2023-12-07T10:02:26.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 Processor -- start 2023-12-07T10:02:26.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- start start 2023-12-07T10:02:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f443813e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44380aacd0 0x7f4438152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380ab7a0 0x7f44381483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44381510a0 con 0x7f44380700a0 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443814a9e0 con 0x7f44380aacd0 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.143+0000 7f443e380640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44381eacd0 con 0x7f44380ab7a0 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f443813e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f443813e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36490/0 (socket says 172.21.15.89:36490) 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 -- 172.21.15.89:0/1626844089 learned_addr learned my addr 172.21.15.89:0/1626844089 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f443c91d640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380ab7a0 0x7f44381483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f44377fe640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44380aacd0 0x7f4438152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 -- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380ab7a0 msgr2=0x7f44381483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380ab7a0 0x7f44381483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 -- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44380aacd0 msgr2=0x7f4438152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44380aacd0 0x7f4438152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 -- 172.21.15.89:0/1626844089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0094d0 con 0x7f44380700a0 2023-12-07T10:02:26.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4437fff640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f443813e340 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f442800c7f0 tx=0x7f442800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428007820 con 0x7f44380700a0 2023-12-07T10:02:26.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4428007980 con 0x7f44380700a0 2023-12-07T10:02:26.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44381eaf90 con 0x7f44380700a0 2023-12-07T10:02:26.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428007d30 con 0x7f44380700a0 2023-12-07T10:02:26.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44381eb550 con 0x7f44380700a0 2023-12-07T10:02:26.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443804e890 con 0x7f44380700a0 2023-12-07T10:02:26.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f44280113f0 con 0x7f44380700a0 2023-12-07T10:02:26.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4434ff9640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44240668d0 0x7f4424068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.147+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4428084a20 con 0x7f44380700a0 2023-12-07T10:02:26.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.151+0000 7f44377fe640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44240668d0 0x7f4424068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.151+0000 7f44377fe640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44240668d0 0x7f4424068d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f442c0ad000 tx=0x7f442c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.151+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44280519a0 con 0x7f44380700a0 2023-12-07T10:02:26.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.303+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443814b150 con 0x7f44380700a0 2023-12-07T10:02:26.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f4434ff9640 1 -- 172.21.15.89:0/1626844089 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7f4428054fc0 con 0x7f44380700a0 2023-12-07T10:02:26.312 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:26.312 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:26.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44240668d0 msgr2=0x7f4424068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44240668d0 0x7f4424068d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f442c0ad000 tx=0x7f442c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 msgr2=0x7f443813e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f443813e340 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f442800c7f0 tx=0x7f442800ccb0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 shutdown_connections 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f44240668d0 0x7f4424068d90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f44380ab7a0 0x7f44381483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44380aacd0 0x7f4438152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 --2- 172.21.15.89:0/1626844089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44380700a0 0x7f443813e340 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 >> 172.21.15.89:0/1626844089 conn(0x7f44380c2ad0 msgr2=0x7f44380c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 shutdown_connections 2023-12-07T10:02:26.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.307+0000 7f443e380640 1 -- 172.21.15.89:0/1626844089 wait complete. 2023-12-07T10:02:26.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:26.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:26.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e759e640 1 Processor -- start 2023-12-07T10:02:26.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e759e640 1 -- start start 2023-12-07T10:02:26.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e759e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e806d600 0x7fe1e80a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e8156360 con 0x7fe1e814fab0 2023-12-07T10:02:26.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e759e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e8152e90 con 0x7fe1e80726c0 2023-12-07T10:02:26.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e759e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8152bd0 con 0x7fe1e806d600 2023-12-07T10:02:26.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe1e814fab0 0x7fe1e81524c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54834/0 (socket says 172.21.15.89:54834) 2023-12-07T10:02:26.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e659c640 1 -- 172.21.15.89:0/3222508202 learned_addr learned my addr 172.21.15.89:0/3222508202 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761484634 0 0) 0x7fe1e8156360 con 0x7fe1e814fab0 2023-12-07T10:02:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d0003530 con 0x7fe1e814fab0 2023-12-07T10:02:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e806d600 0x7fe1e80a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280387085 0 0) 0x7fe1d0003530 con 0x7fe1e814fab0 2023-12-07T10:02:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e806d600 msgr2=0x7fe1e80a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:26.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e806d600 0x7fe1e80a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 >> v1:172.21.15.97:6789/0 conn(0x7fe1e80726c0 legacy=0x7fe1e815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e806da90 con 0x7fe1e814fab0 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fe1d8001680 con 0x7fe1e814fab0 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e806d600 0x7fe1e80a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 >> v1:172.21.15.89:6789/0 conn(0x7fe1e814fab0 legacy=0x7fe1e81524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d00039b0 0x7fe1d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0004380 0x7fe1d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1d0005050 0x7fe1d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8152bd0 con 0x7fe1d0005050 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d000bf80 con 0x7fe1d0004380 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d000c140 con 0x7fe1d00039b0 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.471+0000 7fe1e6d9d640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1d0005050 0x7fe1d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e659c640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d00039b0 0x7fe1d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0004380 0x7fe1d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e6d9d640 1 -- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d00039b0 msgr2=0x7fe1d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e6d9d640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1d00039b0 0x7fe1d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e6d9d640 1 -- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0004380 msgr2=0x7fe1d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e6d9d640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0004380 0x7fe1d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e6d9d640 1 -- 172.21.15.89:0/3222508202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0003530 con 0x7fe1d0005050 2023-12-07T10:02:26.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0004380 0x7fe1d0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:26.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e6d9d640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1d0005050 0x7fe1d000b990 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0001e70 tx=0x7fe1e001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da04c5697690361 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0003b80 con 0x7fe1d0005050 2023-12-07T10:02:26.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0003ce0 con 0x7fe1d0005050 2023-12-07T10:02:26.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.475+0000 7fe1e559a640 1 -- 172.21.15.89:0/3222508202 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00052c0 con 0x7fe1d0005050 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- 172.21.15.89:0/3222508202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1d0005050 msgr2=0x7fe1d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 --2- 172.21.15.89:0/3222508202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1d0005050 0x7fe1d000b990 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0001e70 tx=0x7fe1e001c760 comp rx=0 tx=0).stop 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e6d9d640 1 -- 172.21.15.89:0/3222508202 reap_dead start 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- 172.21.15.89:0/3222508202 shutdown_connections 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- 172.21.15.89:0/3222508202 >> 172.21.15.89:0/3222508202 conn(0x7fe1e80c5a60 msgr2=0x7fe1e80c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- 172.21.15.89:0/3222508202 shutdown_connections 2023-12-07T10:02:26.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- 172.21.15.89:0/3222508202 wait complete. 2023-12-07T10:02:26.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 Processor -- start 2023-12-07T10:02:26.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- start start 2023-12-07T10:02:26.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0005050 0x7fe1e80aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 0x7fe1e80a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e80bfb70 0x7fe1e80c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80a6da0 con 0x7fe1e80be890 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80aab20 con 0x7fe1d0005050 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e759e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80a6720 con 0x7fe1e80bfb70 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 0x7fe1e80a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 0x7fe1e80a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36520/0 (socket says 172.21.15.89:36520) 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 -- 172.21.15.89:0/4255305971 learned_addr learned my addr 172.21.15.89:0/4255305971 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e659c640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0005050 0x7fe1e80aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e6d9d640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e80bfb70 0x7fe1e80c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 -- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e80bfb70 msgr2=0x7fe1e80c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e80bfb70 0x7fe1e80c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 -- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0005050 msgr2=0x7fe1e80aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0005050 0x7fe1e80aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.479+0000 7fe1e5d9b640 1 -- 172.21.15.89:0/4255305971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80bf050 con 0x7fe1e80be890 2023-12-07T10:02:26.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1e5d9b640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 0x7fe1e80a77f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc011620 tx=0x7fe1dc011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00c070 con 0x7fe1e80be890 2023-12-07T10:02:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc015870 con 0x7fe1e80be890 2023-12-07T10:02:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc015c20 con 0x7fe1e80be890 2023-12-07T10:02:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e80a69c0 con 0x7fe1e80be890 2023-12-07T10:02:26.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e80c3cb0 con 0x7fe1e80be890 2023-12-07T10:02:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e80680c0 con 0x7fe1e80be890 2023-12-07T10:02:26.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe1dc01e450 con 0x7fe1e80be890 2023-12-07T10:02:26.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1d6ffd640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe1c80668d0 0x7fe1c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe1dc084b50 con 0x7fe1e80be890 2023-12-07T10:02:26.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.483+0000 7fe1e659c640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe1c80668d0 0x7fe1c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.487+0000 7fe1e659c640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe1c80668d0 0x7fe1c8068d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80011f0 tx=0x7fe1d8001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.487+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1dc051a20 con 0x7fe1e80be890 2023-12-07T10:02:26.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.639+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1e8074970 con 0x7fe1e80be890 2023-12-07T10:02:26.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.639+0000 7fe1d6ffd640 1 -- 172.21.15.89:0/4255305971 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1dc055040 con 0x7fe1e80be890 2023-12-07T10:02:26.645 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe1c80668d0 msgr2=0x7fe1c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe1c80668d0 0x7fe1c8068d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80011f0 tx=0x7fe1d8001160 comp rx=0 tx=0).stop 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 msgr2=0x7fe1e80a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 0x7fe1e80a77f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc011620 tx=0x7fe1dc011a20 comp rx=0 tx=0).stop 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 shutdown_connections 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe1c80668d0 0x7fe1c8068d90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe1e80bfb70 0x7fe1e80c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e80be890 0x7fe1e80a77f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 --2- 172.21.15.89:0/4255305971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1d0005050 0x7fe1e80aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 >> 172.21.15.89:0/4255305971 conn(0x7fe1e80c5a60 msgr2=0x7fe1e81552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:26.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 shutdown_connections 2023-12-07T10:02:26.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.643+0000 7fe1e759e640 1 -- 172.21.15.89:0/4255305971 wait complete. 2023-12-07T10:02:26.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:26.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.799+0000 7f5de51a1640 1 Processor -- start 2023-12-07T10:02:26.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.799+0000 7f5de51a1640 1 -- start start 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5de51a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de00700f0 0x7f5de0070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5de51a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de0071be0 con 0x7f5de006df30 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5de51a1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de0154b90 con 0x7f5de0154000 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5de51a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00a8710 con 0x7f5de00700f0 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5ddf59e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5de006df30 0x7f5de00714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54836/0 (socket says 172.21.15.89:54836) 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5ddf59e640 1 -- 172.21.15.89:0/985524609 learned_addr learned my addr 172.21.15.89:0/985524609 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dd7fff640 1 --2- 172.21.15.89:0/985524609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de00700f0 0x7f5de0070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774696718 0 0) 0x7f5de0071be0 con 0x7f5de006df30 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc003530 con 0x7f5de006df30 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439154044 0 0) 0x7f5de0154b90 con 0x7f5de0154000 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de0071be0 con 0x7f5de0154000 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dd7fff640 1 -- 172.21.15.89:0/985524609 >> v1:172.21.15.97:6789/0 conn(0x7f5de0154000 legacy=0x7f5de01543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dd7fff640 1 -- 172.21.15.89:0/985524609 >> v1:172.21.15.89:6789/0 conn(0x7f5de006df30 legacy=0x7f5de00714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.803+0000 7f5dd7fff640 1 -- 172.21.15.89:0/985524609 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00abd70 con 0x7f5de00700f0 2023-12-07T10:02:26.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5dd7fff640 1 --2- 172.21.15.89:0/985524609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de00700f0 0x7f5de0070f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800a990 tx=0x7f5dc801d770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb283c2d90aa659 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80a67e0 con 0x7f5de00700f0 2023-12-07T10:02:26.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc80a6940 con 0x7f5de00700f0 2023-12-07T10:02:26.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5dde59c640 1 -- 172.21.15.89:0/985524609 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80a6cd0 con 0x7f5de00700f0 2023-12-07T10:02:26.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 -- 172.21.15.89:0/985524609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de00700f0 msgr2=0x7f5de0070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 --2- 172.21.15.89:0/985524609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de00700f0 0x7f5de0070f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800a990 tx=0x7f5dc801d770 comp rx=0 tx=0).stop 2023-12-07T10:02:26.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 -- 172.21.15.89:0/985524609 shutdown_connections 2023-12-07T10:02:26.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 --2- 172.21.15.89:0/985524609 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de00700f0 0x7f5de0070f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 -- 172.21.15.89:0/985524609 >> 172.21.15.89:0/985524609 conn(0x7f5de00c2a60 msgr2=0x7f5de00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:26.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 -- 172.21.15.89:0/985524609 shutdown_connections 2023-12-07T10:02:26.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 -- 172.21.15.89:0/985524609 wait complete. 2023-12-07T10:02:26.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 Processor -- start 2023-12-07T10:02:26.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.807+0000 7f5de51a1640 1 -- start start 2023-12-07T10:02:26.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de006df30 0x7f5de00bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 0x7f5de00bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5de0154000 0x7f5de014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00c3b50 con 0x7f5de00700f0 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01476e0 con 0x7f5de0154000 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01eb670 con 0x7f5de006df30 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 0x7f5de00bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 0x7f5de00bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36530/0 (socket says 172.21.15.89:36530) 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 -- 172.21.15.89:0/2733969537 learned_addr learned my addr 172.21.15.89:0/2733969537 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dded9d640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de006df30 0x7f5de00bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5ddf59e640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5de0154000 0x7f5de014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 -- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de006df30 msgr2=0x7f5de00bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de006df30 0x7f5de00bfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 -- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5de0154000 msgr2=0x7f5de014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5de0154000 0x7f5de014d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 -- 172.21.15.89:0/2733969537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc800a5c0 con 0x7f5de00700f0 2023-12-07T10:02:26.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd7fff640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 0x7f5de00bf0a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800a990 tx=0x7f5dc801a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80b9640 con 0x7f5de00700f0 2023-12-07T10:02:26.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc80b97a0 con 0x7f5de00700f0 2023-12-07T10:02:26.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de01eb950 con 0x7f5de00700f0 2023-12-07T10:02:26.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80b9b30 con 0x7f5de00700f0 2023-12-07T10:02:26.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de00c5ac0 con 0x7f5de00700f0 2023-12-07T10:02:26.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de004e890 con 0x7f5de00700f0 2023-12-07T10:02:26.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.811+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5dc80b5040 con 0x7f5de00700f0 2023-12-07T10:02:26.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.815+0000 7f5dd77fe640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5dc00668d0 0x7f5dc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:26.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.815+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5dc811ecd0 con 0x7f5de00700f0 2023-12-07T10:02:26.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.815+0000 7f5dded9d640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5dc00668d0 0x7f5dc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:26.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.815+0000 7f5dded9d640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5dc00668d0 0x7f5dc0068d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00011f0 tx=0x7f5dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:26.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.819+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5dc80ebcf0 con 0x7f5de00700f0 2023-12-07T10:02:26.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5de00c25f0 con 0x7f5de00700f0 2023-12-07T10:02:26.972 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5dd77fe640 1 -- 172.21.15.89:0/2733969537 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5dc80ef310 con 0x7f5de00700f0 2023-12-07T10:02:26.973 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5dc00668d0 msgr2=0x7f5dc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5dc00668d0 0x7f5dc0068d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00011f0 tx=0x7f5dd0009040 comp rx=0 tx=0).stop 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 msgr2=0x7f5de00bf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 0x7f5de00bf0a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800a990 tx=0x7f5dc801a510 comp rx=0 tx=0).stop 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 shutdown_connections 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5de0154000 0x7f5de014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00700f0 0x7f5de00bf0a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5dc00668d0 0x7f5dc0068d90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.967+0000 7f5de51a1640 1 --2- 172.21.15.89:0/2733969537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5de006df30 0x7f5de00bfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.971+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 >> 172.21.15.89:0/2733969537 conn(0x7f5de00c2a60 msgr2=0x7f5de0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.971+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 shutdown_connections 2023-12-07T10:02:26.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:26.971+0000 7f5de51a1640 1 -- 172.21.15.89:0/2733969537 wait complete. 2023-12-07T10:02:26.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:27.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.127+0000 7fa5e649c640 1 Processor -- start 2023-12-07T10:02:27.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.127+0000 7fa5e649c640 1 -- start start 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5e649c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5e649c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e0152d90 con 0x7fa5e014fb30 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5e649c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e0152480 con 0x7fa5e00a86d0 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5e649c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00a9760 con 0x7fa5e0156600 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5e4a39640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa5e014fb30 0x7fa5e00aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54838/0 (socket says 172.21.15.89:54838) 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5e4a39640 1 -- 172.21.15.89:0/1889128091 learned_addr learned my addr 172.21.15.89:0/1889128091 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:27.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5df7fe640 1 --2- 172.21.15.89:0/1889128091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164711120 0 0) 0x7fa5e0152480 con 0x7fa5e00a86d0 2023-12-07T10:02:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c8003530 con 0x7fa5e00a86d0 2023-12-07T10:02:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914930523 0 0) 0x7fa5e0152d90 con 0x7fa5e014fb30 2023-12-07T10:02:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e0152480 con 0x7fa5e014fb30 2023-12-07T10:02:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5df7fe640 1 -- 172.21.15.89:0/1889128091 >> v1:172.21.15.97:6789/0 conn(0x7fa5e00a86d0 legacy=0x7fa5e00a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5df7fe640 1 -- 172.21.15.89:0/1889128091 >> v1:172.21.15.89:6789/0 conn(0x7fa5e014fb30 legacy=0x7fa5e00aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.131+0000 7fa5df7fe640 1 -- 172.21.15.89:0/1889128091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0152740 con 0x7fa5e0156600 2023-12-07T10:02:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5df7fe640 1 --2- 172.21.15.89:0/1889128091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e014f5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40097f0 tx=0x7fa5d401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fb53b5827ec85c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40ab600 con 0x7fa5e0156600 2023-12-07T10:02:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d40a7050 con 0x7fa5e0156600 2023-12-07T10:02:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5deffd640 1 -- 172.21.15.89:0/1889128091 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40ab980 con 0x7fa5e0156600 2023-12-07T10:02:27.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- 172.21.15.89:0/1889128091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 msgr2=0x7fa5e014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 --2- 172.21.15.89:0/1889128091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e014f5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40097f0 tx=0x7fa5d401c4c0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- 172.21.15.89:0/1889128091 shutdown_connections 2023-12-07T10:02:27.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 --2- 172.21.15.89:0/1889128091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e014f5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- 172.21.15.89:0/1889128091 >> 172.21.15.89:0/1889128091 conn(0x7fa5e00c2a60 msgr2=0x7fa5e00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:27.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- 172.21.15.89:0/1889128091 shutdown_connections 2023-12-07T10:02:27.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- 172.21.15.89:0/1889128091 wait complete. 2023-12-07T10:02:27.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 Processor -- start 2023-12-07T10:02:27.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- start start 2023-12-07T10:02:27.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 0x7fa5e0147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5e014fb30 0x7fa5e00c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e00c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0145560 con 0x7fa5e00a86d0 2023-12-07T10:02:27.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0145800 con 0x7fa5e014fb30 2023-12-07T10:02:27.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.135+0000 7fa5e649c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e014ef90 con 0x7fa5e0156600 2023-12-07T10:02:27.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 0x7fa5e0147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 0x7fa5e0147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36546/0 (socket says 172.21.15.89:36546) 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 -- 172.21.15.89:0/2768683107 learned_addr learned my addr 172.21.15.89:0/2768683107 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5e4a39640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e00c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5df7fe640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5e014fb30 0x7fa5e00c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 -- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 msgr2=0x7fa5e00c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e00c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 -- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5e014fb30 msgr2=0x7fa5e00c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5e014fb30 0x7fa5e00c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 -- 172.21.15.89:0/2768683107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009420 con 0x7fa5e00a86d0 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5df7fe640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5e014fb30 0x7fa5e00c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5e4a39640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e00c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dffff640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 0x7fa5e0147600 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c3a0 tx=0x7fa5d000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00052d0 con 0x7fa5e00a86d0 2023-12-07T10:02:27.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0005430 con 0x7fa5e00a86d0 2023-12-07T10:02:27.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e014f270 con 0x7fa5e00a86d0 2023-12-07T10:02:27.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003820 con 0x7fa5e00a86d0 2023-12-07T10:02:27.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e01467a0 con 0x7fa5e00a86d0 2023-12-07T10:02:27.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e00c3b50 con 0x7fa5e00a86d0 2023-12-07T10:02:27.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa5d0003980 con 0x7fa5e00a86d0 2023-12-07T10:02:27.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.139+0000 7fa5dcff9640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5cc066900 0x7fa5cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.143+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5d0083d40 con 0x7fa5e00a86d0 2023-12-07T10:02:27.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.143+0000 7fa5df7fe640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5cc066900 0x7fa5cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.143+0000 7fa5df7fe640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5cc066900 0x7fa5cc068dc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40ad000 tx=0x7fa5d40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.143+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5d0050c10 con 0x7fa5e00a86d0 2023-12-07T10:02:27.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.295+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5e004e890 con 0x7fa5e00a86d0 2023-12-07T10:02:27.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5dcff9640 1 -- 172.21.15.89:0/2768683107 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5d00170a0 con 0x7fa5e00a86d0 2023-12-07T10:02:27.303 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5cc066900 msgr2=0x7fa5cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5cc066900 0x7fa5cc068dc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40ad000 tx=0x7fa5d40a6000 comp rx=0 tx=0).stop 2023-12-07T10:02:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 msgr2=0x7fa5e0147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 0x7fa5e0147600 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c3a0 tx=0x7fa5d000c860 comp rx=0 tx=0).stop 2023-12-07T10:02:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 shutdown_connections 2023-12-07T10:02:27.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa5cc066900 0x7fa5cc068dc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa5e0156600 0x7fa5e00c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5e014fb30 0x7fa5e00c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 --2- 172.21.15.89:0/2768683107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e00a86d0 0x7fa5e0147600 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 >> 172.21.15.89:0/2768683107 conn(0x7fa5e00c2a60 msgr2=0x7fa5e00c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:27.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 shutdown_connections 2023-12-07T10:02:27.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.299+0000 7fa5e649c640 1 -- 172.21.15.89:0/2768683107 wait complete. 2023-12-07T10:02:27.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:27.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.459+0000 7fb320a79640 1 Processor -- start 2023-12-07T10:02:27.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.459+0000 7fb320a79640 1 -- start start 2023-12-07T10:02:27.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb320a79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb31c156600 0x7fb31c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb320a79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c152d90 con 0x7fb31c14fb30 2023-12-07T10:02:27.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb320a79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c152480 con 0x7fb31c0a86d0 2023-12-07T10:02:27.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb320a79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c14ffa0 con 0x7fb31c156600 2023-12-07T10:02:27.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb31ad9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb31c14fb30 0x7fb31c0aae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54844/0 (socket says 172.21.15.89:54844) 2023-12-07T10:02:27.467 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb31ad9d640 1 -- 172.21.15.89:0/2408186273 learned_addr learned my addr 172.21.15.89:0/2408186273 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:27.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb313fff640 1 --2- 172.21.15.89:0/2408186273 >> v2:172.21.15.97:3300/0 conn(0x7fb31c156600 0x7fb31c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb319d9b640 1 -- 172.21.15.89:0/2408186273 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394269866 0 0) 0x7fb31c152d90 con 0x7fb31c14fb30 2023-12-07T10:02:27.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb319d9b640 1 -- 172.21.15.89:0/2408186273 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb308003530 con 0x7fb31c14fb30 2023-12-07T10:02:27.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb313fff640 1 -- 172.21.15.89:0/2408186273 >> v1:172.21.15.97:6789/0 conn(0x7fb31c0a86d0 legacy=0x7fb31c0a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb313fff640 1 -- 172.21.15.89:0/2408186273 >> v1:172.21.15.89:6789/0 conn(0x7fb31c14fb30 legacy=0x7fb31c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.463+0000 7fb313fff640 1 -- 172.21.15.89:0/2408186273 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0a9760 con 0x7fb31c156600 2023-12-07T10:02:27.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb313fff640 1 --2- 172.21.15.89:0/2408186273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c156600 0x7fb31c14f5f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097f0 tx=0x7fb30401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4945e96b74a8cd55 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb319d9b640 1 -- 172.21.15.89:0/2408186273 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040ab600 con 0x7fb31c156600 2023-12-07T10:02:27.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb319d9b640 1 -- 172.21.15.89:0/2408186273 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040a7050 con 0x7fb31c156600 2023-12-07T10:02:27.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb319d9b640 1 -- 172.21.15.89:0/2408186273 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040ab980 con 0x7fb31c156600 2023-12-07T10:02:27.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 -- 172.21.15.89:0/2408186273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c156600 msgr2=0x7fb31c14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 --2- 172.21.15.89:0/2408186273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c156600 0x7fb31c14f5f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097f0 tx=0x7fb30401c480 comp rx=0 tx=0).stop 2023-12-07T10:02:27.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 -- 172.21.15.89:0/2408186273 shutdown_connections 2023-12-07T10:02:27.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 --2- 172.21.15.89:0/2408186273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c156600 0x7fb31c14f5f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 -- 172.21.15.89:0/2408186273 >> 172.21.15.89:0/2408186273 conn(0x7fb31c0c2a60 msgr2=0x7fb31c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:27.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 -- 172.21.15.89:0/2408186273 shutdown_connections 2023-12-07T10:02:27.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 -- 172.21.15.89:0/2408186273 wait complete. 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 Processor -- start 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.467+0000 7fb320a79640 1 -- start start 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31c0a86d0 0x7fb31c143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c14fb30 0x7fb31c0bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 0x7fb31c0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1f07a0 con 0x7fb31c156600 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1491a0 con 0x7fb31c14fb30 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c143f80 con 0x7fb31c0a86d0 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 0x7fb31c0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 0x7fb31c0c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36560/0 (socket says 172.21.15.89:36560) 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 -- 172.21.15.89:0/3111715146 learned_addr learned my addr 172.21.15.89:0/3111715146 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb313fff640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c14fb30 0x7fb31c0bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31a59c640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31c0a86d0 0x7fb31c143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 -- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31c0a86d0 msgr2=0x7fb31c143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31c0a86d0 0x7fb31c143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 -- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c14fb30 msgr2=0x7fb31c0bf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c14fb30 0x7fb31c0bf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 -- 172.21.15.89:0/3111715146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009420 con 0x7fb31c156600 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb31ad9d640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 0x7fb31c0c18f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fb31400caa0 tx=0x7fb31400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400ac00 con 0x7fb31c156600 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400ad60 con 0x7fb31c156600 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314012620 con 0x7fb31c156600 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c14b1c0 con 0x7fb31c156600 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c144180 con 0x7fb31c156600 2023-12-07T10:02:27.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c0c1610 con 0x7fb31c156600 2023-12-07T10:02:27.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.471+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb314007070 con 0x7fb31c156600 2023-12-07T10:02:27.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.475+0000 7fb312ffd640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2fc0668d0 0x7fb2fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.475+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb314084640 con 0x7fb31c156600 2023-12-07T10:02:27.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.475+0000 7fb31a59c640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2fc0668d0 0x7fb2fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.475+0000 7fb31a59c640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2fc0668d0 0x7fb2fc068d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb30c007fd0 tx=0x7fb30c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.479+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb31c0c1610 con 0x7fb31c156600 2023-12-07T10:02:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb31c0c1610 con 0x7fb31c156600 2023-12-07T10:02:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb312ffd640 1 -- 172.21.15.89:0/3111715146 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v71) v1 ==== 105+0+11 (secure 0 0 0) 0x7fb31c0c1610 con 0x7fb31c156600 2023-12-07T10:02:27.633 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2fc0668d0 msgr2=0x7fb2fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2fc0668d0 0x7fb2fc068d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb30c007fd0 tx=0x7fb30c009040 comp rx=0 tx=0).stop 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 msgr2=0x7fb31c0c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 0x7fb31c0c18f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fb31400caa0 tx=0x7fb31400cf60 comp rx=0 tx=0).stop 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 shutdown_connections 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb31c156600 0x7fb31c0c18f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb31c14fb30 0x7fb31c0bf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb2fc0668d0 0x7fb2fc068d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 --2- 172.21.15.89:0/3111715146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb31c0a86d0 0x7fb31c143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.627+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 >> 172.21.15.89:0/3111715146 conn(0x7fb31c0c2a60 msgr2=0x7fb31c0c43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.631+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 shutdown_connections 2023-12-07T10:02:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.631+0000 7fb320a79640 1 -- 172.21.15.89:0/3111715146 wait complete. 2023-12-07T10:02:27.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:27.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460f45f640 1 Processor -- start 2023-12-07T10:02:27.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460f45f640 1 -- start start 2023-12-07T10:02:27.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460f45f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46080c8430 0x7f460806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460f45f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460806cf70 con 0x7f4608151d80 2023-12-07T10:02:27.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460f45f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4608152160 con 0x7f46080c7f20 2023-12-07T10:02:27.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460f45f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080c6a30 con 0x7f46080c8430 2023-12-07T10:02:27.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460d1fb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4608151d80 0x7f46080c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54856/0 (socket says 172.21.15.89:54856) 2023-12-07T10:02:27.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460d1fb640 1 -- 172.21.15.89:0/4076229438 learned_addr learned my addr 172.21.15.89:0/4076229438 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:27.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190586911 0 0) 0x7f460806cf70 con 0x7f4608151d80 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f4003530 con 0x7f4608151d80 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f460c9fa640 1 --2- 172.21.15.89:0/4076229438 >> v2:172.21.15.97:3300/0 conn(0x7f46080c8430 0x7f460806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812376182 0 0) 0x7f45f4003530 con 0x7f4608151d80 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 >> v2:172.21.15.97:3300/0 conn(0x7f46080c8430 msgr2=0x7f460806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 --2- 172.21.15.89:0/4076229438 >> v2:172.21.15.97:3300/0 conn(0x7f46080c8430 0x7f460806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 >> v1:172.21.15.97:6789/0 conn(0x7f46080c7f20 legacy=0x7f460806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080c72d0 con 0x7f4608151d80 2023-12-07T10:02:27.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f46040016a0 con 0x7f4608151d80 2023-12-07T10:02:27.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 >> v1:172.21.15.89:6789/0 conn(0x7f4608151d80 legacy=0x7f46080c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45f4003980 0x7f45f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.787+0000 7f45fffff640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45f40047d0 0x7f45f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f45f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080c6a30 con 0x7f45f40052b0 2023-12-07T10:02:27.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f400c180 con 0x7f45f40047d0 2023-12-07T10:02:27.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f400c340 con 0x7f45f4003980 2023-12-07T10:02:27.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f45f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d1fb640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45f4003980 0x7f45f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460c9fa640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45f40047d0 0x7f45f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 -- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45f4003980 msgr2=0x7f45f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:27.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45f4003980 0x7f45f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 -- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45f40047d0 msgr2=0x7f45f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:27.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45f40047d0 0x7f45f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 -- 172.21.15.89:0/4076229438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4003530 con 0x7f45f40052b0 2023-12-07T10:02:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 -- 172.21.15.89:0/4076229438 reap_dead start 2023-12-07T10:02:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f460d9fc640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f45f400b990 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4600001ca0 tx=0x7f460001c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d3d2c4de17d024 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600003b80 con 0x7f45f40052b0 2023-12-07T10:02:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600003ce0 con 0x7f45f40052b0 2023-12-07T10:02:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.791+0000 7f45fffff640 1 -- 172.21.15.89:0/4076229438 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600005310 con 0x7f45f40052b0 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- 172.21.15.89:0/4076229438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 msgr2=0x7f45f400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f45f400b990 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4600001ca0 tx=0x7f460001c5a0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- 172.21.15.89:0/4076229438 shutdown_connections 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 --2- 172.21.15.89:0/4076229438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f45f400b990 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- 172.21.15.89:0/4076229438 >> 172.21.15.89:0/4076229438 conn(0x7f46080abd00 msgr2=0x7f46080ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- 172.21.15.89:0/4076229438 shutdown_connections 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- 172.21.15.89:0/4076229438 wait complete. 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 Processor -- start 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- start start 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f460814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4608158330 0x7f46080c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4608158790 0x7f46080c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080c2230 con 0x7f45f40052b0 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4608157ca0 con 0x7f4608158330 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460f45f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46081565e0 con 0x7f4608158790 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f460814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f460814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36582/0 (socket says 172.21.15.89:36582) 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 -- 172.21.15.89:0/1088321931 learned_addr learned my addr 172.21.15.89:0/1088321931 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460c9fa640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4608158330 0x7f46080c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d9fc640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4608158790 0x7f46080c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 -- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4608158790 msgr2=0x7f46080c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4608158790 0x7f46080c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 -- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4608158330 msgr2=0x7f46080c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4608158330 0x7f46080c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460d1fb640 1 -- 172.21.15.89:0/1088321931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608156880 con 0x7f45f40052b0 2023-12-07T10:02:27.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.795+0000 7f460c9fa640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4608158330 0x7f46080c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f460d1fb640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f460814e560 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f46040124c0 tx=0x7f4604012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604014810 con 0x7f45f40052b0 2023-12-07T10:02:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46040149b0 con 0x7f45f40052b0 2023-12-07T10:02:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4608156b60 con 0x7f45f40052b0 2023-12-07T10:02:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604014d60 con 0x7f45f40052b0 2023-12-07T10:02:27.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460814eaa0 con 0x7f45f40052b0 2023-12-07T10:02:27.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4608156da0 con 0x7f45f40052b0 2023-12-07T10:02:27.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4604016480 con 0x7f45f40052b0 2023-12-07T10:02:27.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f45fdffb640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f45ec0668d0 0x7f45ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:27.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4604087d20 con 0x7f45f40052b0 2023-12-07T10:02:27.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.799+0000 7f460c9fa640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f45ec0668d0 0x7f45ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:27.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.803+0000 7f460c9fa640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f45ec0668d0 0x7f45ec068d90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f46080cae60 tx=0x7f45f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:27.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.803+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4608156da0 con 0x7f45f40052b0 2023-12-07T10:02:27.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f46080c14d0 con 0x7f45f40052b0 2023-12-07T10:02:27.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f45fdffb640 1 -- 172.21.15.89:0/1088321931 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v71) v1 ==== 101+0+11 (secure 0 0 0) 0x7f46080c14d0 con 0x7f45f40052b0 2023-12-07T10:02:27.960 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f45ec0668d0 msgr2=0x7f45ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f45ec0668d0 0x7f45ec068d90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f46080cae60 tx=0x7f45f8008040 comp rx=0 tx=0).stop 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 msgr2=0x7f460814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f460814e560 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f46040124c0 tx=0x7f4604012980 comp rx=0 tx=0).stop 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 shutdown_connections 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f45ec0668d0 0x7f45ec068d90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4608158790 0x7f46080c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4608158330 0x7f46080c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 --2- 172.21.15.89:0/1088321931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f40052b0 0x7f460814e560 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:27.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 >> 172.21.15.89:0/1088321931 conn(0x7f46080abd00 msgr2=0x7f4608150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:27.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 shutdown_connections 2023-12-07T10:02:27.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:27.955+0000 7f460f45f640 1 -- 172.21.15.89:0/1088321931 wait complete. 2023-12-07T10:02:27.980 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:02:28.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.111+0000 7f1fc230f640 1 Processor -- start 2023-12-07T10:02:28.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.111+0000 7f1fc230f640 1 -- start start 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc230f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1fbc14fcc0 0x7f1fbc156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc230f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1fbc0c19e0 0x7f1fbc0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc230f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0ab580 con 0x7f1fbc06d980 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc230f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc0aa340 con 0x7f1fbc0c19e0 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc230f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc152fe0 con 0x7f1fbc14fcc0 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fbb7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1fbc06d980 0x7f1fbc0aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54864/0 (socket says 172.21.15.89:54864) 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fbb7fe640 1 -- 172.21.15.89:0/2487270743 learned_addr learned my addr 172.21.15.89:0/2487270743 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:28.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc08ac640 1 --2- 172.21.15.89:0/2487270743 >> v2:172.21.15.89:3300/0 conn(0x7f1fbc0c19e0 0x7f1fbc0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fbbfff640 1 --2- 172.21.15.89:0/2487270743 >> v2:172.21.15.97:3300/0 conn(0x7f1fbc14fcc0 0x7f1fbc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fbaffd640 1 -- 172.21.15.89:0/2487270743 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586187930 0 0) 0x7f1fbc0ab580 con 0x7f1fbc06d980 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fbaffd640 1 -- 172.21.15.89:0/2487270743 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa4003530 con 0x7f1fbc06d980 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc08ac640 1 -- 172.21.15.89:0/2487270743 >> v2:172.21.15.97:3300/0 conn(0x7f1fbc14fcc0 msgr2=0x7f1fbc156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc08ac640 1 --2- 172.21.15.89:0/2487270743 >> v2:172.21.15.97:3300/0 conn(0x7f1fbc14fcc0 0x7f1fbc156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc08ac640 1 -- 172.21.15.89:0/2487270743 >> v1:172.21.15.89:6789/0 conn(0x7f1fbc06d980 legacy=0x7f1fbc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.115+0000 7f1fc08ac640 1 -- 172.21.15.89:0/2487270743 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc1532c0 con 0x7f1fbc0c19e0 2023-12-07T10:02:28.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc08ac640 1 --2- 172.21.15.89:0/2487270743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0c19e0 0x7f1fbc0c1e50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc06e350 tx=0x7f1fb401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717726f3c561db2a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fbaffd640 1 -- 172.21.15.89:0/2487270743 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40a58b0 con 0x7f1fbc0c19e0 2023-12-07T10:02:28.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fbaffd640 1 -- 172.21.15.89:0/2487270743 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb40a5a10 con 0x7f1fbc0c19e0 2023-12-07T10:02:28.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fbaffd640 1 -- 172.21.15.89:0/2487270743 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40a5d80 con 0x7f1fbc0c19e0 2023-12-07T10:02:28.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 -- 172.21.15.89:0/2487270743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0c19e0 msgr2=0x7f1fbc0c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 --2- 172.21.15.89:0/2487270743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0c19e0 0x7f1fbc0c1e50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc06e350 tx=0x7f1fb401c8e0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 -- 172.21.15.89:0/2487270743 shutdown_connections 2023-12-07T10:02:28.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 --2- 172.21.15.89:0/2487270743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0c19e0 0x7f1fbc0c1e50 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 --2- 172.21.15.89:0/2487270743 >> v2:172.21.15.97:3300/0 conn(0x7f1fbc14fcc0 0x7f1fbc156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 -- 172.21.15.89:0/2487270743 >> 172.21.15.89:0/2487270743 conn(0x7f1fbc0c2ad0 msgr2=0x7f1fbc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:28.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 -- 172.21.15.89:0/2487270743 shutdown_connections 2023-12-07T10:02:28.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 -- 172.21.15.89:0/2487270743 wait complete. 2023-12-07T10:02:28.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 Processor -- start 2023-12-07T10:02:28.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.119+0000 7f1fc230f640 1 -- start start 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fbc06d980 0x7f1fbc152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fbc0c19e0 0x7f1fbc15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 0x7f1fbc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1eedd0 con 0x7f1fbc0baff0 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0bbb00 con 0x7f1fbc06d980 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1ee810 con 0x7f1fbc0c19e0 2023-12-07T10:02:28.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 0x7f1fbc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 0x7f1fbc15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36600/0 (socket says 172.21.15.89:36600) 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 -- 172.21.15.89:0/1229048231 learned_addr learned my addr 172.21.15.89:0/1229048231 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fbb7fe640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fbc0c19e0 0x7f1fbc15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fbbfff640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fbc06d980 0x7f1fbc152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 -- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fbc0c19e0 msgr2=0x7f1fbc15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fbc0c19e0 0x7f1fbc15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 -- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fbc06d980 msgr2=0x7f1fbc152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fbc06d980 0x7f1fbc152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 -- 172.21.15.89:0/1229048231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb4009a70 con 0x7f1fbc0baff0 2023-12-07T10:02:28.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc08ac640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 0x7f1fbc15b280 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40194f0 tx=0x7f1fb4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40ad640 con 0x7f1fbc0baff0 2023-12-07T10:02:28.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb40ad7a0 con 0x7f1fbc0baff0 2023-12-07T10:02:28.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40adb10 con 0x7f1fbc0baff0 2023-12-07T10:02:28.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc1eeaf0 con 0x7f1fbc0baff0 2023-12-07T10:02:28.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc152a70 con 0x7f1fbc0baff0 2023-12-07T10:02:28.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc0bb960 con 0x7f1fbc0baff0 2023-12-07T10:02:28.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.123+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1fb40b4070 con 0x7f1fbc0baff0 2023-12-07T10:02:28.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.127+0000 7f1fb8ff9640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fa80668d0 0x7f1fa8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.127+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1fb411f4c0 con 0x7f1fbc0baff0 2023-12-07T10:02:28.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.127+0000 7f1fbbfff640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fa80668d0 0x7f1fa8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.127+0000 7f1fbbfff640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fa80668d0 0x7f1fa8068d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009ac0 tx=0x7f1fac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.131+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fbc0bb960 con 0x7f1fbc0baff0 2023-12-07T10:02:28.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1fbc06dd60 con 0x7f1fbc0baff0 2023-12-07T10:02:28.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fb8ff9640 1 -- 172.21.15.89:0/1229048231 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1fbc06dd60 con 0x7f1fbc0baff0 2023-12-07T10:02:28.295 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:02:28.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fa80668d0 msgr2=0x7f1fa8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fa80668d0 0x7f1fa8068d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009ac0 tx=0x7f1fac009190 comp rx=0 tx=0).stop 2023-12-07T10:02:28.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 msgr2=0x7f1fbc15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 0x7f1fbc15b280 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40194f0 tx=0x7f1fb4019680 comp rx=0 tx=0).stop 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 shutdown_connections 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fbc0baff0 0x7f1fbc15b280 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1fa80668d0 0x7f1fa8068d90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1fbc0c19e0 0x7f1fbc15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 --2- 172.21.15.89:0/1229048231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fbc06d980 0x7f1fbc152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 >> 172.21.15.89:0/1229048231 conn(0x7f1fbc0c2ad0 msgr2=0x7f1fbc153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 shutdown_connections 2023-12-07T10:02:28.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.291+0000 7f1fc230f640 1 -- 172.21.15.89:0/1229048231 wait complete. 2023-12-07T10:02:28.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-07T10:02:28.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:28.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-07T10:02:28.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:02:28.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:28.343 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T10:02:28.395 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:28.395 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:28.405 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:28.405 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:28.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:28.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d25c3640 1 Processor -- start 2023-12-07T10:02:28.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d25c3640 1 -- start start 2023-12-07T10:02:28.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d25c3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2cc160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d25c3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc155790 con 0x7fc2cc0bd720 2023-12-07T10:02:28.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d25c3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc0c4b00 con 0x7fc2cc0ca610 2023-12-07T10:02:28.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d25c3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c4de0 con 0x7fc2cc06cd90 2023-12-07T10:02:28.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cb7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc2cc0bd720 0x7fc2cc158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54880/0 (socket says 172.21.15.89:54880) 2023-12-07T10:02:28.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/328648563 learned_addr learned my addr 172.21.15.89:0/328648563 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2cc160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884944376 0 0) 0x7fc2cc155790 con 0x7fc2cc0bd720 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b4003530 con 0x7fc2cc0bd720 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598200301 0 0) 0x7fc2cc0c4b00 con 0x7fc2cc0ca610 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc155790 con 0x7fc2cc0ca610 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411916002 0 0) 0x7fc2b4003530 con 0x7fc2cc0bd720 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 msgr2=0x7fc2cc160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:28.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2cc160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 >> v1:172.21.15.97:6789/0 conn(0x7fc2cc0ca610 legacy=0x7fc2cc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc157e30 con 0x7fc2cc0bd720 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fc2c0001680 con 0x7fc2cc0bd720 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2cc160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 >> v1:172.21.15.89:6789/0 conn(0x7fc2cc0bd720 legacy=0x7fc2cc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4003b40 0x7fc2b4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4004d10 0x7fc2b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c4de0 con 0x7fc2b4003b40 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b400bb50 con 0x7fc2b4004d10 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b400bd10 con 0x7fc2cc06cd90 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4003b40 0x7fc2b4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cb7fe640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4004d10 0x7fc2b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cbfff640 1 -- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 msgr2=0x7fc2b40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc06cd90 0x7fc2b40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cbfff640 1 -- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4004d10 msgr2=0x7fc2b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4004d10 0x7fc2b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2cbfff640 1 -- 172.21.15.89:0/328648563 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4009a70 con 0x7fc2b4003b40 2023-12-07T10:02:28.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.591+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4004d10 0x7fc2b4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:28.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4003b40 0x7fc2b4003f40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0018d0 tx=0x7fc2bc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a96d95a40d5351f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0c52d0 con 0x7fc2b4003b40 2023-12-07T10:02:28.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0052f0 con 0x7fc2b4003b40 2023-12-07T10:02:28.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2caffd640 1 -- 172.21.15.89:0/328648563 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0a47a0 con 0x7fc2b4003b40 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d25c3640 1 -- 172.21.15.89:0/328648563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4003b40 msgr2=0x7fc2b4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/328648563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4003b40 0x7fc2b4003f40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0018d0 tx=0x7fc2bc01c240 comp rx=0 tx=0).stop 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d0b60640 1 -- 172.21.15.89:0/328648563 reap_dead start 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d25c3640 1 -- 172.21.15.89:0/328648563 shutdown_connections 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d25c3640 1 -- 172.21.15.89:0/328648563 >> 172.21.15.89:0/328648563 conn(0x7fc2cc071ea0 msgr2=0x7fc2cc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d25c3640 1 -- 172.21.15.89:0/328648563 shutdown_connections 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.595+0000 7fc2d25c3640 1 -- 172.21.15.89:0/328648563 wait complete. 2023-12-07T10:02:28.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 Processor -- start 2023-12-07T10:02:28.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 -- start start 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4003b40 0x7fc2cc14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc0aa990 0x7fc2cc14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 0x7fc2cc0ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0adee0 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0ad2d0 con 0x7fc2b4003b40 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0ad5b0 con 0x7fc2cc0aa990 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 0x7fc2cc0ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 0x7fc2cc0ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36608/0 (socket says 172.21.15.89:36608) 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 -- 172.21.15.89:0/1146974843 learned_addr learned my addr 172.21.15.89:0/1146974843 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4003b40 0x7fc2cc14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2cb7fe640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc0aa990 0x7fc2cc14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 -- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc0aa990 msgr2=0x7fc2cc14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc0aa990 0x7fc2cc14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 -- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4003b40 msgr2=0x7fc2cc14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4003b40 0x7fc2cc14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 -- 172.21.15.89:0/1146974843 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0ad890 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2cb7fe640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc0aa990 0x7fc2cc14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4003b40 0x7fc2cc14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d0b60640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 0x7fc2cc0ac0d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc06cb40 tx=0x7fc2c40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c400e070 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40039a0 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4003b10 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc0adb70 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.599+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc156360 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.603+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc0add00 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.603+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc2c4003c70 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.603+0000 7fc2c8ff9640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2b8066900 0x7fc2b8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.603+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc2c4084f80 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.603+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2b8066900 0x7fc2b8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.603+0000 7fc2cbfff640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2b8066900 0x7fc2b8068dc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ac000 tx=0x7fc2bc0a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.607+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2c4051e50 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.755+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2cc04e890 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2c8ff9640 1 -- 172.21.15.89:0/1146974843 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7fc2c4055470 con 0x7fc2cc0a9a70 2023-12-07T10:02:28.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:28.764 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2b8066900 msgr2=0x7fc2b8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2b8066900 0x7fc2b8068dc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ac000 tx=0x7fc2bc0a6070 comp rx=0 tx=0).stop 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 msgr2=0x7fc2cc0ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 0x7fc2cc0ac0d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc06cb40 tx=0x7fc2c40115a0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 shutdown_connections 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2cc0a9a70 0x7fc2cc0ac0d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2b8066900 0x7fc2b8068dc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc2cc0aa990 0x7fc2cc14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 --2- 172.21.15.89:0/1146974843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2b4003b40 0x7fc2cc14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 >> 172.21.15.89:0/1146974843 conn(0x7fc2cc071ea0 msgr2=0x7fc2cc153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 shutdown_connections 2023-12-07T10:02:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.759+0000 7fc2d25c3640 1 -- 172.21.15.89:0/1146974843 wait complete. 2023-12-07T10:02:28.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:28.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:28.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1e757640 1 Processor -- start 2023-12-07T10:02:28.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1e757640 1 -- start start 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1e757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c1806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1e757640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1806de00 con 0x7f9c180a8470 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1e757640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c18070390 con 0x7f9c1814eaf0 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1e757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1814eed0 con 0x7f9c180c0370 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1ccf4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9c180a8470 0x7f9c1806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54888/0 (socket says 172.21.15.89:54888) 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.919+0000 7f9c1ccf4640 1 -- 172.21.15.89:0/3688050777 learned_addr learned my addr 172.21.15.89:0/3688050777 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c177fe640 1 --2- 172.21.15.89:0/3688050777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c1806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268713222 0 0) 0x7f9c1806de00 con 0x7f9c180a8470 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00003530 con 0x7f9c180a8470 2023-12-07T10:02:28.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178055909 0 0) 0x7f9c18070390 con 0x7f9c1814eaf0 2023-12-07T10:02:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1806de00 con 0x7f9c1814eaf0 2023-12-07T10:02:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c177fe640 1 -- 172.21.15.89:0/3688050777 >> v1:172.21.15.97:6789/0 conn(0x7f9c1814eaf0 legacy=0x7f9c18151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c177fe640 1 -- 172.21.15.89:0/3688050777 >> v1:172.21.15.89:6789/0 conn(0x7f9c180a8470 legacy=0x7f9c1806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c177fe640 1 -- 172.21.15.89:0/3688050777 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18151270 con 0x7f9c180c0370 2023-12-07T10:02:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c177fe640 1 --2- 172.21.15.89:0/3688050777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c1806d110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097f0 tx=0x7f9c0c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed44815aa4190a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ac600 con 0x7f9c180c0370 2023-12-07T10:02:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0a8050 con 0x7f9c180c0370 2023-12-07T10:02:28.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.923+0000 7f9c16ffd640 1 -- 172.21.15.89:0/3688050777 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ac960 con 0x7f9c180c0370 2023-12-07T10:02:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- 172.21.15.89:0/3688050777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 msgr2=0x7f9c1806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 --2- 172.21.15.89:0/3688050777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c1806d110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097f0 tx=0x7f9c0c01c3a0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- 172.21.15.89:0/3688050777 shutdown_connections 2023-12-07T10:02:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 --2- 172.21.15.89:0/3688050777 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c1806d110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- 172.21.15.89:0/3688050777 >> 172.21.15.89:0/3688050777 conn(0x7f9c180c2a60 msgr2=0x7f9c180c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- 172.21.15.89:0/3688050777 shutdown_connections 2023-12-07T10:02:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- 172.21.15.89:0/3688050777 wait complete. 2023-12-07T10:02:28.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 Processor -- start 2023-12-07T10:02:28.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- start start 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c180a8470 0x7f9c180a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c180c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 0x7f9c181406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180aa4a0 con 0x7f9c1814eaf0 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180aafa0 con 0x7f9c180a8470 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1e757640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c3b50 con 0x7f9c180c0370 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1ccf4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 0x7f9c181406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1ccf4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 0x7f9c181406d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36612/0 (socket says 172.21.15.89:36612) 2023-12-07T10:02:28.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c1ccf4640 1 -- 172.21.15.89:0/2775940037 learned_addr learned my addr 172.21.15.89:0/2775940037 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.927+0000 7f9c177fe640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c180c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c17fff640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c180a8470 0x7f9c180a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1ccf4640 1 -- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 msgr2=0x7f9c180c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1ccf4640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c180c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1ccf4640 1 -- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c180a8470 msgr2=0x7f9c180a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1ccf4640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c180a8470 0x7f9c180a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1ccf4640 1 -- 172.21.15.89:0/2775940037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009420 con 0x7f9c1814eaf0 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c177fe640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c180c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c17fff640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c180a8470 0x7f9c180a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1ccf4640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 0x7f9c181406d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000cbf0 tx=0x7f9c1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000ace0 con 0x7f9c1814eaf0 2023-12-07T10:02:28.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000ae40 con 0x7f9c1814eaf0 2023-12-07T10:02:28.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10012600 con 0x7f9c1814eaf0 2023-12-07T10:02:28.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c18144c50 con 0x7f9c1814eaf0 2023-12-07T10:02:28.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c18144970 con 0x7f9c1814eaf0 2023-12-07T10:02:28.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c180c2810 con 0x7f9c1814eaf0 2023-12-07T10:02:28.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c10007070 con 0x7f9c1814eaf0 2023-12-07T10:02:28.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c14ff9640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c04066900 0x7f9c04068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:28.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9c10084660 con 0x7f9c1814eaf0 2023-12-07T10:02:28.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.931+0000 7f9c17fff640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c04066900 0x7f9c04068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:28.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.935+0000 7f9c17fff640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c04066900 0x7f9c04068dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9c080011f0 tx=0x7f9c08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:28.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:28.935+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c100515e0 con 0x7f9c1814eaf0 2023-12-07T10:02:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c181ed0e0 con 0x7f9c1814eaf0 2023-12-07T10:02:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c14ff9640 1 -- 172.21.15.89:0/2775940037 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c10054c00 con 0x7f9c1814eaf0 2023-12-07T10:02:29.093 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c04066900 msgr2=0x7f9c04068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c04066900 0x7f9c04068dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9c080011f0 tx=0x7f9c08009040 comp rx=0 tx=0).stop 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 msgr2=0x7f9c181406d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 0x7f9c181406d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000cbf0 tx=0x7f9c1000a430 comp rx=0 tx=0).stop 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 shutdown_connections 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1814eaf0 0x7f9c181406d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9c04066900 0x7f9c04068dc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9c180c0370 0x7f9c180c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 --2- 172.21.15.89:0/2775940037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c180a8470 0x7f9c180a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.087+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 >> 172.21.15.89:0/2775940037 conn(0x7f9c180c2a60 msgr2=0x7f9c180711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.091+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 shutdown_connections 2023-12-07T10:02:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.091+0000 7f9c1e757640 1 -- 172.21.15.89:0/2775940037 wait complete. 2023-12-07T10:02:29.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:29.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 Processor -- start 2023-12-07T10:02:29.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 -- start start 2023-12-07T10:02:29.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f71f0156600 0x7f71f014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f014fb30 0x7f71f00aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f0152d90 con 0x7f71f00a86d0 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f0152480 con 0x7f71f0156600 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.247+0000 7f71f6ae3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00a9760 con 0x7f71f014fb30 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71f487f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f71f00a86d0 0x7f71f00a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54904/0 (socket says 172.21.15.89:54904) 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71f487f640 1 -- 172.21.15.89:0/3945168760 learned_addr learned my addr 172.21.15.89:0/3945168760 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e7fff640 1 --2- 172.21.15.89:0/3945168760 >> v2:172.21.15.97:3300/0 conn(0x7f71f0156600 0x7f71f014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71f5080640 1 --2- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f014fb30 0x7f71f00aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e77fe640 1 -- 172.21.15.89:0/3945168760 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840384363 0 0) 0x7f71f0152d90 con 0x7f71f00a86d0 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e77fe640 1 -- 172.21.15.89:0/3945168760 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d8003530 con 0x7f71f00a86d0 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e7fff640 1 -- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f014fb30 msgr2=0x7f71f00aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e7fff640 1 --2- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f014fb30 0x7f71f00aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e7fff640 1 -- 172.21.15.89:0/3945168760 >> v1:172.21.15.89:6789/0 conn(0x7f71f00a86d0 legacy=0x7f71f00a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.251+0000 7f71e7fff640 1 -- 172.21.15.89:0/3945168760 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0152740 con 0x7f71f0156600 2023-12-07T10:02:29.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71e7fff640 1 --2- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f0156600 0x7f71f014f5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71e00097f0 tx=0x7f71e001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46ab1b087c4c790b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71e77fe640 1 -- 172.21.15.89:0/3945168760 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00ab600 con 0x7f71f0156600 2023-12-07T10:02:29.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71e77fe640 1 -- 172.21.15.89:0/3945168760 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e00a7050 con 0x7f71f0156600 2023-12-07T10:02:29.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71e77fe640 1 -- 172.21.15.89:0/3945168760 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00ab980 con 0x7f71f0156600 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f0156600 msgr2=0x7f71f014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f0156600 0x7f71f014f5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71e00097f0 tx=0x7f71e001c480 comp rx=0 tx=0).stop 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3945168760 shutdown_connections 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f014fb30 0x7f71f00aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3945168760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f0156600 0x7f71f014f5f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3945168760 >> 172.21.15.89:0/3945168760 conn(0x7f71f00c2a60 msgr2=0x7f71f00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3945168760 shutdown_connections 2023-12-07T10:02:29.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3945168760 wait complete. 2023-12-07T10:02:29.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 Processor -- start 2023-12-07T10:02:29.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- start start 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f00a86d0 0x7f71f01f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 0x7f71f0154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f0156600 0x7f71f0155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f014af60 con 0x7f71f014fb30 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f01f11e0 con 0x7f71f00a86d0 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.255+0000 7f71f6ae3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f01f1450 con 0x7f71f0156600 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 0x7f71f0154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 0x7f71f0154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36622/0 (socket says 172.21.15.89:36622) 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 -- 172.21.15.89:0/3654847898 learned_addr learned my addr 172.21.15.89:0/3654847898 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71f487f640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f00a86d0 0x7f71f01f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71f5080640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f0156600 0x7f71f0155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 -- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f0156600 msgr2=0x7f71f0155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f0156600 0x7f71f0155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 -- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f00a86d0 msgr2=0x7f71f01f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f00a86d0 0x7f71f01f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 -- 172.21.15.89:0/3654847898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0009420 con 0x7f71f014fb30 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71f487f640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f00a86d0 0x7f71f01f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e7fff640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 0x7f71f0154e10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f71e001ab30 tx=0x7f71e0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00b4400 con 0x7f71f014fb30 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e00b4580 con 0x7f71f014fb30 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f01548f0 con 0x7f71f014fb30 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00b4930 con 0x7f71f014fb30 2023-12-07T10:02:29.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f014b1b0 con 0x7f71f014fb30 2023-12-07T10:02:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f004e890 con 0x7f71f014fb30 2023-12-07T10:02:29.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71e00b2040 con 0x7f71f014fb30 2023-12-07T10:02:29.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.259+0000 7f71e57fa640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71dc0668d0 0x7f71dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.263+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f71e011e7a0 con 0x7f71f014fb30 2023-12-07T10:02:29.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.263+0000 7f71f487f640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71dc0668d0 0x7f71dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.263+0000 7f71f487f640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71dc0668d0 0x7f71dc068d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0011f0 tx=0x7f71ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.263+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71e00eb670 con 0x7f71f014fb30 2023-12-07T10:02:29.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.415+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71f014bac0 con 0x7f71f014fb30 2023-12-07T10:02:29.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.415+0000 7f71e57fa640 1 -- 172.21.15.89:0/3654847898 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71e00eec90 con 0x7f71f014fb30 2023-12-07T10:02:29.422 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71dc0668d0 msgr2=0x7f71dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71dc0668d0 0x7f71dc068d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0011f0 tx=0x7f71ec009040 comp rx=0 tx=0).stop 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 msgr2=0x7f71f0154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 0x7f71f0154e10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f71e001ab30 tx=0x7f71e0019220 comp rx=0 tx=0).stop 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 shutdown_connections 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f71dc0668d0 0x7f71dc068d90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f71f0156600 0x7f71f0155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f014fb30 0x7f71f0154e10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 --2- 172.21.15.89:0/3654847898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71f00a86d0 0x7f71f01f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 >> 172.21.15.89:0/3654847898 conn(0x7f71f00c2a60 msgr2=0x7f71f00c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 shutdown_connections 2023-12-07T10:02:29.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.419+0000 7f71f6ae3640 1 -- 172.21.15.89:0/3654847898 wait complete. 2023-12-07T10:02:29.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:29.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.575+0000 7f836271d640 1 Processor -- start 2023-12-07T10:02:29.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f836271d640 1 -- start start 2023-12-07T10:02:29.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f836271d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f835c0a86d0 0x7f835c0a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f836271d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f836271d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c152d90 con 0x7f835c156600 2023-12-07T10:02:29.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f836271d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c152480 con 0x7f835c0a86d0 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f836271d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0a9760 con 0x7f835c14fd00 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f835c0a86d0 0x7f835c0a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f835c0a86d0 0x7f835c0a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38996/0 (socket says 172.21.15.89:38996) 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f835c156600 0x7f835c14f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47824/0 (socket says 172.21.15.89:47824) 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 -- 172.21.15.89:0/2442566258 learned_addr learned my addr 172.21.15.89:0/2442566258 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f8360cba640 1 --2- 172.21.15.89:0/2442566258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 -- 172.21.15.89:0/2442566258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 msgr2=0x7f835c0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 --2- 172.21.15.89:0/2442566258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 -- 172.21.15.89:0/2442566258 >> v1:172.21.15.89:6789/0 conn(0x7f835c156600 legacy=0x7f835c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835affd640 1 -- 172.21.15.89:0/2442566258 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484505999 0 0) 0x7f835c152d90 con 0x7f835c156600 2023-12-07T10:02:29.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.579+0000 7f835bfff640 1 -- 172.21.15.89:0/2442566258 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c152740 con 0x7f835c0a86d0 2023-12-07T10:02:29.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f835bfff640 1 --2- 172.21.15.89:0/2442566258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c0a8f30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f834c0098a0 tx=0x7f834c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efcf06c042576b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f835affd640 1 -- 172.21.15.89:0/2442566258 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0ab610 con 0x7f835c0a86d0 2023-12-07T10:02:29.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f835affd640 1 -- 172.21.15.89:0/2442566258 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0ab770 con 0x7f835c0a86d0 2023-12-07T10:02:29.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f835affd640 1 -- 172.21.15.89:0/2442566258 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0abb00 con 0x7f835c0a86d0 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 -- 172.21.15.89:0/2442566258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 msgr2=0x7f835c0a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 --2- 172.21.15.89:0/2442566258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c0a8f30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f834c0098a0 tx=0x7f834c01c520 comp rx=0 tx=0).stop 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 -- 172.21.15.89:0/2442566258 shutdown_connections 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 --2- 172.21.15.89:0/2442566258 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 --2- 172.21.15.89:0/2442566258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c0a8f30 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 -- 172.21.15.89:0/2442566258 >> 172.21.15.89:0/2442566258 conn(0x7f835c0c2a60 msgr2=0x7f835c0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 -- 172.21.15.89:0/2442566258 shutdown_connections 2023-12-07T10:02:29.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 -- 172.21.15.89:0/2442566258 wait complete. 2023-12-07T10:02:29.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.583+0000 7f836271d640 1 Processor -- start 2023-12-07T10:02:29.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- start start 2023-12-07T10:02:29.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f835c156600 0x7f835c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c071610 con 0x7f835c0a86d0 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1495f0 con 0x7f835c156600 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1480c0 con 0x7f835c14fd00 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c15b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39002/0 (socket says 172.21.15.89:39002) 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 -- 172.21.15.89:0/149399164 learned_addr learned my addr 172.21.15.89:0/149399164 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f8360cba640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f835c156600 0x7f835c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835b7fe640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 -- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 msgr2=0x7f835c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 -- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f835c156600 msgr2=0x7f835c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f835c156600 0x7f835c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 -- 172.21.15.89:0/149399164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0094d0 con 0x7f835c0a86d0 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835b7fe640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c06c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f835bfff640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c15b360 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f834c0ad040 tx=0x7f834c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0ab610 con 0x7f835c0a86d0 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0b4820 con 0x7f835c0a86d0 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c1533a0 con 0x7f835c0a86d0 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0b4bd0 con 0x7f835c0a86d0 2023-12-07T10:02:29.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c071230 con 0x7f835c0a86d0 2023-12-07T10:02:29.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c04e890 con 0x7f835c0a86d0 2023-12-07T10:02:29.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.587+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f834c0b4d30 con 0x7f835c0a86d0 2023-12-07T10:02:29.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.591+0000 7f8358ff9640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8348066900 0x7f8348068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.591+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f834c11ee40 con 0x7f835c0a86d0 2023-12-07T10:02:29.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.591+0000 7f835b7fe640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8348066900 0x7f8348068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.591+0000 7f835b7fe640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8348066900 0x7f8348068dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8350007fd0 tx=0x7f8350009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.595+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f834c0ebd30 con 0x7f835c0a86d0 2023-12-07T10:02:29.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f835c152020 con 0x7f835c0a86d0 2023-12-07T10:02:29.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f8358ff9640 1 -- 172.21.15.89:0/149399164 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f834c0c4070 con 0x7f835c0a86d0 2023-12-07T10:02:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8348066900 msgr2=0x7f8348068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8348066900 0x7f8348068dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8350007fd0 tx=0x7f8350009040 comp rx=0 tx=0).stop 2023-12-07T10:02:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 msgr2=0x7f835c15b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c15b360 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f834c0ad040 tx=0x7f834c01ad60 comp rx=0 tx=0).stop 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 shutdown_connections 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f835c156600 0x7f835c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8348066900 0x7f8348068dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f835c14fd00 0x7f835c06c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 --2- 172.21.15.89:0/149399164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f835c0a86d0 0x7f835c15b360 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 >> 172.21.15.89:0/149399164 conn(0x7f835c0c2a60 msgr2=0x7f835c0c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 shutdown_connections 2023-12-07T10:02:29.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.743+0000 7f836271d640 1 -- 172.21.15.89:0/149399164 wait complete. 2023-12-07T10:02:29.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:29.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.903+0000 7fc11adfd640 1 Processor -- start 2023-12-07T10:02:29.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.903+0000 7fc11adfd640 1 -- start start 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11adfd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1140c0460 0x7fc1140c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11adfd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1140c1410 con 0x7fc1140c2750 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11adfd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1140c0e90 con 0x7fc1140bca80 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11adfd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1140c1130 con 0x7fc1140c0460 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11a5fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1140c0460 0x7fc1140c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11a5fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1140c0460 0x7fc1140c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39018/0 (socket says 172.21.15.89:39018) 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc119dfb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc1140c2750 0x7fc1140bc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47836/0 (socket says 172.21.15.89:47836) 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11a5fc640 1 -- 172.21.15.89:0/1154516000 learned_addr learned my addr 172.21.15.89:0/1154516000 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11a5fc640 1 -- 172.21.15.89:0/1154516000 >> v1:172.21.15.97:6789/0 conn(0x7fc1140bca80 legacy=0x7fc1140c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11a5fc640 1 -- 172.21.15.89:0/1154516000 >> v1:172.21.15.89:6789/0 conn(0x7fc1140c2750 legacy=0x7fc1140bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.907+0000 7fc11a5fc640 1 -- 172.21.15.89:0/1154516000 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11406da20 con 0x7fc1140c0460 2023-12-07T10:02:29.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11a5fc640 1 --2- 172.21.15.89:0/1154516000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c0460 0x7fc1140c5090 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009e80 tx=0x7fc10c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbe889d18fc7631 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc118df9640 1 -- 172.21.15.89:0/1154516000 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0a5810 con 0x7fc1140c0460 2023-12-07T10:02:29.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc118df9640 1 -- 172.21.15.89:0/1154516000 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0a5970 con 0x7fc1140c0460 2023-12-07T10:02:29.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc118df9640 1 -- 172.21.15.89:0/1154516000 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0a5d00 con 0x7fc1140c0460 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- 172.21.15.89:0/1154516000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c0460 msgr2=0x7fc1140c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 --2- 172.21.15.89:0/1154516000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c0460 0x7fc1140c5090 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009e80 tx=0x7fc10c01c930 comp rx=0 tx=0).stop 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- 172.21.15.89:0/1154516000 shutdown_connections 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 --2- 172.21.15.89:0/1154516000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c0460 0x7fc1140c5090 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- 172.21.15.89:0/1154516000 >> 172.21.15.89:0/1154516000 conn(0x7fc1140c5a60 msgr2=0x7fc1140c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- 172.21.15.89:0/1154516000 shutdown_connections 2023-12-07T10:02:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- 172.21.15.89:0/1154516000 wait complete. 2023-12-07T10:02:29.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 Processor -- start 2023-12-07T10:02:29.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- start start 2023-12-07T10:02:29.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1140bca80 0x7fc114150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1140c0460 0x7fc1141507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 0x7fc1140bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140bf9f0 con 0x7fc1140c2750 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11414be10 con 0x7fc1140bca80 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.911+0000 7fc11adfd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1140bfc00 con 0x7fc1140c0460 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 0x7fc1140bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 0x7fc1140bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39030/0 (socket says 172.21.15.89:39030) 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 -- 172.21.15.89:0/770674088 learned_addr learned my addr 172.21.15.89:0/770674088 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc119dfb640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1140bca80 0x7fc114150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc1195fa640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1140c0460 0x7fc1141507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 -- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1140c0460 msgr2=0x7fc1141507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1140c0460 0x7fc1141507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 -- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1140bca80 msgr2=0x7fc114150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1140bca80 0x7fc114150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 -- 172.21.15.89:0/770674088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009b30 con 0x7fc1140c2750 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11a5fc640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 0x7fc1140bed60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0af040 tx=0x7fc10c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0b8670 con 0x7fc1140c2750 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0b87f0 con 0x7fc1140c2750 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1140aab80 con 0x7fc1140c2750 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0b8ba0 con 0x7fc1140c2750 2023-12-07T10:02:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc114154cd0 con 0x7fc1140c2750 2023-12-07T10:02:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1140bfdc0 con 0x7fc1140c2750 2023-12-07T10:02:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.915+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc10c0b8d00 con 0x7fc1140c2750 2023-12-07T10:02:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.919+0000 7fc10a7fc640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc0f80668d0 0x7fc0f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.919+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc10c11f950 con 0x7fc1140c2750 2023-12-07T10:02:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.919+0000 7fc119dfb640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc0f80668d0 0x7fc0f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:29.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.919+0000 7fc119dfb640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc0f80668d0 0x7fc0f8068d90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc110000f70 tx=0x7fc110007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:29.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:29.919+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc10c0ec820 con 0x7fc1140c2750 2023-12-07T10:02:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.071+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1140680c0 con 0x7fc1140c2750 2023-12-07T10:02:30.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.071+0000 7fc10a7fc640 1 -- 172.21.15.89:0/770674088 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v71) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc10c0efe40 con 0x7fc1140c2750 2023-12-07T10:02:30.077 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc0f80668d0 msgr2=0x7fc0f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc0f80668d0 0x7fc0f8068d90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc110000f70 tx=0x7fc110007e50 comp rx=0 tx=0).stop 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 msgr2=0x7fc1140bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 0x7fc1140bed60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0af040 tx=0x7fc10c0196d0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 shutdown_connections 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1140c2750 0x7fc1140bed60 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc0f80668d0 0x7fc0f8068d90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc1140c0460 0x7fc1141507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 --2- 172.21.15.89:0/770674088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1140bca80 0x7fc114150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 >> 172.21.15.89:0/770674088 conn(0x7fc1140c5a60 msgr2=0x7fc1140bc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:30.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 shutdown_connections 2023-12-07T10:02:30.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.075+0000 7fc11adfd640 1 -- 172.21.15.89:0/770674088 wait complete. 2023-12-07T10:02:30.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 Processor -- start 2023-12-07T10:02:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 -- start start 2023-12-07T10:02:30.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62600c2750 0x7f62600bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6260071f30 0x7f62600bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600c1410 con 0x7f62600c0460 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600c0e90 con 0x7f6260071f30 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625f59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c1130 con 0x7f62600c2750 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6260071f30 0x7f62600bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6260071f30 0x7f62600bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39042/0 (socket says 172.21.15.89:39042) 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 -- 172.21.15.89:0/3885434152 learned_addr learned my addr 172.21.15.89:0/3885434152 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625e59c640 1 --2- 172.21.15.89:0/3885434152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62600c2750 0x7f62600bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 -- 172.21.15.89:0/3885434152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62600c2750 msgr2=0x7f62600bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 --2- 172.21.15.89:0/3885434152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62600c2750 0x7f62600bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 -- 172.21.15.89:0/3885434152 >> v1:172.21.15.97:6789/0 conn(0x7f62600c0460 legacy=0x7f62600c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.235+0000 7f625ed9d640 1 -- 172.21.15.89:0/3885434152 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626006da20 con 0x7f6260071f30 2023-12-07T10:02:30.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.239+0000 7f625ed9d640 1 --2- 172.21.15.89:0/3885434152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6260071f30 0x7f62600bc8b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6258009e50 tx=0x7f625801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb70319077cf08e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:30.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.239+0000 7f625d59a640 1 -- 172.21.15.89:0/3885434152 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580a57a0 con 0x7f6260071f30 2023-12-07T10:02:30.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.239+0000 7f625d59a640 1 -- 172.21.15.89:0/3885434152 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62600c4020 con 0x7f6260071f30 2023-12-07T10:02:30.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.239+0000 7f625d59a640 1 -- 172.21.15.89:0/3885434152 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580a5b20 con 0x7f6260071f30 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.239+0000 7f625f59e640 1 -- 172.21.15.89:0/3885434152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6260071f30 msgr2=0x7f62600bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.239+0000 7f625f59e640 1 --2- 172.21.15.89:0/3885434152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6260071f30 0x7f62600bc8b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6258009e50 tx=0x7f625801c8c0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- 172.21.15.89:0/3885434152 shutdown_connections 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 --2- 172.21.15.89:0/3885434152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6260071f30 0x7f62600bc8b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 --2- 172.21.15.89:0/3885434152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62600c2750 0x7f62600bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- 172.21.15.89:0/3885434152 >> 172.21.15.89:0/3885434152 conn(0x7f62600c5a60 msgr2=0x7f62600c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- 172.21.15.89:0/3885434152 shutdown_connections 2023-12-07T10:02:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- 172.21.15.89:0/3885434152 wait complete. 2023-12-07T10:02:30.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 Processor -- start 2023-12-07T10:02:30.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- start start 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6260071f30 0x7f62601ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62600c0460 0x7f62601ea620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 0x7f626014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626014db50 con 0x7f62600c2750 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600a4c90 con 0x7f62600c0460 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625f59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62601ed550 con 0x7f6260071f30 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 0x7f626014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 0x7f626014ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39048/0 (socket says 172.21.15.89:39048) 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 -- 172.21.15.89:0/3671408221 learned_addr learned my addr 172.21.15.89:0/3671408221 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625e59c640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6260071f30 0x7f62601ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625dd9b640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62600c0460 0x7f62601ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 -- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6260071f30 msgr2=0x7f62601ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6260071f30 0x7f62601ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 -- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62600c0460 msgr2=0x7f62601ea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62600c0460 0x7f62601ea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.243+0000 7f625ed9d640 1 -- 172.21.15.89:0/3671408221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009b30 con 0x7f62600c2750 2023-12-07T10:02:30.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f625ed9d640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 0x7f626014ee90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f625801a4f0 tx=0x7f6258019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:30.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580b8670 con 0x7f62600c2750 2023-12-07T10:02:30.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580b87d0 con 0x7f62600c2750 2023-12-07T10:02:30.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580b8b80 con 0x7f62600c2750 2023-12-07T10:02:30.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62601ec830 con 0x7f62600c2750 2023-12-07T10:02:30.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626014d870 con 0x7f62600c2750 2023-12-07T10:02:30.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62600680c0 con 0x7f62600c2750 2023-12-07T10:02:30.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f62580b8ce0 con 0x7f62600c2750 2023-12-07T10:02:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f624effd640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6240066900 0x7f6240068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f625811fa40 con 0x7f62600c2750 2023-12-07T10:02:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f625e59c640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6240066900 0x7f6240068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.247+0000 7f625e59c640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6240066900 0x7f6240068dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6250009ac0 tx=0x7f6250009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:30.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.251+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62580ecb10 con 0x7f62600c2750 2023-12-07T10:02:30.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.403+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6260074970 con 0x7f62600c2750 2023-12-07T10:02:30.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.403+0000 7f624effd640 1 -- 172.21.15.89:0/3671408221 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v71) v1 ==== 101+0+11 (secure 0 0 0) 0x7f62580bc020 con 0x7f62600c2750 2023-12-07T10:02:30.410 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:30.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6240066900 msgr2=0x7f6240068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6240066900 0x7f6240068dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6250009ac0 tx=0x7f6250009190 comp rx=0 tx=0).stop 2023-12-07T10:02:30.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 msgr2=0x7f626014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 0x7f626014ee90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f625801a4f0 tx=0x7f6258019660 comp rx=0 tx=0).stop 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 shutdown_connections 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62600c2750 0x7f626014ee90 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62600c0460 0x7f62601ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6240066900 0x7f6240068dc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 --2- 172.21.15.89:0/3671408221 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6260071f30 0x7f62601ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 >> 172.21.15.89:0/3671408221 conn(0x7f62600c5a60 msgr2=0x7f62600c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 shutdown_connections 2023-12-07T10:02:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.407+0000 7f625f59e640 1 -- 172.21.15.89:0/3671408221 wait complete. 2023-12-07T10:02:30.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T10:02:30.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 Processor -- start 2023-12-07T10:02:30.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 -- start start 2023-12-07T10:02:30.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcb8814e9d0 0x7fcb88151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb880a8470 0x7fcb8806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8806d320 con 0x7fcb88070b80 2023-12-07T10:02:30.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb880721b0 con 0x7fcb880a8470 2023-12-07T10:02:30.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb8df1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb880c2830 con 0x7fcb8814e9d0 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb880a8470 0x7fcb8806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb880a8470 0x7fcb8806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39056/0 (socket says 172.21.15.89:39056) 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 -- 172.21.15.89:0/2931062337 learned_addr learned my addr 172.21.15.89:0/2931062337 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb877fe640 1 --2- 172.21.15.89:0/2931062337 >> v2:172.21.15.97:3300/0 conn(0x7fcb8814e9d0 0x7fcb88151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 -- 172.21.15.89:0/2931062337 >> v2:172.21.15.97:3300/0 conn(0x7fcb8814e9d0 msgr2=0x7fcb88151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 --2- 172.21.15.89:0/2931062337 >> v2:172.21.15.97:3300/0 conn(0x7fcb8814e9d0 0x7fcb88151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 -- 172.21.15.89:0/2931062337 >> v1:172.21.15.97:6789/0 conn(0x7fcb88070b80 legacy=0x7fcb880c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.567+0000 7fcb87fff640 1 -- 172.21.15.89:0/2931062337 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88072450 con 0x7fcb880a8470 2023-12-07T10:02:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb87fff640 1 --2- 172.21.15.89:0/2931062337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880a8470 0x7fcb8806d7b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcb880c3980 tx=0x7fcb8001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db85f64801c37a7a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb867fc640 1 -- 172.21.15.89:0/2931062337 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800a5710 con 0x7fcb880a8470 2023-12-07T10:02:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb867fc640 1 -- 172.21.15.89:0/2931062337 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800a5870 con 0x7fcb880a8470 2023-12-07T10:02:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb867fc640 1 -- 172.21.15.89:0/2931062337 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800a5c00 con 0x7fcb880a8470 2023-12-07T10:02:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2931062337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880a8470 msgr2=0x7fcb8806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2931062337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880a8470 0x7fcb8806d7b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcb880c3980 tx=0x7fcb8001c940 comp rx=0 tx=0).stop 2023-12-07T10:02:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2931062337 shutdown_connections 2023-12-07T10:02:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2931062337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb880a8470 0x7fcb8806d7b0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2931062337 >> v2:172.21.15.97:3300/0 conn(0x7fcb8814e9d0 0x7fcb88151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2931062337 >> 172.21.15.89:0/2931062337 conn(0x7fcb880c2ad0 msgr2=0x7fcb880c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2931062337 shutdown_connections 2023-12-07T10:02:30.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2931062337 wait complete. 2023-12-07T10:02:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 Processor -- start 2023-12-07T10:02:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.571+0000 7fcb8df1d640 1 -- start start 2023-12-07T10:02:30.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 0x7fcb880ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880a8470 0x7fcb881ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8814e9d0 0x7fcb881ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814c020 con 0x7fcb88070b80 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880abf50 con 0x7fcb880a8470 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880ac230 con 0x7fcb8814e9d0 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 0x7fcb880ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 0x7fcb880ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39072/0 (socket says 172.21.15.89:39072) 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 -- 172.21.15.89:0/2171968005 learned_addr learned my addr 172.21.15.89:0/2171968005 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880a8470 0x7fcb881ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb87fff640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8814e9d0 0x7fcb881ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 -- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8814e9d0 msgr2=0x7fcb881ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8814e9d0 0x7fcb881ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 -- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880a8470 msgr2=0x7fcb881ecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880a8470 0x7fcb881ecc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 -- 172.21.15.89:0/2171968005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80009b30 con 0x7fcb88070b80 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb877fe640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 0x7fcb880ab110 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800d5f0 tx=0x7fcb7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780125f0 con 0x7fcb88070b80 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb78012750 con 0x7fcb88070b80 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8814a440 con 0x7fcb88070b80 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78012ae0 con 0x7fcb88070b80 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8814aa00 con 0x7fcb88070b80 2023-12-07T10:02:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.575+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8804e890 con 0x7fcb88070b80 2023-12-07T10:02:30.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.579+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb78012c40 con 0x7fcb88070b80 2023-12-07T10:02:30.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.579+0000 7fcb6ffff640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb740668d0 0x7fcb74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:30.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.579+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcb78084bc0 con 0x7fcb88070b80 2023-12-07T10:02:30.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.579+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb740668d0 0x7fcb74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:30.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.579+0000 7fcb86ffd640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb740668d0 0x7fcb74068d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcb8806dbf0 tx=0x7fcb7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:30.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.583+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb78051ab0 con 0x7fcb88070b80 2023-12-07T10:02:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.743+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb880700a0 con 0x7fcb88070b80 2023-12-07T10:02:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.743+0000 7fcb6ffff640 1 -- 172.21.15.89:0/2171968005 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb780550d0 con 0x7fcb88070b80 2023-12-07T10:02:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-12-07T10:02:30.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb740668d0 msgr2=0x7fcb74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb740668d0 0x7fcb74068d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcb8806dbf0 tx=0x7fcb7c009040 comp rx=0 tx=0).stop 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 msgr2=0x7fcb880ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 0x7fcb880ab110 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800d5f0 tx=0x7fcb7800dab0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 shutdown_connections 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fcb740668d0 0x7fcb74068d90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb8814e9d0 0x7fcb881ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb880a8470 0x7fcb881ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 --2- 172.21.15.89:0/2171968005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb88070b80 0x7fcb880ab110 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 >> 172.21.15.89:0/2171968005 conn(0x7fcb880c2ad0 msgr2=0x7fcb880c0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 shutdown_connections 2023-12-07T10:02:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:30.747+0000 7fcb8df1d640 1 -- 172.21.15.89:0/2171968005 wait complete. 2023-12-07T10:02:30.770 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-07T10:02:30.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:30.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T10:02:30.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:02:30.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:30.800 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T10:02:30.853 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T10:02:30.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:02:30.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T10:02:31.023 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T10:02:31.023 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:31.023 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:31.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:02:31.032 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:31.032 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:31.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:02:31.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ffe079640 1 Processor -- start 2023-12-07T10:02:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ffe079640 1 -- start start 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ffe079640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ff8154160 0x7f3ff81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ffe079640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff8072780 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ffe079640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff80ac160 con 0x7f3ff80700a0 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ffe079640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8154af0 con 0x7f3ff8154160 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ff8154160 0x7f3ff81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff6ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3ff80ab7a0 0x7f3ff80aacd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47840/0 (socket says 172.21.15.89:47840) 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff6ffd640 1 -- 172.21.15.89:0/3711115961 learned_addr learned my addr 172.21.15.89:0/3711115961 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:31.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ff8154160 0x7f3ff81545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39078/0 (socket says 172.21.15.89:39078) 2023-12-07T10:02:31.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff7fff640 1 -- 172.21.15.89:0/3711115961 >> v1:172.21.15.97:6789/0 conn(0x7f3ff80700a0 legacy=0x7f3ff80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff7fff640 1 -- 172.21.15.89:0/3711115961 >> v1:172.21.15.89:6789/0 conn(0x7f3ff80ab7a0 legacy=0x7f3ff80aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.207+0000 7f3ff7fff640 1 -- 172.21.15.89:0/3711115961 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80ab3e0 con 0x7f3ff8154160 2023-12-07T10:02:31.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ff7fff640 1 --2- 172.21.15.89:0/3711115961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff8154160 0x7f3ff81545b0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009d90 tx=0x7f3ff001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa9ac244826434e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ff67fc640 1 -- 172.21.15.89:0/3711115961 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff00a57e0 con 0x7f3ff8154160 2023-12-07T10:02:31.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ff67fc640 1 -- 172.21.15.89:0/3711115961 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff00a5940 con 0x7f3ff8154160 2023-12-07T10:02:31.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ff67fc640 1 -- 172.21.15.89:0/3711115961 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff00a5cd0 con 0x7f3ff8154160 2023-12-07T10:02:31.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 -- 172.21.15.89:0/3711115961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff8154160 msgr2=0x7f3ff81545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 --2- 172.21.15.89:0/3711115961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff8154160 0x7f3ff81545b0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009d90 tx=0x7f3ff001c830 comp rx=0 tx=0).stop 2023-12-07T10:02:31.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 -- 172.21.15.89:0/3711115961 shutdown_connections 2023-12-07T10:02:31.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 --2- 172.21.15.89:0/3711115961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff8154160 0x7f3ff81545b0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 -- 172.21.15.89:0/3711115961 >> 172.21.15.89:0/3711115961 conn(0x7f3ff80c2ad0 msgr2=0x7f3ff80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:31.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 -- 172.21.15.89:0/3711115961 shutdown_connections 2023-12-07T10:02:31.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.211+0000 7f3ffe079640 1 -- 172.21.15.89:0/3711115961 wait complete. 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 Processor -- start 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 -- start start 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ff80700a0 0x7f3ff8143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 0x7f3ff80c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ff8154160 0x7f3ff80c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c4ca0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80bf630 con 0x7f3ff8154160 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80bf910 con 0x7f3ff80700a0 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 0x7f3ff80c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 0x7f3ff80c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39088/0 (socket says 172.21.15.89:39088) 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 -- 172.21.15.89:0/220926299 learned_addr learned my addr 172.21.15.89:0/220926299 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff77fe640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ff80700a0 0x7f3ff8143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff7fff640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ff8154160 0x7f3ff80c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 -- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ff80700a0 msgr2=0x7f3ff8143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ff80700a0 0x7f3ff8143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 -- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ff8154160 msgr2=0x7f3ff80c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ff8154160 0x7f3ff80c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 -- 172.21.15.89:0/220926299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0009a70 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff7fff640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ff8154160 0x7f3ff80c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ff6ffd640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 0x7f3ff80c4220 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00c500 tx=0x7f3fec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec005cf0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec005e50 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff80bfbf0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0072f0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.215+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff81531a0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.219+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff804e890 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.219+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3fec007450 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.219+0000 7f3fdffff640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3fe40668d0 0x7f3fe4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.219+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3fec083bc0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.219+0000 7f3ff77fe640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3fe40668d0 0x7f3fe4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.219+0000 7f3ff77fe640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3fe40668d0 0x7f3fe4068d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000f70 tx=0x7f3fe8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.223+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fec050bc0 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.411+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ff8071f80 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.411+0000 7f3fdffff640 1 -- 172.21.15.89:0/220926299 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f3fec017020 con 0x7f3ff80ab7a0 2023-12-07T10:02:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:31.417 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:31.417 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 53 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3fe40668d0 msgr2=0x7f3fe4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3fe40668d0 0x7f3fe4068d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000f70 tx=0x7f3fe8009040 comp rx=0 tx=0).stop 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 msgr2=0x7f3ff80c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 0x7f3ff80c4220 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00c500 tx=0x7f3fec00c9c0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 shutdown_connections 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ff8154160 0x7f3ff80c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ff80ab7a0 0x7f3ff80c4220 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3fe40668d0 0x7f3fe4068d90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 --2- 172.21.15.89:0/220926299 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3ff80700a0 0x7f3ff8143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 >> 172.21.15.89:0/220926299 conn(0x7f3ff80c2ad0 msgr2=0x7f3ff8150d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 shutdown_connections 2023-12-07T10:02:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.415+0000 7f3ffe079640 1 -- 172.21.15.89:0/220926299 wait complete. 2023-12-07T10:02:31.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:31.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.571+0000 7f5c780bb640 1 Processor -- start 2023-12-07T10:02:31.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.571+0000 7f5c780bb640 1 -- start start 2023-12-07T10:02:31.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c780bb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c7014e9d0 0x7f5c70151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c780bb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7006d320 con 0x7f5c700a8470 2023-12-07T10:02:31.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c780bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700721b0 con 0x7f5c70070b80 2023-12-07T10:02:31.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c780bb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700c2830 con 0x7f5c7014e9d0 2023-12-07T10:02:31.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c75e57640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c7014e9d0 0x7f5c70151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c75e57640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c7014e9d0 0x7f5c70151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39096/0 (socket says 172.21.15.89:39096) 2023-12-07T10:02:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c75e57640 1 -- 172.21.15.89:0/4073785114 learned_addr learned my addr 172.21.15.89:0/4073785114 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c75e57640 1 -- 172.21.15.89:0/4073785114 >> v1:172.21.15.97:6789/0 conn(0x7f5c70070b80 legacy=0x7f5c700c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c75e57640 1 -- 172.21.15.89:0/4073785114 >> v1:172.21.15.89:6789/0 conn(0x7f5c700a8470 legacy=0x7f5c7006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.575+0000 7f5c75e57640 1 -- 172.21.15.89:0/4073785114 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70072450 con 0x7f5c7014e9d0 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c75e57640 1 --2- 172.21.15.89:0/4073785114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7014e9d0 0x7f5c70151e60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00bb10 tx=0x7f5c6c01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67997aecfc468205 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c74e55640 1 -- 172.21.15.89:0/4073785114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0a7a60 con 0x7f5c7014e9d0 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c74e55640 1 -- 172.21.15.89:0/4073785114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c0a7bc0 con 0x7f5c7014e9d0 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c74e55640 1 -- 172.21.15.89:0/4073785114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0af440 con 0x7f5c7014e9d0 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- 172.21.15.89:0/4073785114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7014e9d0 msgr2=0x7f5c70151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 --2- 172.21.15.89:0/4073785114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7014e9d0 0x7f5c70151e60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00bb10 tx=0x7f5c6c01eb80 comp rx=0 tx=0).stop 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- 172.21.15.89:0/4073785114 shutdown_connections 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 --2- 172.21.15.89:0/4073785114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7014e9d0 0x7f5c70151e60 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- 172.21.15.89:0/4073785114 >> 172.21.15.89:0/4073785114 conn(0x7f5c700c2ad0 msgr2=0x7f5c700c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:31.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- 172.21.15.89:0/4073785114 shutdown_connections 2023-12-07T10:02:31.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- 172.21.15.89:0/4073785114 wait complete. 2023-12-07T10:02:31.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 Processor -- start 2023-12-07T10:02:31.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- start start 2023-12-07T10:02:31.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c70070b80 0x7f5c700ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 0x7f5c700bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c7014e9d0 0x7f5c701ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700ab620 con 0x7f5c700a8470 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700ab830 con 0x7f5c7014e9d0 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.579+0000 7f5c780bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701f0cb0 con 0x7f5c70070b80 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 0x7f5c700bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 0x7f5c700bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39098/0 (socket says 172.21.15.89:39098) 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 -- 172.21.15.89:0/608211042 learned_addr learned my addr 172.21.15.89:0/608211042 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c76658640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c7014e9d0 0x7f5c701ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75e57640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c70070b80 0x7f5c700ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 -- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c70070b80 msgr2=0x7f5c700ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c70070b80 0x7f5c700ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 -- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c7014e9d0 msgr2=0x7f5c701ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c7014e9d0 0x7f5c701ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 -- 172.21.15.89:0/608211042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c00b770 con 0x7f5c700a8470 2023-12-07T10:02:31.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c75656640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 0x7f5c700bf660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000c4d0 tx=0x7f5c6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600052d0 con 0x7f5c700a8470 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60005430 con 0x7f5c700a8470 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60012830 con 0x7f5c700a8470 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c701f0f90 con 0x7f5c700a8470 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c700bfba0 con 0x7f5c700a8470 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7004e890 con 0x7f5c700a8470 2023-12-07T10:02:31.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5c60012990 con 0x7f5c700a8470 2023-12-07T10:02:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.583+0000 7f5c667fc640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5c540668d0 0x7f5c54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.587+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5c60084220 con 0x7f5c700a8470 2023-12-07T10:02:31.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.587+0000 7f5c75e57640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5c540668d0 0x7f5c54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.587+0000 7f5c75e57640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5c540668d0 0x7f5c54068d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0b1000 tx=0x7f5c6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.587+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c60051190 con 0x7f5c700a8470 2023-12-07T10:02:31.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.739+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c700700a0 con 0x7f5c700a8470 2023-12-07T10:02:31.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.739+0000 7f5c667fc640 1 -- 172.21.15.89:0/608211042 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7f5c600547b0 con 0x7f5c700a8470 2023-12-07T10:02:31.745 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:31.745 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5c540668d0 msgr2=0x7f5c54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5c540668d0 0x7f5c54068d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0b1000 tx=0x7f5c6c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 msgr2=0x7f5c700bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 0x7f5c700bf660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000c4d0 tx=0x7f5c6000c990 comp rx=0 tx=0).stop 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 shutdown_connections 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c7014e9d0 0x7f5c701ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c700a8470 0x7f5c700bf660 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5c540668d0 0x7f5c54068d90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 --2- 172.21.15.89:0/608211042 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5c70070b80 0x7f5c700ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 >> 172.21.15.89:0/608211042 conn(0x7f5c700c2ad0 msgr2=0x7f5c7014d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 shutdown_connections 2023-12-07T10:02:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.743+0000 7f5c780bb640 1 -- 172.21.15.89:0/608211042 wait complete. 2023-12-07T10:02:31.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T10:01:48.336104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T10:01:49.595527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:31.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:31.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 Processor -- start 2023-12-07T10:02:31.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 -- start start 2023-12-07T10:02:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe284156600 0x7fe28414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 0x7fe2840aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe284152d90 con 0x7fe2840a86d0 2023-12-07T10:02:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe284152480 con 0x7fe284156600 2023-12-07T10:02:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe28a98d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840a9760 con 0x7fe28414fb30 2023-12-07T10:02:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe283fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe2840a86d0 0x7fe2840a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47854/0 (socket says 172.21.15.89:47854) 2023-12-07T10:02:31.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe283fff640 1 -- 172.21.15.89:0/3110016400 learned_addr learned my addr 172.21.15.89:0/3110016400 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:31.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe288f2a640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 0x7fe2840aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe2837fe640 1 --2- 172.21.15.89:0/3110016400 >> v2:172.21.15.97:3300/0 conn(0x7fe284156600 0x7fe28414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244787288 0 0) 0x7fe284152d90 con 0x7fe2840a86d0 2023-12-07T10:02:31.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe26c003530 con 0x7fe2840a86d0 2023-12-07T10:02:31.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732265981 0 0) 0x7fe26c003530 con 0x7fe2840a86d0 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 msgr2=0x7fe2840aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 0x7fe2840aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 >> v2:172.21.15.97:3300/0 conn(0x7fe284156600 msgr2=0x7fe28414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 --2- 172.21.15.89:0/3110016400 >> v2:172.21.15.97:3300/0 conn(0x7fe284156600 0x7fe28414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284152740 con 0x7fe2840a86d0 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fe274001680 con 0x7fe2840a86d0 2023-12-07T10:02:31.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 >> v1:172.21.15.89:6789/0 conn(0x7fe2840a86d0 legacy=0x7fe2840a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 0x7fe26c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe26c003f50 0x7fe26c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c004d10 0x7fe26c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe284152480 con 0x7fe26c003f50 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840a9760 con 0x7fe26c004d10 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c00b990 con 0x7fe28414fb30 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe2837fe640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe26c003f50 0x7fe26c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe283fff640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 0x7fe26c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe288f2a640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c004d10 0x7fe26c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe2837fe640 1 -- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 msgr2=0x7fe26c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:31.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe2837fe640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe28414fb30 0x7fe26c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.903+0000 7fe2837fe640 1 -- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c004d10 msgr2=0x7fe26c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:31.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe2837fe640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c004d10 0x7fe26c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe2837fe640 1 -- 172.21.15.89:0/3110016400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c003530 con 0x7fe26c003f50 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe2837fe640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe26c003f50 0x7fe26c0047d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe278009ae0 tx=0x7fe27801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c291d28ddce89d78 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780a5640 con 0x7fe26c003f50 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2780a57a0 con 0x7fe26c003f50 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe282ffd640 1 -- 172.21.15.89:0/3110016400 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780a5b50 con 0x7fe26c003f50 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe28a98d640 1 -- 172.21.15.89:0/3110016400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe26c003f50 msgr2=0x7fe26c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe28a98d640 1 --2- 172.21.15.89:0/3110016400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe26c003f50 0x7fe26c0047d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe278009ae0 tx=0x7fe27801ca50 comp rx=0 tx=0).stop 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe288f2a640 1 -- 172.21.15.89:0/3110016400 reap_dead start 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe28a98d640 1 -- 172.21.15.89:0/3110016400 shutdown_connections 2023-12-07T10:02:31.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe28a98d640 1 -- 172.21.15.89:0/3110016400 >> 172.21.15.89:0/3110016400 conn(0x7fe2840c2a60 msgr2=0x7fe2840c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe28a98d640 1 -- 172.21.15.89:0/3110016400 shutdown_connections 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.907+0000 7fe28a98d640 1 -- 172.21.15.89:0/3110016400 wait complete. 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 Processor -- start 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 -- start start 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c003f50 0x7fe2840714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2840c4c90 0x7fe2841457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 0x7fe284145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840c5b90 con 0x7fe2840bffb0 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe284146c50 con 0x7fe26c003f50 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe284147640 con 0x7fe2840c4c90 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 0x7fe284145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 0x7fe284145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39128/0 (socket says 172.21.15.89:39128) 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 -- 172.21.15.89:0/1595647521 learned_addr learned my addr 172.21.15.89:0/1595647521 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe283fff640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c003f50 0x7fe2840714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe2837fe640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2840c4c90 0x7fe2841457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 -- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2840c4c90 msgr2=0x7fe2841457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2840c4c90 0x7fe2841457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 -- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c003f50 msgr2=0x7fe2840714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c003f50 0x7fe2840714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 -- 172.21.15.89:0/1595647521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2841533a0 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe288f2a640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 0x7fe284145d20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe2840c6f00 tx=0x7fe27c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00e040 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00f040 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe284147360 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.911+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c015430 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2840c54d0 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28404e890 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe27c015590 con 0x7fe2840bffb0 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe280ff9640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2700668d0 0x7fe270068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:31.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe27c084fe0 con 0x7fe2840bffb0 2023-12-07T10:02:31.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe283fff640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2700668d0 0x7fe270068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:31.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.915+0000 7fe283fff640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2700668d0 0x7fe270068d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c10 tx=0x7fe274001b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:31.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:31.919+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe27c051ed0 con 0x7fe2840bffb0 2023-12-07T10:02:32.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2840c1520 con 0x7fe2840bffb0 2023-12-07T10:02:32.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe280ff9640 1 -- 172.21.15.89:0/1595647521 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe27c0554f0 con 0x7fe2840bffb0 2023-12-07T10:02:32.075 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2700668d0 msgr2=0x7fe270068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2700668d0 0x7fe270068d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c10 tx=0x7fe274001b40 comp rx=0 tx=0).stop 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 msgr2=0x7fe284145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 0x7fe284145d20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe2840c6f00 tx=0x7fe27c00f1b0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 shutdown_connections 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840bffb0 0x7fe284145d20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2700668d0 0x7fe270068d90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2840c4c90 0x7fe2841457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 --2- 172.21.15.89:0/1595647521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe26c003f50 0x7fe2840714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 >> 172.21.15.89:0/1595647521 conn(0x7fe2840c2a60 msgr2=0x7fe28414d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 shutdown_connections 2023-12-07T10:02:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.071+0000 7fe28a98d640 1 -- 172.21.15.89:0/1595647521 wait complete. 2023-12-07T10:02:32.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T10:02:32.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 Processor -- start 2023-12-07T10:02:32.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 -- start start 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c340c8430 0x7f7c3406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c340c7f20 0x7f7c3406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3406cf70 con 0x7f7c34151d80 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34152160 con 0x7f7c340c8430 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c3ae32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c6a30 con 0x7f7c340c7f20 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c340c8430 0x7f7c3406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c340c8430 0x7f7c3406b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39142/0 (socket says 172.21.15.89:39142) 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 -- 172.21.15.89:0/1981850401 learned_addr learned my addr 172.21.15.89:0/1981850401 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c393cf640 1 --2- 172.21.15.89:0/1981850401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c340c7f20 0x7f7c3406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 -- 172.21.15.89:0/1981850401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c340c7f20 msgr2=0x7f7c3406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:32.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 --2- 172.21.15.89:0/1981850401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c340c7f20 0x7f7c3406bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 -- 172.21.15.89:0/1981850401 >> v1:172.21.15.97:6789/0 conn(0x7f7c34151d80 legacy=0x7f7c340c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.231+0000 7f7c33fff640 1 -- 172.21.15.89:0/1981850401 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340c72d0 con 0x7f7c340c8430 2023-12-07T10:02:32.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c33fff640 1 --2- 172.21.15.89:0/1981850401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c8430 0x7f7c3406b720 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009870 tx=0x7f7c2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d6c722a5fd8094 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c337fe640 1 -- 172.21.15.89:0/1981850401 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200ab680 con 0x7f7c340c8430 2023-12-07T10:02:32.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c337fe640 1 -- 172.21.15.89:0/1981850401 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c200ab7e0 con 0x7f7c340c8430 2023-12-07T10:02:32.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c337fe640 1 -- 172.21.15.89:0/1981850401 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200abb70 con 0x7f7c340c8430 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 -- 172.21.15.89:0/1981850401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c8430 msgr2=0x7f7c3406b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/1981850401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c8430 0x7f7c3406b720 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009870 tx=0x7f7c2001c480 comp rx=0 tx=0).stop 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 -- 172.21.15.89:0/1981850401 shutdown_connections 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/1981850401 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c340c7f20 0x7f7c3406bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/1981850401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c8430 0x7f7c3406b720 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 -- 172.21.15.89:0/1981850401 >> 172.21.15.89:0/1981850401 conn(0x7f7c340abd00 msgr2=0x7f7c340ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:32.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 -- 172.21.15.89:0/1981850401 shutdown_connections 2023-12-07T10:02:32.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.235+0000 7f7c3ae32640 1 -- 172.21.15.89:0/1981850401 wait complete. 2023-12-07T10:02:32.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 Processor -- start 2023-12-07T10:02:32.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 -- start start 2023-12-07T10:02:32.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 0x7f7c340c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c340c8430 0x7f7c3414d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c34151d80 0x7f7c3414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c01f0 con 0x7f7c340c7f20 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340bdf10 con 0x7f7c340c8430 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c3040 con 0x7f7c34151d80 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 0x7f7c340c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 0x7f7c340c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39146/0 (socket says 172.21.15.89:39146) 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 -- 172.21.15.89:0/525124522 learned_addr learned my addr 172.21.15.89:0/525124522 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c393cf640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c34151d80 0x7f7c3414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c33fff640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c340c8430 0x7f7c3414d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 -- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c34151d80 msgr2=0x7f7c3414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c34151d80 0x7f7c3414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 -- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c340c8430 msgr2=0x7f7c3414d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c340c8430 0x7f7c3414d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 -- 172.21.15.89:0/525124522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200094d0 con 0x7f7c340c7f20 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c38bce640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 0x7f7c340c2b00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c3c0 tx=0x7f7c2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280052d0 con 0x7f7c340c7f20 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28005430 con 0x7f7c340c7f20 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28003840 con 0x7f7c340c7f20 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340c3270 con 0x7f7c340c7f20 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.239+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340c3810 con 0x7f7c340c7f20 2023-12-07T10:02:32.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.243+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3404e890 con 0x7f7c340c7f20 2023-12-07T10:02:32.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.243+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c280039a0 con 0x7f7c340c7f20 2023-12-07T10:02:32.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.243+0000 7f7c317fa640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c18066900 0x7f7c18068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.243+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7c28083c50 con 0x7f7c340c7f20 2023-12-07T10:02:32.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.243+0000 7f7c33fff640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c18066900 0x7f7c18068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.243+0000 7f7c33fff640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c18066900 0x7f7c18068dc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c200af000 tx=0x7f7c200b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.247+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c28050bd0 con 0x7f7c340c7f20 2023-12-07T10:02:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c34153760 con 0x7f7c340c7f20 2023-12-07T10:02:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c317fa640 1 -- 172.21.15.89:0/525124522 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c280541f0 con 0x7f7c340c7f20 2023-12-07T10:02:32.408 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c18066900 msgr2=0x7f7c18068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c18066900 0x7f7c18068dc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c200af000 tx=0x7f7c200b6040 comp rx=0 tx=0).stop 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 msgr2=0x7f7c340c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 0x7f7c340c2b00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c3c0 tx=0x7f7c2800c880 comp rx=0 tx=0).stop 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 shutdown_connections 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f7c18066900 0x7f7c18068dc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c34151d80 0x7f7c3414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c340c8430 0x7f7c3414d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 --2- 172.21.15.89:0/525124522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340c7f20 0x7f7c340c2b00 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 >> 172.21.15.89:0/525124522 conn(0x7f7c340abd00 msgr2=0x7f7c340c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 shutdown_connections 2023-12-07T10:02:32.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.403+0000 7f7c3ae32640 1 -- 172.21.15.89:0/525124522 wait complete. 2023-12-07T10:02:32.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T10:02:32.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.567+0000 7f120131d640 1 Processor -- start 2023-12-07T10:02:32.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.567+0000 7f120131d640 1 -- start start 2023-12-07T10:02:32.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.567+0000 7f120131d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.567+0000 7f120131d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0a5560 con 0x7f11fc0c1f80 2023-12-07T10:02:32.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.567+0000 7f120131d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc06da20 con 0x7f11fc0a5180 2023-12-07T10:02:32.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.567+0000 7f120131d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc155140 con 0x7f11fc0baa80 2023-12-07T10:02:32.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11f27fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f11fc0c1f80 0x7f11fc1541c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47864/0 (socket says 172.21.15.89:47864) 2023-12-07T10:02:32.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11f27fc640 1 -- 172.21.15.89:0/271159327 learned_addr learned my addr 172.21.15.89:0/271159327 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:32.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fb7fe640 1 --2- 172.21.15.89:0/271159327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455025249 0 0) 0x7f11fc0a5560 con 0x7f11fc0c1f80 2023-12-07T10:02:32.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e8003530 con 0x7f11fc0c1f80 2023-12-07T10:02:32.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145270146 0 0) 0x7f11fc06da20 con 0x7f11fc0a5180 2023-12-07T10:02:32.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc0a5560 con 0x7f11fc0a5180 2023-12-07T10:02:32.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fb7fe640 1 -- 172.21.15.89:0/271159327 >> v1:172.21.15.97:6789/0 conn(0x7f11fc0a5180 legacy=0x7f11fc0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fb7fe640 1 -- 172.21.15.89:0/271159327 >> v1:172.21.15.89:6789/0 conn(0x7f11fc0c1f80 legacy=0x7f11fc1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fb7fe640 1 -- 172.21.15.89:0/271159327 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc06dd00 con 0x7f11fc0baa80 2023-12-07T10:02:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fb7fe640 1 --2- 172.21.15.89:0/271159327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc1548d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11f400a990 tx=0x7f11f401d800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dc90a6fdc76b15b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40a7660 con 0x7f11fc0baa80 2023-12-07T10:02:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f40a77c0 con 0x7f11fc0baa80 2023-12-07T10:02:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.571+0000 7f11fa7fc640 1 -- 172.21.15.89:0/271159327 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40a7b30 con 0x7f11fc0baa80 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- 172.21.15.89:0/271159327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 msgr2=0x7f11fc1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 --2- 172.21.15.89:0/271159327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc1548d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11f400a990 tx=0x7f11f401d800 comp rx=0 tx=0).stop 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- 172.21.15.89:0/271159327 shutdown_connections 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 --2- 172.21.15.89:0/271159327 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc1548d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- 172.21.15.89:0/271159327 >> 172.21.15.89:0/271159327 conn(0x7f11fc06a5a0 msgr2=0x7f11fc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- 172.21.15.89:0/271159327 shutdown_connections 2023-12-07T10:02:32.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- 172.21.15.89:0/271159327 wait complete. 2023-12-07T10:02:32.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 Processor -- start 2023-12-07T10:02:32.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- start start 2023-12-07T10:02:32.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 0x7f11fc0bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc0be4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11fc0c1f80 0x7f11fc149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc1eda50 con 0x7f11fc0a5180 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc1ed4b0 con 0x7f11fc0c1f80 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f120131d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc1ed770 con 0x7f11fc0baa80 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 0x7f11fc0bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 0x7f11fc0bf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39148/0 (socket says 172.21.15.89:39148) 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 -- 172.21.15.89:0/188914470 learned_addr learned my addr 172.21.15.89:0/188914470 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11fb7fe640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11fc0c1f80 0x7f11fc149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 -- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 msgr2=0x7f11fc0be4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc0be4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 -- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11fc0c1f80 msgr2=0x7f11fc149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11fc0c1f80 0x7f11fc149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11faffd640 1 -- 172.21.15.89:0/188914470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f400a5c0 con 0x7f11fc0a5180 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.575+0000 7f11fb7fe640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11fc0c1f80 0x7f11fc149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:32.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11faffd640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 0x7f11fc0bf210 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00c430 tx=0x7f11ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0052d0 con 0x7f11fc0a5180 2023-12-07T10:02:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec005450 con 0x7f11fc0a5180 2023-12-07T10:02:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec003840 con 0x7f11fc0a5180 2023-12-07T10:02:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc0bdcb0 con 0x7f11fc0a5180 2023-12-07T10:02:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc0bf750 con 0x7f11fc0a5180 2023-12-07T10:02:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc0680c0 con 0x7f11fc0a5180 2023-12-07T10:02:32.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f11ec0039a0 con 0x7f11fc0a5180 2023-12-07T10:02:32.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f3fff640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f11dc0668d0 0x7f11dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f11ec083dd0 con 0x7f11fc0a5180 2023-12-07T10:02:32.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.579+0000 7f11f27fc640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f11dc0668d0 0x7f11dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.583+0000 7f11f27fc640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f11dc0668d0 0x7f11dc068d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0c3580 tx=0x7f11e40016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.583+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11ec050ca0 con 0x7f11fc0a5180 2023-12-07T10:02:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.731+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11fc0bdb10 con 0x7f11fc0a5180 2023-12-07T10:02:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f11f3fff640 1 -- 172.21.15.89:0/188914470 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11fc0bdb10 con 0x7f11fc0a5180 2023-12-07T10:02:32.739 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f11dc0668d0 msgr2=0x7f11dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f11dc0668d0 0x7f11dc068d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0c3580 tx=0x7f11e40016a0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 msgr2=0x7f11fc0bf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 0x7f11fc0bf210 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00c430 tx=0x7f11ec00c8f0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 shutdown_connections 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11fc0c1f80 0x7f11fc149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f11dc0668d0 0x7f11dc068d90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f11fc0baa80 0x7f11fc0be4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 --2- 172.21.15.89:0/188914470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11fc0a5180 0x7f11fc0bf210 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 >> 172.21.15.89:0/188914470 conn(0x7f11fc06a5a0 msgr2=0x7f11fc0a8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 shutdown_connections 2023-12-07T10:02:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.735+0000 7f120131d640 1 -- 172.21.15.89:0/188914470 wait complete. 2023-12-07T10:02:32.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:32.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7de157640 1 Processor -- start 2023-12-07T10:02:32.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7de157640 1 -- start start 2023-12-07T10:02:32.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7de157640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7d8151d80 0x7ff7d80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7de157640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d806cf70 con 0x7ff7d80c8430 2023-12-07T10:02:32.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7de157640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d8152160 con 0x7ff7d80c7f20 2023-12-07T10:02:32.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7de157640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80c6a30 con 0x7ff7d8151d80 2023-12-07T10:02:32.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff7d80c8430 0x7ff7d806b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47878/0 (socket says 172.21.15.89:47878) 2023-12-07T10:02:32.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1028531216 learned_addr learned my addr 172.21.15.89:0/1028531216 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:32.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d77fe640 1 --2- 172.21.15.89:0/1028531216 >> v2:172.21.15.97:3300/0 conn(0x7ff7d8151d80 0x7ff7d80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890053714 0 0) 0x7ff7d806cf70 con 0x7ff7d80c8430 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c0003530 con 0x7ff7d80c8430 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011413356 0 0) 0x7ff7c0003530 con 0x7ff7d80c8430 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 >> v2:172.21.15.97:3300/0 conn(0x7ff7d8151d80 msgr2=0x7ff7d80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 --2- 172.21.15.89:0/1028531216 >> v2:172.21.15.97:3300/0 conn(0x7ff7d8151d80 0x7ff7d80c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 >> v1:172.21.15.97:6789/0 conn(0x7ff7d80c7f20 legacy=0x7ff7d806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80c72d0 con 0x7ff7d80c8430 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7ff7cc0016a0 con 0x7ff7d80c8430 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 >> v1:172.21.15.89:6789/0 conn(0x7ff7d80c8430 legacy=0x7ff7d806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c0003980 0x7ff7c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7c00047d0 0x7ff7c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00052b0 0x7ff7c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c6a30 con 0x7ff7c00047d0 2023-12-07T10:02:32.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c000c180 con 0x7ff7c0003980 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c000c340 con 0x7ff7c00052b0 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7c00047d0 0x7ff7c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d77fe640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c0003980 0x7ff7c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d7fff640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00052b0 0x7ff7c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00052b0 msgr2=0x7ff7c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00052b0 0x7ff7c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c0003980 msgr2=0x7ff7c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c0003980 0x7ff7c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1028531216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0003530 con 0x7ff7c00047d0 2023-12-07T10:02:32.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d7fff640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00052b0 0x7ff7c000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:32.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.895+0000 7ff7d7fff640 1 -- 172.21.15.89:0/1028531216 reap_dead start 2023-12-07T10:02:32.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7c00047d0 0x7ff7c0004c50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80c9f00 tx=0x7ff7cc01cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb45ea98e97edd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0058e0 con 0x7ff7c00047d0 2023-12-07T10:02:32.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc005a60 con 0x7ff7c00047d0 2023-12-07T10:02:32.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7d67fc640 1 -- 172.21.15.89:0/1028531216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc005c50 con 0x7ff7c00047d0 2023-12-07T10:02:32.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 -- 172.21.15.89:0/1028531216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7c00047d0 msgr2=0x7ff7c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7c00047d0 0x7ff7c0004c50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80c9f00 tx=0x7ff7cc01cb70 comp rx=0 tx=0).stop 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 -- 172.21.15.89:0/1028531216 shutdown_connections 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 --2- 172.21.15.89:0/1028531216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7c00047d0 0x7ff7c0004c50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 -- 172.21.15.89:0/1028531216 >> 172.21.15.89:0/1028531216 conn(0x7ff7d80abd00 msgr2=0x7ff7d80ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 -- 172.21.15.89:0/1028531216 shutdown_connections 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.899+0000 7ff7de157640 1 -- 172.21.15.89:0/1028531216 wait complete. 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 Processor -- start 2023-12-07T10:02:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 -- start start 2023-12-07T10:02:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00047d0 0x7ff7d81f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 0x7ff7d81f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c34b0 0x7ff7d80c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81f0d30 con 0x7ff7d81e2790 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81e1420 con 0x7ff7d80c34b0 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80aff30 con 0x7ff7c00047d0 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 0x7ff7d81f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 0x7ff7d81f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39158/0 (socket says 172.21.15.89:39158) 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1211378479 learned_addr learned my addr 172.21.15.89:0/1211378479 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d7fff640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c34b0 0x7ff7d80c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d77fe640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00047d0 0x7ff7d81f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00047d0 msgr2=0x7ff7d81f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00047d0 0x7ff7d81f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c34b0 msgr2=0x7ff7d80c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c34b0 0x7ff7d80c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 -- 172.21.15.89:0/1211378479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d81e0af0 con 0x7ff7d81e2790 2023-12-07T10:02:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7d6ffd640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 0x7ff7d81f0720 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc01c9a0 tx=0x7ff7c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc001660 con 0x7ff7d81e2790 2023-12-07T10:02:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0a5850 con 0x7ff7d81e2790 2023-12-07T10:02:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d81e0dd0 con 0x7ff7d81e2790 2023-12-07T10:02:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0a5c00 con 0x7ff7d81e2790 2023-12-07T10:02:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.903+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d81e1b20 con 0x7ff7d81e2790 2023-12-07T10:02:32.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.907+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d804e890 con 0x7ff7d81e2790 2023-12-07T10:02:32.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.907+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff7cc0b4070 con 0x7ff7d81e2790 2023-12-07T10:02:32.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.907+0000 7ff7bffff640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c4066900 0x7ff7c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:32.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.907+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff7cc11df20 con 0x7ff7d81e2790 2023-12-07T10:02:32.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.907+0000 7ff7d77fe640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c4066900 0x7ff7c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:32.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.907+0000 7ff7d77fe640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c4066900 0x7ff7c4068dc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009ba0 tx=0x7ff7c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:32.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:32.911+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7cc0eae00 con 0x7ff7d81e2790 2023-12-07T10:02:33.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.059+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7d81e1560 con 0x7ff7d81e2790 2023-12-07T10:02:33.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.059+0000 7ff7bffff640 1 -- 172.21.15.89:0/1211378479 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v71) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff7cc0ee420 con 0x7ff7d81e2790 2023-12-07T10:02:33.065 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c4066900 msgr2=0x7ff7c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c4066900 0x7ff7c4068dc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009ba0 tx=0x7ff7c8008040 comp rx=0 tx=0).stop 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 msgr2=0x7ff7d81f0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 0x7ff7d81f0720 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc01c9a0 tx=0x7ff7c0005800 comp rx=0 tx=0).stop 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 shutdown_connections 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7d80c34b0 0x7ff7d80c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7d81e2790 0x7ff7d81f0720 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff7c4066900 0x7ff7c4068dc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 --2- 172.21.15.89:0/1211378479 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff7c00047d0 0x7ff7d81f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 >> 172.21.15.89:0/1211378479 conn(0x7ff7d80abd00 msgr2=0x7ff7d814b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:33.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 shutdown_connections 2023-12-07T10:02:33.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.063+0000 7ff7de157640 1 -- 172.21.15.89:0/1211378479 wait complete. 2023-12-07T10:02:33.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:33.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.219+0000 7f57ec956640 1 Processor -- start 2023-12-07T10:02:33.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.219+0000 7f57ec956640 1 -- start start 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57ec956640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e80c7de0 0x7f57e81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57ec956640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57e8154bf0 0x7f57e815f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57ec956640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e8157ca0 con 0x7f57e8151df0 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57ec956640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e81521d0 con 0x7f57e8154bf0 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57ec956640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80c55f0 con 0x7f57e80c7de0 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57e8154bf0 0x7f57e815f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e77fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f57e8151df0 0x7f57e80c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47890/0 (socket says 172.21.15.89:47890) 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57e8154bf0 0x7f57e815f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39168/0 (socket says 172.21.15.89:39168) 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e77fe640 1 -- 172.21.15.89:0/641750888 learned_addr learned my addr 172.21.15.89:0/641750888 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57dffff640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e80c7de0 0x7f57e81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e7fff640 1 -- 172.21.15.89:0/641750888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e80c7de0 msgr2=0x7f57e81546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e7fff640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e80c7de0 0x7f57e81546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e7fff640 1 -- 172.21.15.89:0/641750888 >> v1:172.21.15.89:6789/0 conn(0x7f57e8151df0 legacy=0x7f57e80c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e7fff640 1 -- 172.21.15.89:0/641750888 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8157ef0 con 0x7f57e8154bf0 2023-12-07T10:02:33.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57e6ffd640 1 -- 172.21.15.89:0/641750888 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359701054 0 0) 0x7f57e8157ca0 con 0x7f57e8151df0 2023-12-07T10:02:33.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.223+0000 7f57dffff640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e80c7de0 0x7f57e81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:33.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57e7fff640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e8154bf0 0x7f57e815f030 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009d90 tx=0x7f57e001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdc29f777219c86 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57e6ffd640 1 -- 172.21.15.89:0/641750888 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e00a5780 con 0x7f57e8154bf0 2023-12-07T10:02:33.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57e6ffd640 1 -- 172.21.15.89:0/641750888 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e00a58e0 con 0x7f57e8154bf0 2023-12-07T10:02:33.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57e6ffd640 1 -- 172.21.15.89:0/641750888 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e00a5c70 con 0x7f57e8154bf0 2023-12-07T10:02:33.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- 172.21.15.89:0/641750888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e8154bf0 msgr2=0x7f57e815f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e8154bf0 0x7f57e815f030 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009d90 tx=0x7f57e001c8c0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- 172.21.15.89:0/641750888 shutdown_connections 2023-12-07T10:02:33.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e8154bf0 0x7f57e815f030 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 --2- 172.21.15.89:0/641750888 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e80c7de0 0x7f57e81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- 172.21.15.89:0/641750888 >> 172.21.15.89:0/641750888 conn(0x7f57e80abab0 msgr2=0x7f57e80abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:33.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- 172.21.15.89:0/641750888 shutdown_connections 2023-12-07T10:02:33.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- 172.21.15.89:0/641750888 wait complete. 2023-12-07T10:02:33.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 Processor -- start 2023-12-07T10:02:33.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- start start 2023-12-07T10:02:33.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 0x7f57e80c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57e8151df0 0x7f57e8149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e8154bf0 0x7f57e8153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80c1ab0 con 0x7f57e80c7de0 2023-12-07T10:02:33.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e81532a0 con 0x7f57e8151df0 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.227+0000 7f57ec956640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80bff60 con 0x7f57e8154bf0 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 0x7f57e80c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 0x7f57e80c1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39172/0 (socket says 172.21.15.89:39172) 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 -- 172.21.15.89:0/348126105 learned_addr learned my addr 172.21.15.89:0/348126105 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 -- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e8154bf0 msgr2=0x7f57e8153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e8154bf0 0x7f57e8153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 -- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57e8151df0 msgr2=0x7f57e8149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57dffff640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57e8151df0 0x7f57e8149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57e8151df0 0x7f57e8149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 -- 172.21.15.89:0/348126105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e0009a70 con 0x7f57e80c7de0 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57dffff640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57e8151df0 0x7f57e8149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:33.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e77fe640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 0x7f57e80c1e60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f57d80011f0 tx=0x7f57d800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80074e0 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8007640 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004a10 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e80c0240 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e8154760 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e8067a40 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f57d8004b70 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e4ff9640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c80668d0 0x7f57c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.231+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f57d80839a0 con 0x7f57e80c7de0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.235+0000 7f57dffff640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c80668d0 0x7f57c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.235+0000 7f57dffff640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c80668d0 0x7f57c8068d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f57e80a9a20 tx=0x7f57d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.235+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57d8050870 con 0x7f57e80c7de0 2023-12-07T10:02:33.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.387+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f57e8074970 con 0x7f57e80c7de0 2023-12-07T10:02:33.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.387+0000 7f57e4ff9640 1 -- 172.21.15.89:0/348126105 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v71) v1 ==== 101+0+11 (secure 0 0 0) 0x7f57d8018020 con 0x7f57e80c7de0 2023-12-07T10:02:33.394 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c80668d0 msgr2=0x7f57c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c80668d0 0x7f57c8068d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f57e80a9a20 tx=0x7f57d0008040 comp rx=0 tx=0).stop 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 msgr2=0x7f57e80c1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 0x7f57e80c1e60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f57d80011f0 tx=0x7f57d800c9b0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 shutdown_connections 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c80668d0 0x7f57c8068d90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57e8154bf0 0x7f57e8153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57e8151df0 0x7f57e8149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 --2- 172.21.15.89:0/348126105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e80c7de0 0x7f57e80c1e60 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 >> 172.21.15.89:0/348126105 conn(0x7f57e80abab0 msgr2=0x7f57e80aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 shutdown_connections 2023-12-07T10:02:33.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.391+0000 7f57ec956640 1 -- 172.21.15.89:0/348126105 wait complete. 2023-12-07T10:02:33.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:33.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.547+0000 7f37bba94640 1 Processor -- start 2023-12-07T10:02:33.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.547+0000 7f37bba94640 1 -- start start 2023-12-07T10:02:33.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37bba94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37b414e9d0 0x7f37b4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37bba94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 0x7f37b40c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37bba94640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b406d320 con 0x7f37b40c1f20 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37bba94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b40721b0 con 0x7f37b414e9d0 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37bba94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c2830 con 0x7f37b4070b80 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f37b40c1f20 0x7f37b406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47892/0 (socket says 172.21.15.89:47892) 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 -- 172.21.15.89:0/3464842759 learned_addr learned my addr 172.21.15.89:0/3464842759 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b902f640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 0x7f37b40c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b9830640 1 --2- 172.21.15.89:0/3464842759 >> v2:172.21.15.97:3300/0 conn(0x7f37b414e9d0 0x7f37b4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338873750 0 0) 0x7f37b406d320 con 0x7f37b40c1f20 2023-12-07T10:02:33.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a0003530 con 0x7f37b40c1f20 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476100188 0 0) 0x7f37a0003530 con 0x7f37b40c1f20 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 msgr2=0x7f37b40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 0x7f37b40c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 >> v2:172.21.15.97:3300/0 conn(0x7f37b414e9d0 msgr2=0x7f37b4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 --2- 172.21.15.89:0/3464842759 >> v2:172.21.15.97:3300/0 conn(0x7f37b414e9d0 0x7f37b4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4072450 con 0x7f37b40c1f20 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f37ac001a00 con 0x7f37b40c1f20 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 >> v1:172.21.15.89:6789/0 conn(0x7f37b40c1f20 legacy=0x7f37b406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0003980 0x7f37a0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 0x7f37a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a0004d10 0x7f37a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40721b0 con 0x7f37a0004d10 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c2830 con 0x7f37a0003980 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a000b990 con 0x7f37b4070b80 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a0004d10 0x7f37a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b9830640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0003980 0x7f37a0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37b902f640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 0x7f37a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 -- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 msgr2=0x7f37a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b4070b80 0x7f37a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 -- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0003980 msgr2=0x7f37a0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0003980 0x7f37a0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.551+0000 7f37ba031640 1 -- 172.21.15.89:0/3464842759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0003530 con 0x7f37a0004d10 2023-12-07T10:02:33.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37ba031640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a0004d10 0x7f37a0005190 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00a830 tx=0x7f37ac01fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a846b9d9558e7d86 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0aa6f0 con 0x7f37a0004d10 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac0aa850 con 0x7f37a0004d10 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37b882e640 1 -- 172.21.15.89:0/3464842759 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0aac20 con 0x7f37a0004d10 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 -- 172.21.15.89:0/3464842759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a0004d10 msgr2=0x7f37a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 --2- 172.21.15.89:0/3464842759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a0004d10 0x7f37a0005190 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00a830 tx=0x7f37ac01fac0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37ba031640 1 -- 172.21.15.89:0/3464842759 reap_dead start 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 -- 172.21.15.89:0/3464842759 shutdown_connections 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 -- 172.21.15.89:0/3464842759 >> 172.21.15.89:0/3464842759 conn(0x7f37b40c2ad0 msgr2=0x7f37b40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 -- 172.21.15.89:0/3464842759 shutdown_connections 2023-12-07T10:02:33.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 -- 172.21.15.89:0/3464842759 wait complete. 2023-12-07T10:02:33.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.555+0000 7f37bba94640 1 Processor -- start 2023-12-07T10:02:33.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- start start 2023-12-07T10:02:33.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0004d10 0x7f37b40c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b40bfcd0 0x7f37b41ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 0x7f37b41ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c4370 con 0x7f37b4147170 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c01c0 con 0x7f37a0004d10 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c04a0 con 0x7f37b40bfcd0 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 0x7f37b41ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 0x7f37b41ecd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39196/0 (socket says 172.21.15.89:39196) 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 -- 172.21.15.89:0/390169253 learned_addr learned my addr 172.21.15.89:0/390169253 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37b902f640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b40bfcd0 0x7f37b41ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37b9830640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0004d10 0x7f37b40c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 -- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b40bfcd0 msgr2=0x7f37b41ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b40bfcd0 0x7f37b41ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 -- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0004d10 msgr2=0x7f37b40c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0004d10 0x7f37b40c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 -- 172.21.15.89:0/390169253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b41e9ad0 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37b9830640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0004d10 0x7f37b40c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37ba031640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 0x7f37b41ecd70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f37ac01f8f0 tx=0x7f37a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0aa6f0 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac001fd0 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b41e9db0 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0019c0 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b41475f0 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.559+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4067a40 con 0x7f37b4147170 2023-12-07T10:02:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.563+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37ac0070c0 con 0x7f37b4147170 2023-12-07T10:02:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.563+0000 7f37aa7fc640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3798066900 0x7f3798068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.563+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f37ac121c60 con 0x7f37b4147170 2023-12-07T10:02:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.563+0000 7f37b9830640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3798066900 0x7f3798068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.563+0000 7f37b9830640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3798066900 0x7f3798068dc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009be0 tx=0x7f37b0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.567+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37ac0eebf0 con 0x7f37b4147170 2023-12-07T10:02:33.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37b404e890 con 0x7f37b4147170 2023-12-07T10:02:33.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37aa7fc640 1 -- 172.21.15.89:0/390169253 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f37ac0f2210 con 0x7f37b4147170 2023-12-07T10:02:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:33.752 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:33.752 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 53 2023-12-07T10:02:33.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3798066900 msgr2=0x7f3798068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3798066900 0x7f3798068dc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009be0 tx=0x7f37b0009190 comp rx=0 tx=0).stop 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 msgr2=0x7f37b41ecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 0x7f37b41ecd70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f37ac01f8f0 tx=0x7f37a0005800 comp rx=0 tx=0).stop 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 shutdown_connections 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37b4147170 0x7f37b41ecd70 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f3798066900 0x7f3798068dc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f37b40bfcd0 0x7f37b41ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 --2- 172.21.15.89:0/390169253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37a0004d10 0x7f37b40c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 >> 172.21.15.89:0/390169253 conn(0x7f37b40c2ad0 msgr2=0x7f37b414af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 shutdown_connections 2023-12-07T10:02:33.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.747+0000 7f37bba94640 1 -- 172.21.15.89:0/390169253 wait complete. 2023-12-07T10:02:33.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbf01b8d640 1 Processor -- start 2023-12-07T10:02:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbf01b8d640 1 -- start start 2023-12-07T10:02:33.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbf01b8d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbefc06cd90 0x7fbefc160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbf01b8d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc155790 con 0x7fbefc0ca610 2023-12-07T10:02:33.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbf01b8d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0c4b00 con 0x7fbefc0bd720 2023-12-07T10:02:33.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbf01b8d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc0c4de0 con 0x7fbefc06cd90 2023-12-07T10:02:33.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefb7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbefc0ca610 0x7fbefc0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47898/0 (socket says 172.21.15.89:47898) 2023-12-07T10:02:33.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefb7fe640 1 -- 172.21.15.89:0/456277412 learned_addr learned my addr 172.21.15.89:0/456277412 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:33.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefbfff640 1 --2- 172.21.15.89:0/456277412 >> v2:172.21.15.97:3300/0 conn(0x7fbefc06cd90 0x7fbefc160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593967003 0 0) 0x7fbefc155790 con 0x7fbefc0ca610 2023-12-07T10:02:33.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee4003530 con 0x7fbefc0ca610 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 494182673 0 0) 0x7fbee4003530 con 0x7fbefc0ca610 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 >> v2:172.21.15.97:3300/0 conn(0x7fbefc06cd90 msgr2=0x7fbefc160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 --2- 172.21.15.89:0/456277412 >> v2:172.21.15.97:3300/0 conn(0x7fbefc06cd90 0x7fbefc160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 >> v1:172.21.15.97:6789/0 conn(0x7fbefc0bd720 legacy=0x7fbefc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc157e30 con 0x7fbefc0ca610 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fbeec001680 con 0x7fbefc0ca610 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 >> v1:172.21.15.89:6789/0 conn(0x7fbefc0ca610 legacy=0x7fbefc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee4003980 0x7fbee4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbee4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40052b0 0x7fbee400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0c4de0 con 0x7fbee40047d0 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee400c180 con 0x7fbee40052b0 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee400c340 con 0x7fbee4003980 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefaffd640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbee4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefb7fe640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee4003980 0x7fbee4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefbfff640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40052b0 0x7fbee400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefaffd640 1 -- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee4003980 msgr2=0x7fbee4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefaffd640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee4003980 0x7fbee4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefaffd640 1 -- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40052b0 msgr2=0x7fbee400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefaffd640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbee40052b0 0x7fbee400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefaffd640 1 -- 172.21.15.89:0/456277412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4003530 con 0x7fbee40047d0 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefbfff640 1 -- 172.21.15.89:0/456277412 reap_dead start 2023-12-07T10:02:33.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.907+0000 7fbefb7fe640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbee4003980 0x7fbee4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:33.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbefaffd640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbee4004c50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001750 tx=0x7fbef001c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec335fb410d68a73 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0c52d0 con 0x7fbee40047d0 2023-12-07T10:02:33.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef00052f0 con 0x7fbee40047d0 2023-12-07T10:02:33.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbefa7fc640 1 -- 172.21.15.89:0/456277412 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0003600 con 0x7fbee40047d0 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 -- 172.21.15.89:0/456277412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 msgr2=0x7fbee4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbee4004c50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001750 tx=0x7fbef001c080 comp rx=0 tx=0).stop 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 -- 172.21.15.89:0/456277412 shutdown_connections 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/456277412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbee4004c50 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 -- 172.21.15.89:0/456277412 >> 172.21.15.89:0/456277412 conn(0x7fbefc071ea0 msgr2=0x7fbefc0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 -- 172.21.15.89:0/456277412 shutdown_connections 2023-12-07T10:02:33.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.911+0000 7fbf01b8d640 1 -- 172.21.15.89:0/456277412 wait complete. 2023-12-07T10:02:33.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 Processor -- start 2023-12-07T10:02:33.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 -- start start 2023-12-07T10:02:33.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbefc0a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbefc1e10a0 0x7fbefc1f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbefc1f1e90 0x7fbefc0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0ae2d0 con 0x7fbee40047d0 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0abbe0 con 0x7fbefc1e10a0 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0abec0 con 0x7fbefc1f1e90 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbefc0a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbefc0a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39200/0 (socket says 172.21.15.89:39200) 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 -- 172.21.15.89:0/1369579073 learned_addr learned my addr 172.21.15.89:0/1369579073 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefbfff640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbefc1f1e90 0x7fbefc0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefaffd640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbefc1e10a0 0x7fbefc1f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 -- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbefc1f1e90 msgr2=0x7fbefc0acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbefc1f1e90 0x7fbefc0acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 -- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbefc1e10a0 msgr2=0x7fbefc1f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:33.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbefc1e10a0 0x7fbefc1f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 -- 172.21.15.89:0/1369579073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0ac1a0 con 0x7fbee40047d0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefaffd640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbefc1e10a0 0x7fbefc1f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbefb7fe640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbefc0a9cd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000fc0 tx=0x7fbeec007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00f890 con 0x7fbee40047d0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00f9f0 con 0x7fbee40047d0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc0ac480 con 0x7fbee40047d0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00fd60 con 0x7fbee40047d0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.915+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc0ac760 con 0x7fbee40047d0 2023-12-07T10:02:33.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.919+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc04e890 con 0x7fbee40047d0 2023-12-07T10:02:33.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.919+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbeec01d460 con 0x7fbee40047d0 2023-12-07T10:02:33.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.919+0000 7fbee3fff640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbee8066900 0x7fbee8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:33.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.919+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbeec084710 con 0x7fbee40047d0 2023-12-07T10:02:33.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.919+0000 7fbefaffd640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbee8066900 0x7fbee8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:33.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.919+0000 7fbefaffd640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbee8066900 0x7fbee8068dc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbee40057b0 tx=0x7fbef00011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:33.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:33.923+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbeec0515e0 con 0x7fbee40047d0 2023-12-07T10:02:34.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.071+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbefc1f16b0 con 0x7fbee40047d0 2023-12-07T10:02:34.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbee3fff640 1 -- 172.21.15.89:0/1369579073 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7fbeec054c00 con 0x7fbee40047d0 2023-12-07T10:02:34.079 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:34.079 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbee8066900 msgr2=0x7fbee8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbee8066900 0x7fbee8068dc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbee40057b0 tx=0x7fbef00011a0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 msgr2=0x7fbefc0a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbefc0a9cd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000fc0 tx=0x7fbeec007720 comp rx=0 tx=0).stop 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 shutdown_connections 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbee8066900 0x7fbee8068dc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbefc1f1e90 0x7fbefc0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbefc1e10a0 0x7fbefc1f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 --2- 172.21.15.89:0/1369579073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbee40047d0 0x7fbefc0a9cd0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 >> 172.21.15.89:0/1369579073 conn(0x7fbefc071ea0 msgr2=0x7fbefc1e3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:34.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 shutdown_connections 2023-12-07T10:02:34.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.075+0000 7fbf01b8d640 1 -- 172.21.15.89:0/1369579073 wait complete. 2023-12-07T10:02:34.100 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-07T10:02:34.100 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:34.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc51732a640 1 Processor -- start 2023-12-07T10:02:34.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc51732a640 1 -- start start 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc51732a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc510156500 0x7fc51006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc51732a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51006dec0 con 0x7fc51014fcc0 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc51732a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc510156980 con 0x7fc5100c19e0 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc51732a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5100aa340 con 0x7fc510156500 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc5148c5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc510156500 0x7fc51006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc5150c6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc51014fcc0 0x7fc5100aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47912/0 (socket says 172.21.15.89:47912) 2023-12-07T10:02:34.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.231+0000 7fc5150c6640 1 -- 172.21.15.89:0/866788291 learned_addr learned my addr 172.21.15.89:0/866788291 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:34.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc507fff640 1 -- 172.21.15.89:0/866788291 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244583273 0 0) 0x7fc51006dec0 con 0x7fc51014fcc0 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc507fff640 1 -- 172.21.15.89:0/866788291 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4fc003530 con 0x7fc51014fcc0 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc5148c5640 1 -- 172.21.15.89:0/866788291 >> v1:172.21.15.97:6789/0 conn(0x7fc5100c19e0 legacy=0x7fc5100c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc5148c5640 1 -- 172.21.15.89:0/866788291 >> v1:172.21.15.89:6789/0 conn(0x7fc51014fcc0 legacy=0x7fc5100aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc5148c5640 1 -- 172.21.15.89:0/866788291 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5100ab580 con 0x7fc510156500 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc5148c5640 1 --2- 172.21.15.89:0/866788291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc51006d980 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc5000097c0 tx=0x7fc50001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c6d504aa7b8ad9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc507fff640 1 -- 172.21.15.89:0/866788291 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000ab650 con 0x7fc510156500 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc507fff640 1 -- 172.21.15.89:0/866788291 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5000ab7b0 con 0x7fc510156500 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc507fff640 1 -- 172.21.15.89:0/866788291 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000abb40 con 0x7fc510156500 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc51732a640 1 -- 172.21.15.89:0/866788291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 msgr2=0x7fc51006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.235+0000 7fc51732a640 1 --2- 172.21.15.89:0/866788291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc51006d980 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc5000097c0 tx=0x7fc50001c450 comp rx=0 tx=0).stop 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- 172.21.15.89:0/866788291 shutdown_connections 2023-12-07T10:02:34.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 --2- 172.21.15.89:0/866788291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc51006d980 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- 172.21.15.89:0/866788291 >> 172.21.15.89:0/866788291 conn(0x7fc5100c2ad0 msgr2=0x7fc5100c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:34.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- 172.21.15.89:0/866788291 shutdown_connections 2023-12-07T10:02:34.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- 172.21.15.89:0/866788291 wait complete. 2023-12-07T10:02:34.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 Processor -- start 2023-12-07T10:02:34.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- start start 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5100c19e0 0x7fc5101ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc5100bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5101505f0 0x7fc510070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51014ce20 con 0x7fc510156500 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100700a0 con 0x7fc5101505f0 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc51732a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc510071280 con 0x7fc5100c19e0 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc5100bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc5100bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39212/0 (socket says 172.21.15.89:39212) 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 -- 172.21.15.89:0/2400694766 learned_addr learned my addr 172.21.15.89:0/2400694766 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5158c7640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5101505f0 0x7fc510070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5150c6640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5100c19e0 0x7fc5101ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 -- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5100c19e0 msgr2=0x7fc5101ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5100c19e0 0x7fc5101ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 -- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5101505f0 msgr2=0x7fc510070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5101505f0 0x7fc510070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 -- 172.21.15.89:0/2400694766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009420 con 0x7fc510156500 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5150c6640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5100c19e0 0x7fc5101ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:34.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.239+0000 7fc5148c5640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc5100bf660 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc5000ad040 tx=0x7fc50001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000bf610 con 0x7fc510156500 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5000bf770 con 0x7fc510156500 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc510071560 con 0x7fc510156500 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000bfb20 con 0x7fc510156500 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5100702f0 con 0x7fc510156500 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc510066600 con 0x7fc510156500 2023-12-07T10:02:34.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc5000b5400 con 0x7fc510156500 2023-12-07T10:02:34.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc505ffb640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4f4066900 0x7fc4f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc50011f780 con 0x7fc510156500 2023-12-07T10:02:34.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc5150c6640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4f4066900 0x7fc4f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.243+0000 7fc5150c6640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4f4066900 0x7fc4f4068dc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0011f0 tx=0x7fc50c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.247+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5000ec700 con 0x7fc510156500 2023-12-07T10:02:34.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.427+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc51004e890 con 0x7fc510156500 2023-12-07T10:02:34.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc505ffb640 1 -- 172.21.15.89:0/2400694766 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7fc5000efd20 con 0x7fc510156500 2023-12-07T10:02:34.435 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:34.435 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:34.435 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 53 2023-12-07T10:02:34.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4f4066900 msgr2=0x7fc4f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4f4066900 0x7fc4f4068dc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0011f0 tx=0x7fc50c009040 comp rx=0 tx=0).stop 2023-12-07T10:02:34.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 msgr2=0x7fc5100bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc5100bf660 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc5000ad040 tx=0x7fc50001ac90 comp rx=0 tx=0).stop 2023-12-07T10:02:34.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 shutdown_connections 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5101505f0 0x7fc510070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc510156500 0x7fc5100bf660 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc4f4066900 0x7fc4f4068dc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 --2- 172.21.15.89:0/2400694766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5100c19e0 0x7fc5101ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 >> 172.21.15.89:0/2400694766 conn(0x7fc5100c2ad0 msgr2=0x7fc5100c1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 shutdown_connections 2023-12-07T10:02:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.431+0000 7fc51732a640 1 -- 172.21.15.89:0/2400694766 wait complete. 2023-12-07T10:02:34.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:34.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.587+0000 7f9397a79640 1 Processor -- start 2023-12-07T10:02:34.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.587+0000 7f9397a79640 1 -- start start 2023-12-07T10:02:34.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9397a79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9390152ce0 0x7f939006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9397a79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f939006d100 0x7f93900c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9397a79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939006bea0 con 0x7f939006db80 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9397a79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9390159b10 con 0x7f939006d100 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9397a79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9390159550 con 0x7f9390152ce0 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9395014640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f939006db80 0x7f93900700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47924/0 (socket says 172.21.15.89:47924) 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9395014640 1 -- 172.21.15.89:0/891008287 learned_addr learned my addr 172.21.15.89:0/891008287 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9396016640 1 --2- 172.21.15.89:0/891008287 >> v2:172.21.15.89:3300/0 conn(0x7f939006d100 0x7f93900c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9395815640 1 --2- 172.21.15.89:0/891008287 >> v2:172.21.15.97:3300/0 conn(0x7f9390152ce0 0x7f939006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9394813640 1 -- 172.21.15.89:0/891008287 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354438234 0 0) 0x7f939006bea0 con 0x7f939006db80 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9394813640 1 -- 172.21.15.89:0/891008287 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f937c003530 con 0x7f939006db80 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9396016640 1 -- 172.21.15.89:0/891008287 >> v2:172.21.15.97:3300/0 conn(0x7f9390152ce0 msgr2=0x7f939006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9396016640 1 --2- 172.21.15.89:0/891008287 >> v2:172.21.15.97:3300/0 conn(0x7f9390152ce0 0x7f939006c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9396016640 1 -- 172.21.15.89:0/891008287 >> v1:172.21.15.89:6789/0 conn(0x7f939006db80 legacy=0x7f93900700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9396016640 1 -- 172.21.15.89:0/891008287 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390159830 con 0x7f939006d100 2023-12-07T10:02:34.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.591+0000 7f9396016640 1 --2- 172.21.15.89:0/891008287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93900c19e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f93900c2800 tx=0x7f938801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f91f1cc8eec90c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9394813640 1 -- 172.21.15.89:0/891008287 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880a5940 con 0x7f939006d100 2023-12-07T10:02:34.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9394813640 1 -- 172.21.15.89:0/891008287 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93880a5aa0 con 0x7f939006d100 2023-12-07T10:02:34.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9394813640 1 -- 172.21.15.89:0/891008287 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880a5e30 con 0x7f939006d100 2023-12-07T10:02:34.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- 172.21.15.89:0/891008287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 msgr2=0x7f93900c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 --2- 172.21.15.89:0/891008287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93900c19e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f93900c2800 tx=0x7f938801c880 comp rx=0 tx=0).stop 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- 172.21.15.89:0/891008287 shutdown_connections 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 --2- 172.21.15.89:0/891008287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93900c19e0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 --2- 172.21.15.89:0/891008287 >> v2:172.21.15.97:3300/0 conn(0x7f9390152ce0 0x7f939006c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- 172.21.15.89:0/891008287 >> 172.21.15.89:0/891008287 conn(0x7f93900c2ad0 msgr2=0x7f93900c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- 172.21.15.89:0/891008287 shutdown_connections 2023-12-07T10:02:34.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- 172.21.15.89:0/891008287 wait complete. 2023-12-07T10:02:34.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 Processor -- start 2023-12-07T10:02:34.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- start start 2023-12-07T10:02:34.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93901f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f939006db80 0x7f93901f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9390152ce0 0x7f93900c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900c4ae0 con 0x7f939006d100 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939013b0d0 con 0x7f939006db80 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9397a79640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93900c3b80 con 0x7f9390152ce0 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9395815640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93901f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9395815640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93901f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39236/0 (socket says 172.21.15.89:39236) 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.595+0000 7f9395815640 1 -- 172.21.15.89:0/570949317 learned_addr learned my addr 172.21.15.89:0/570949317 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395815640 1 -- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9390152ce0 msgr2=0x7f93900c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395014640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f939006db80 0x7f93901f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9396016640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9390152ce0 0x7f93900c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395815640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9390152ce0 0x7f93900c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395815640 1 -- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f939006db80 msgr2=0x7f93901f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395815640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f939006db80 0x7f93901f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395815640 1 -- 172.21.15.89:0/570949317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388009a70 con 0x7f939006d100 2023-12-07T10:02:34.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395014640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f939006db80 0x7f93901f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:34.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9396016640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9390152ce0 0x7f93900c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:34.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9395815640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93901f14a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e870 tx=0x7f938c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c009510 con 0x7f939006d100 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c00eec0 con 0x7f939006d100 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00cb40 con 0x7f939006d100 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93900c3e60 con 0x7f939006d100 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93900c4420 con 0x7f939006d100 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939004e890 con 0x7f939006d100 2023-12-07T10:02:34.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.599+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f938c00cca0 con 0x7f939006d100 2023-12-07T10:02:34.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.603+0000 7f93867fc640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93740668d0 0x7f9374068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.603+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f938c0848b0 con 0x7f939006d100 2023-12-07T10:02:34.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.603+0000 7f9395014640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93740668d0 0x7f9374068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.603+0000 7f9395014640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93740668d0 0x7f9374068d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f93901ef2e0 tx=0x7f9380009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.607+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f938c051800 con 0x7f939006d100 2023-12-07T10:02:34.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.783+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f939006cee0 con 0x7f939006d100 2023-12-07T10:02:34.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.783+0000 7f93867fc640 1 -- 172.21.15.89:0/570949317 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f938c054e20 con 0x7f939006d100 2023-12-07T10:02:34.790 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:34.790 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:01:50.597494+0000","modified":"2023-12-07T10:01:53.613494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6561},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6561":{"gid":6561,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/3031036225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3031036225},{"type":"v1","addr":"172.21.15.89:6836","nonce":3031036225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:34.790 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 53 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93740668d0 msgr2=0x7f9374068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93740668d0 0x7f9374068d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f93901ef2e0 tx=0x7f9380009040 comp rx=0 tx=0).stop 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 msgr2=0x7f93901f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93901f14a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e870 tx=0x7f938c00ec70 comp rx=0 tx=0).stop 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 shutdown_connections 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f93740668d0 0x7f9374068d90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9390152ce0 0x7f93900c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f939006db80 0x7f93901f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 --2- 172.21.15.89:0/570949317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939006d100 0x7f93901f14a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 >> 172.21.15.89:0/570949317 conn(0x7f93900c2ad0 msgr2=0x7f93900709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 shutdown_connections 2023-12-07T10:02:34.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.787+0000 7f9397a79640 1 -- 172.21.15.89:0/570949317 wait complete. 2023-12-07T10:02:34.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:34.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 Processor -- start 2023-12-07T10:02:34.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 -- start start 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89480ca610 0x7f89480c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f894806cd90 0x7f89480c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8948155790 con 0x7f89480bd720 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480c4b00 con 0x7f89480ca610 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894e6c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480c4de0 con 0x7f894806cd90 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89480ca610 0x7f89480c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89480ca610 0x7f89480c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39248/0 (socket says 172.21.15.89:39248) 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 -- 172.21.15.89:0/308377302 learned_addr learned my addr 172.21.15.89:0/308377302 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f89477fe640 1 --1- 172.21.15.89:0/308377302 >> v1:172.21.15.89:6789/0 conn(0x7f89480bd720 0x7f8948158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47940/0 (socket says 172.21.15.89:47940) 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894cc66640 1 --2- 172.21.15.89:0/308377302 >> v2:172.21.15.97:3300/0 conn(0x7f894806cd90 0x7f89480c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 -- 172.21.15.89:0/308377302 >> v2:172.21.15.97:3300/0 conn(0x7f894806cd90 msgr2=0x7f89480c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:34.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 --2- 172.21.15.89:0/308377302 >> v2:172.21.15.97:3300/0 conn(0x7f894806cd90 0x7f89480c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 -- 172.21.15.89:0/308377302 >> v1:172.21.15.89:6789/0 conn(0x7f89480bd720 legacy=0x7f8948158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8947fff640 1 -- 172.21.15.89:0/308377302 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948157e30 con 0x7f89480ca610 2023-12-07T10:02:34.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f8946ffd640 1 -- 172.21.15.89:0/308377302 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597907624 0 0) 0x7f8948155790 con 0x7f89480bd720 2023-12-07T10:02:34.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.947+0000 7f894cc66640 1 --2- 172.21.15.89:0/308377302 >> v2:172.21.15.97:3300/0 conn(0x7f894806cd90 0x7f89480c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:34.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f8947fff640 1 --2- 172.21.15.89:0/308377302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480ca610 0x7f89480c94c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f89481547a0 tx=0x7f893801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee8e012b9faf043 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f8946ffd640 1 -- 172.21.15.89:0/308377302 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89480c52d0 con 0x7f89480ca610 2023-12-07T10:02:34.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f8946ffd640 1 -- 172.21.15.89:0/308377302 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89380a4900 con 0x7f89480ca610 2023-12-07T10:02:34.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f8946ffd640 1 -- 172.21.15.89:0/308377302 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380a4c90 con 0x7f89480ca610 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 -- 172.21.15.89:0/308377302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480ca610 msgr2=0x7f89480c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 --2- 172.21.15.89:0/308377302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480ca610 0x7f89480c94c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f89481547a0 tx=0x7f893801c0c0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 -- 172.21.15.89:0/308377302 shutdown_connections 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 --2- 172.21.15.89:0/308377302 >> v2:172.21.15.97:3300/0 conn(0x7f894806cd90 0x7f89480c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 --2- 172.21.15.89:0/308377302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480ca610 0x7f89480c94c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 -- 172.21.15.89:0/308377302 >> 172.21.15.89:0/308377302 conn(0x7f8948071ea0 msgr2=0x7f89480722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 -- 172.21.15.89:0/308377302 shutdown_connections 2023-12-07T10:02:34.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.951+0000 7f894e6c9640 1 -- 172.21.15.89:0/308377302 wait complete. 2023-12-07T10:02:34.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 Processor -- start 2023-12-07T10:02:34.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- start start 2023-12-07T10:02:34.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f894806cd90 0x7f894814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 0x7f89480c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89480ca610 0x7f89480c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948153420 con 0x7f89480bd720 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480bec20 con 0x7f894806cd90 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480a9ab0 con 0x7f89480ca610 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 0x7f89480c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 0x7f89480c0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39256/0 (socket says 172.21.15.89:39256) 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 -- 172.21.15.89:0/170277940 learned_addr learned my addr 172.21.15.89:0/170277940 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894cc66640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89480ca610 0x7f89480c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f8947fff640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f894806cd90 0x7f894814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 -- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89480ca610 msgr2=0x7f89480c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89480ca610 0x7f89480c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 -- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f894806cd90 msgr2=0x7f894814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f894806cd90 0x7f894814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 -- 172.21.15.89:0/170277940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380094d0 con 0x7f89480bd720 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f8947fff640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f894806cd90 0x7f894814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f89477fe640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 0x7f89480c0410 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f893c0011f0 tx=0x7f893c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0074e0 con 0x7f89480bd720 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c007640 con 0x7f89480bd720 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89480a9d90 con 0x7f89480bd720 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c004a10 con 0x7f89480bd720 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948153670 con 0x7f89480bd720 2023-12-07T10:02:34.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.955+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894804e890 con 0x7f89480bd720 2023-12-07T10:02:34.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.959+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f893c004b70 con 0x7f89480bd720 2023-12-07T10:02:34.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.959+0000 7f8944ff9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89340668d0 0x7f8934068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:34.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.959+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f893c083ab0 con 0x7f89480bd720 2023-12-07T10:02:34.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.959+0000 7f8947fff640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89340668d0 0x7f8934068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:34.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.959+0000 7f8947fff640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89340668d0 0x7f8934068d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f89380ae000 tx=0x7f89380a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:34.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:34.963+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f893c050980 con 0x7f89480bd720 2023-12-07T10:02:35.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.115+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f894806cb70 con 0x7f89480bd720 2023-12-07T10:02:35.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.115+0000 7f8944ff9640 1 -- 172.21.15.89:0/170277940 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20154 (secure 0 0 0) 0x7f893c018020 con 0x7f89480bd720 2023-12-07T10:02:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:35.121 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":71,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:09.521302+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-07T10:01:48.336104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-07T10:01:49.595527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:35.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89340668d0 msgr2=0x7f8934068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89340668d0 0x7f8934068d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f89380ae000 tx=0x7f89380a6070 comp rx=0 tx=0).stop 2023-12-07T10:02:35.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 msgr2=0x7f89480c0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 0x7f89480c0410 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f893c0011f0 tx=0x7f893c00c9b0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 shutdown_connections 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f89340668d0 0x7f8934068d90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89480ca610 0x7f89480c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89480bd720 0x7f89480c0410 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 --2- 172.21.15.89:0/170277940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f894806cd90 0x7f894814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 >> 172.21.15.89:0/170277940 conn(0x7f8948071ea0 msgr2=0x7f894815f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 shutdown_connections 2023-12-07T10:02:35.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.119+0000 7f894e6c9640 1 -- 172.21.15.89:0/170277940 wait complete. 2023-12-07T10:02:35.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-07T10:02:35.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.275+0000 7f465b3df640 1 Processor -- start 2023-12-07T10:02:35.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.275+0000 7f465b3df640 1 -- start start 2023-12-07T10:02:35.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465b3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f465406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465b3df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f465406d100 0x7f46540c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465b3df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465406bea0 con 0x7f4654152ce0 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465b3df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4654159b10 con 0x7f465406d100 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465b3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654159550 con 0x7f465406db80 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465997c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f465406d100 0x7f46540c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465917b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4654152ce0 0x7f46540700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47952/0 (socket says 172.21.15.89:47952) 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465917b640 1 -- 172.21.15.89:0/1376432180 learned_addr learned my addr 172.21.15.89:0/1376432180 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465897a640 1 --2- 172.21.15.89:0/1376432180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f465406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465997c640 1 -- 172.21.15.89:0/1376432180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 msgr2=0x7f465406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465997c640 1 --2- 172.21.15.89:0/1376432180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f465406c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465997c640 1 -- 172.21.15.89:0/1376432180 >> v1:172.21.15.89:6789/0 conn(0x7f4654152ce0 legacy=0x7f46540700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465997c640 1 -- 172.21.15.89:0/1376432180 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654159830 con 0x7f465406d100 2023-12-07T10:02:35.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.279+0000 7f465997c640 1 --2- 172.21.15.89:0/1376432180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f46540c19e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f464c009d90 tx=0x7f464c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ec8dd7f0f8e8a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:35.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f464bfff640 1 -- 172.21.15.89:0/1376432180 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0a5980 con 0x7f465406d100 2023-12-07T10:02:35.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f464bfff640 1 -- 172.21.15.89:0/1376432180 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c0a5ae0 con 0x7f465406d100 2023-12-07T10:02:35.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f464bfff640 1 -- 172.21.15.89:0/1376432180 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0a5e70 con 0x7f465406d100 2023-12-07T10:02:35.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- 172.21.15.89:0/1376432180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 msgr2=0x7f46540c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 --2- 172.21.15.89:0/1376432180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f46540c19e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f464c009d90 tx=0x7f464c01c8c0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- 172.21.15.89:0/1376432180 shutdown_connections 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 --2- 172.21.15.89:0/1376432180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f46540c19e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 --2- 172.21.15.89:0/1376432180 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f465406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- 172.21.15.89:0/1376432180 >> 172.21.15.89:0/1376432180 conn(0x7f46540c2ad0 msgr2=0x7f46540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- 172.21.15.89:0/1376432180 shutdown_connections 2023-12-07T10:02:35.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- 172.21.15.89:0/1376432180 wait complete. 2023-12-07T10:02:35.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 Processor -- start 2023-12-07T10:02:35.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- start start 2023-12-07T10:02:35.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f465414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f46541f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4654152ce0 0x7f46541f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f5320 con 0x7f465406d100 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f5850 con 0x7f4654152ce0 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465b3df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f5570 con 0x7f465406db80 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465917b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f465414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465917b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f465414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39270/0 (socket says 172.21.15.89:39270) 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.283+0000 7f465917b640 1 -- 172.21.15.89:0/724349086 learned_addr learned my addr 172.21.15.89:0/724349086 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465897a640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f46541f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465997c640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4654152ce0 0x7f46541f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465917b640 1 -- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 msgr2=0x7f46541f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465917b640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f46541f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465917b640 1 -- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4654152ce0 msgr2=0x7f46541f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465917b640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4654152ce0 0x7f46541f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465917b640 1 -- 172.21.15.89:0/724349086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009a70 con 0x7f465406d100 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465917b640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f465414dab0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f465000c400 tx=0x7f465000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650005cf0 con 0x7f465406d100 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4650005e50 con 0x7f465406d100 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46540c5a00 con 0x7f465406d100 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500072d0 con 0x7f465406d100 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465414dff0 con 0x7f465406d100 2023-12-07T10:02:35.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465404e890 con 0x7f465406d100 2023-12-07T10:02:35.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4650007430 con 0x7f465406d100 2023-12-07T10:02:35.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f4649ffb640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46380668d0 0x7f4638068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4650083c70 con 0x7f465406d100 2023-12-07T10:02:35.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.287+0000 7f465897a640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46380668d0 0x7f4638068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.291+0000 7f465897a640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46380668d0 0x7f4638068d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f465414e4b0 tx=0x7f4644008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:35.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.291+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4650050bf0 con 0x7f465406d100 2023-12-07T10:02:35.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.475+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f465415cef0 con 0x7f465406d100 2023-12-07T10:02:35.483 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T10:02:35.479+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T10:02:35.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.479+0000 7f4649ffb640 1 -- 172.21.15.89:0/724349086 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4650017090 con 0x7f465406d100 2023-12-07T10:02:35.485 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46380668d0 msgr2=0x7f4638068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46380668d0 0x7f4638068d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f465414e4b0 tx=0x7f4644008040 comp rx=0 tx=0).stop 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 msgr2=0x7f465414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f465414dab0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f465000c400 tx=0x7f465000c8c0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 shutdown_connections 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4654152ce0 0x7f46541f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46380668d0 0x7f4638068d90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f465406db80 0x7f46541f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 --2- 172.21.15.89:0/724349086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f465406d100 0x7f465414dab0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 >> 172.21.15.89:0/724349086 conn(0x7f46540c2ad0 msgr2=0x7f465414c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:35.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 shutdown_connections 2023-12-07T10:02:35.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.483+0000 7f465b3df640 1 -- 172.21.15.89:0/724349086 wait complete. 2023-12-07T10:02:35.497 INFO:tasks.ceph.mds.a.smithi089.stderr: -5228> 2023-12-07T10:01:56.196+0000 7fb2f2a15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:02:35.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-07T10:02:35.544 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-12-07T10:02:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.647+0000 7fd24732a640 1 Processor -- start 2023-12-07T10:02:35.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.647+0000 7fd24732a640 1 -- start start 2023-12-07T10:02:35.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd24732a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd240151d80 0x7fd2400c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd24732a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd2400c7f20 0x7fd24006be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd24732a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24006cf70 con 0x7fd2400c8430 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd24732a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd240152160 con 0x7fd2400c7f20 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd24732a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2400c6a30 con 0x7fd240151d80 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2458c7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd2400c7f20 0x7fd24006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2448c5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd2400c8430 0x7fd24006b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47966/0 (socket says 172.21.15.89:47966) 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2448c5640 1 -- 172.21.15.89:0/3097522160 learned_addr learned my addr 172.21.15.89:0/3097522160 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2450c6640 1 --2- 172.21.15.89:0/3097522160 >> v2:172.21.15.97:3300/0 conn(0x7fd240151d80 0x7fd2400c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2458c7640 1 -- 172.21.15.89:0/3097522160 >> v2:172.21.15.97:3300/0 conn(0x7fd240151d80 msgr2=0x7fd2400c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2458c7640 1 --2- 172.21.15.89:0/3097522160 >> v2:172.21.15.97:3300/0 conn(0x7fd240151d80 0x7fd2400c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2458c7640 1 -- 172.21.15.89:0/3097522160 >> v1:172.21.15.89:6789/0 conn(0x7fd2400c8430 legacy=0x7fd24006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd2458c7640 1 -- 172.21.15.89:0/3097522160 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400c72d0 con 0x7fd2400c7f20 2023-12-07T10:02:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.651+0000 7fd237fff640 1 -- 172.21.15.89:0/3097522160 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287318230 0 0) 0x7fd24006cf70 con 0x7fd2400c8430 2023-12-07T10:02:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd2458c7640 1 --2- 172.21.15.89:0/3097522160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd24006be30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd24008b3e0 tx=0x7fd23801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a78d9187e1b2b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd237fff640 1 -- 172.21.15.89:0/3097522160 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380a5910 con 0x7fd2400c7f20 2023-12-07T10:02:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd237fff640 1 -- 172.21.15.89:0/3097522160 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380a5a70 con 0x7fd2400c7f20 2023-12-07T10:02:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd237fff640 1 -- 172.21.15.89:0/3097522160 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380a5e00 con 0x7fd2400c7f20 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 -- 172.21.15.89:0/3097522160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 msgr2=0x7fd24006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 --2- 172.21.15.89:0/3097522160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd24006be30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd24008b3e0 tx=0x7fd23801c850 comp rx=0 tx=0).stop 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 -- 172.21.15.89:0/3097522160 shutdown_connections 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 --2- 172.21.15.89:0/3097522160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd24006be30 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 --2- 172.21.15.89:0/3097522160 >> v2:172.21.15.97:3300/0 conn(0x7fd240151d80 0x7fd2400c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 -- 172.21.15.89:0/3097522160 >> 172.21.15.89:0/3097522160 conn(0x7fd2400abd00 msgr2=0x7fd2400ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 -- 172.21.15.89:0/3097522160 shutdown_connections 2023-12-07T10:02:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 -- 172.21.15.89:0/3097522160 wait complete. 2023-12-07T10:02:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 Processor -- start 2023-12-07T10:02:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.655+0000 7fd24732a640 1 -- start start 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd2401ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2400c8430 0x7fd2400c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd240151d80 0x7fd24014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24014bf50 con 0x7fd2400c7f20 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401ec9f0 con 0x7fd2400c8430 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401f0a00 con 0x7fd240151d80 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd2401ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd2401ed1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39306/0 (socket says 172.21.15.89:39306) 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 -- 172.21.15.89:0/3105775254 learned_addr learned my addr 172.21.15.89:0/3105775254 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2448c5640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2400c8430 0x7fd2400c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2458c7640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd240151d80 0x7fd24014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 -- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd240151d80 msgr2=0x7fd24014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd240151d80 0x7fd24014adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 -- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2400c8430 msgr2=0x7fd2400c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2400c8430 0x7fd2400c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 -- 172.21.15.89:0/3105775254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238009a70 con 0x7fd2400c7f20 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2458c7640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd240151d80 0x7fd24014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd2450c6640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd2401ed1b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00e9b0 tx=0x7fd23c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0096b0 con 0x7fd2400c7f20 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00c9a0 con 0x7fd2400c7f20 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2401ecc90 con 0x7fd2400c7f20 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00cd30 con 0x7fd2400c7f20 2023-12-07T10:02:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd240158250 con 0x7fd2400c7f20 2023-12-07T10:02:35.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24004e890 con 0x7fd2400c7f20 2023-12-07T10:02:35.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.659+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd23c013470 con 0x7fd2400c7f20 2023-12-07T10:02:35.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.663+0000 7fd235ffb640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd224066900 0x7fd224068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:35.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.663+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fd23c084980 con 0x7fd2400c7f20 2023-12-07T10:02:35.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.663+0000 7fd2448c5640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd224066900 0x7fd224068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:35.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.663+0000 7fd2448c5640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd224066900 0x7fd224068dc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd2400c0fe0 tx=0x7fd230009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:35.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.667+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd23c0518a0 con 0x7fd2400c7f20 2023-12-07T10:02:35.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:35.847+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd24006cb00 con 0x7fd2400c7f20 2023-12-07T10:02:36.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.487+0000 7fd235ffb640 1 -- 172.21.15.89:0/3105775254 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd23c054ec0 con 0x7fd2400c7f20 2023-12-07T10:02:36.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd224066900 msgr2=0x7fd224068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:36.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd224066900 0x7fd224068dc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd2400c0fe0 tx=0x7fd230009040 comp rx=0 tx=0).stop 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 msgr2=0x7fd2401ed1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd2401ed1b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00e9b0 tx=0x7fd23c00ee70 comp rx=0 tx=0).stop 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 shutdown_connections 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd224066900 0x7fd224068dc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd240151d80 0x7fd24014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2400c8430 0x7fd2400c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 --2- 172.21.15.89:0/3105775254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2400c7f20 0x7fd2401ed1b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 >> 172.21.15.89:0/3105775254 conn(0x7fd2400abd00 msgr2=0x7fd24015e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 shutdown_connections 2023-12-07T10:02:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.491+0000 7fd24732a640 1 -- 172.21.15.89:0/3105775254 wait complete. 2023-12-07T10:02:36.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-07T10:02:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 Processor -- start 2023-12-07T10:02:36.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 -- start start 2023-12-07T10:02:36.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd934154ea0 0x7fd934155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93406b0c0 0x7fd93414e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd93414edc0 0x7fd934070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9341557c0 con 0x7fd93414edc0 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9341559d0 con 0x7fd934154ea0 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd93a6fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93406d910 con 0x7fd93406b0c0 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd938c9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd93414edc0 0x7fd934070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd938c9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd93414edc0 0x7fd934070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39312/0 (socket says 172.21.15.89:39312) 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd938c9b640 1 -- 172.21.15.89:0/735575736 learned_addr learned my addr 172.21.15.89:0/735575736 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.695+0000 7fd9337fe640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93406b0c0 0x7fd93414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd933fff640 1 --2- 172.21.15.89:0/735575736 >> v2:172.21.15.97:3300/0 conn(0x7fd934154ea0 0x7fd934155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd938c9b640 1 -- 172.21.15.89:0/735575736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93406b0c0 msgr2=0x7fd93414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd938c9b640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93406b0c0 0x7fd93414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd938c9b640 1 -- 172.21.15.89:0/735575736 >> v2:172.21.15.97:3300/0 conn(0x7fd934154ea0 msgr2=0x7fd934155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:36.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd938c9b640 1 --2- 172.21.15.89:0/735575736 >> v2:172.21.15.97:3300/0 conn(0x7fd934154ea0 0x7fd934155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd938c9b640 1 -- 172.21.15.89:0/735575736 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9340c1230 con 0x7fd93414edc0 2023-12-07T10:02:36.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd9337fe640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93406b0c0 0x7fd93414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:36.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd933fff640 1 --2- 172.21.15.89:0/735575736 >> v2:172.21.15.97:3300/0 conn(0x7fd934154ea0 0x7fd934155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:36.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd938c9b640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd93414edc0 0x7fd934070260 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd93406fde0 tx=0x7fd92c01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67de5eded0d4fa9a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:36.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd932ffd640 1 -- 172.21.15.89:0/735575736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0a79b0 con 0x7fd93414edc0 2023-12-07T10:02:36.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd932ffd640 1 -- 172.21.15.89:0/735575736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0a7b10 con 0x7fd93414edc0 2023-12-07T10:02:36.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd932ffd640 1 -- 172.21.15.89:0/735575736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0a7ea0 con 0x7fd93414edc0 2023-12-07T10:02:36.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 -- 172.21.15.89:0/735575736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd93414edc0 msgr2=0x7fd934070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:36.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd93414edc0 0x7fd934070260 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd93406fde0 tx=0x7fd92c01eb20 comp rx=0 tx=0).stop 2023-12-07T10:02:36.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 -- 172.21.15.89:0/735575736 shutdown_connections 2023-12-07T10:02:36.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd93414edc0 0x7fd934070260 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/735575736 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93406b0c0 0x7fd93414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/735575736 >> v2:172.21.15.97:3300/0 conn(0x7fd934154ea0 0x7fd934155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.699+0000 7fd93a6fe640 1 -- 172.21.15.89:0/735575736 >> 172.21.15.89:0/735575736 conn(0x7fd93406a5a0 msgr2=0x7fd93406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:36.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 -- 172.21.15.89:0/735575736 shutdown_connections 2023-12-07T10:02:36.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 -- 172.21.15.89:0/735575736 wait complete. 2023-12-07T10:02:36.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 Processor -- start 2023-12-07T10:02:36.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 -- start start 2023-12-07T10:02:36.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd93406b0c0 0x7fd93415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93414edc0 0x7fd9341481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 0x7fd934148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd934143790 con 0x7fd934154ea0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9341edd30 con 0x7fd93406b0c0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd93a6fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd934147ba0 con 0x7fd93414edc0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 0x7fd934148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 0x7fd934148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39316/0 (socket says 172.21.15.89:39316) 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 -- 172.21.15.89:0/3050831649 learned_addr learned my addr 172.21.15.89:0/3050831649 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd933fff640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd93406b0c0 0x7fd93415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd9337fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93414edc0 0x7fd9341481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 -- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93414edc0 msgr2=0x7fd9341481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93414edc0 0x7fd9341481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 -- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd93406b0c0 msgr2=0x7fd93415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd93406b0c0 0x7fd93415a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 -- 172.21.15.89:0/3050831649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c009b30 con 0x7fd934154ea0 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd933fff640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd93406b0c0 0x7fd93415a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:36.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.703+0000 7fd938c9b640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 0x7fd934148700 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0b1040 tx=0x7fd934152660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00e150 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c009510 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340ac280 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c007e80 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9341ed390 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340a98e0 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd92c0c2450 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd930ff9640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9200668d0 0x7fd920068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fd92c11eed0 con 0x7fd934154ea0 2023-12-07T10:02:36.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.707+0000 7fd933fff640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9200668d0 0x7fd920068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:36.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.711+0000 7fd933fff640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9200668d0 0x7fd920068d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd92400a9b0 tx=0x7fd924008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:36.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.711+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd92c0ebd50 con 0x7fd934154ea0 2023-12-07T10:02:36.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:36.863+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9341ede70 con 0x7fd934154ea0 2023-12-07T10:02:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.487+0000 7fd930ff9640 1 -- 172.21.15.89:0/3050831649 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd9341ede70 con 0x7fd934154ea0 2023-12-07T10:02:37.494 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2023-12-07T10:02:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.491+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9200668d0 msgr2=0x7fd920068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:37.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.491+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9200668d0 0x7fd920068d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd92400a9b0 tx=0x7fd924008040 comp rx=0 tx=0).stop 2023-12-07T10:02:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.491+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 msgr2=0x7fd934148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:37.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.491+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 0x7fd934148700 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0b1040 tx=0x7fd934152660 comp rx=0 tx=0).stop 2023-12-07T10:02:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 shutdown_connections 2023-12-07T10:02:37.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd934154ea0 0x7fd934148700 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd9200668d0 0x7fd920068d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd93414edc0 0x7fd9341481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 --2- 172.21.15.89:0/3050831649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd93406b0c0 0x7fd93415a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 >> 172.21.15.89:0/3050831649 conn(0x7fd93406a5a0 msgr2=0x7fd93406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 shutdown_connections 2023-12-07T10:02:37.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.495+0000 7fd93a6fe640 1 -- 172.21.15.89:0/3050831649 wait complete. 2023-12-07T10:02:37.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-07T10:02:37.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 Processor -- start 2023-12-07T10:02:37.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 -- start start 2023-12-07T10:02:37.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f791c14e390 0x7f791c0c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f791c0abde0 0x7f791c0c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c14e770 con 0x7f791c0c1940 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c06b2e0 con 0x7f791c0abde0 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f7921f1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c1518d0 con 0x7f791c14e390 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f791c0abde0 0x7f791c0c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f791c0abde0 0x7f791c0c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39322/0 (socket says 172.21.15.89:39322) 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 -- 172.21.15.89:0/445034663 learned_addr learned my addr 172.21.15.89:0/445034663 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791b7fe640 1 --2- 172.21.15.89:0/445034663 >> v2:172.21.15.97:3300/0 conn(0x7f791c14e390 0x7f791c0c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 -- 172.21.15.89:0/445034663 >> v2:172.21.15.97:3300/0 conn(0x7f791c14e390 msgr2=0x7f791c0c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 --2- 172.21.15.89:0/445034663 >> v2:172.21.15.97:3300/0 conn(0x7f791c14e390 0x7f791c0c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 -- 172.21.15.89:0/445034663 >> v1:172.21.15.97:6789/0 conn(0x7f791c0c1940 legacy=0x7f791c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:37.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.663+0000 7f791affd640 1 -- 172.21.15.89:0/445034663 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c151bb0 con 0x7f791c0abde0 2023-12-07T10:02:37.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f791affd640 1 --2- 172.21.15.89:0/445034663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c0abde0 0x7f791c0c1400 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f791c074610 tx=0x7f791001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362f369ad297d4af server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:37.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f791a7fc640 1 -- 172.21.15.89:0/445034663 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100ab670 con 0x7f791c0abde0 2023-12-07T10:02:37.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f791a7fc640 1 -- 172.21.15.89:0/445034663 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100ab7d0 con 0x7f791c0abde0 2023-12-07T10:02:37.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f791a7fc640 1 -- 172.21.15.89:0/445034663 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100abb60 con 0x7f791c0abde0 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 -- 172.21.15.89:0/445034663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c0abde0 msgr2=0x7f791c0c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 --2- 172.21.15.89:0/445034663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c0abde0 0x7f791c0c1400 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f791c074610 tx=0x7f791001c470 comp rx=0 tx=0).stop 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 -- 172.21.15.89:0/445034663 shutdown_connections 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 --2- 172.21.15.89:0/445034663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c0abde0 0x7f791c0c1400 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 --2- 172.21.15.89:0/445034663 >> v2:172.21.15.97:3300/0 conn(0x7f791c14e390 0x7f791c0c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 -- 172.21.15.89:0/445034663 >> 172.21.15.89:0/445034663 conn(0x7f791c06a5a0 msgr2=0x7f791c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 -- 172.21.15.89:0/445034663 shutdown_connections 2023-12-07T10:02:37.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 -- 172.21.15.89:0/445034663 wait complete. 2023-12-07T10:02:37.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 Processor -- start 2023-12-07T10:02:37.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.667+0000 7f7921f1d640 1 -- start start 2023-12-07T10:02:37.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f791c0abde0 0x7f791c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f791c0c1940 0x7f791c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 0x7f791c1ee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c1ef3a0 con 0x7f791c14e390 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c1557a0 con 0x7f791c0c1940 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c155a80 con 0x7f791c0abde0 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 0x7f791c1ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 0x7f791c1ee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39332/0 (socket says 172.21.15.89:39332) 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 -- 172.21.15.89:0/2937800186 learned_addr learned my addr 172.21.15.89:0/2937800186 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791b7fe640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f791c0abde0 0x7f791c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791affd640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f791c0c1940 0x7f791c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:37.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 -- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f791c0abde0 msgr2=0x7f791c151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:37.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f791c0abde0 0x7f791c151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 -- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f791c0c1940 msgr2=0x7f791c152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:37.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f791c0c1940 0x7f791c152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:37.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 -- 172.21.15.89:0/2937800186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100094d0 con 0x7f791c14e390 2023-12-07T10:02:37.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f791bfff640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 0x7f791c1ee760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f791400c770 tx=0x7f791400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:37.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914003b80 con 0x7f791c14e390 2023-12-07T10:02:37.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914003ce0 con 0x7f791c14e390 2023-12-07T10:02:37.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c155d60 con 0x7f791c14e390 2023-12-07T10:02:37.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400aa90 con 0x7f791c14e390 2023-12-07T10:02:37.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c14f490 con 0x7f791c14e390 2023-12-07T10:02:37.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.671+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791c04e890 con 0x7f791c14e390 2023-12-07T10:02:37.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.675+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f791400abf0 con 0x7f791c14e390 2023-12-07T10:02:37.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.675+0000 7f7903fff640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79080668d0 0x7f7908068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:37.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.675+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f79140843d0 con 0x7f791c14e390 2023-12-07T10:02:37.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.675+0000 7f791b7fe640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79080668d0 0x7f7908068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:37.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.675+0000 7f791b7fe640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79080668d0 0x7f7908068d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f791c0c05e0 tx=0x7f790c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:37.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.679+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79140514b0 con 0x7f791c14e390 2023-12-07T10:02:37.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:37.835+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f791c0c23f0 con 0x7f791c14e390 2023-12-07T10:02:38.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7903fff640 1 -- 172.21.15.89:0/2937800186 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7914054ad0 con 0x7f791c14e390 2023-12-07T10:02:38.500 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79080668d0 msgr2=0x7f7908068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79080668d0 0x7f7908068d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f791c0c05e0 tx=0x7f790c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 msgr2=0x7f791c1ee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 0x7f791c1ee760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f791400c770 tx=0x7f791400cc30 comp rx=0 tx=0).stop 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 shutdown_connections 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791c14e390 0x7f791c1ee760 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f791c0c1940 0x7f791c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f79080668d0 0x7f7908068d90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 --2- 172.21.15.89:0/2937800186 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f791c0abde0 0x7f791c151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.495+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 >> 172.21.15.89:0/2937800186 conn(0x7f791c06a5a0 msgr2=0x7f791c070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:38.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.499+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 shutdown_connections 2023-12-07T10:02:38.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.499+0000 7f7921f1d640 1 -- 172.21.15.89:0/2937800186 wait complete. 2023-12-07T10:02:38.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafdae54640 1 Processor -- start 2023-12-07T10:02:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafdae54640 1 -- start start 2023-12-07T10:02:38.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafdae54640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fafd414e9d0 0x7fafd4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafdae54640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd406d320 con 0x7fafd40a8470 2023-12-07T10:02:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafdae54640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd40721b0 con 0x7fafd4070b80 2023-12-07T10:02:38.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafdae54640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40c2830 con 0x7fafd414e9d0 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafd93f1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fafd40a8470 0x7fafd406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47970/0 (socket says 172.21.15.89:47970) 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafd93f1640 1 -- 172.21.15.89:0/3781231683 learned_addr learned my addr 172.21.15.89:0/3781231683 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafd8bf0640 1 --2- 172.21.15.89:0/3781231683 >> v2:172.21.15.97:3300/0 conn(0x7fafd414e9d0 0x7fafd4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafcb7fe640 1 -- 172.21.15.89:0/3781231683 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404386265 0 0) 0x7fafd406d320 con 0x7fafd40a8470 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafcb7fe640 1 -- 172.21.15.89:0/3781231683 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafbc005740 con 0x7fafd40a8470 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3781231683 >> v1:172.21.15.97:6789/0 conn(0x7fafd4070b80 legacy=0x7fafd40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafcb7fe640 1 -- 172.21.15.89:0/3781231683 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386044206 0 0) 0x7fafbc005740 con 0x7fafd40a8470 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3781231683 >> v1:172.21.15.89:6789/0 conn(0x7fafd40a8470 legacy=0x7fafd406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.663+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3781231683 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4072450 con 0x7fafd414e9d0 2023-12-07T10:02:38.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafd8bf0640 1 --2- 172.21.15.89:0/3781231683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd4151e60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fafd00097c0 tx=0x7fafd001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3cc5128069ab9c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:38.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafcb7fe640 1 -- 172.21.15.89:0/3781231683 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc001a00 con 0x7fafd414e9d0 2023-12-07T10:02:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafcb7fe640 1 -- 172.21.15.89:0/3781231683 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd00a7050 con 0x7fafd414e9d0 2023-12-07T10:02:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafcb7fe640 1 -- 172.21.15.89:0/3781231683 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00ab620 con 0x7fafd414e9d0 2023-12-07T10:02:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 -- 172.21.15.89:0/3781231683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 msgr2=0x7fafd4151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 --2- 172.21.15.89:0/3781231683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd4151e60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fafd00097c0 tx=0x7fafd001c310 comp rx=0 tx=0).stop 2023-12-07T10:02:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 -- 172.21.15.89:0/3781231683 shutdown_connections 2023-12-07T10:02:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 --2- 172.21.15.89:0/3781231683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd4151e60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 -- 172.21.15.89:0/3781231683 >> 172.21.15.89:0/3781231683 conn(0x7fafd40c2ad0 msgr2=0x7fafd40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 -- 172.21.15.89:0/3781231683 shutdown_connections 2023-12-07T10:02:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.667+0000 7fafdae54640 1 -- 172.21.15.89:0/3781231683 wait complete. 2023-12-07T10:02:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 Processor -- start 2023-12-07T10:02:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 -- start start 2023-12-07T10:02:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 0x7fafd40aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafd40a8470 0x7fafd4142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd40ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd41417f0 con 0x7fafd4070b80 2023-12-07T10:02:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd41429c0 con 0x7fafd414e9d0 2023-12-07T10:02:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4141a10 con 0x7fafd40a8470 2023-12-07T10:02:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 0x7fafd40aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 0x7fafd40aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39336/0 (socket says 172.21.15.89:39336) 2023-12-07T10:02:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3899023289 learned_addr learned my addr 172.21.15.89:0/3899023289 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd93f1640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd40ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafcbfff640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafd40a8470 0x7fafd4142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafd40a8470 msgr2=0x7fafd4142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafd40a8470 0x7fafd4142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 msgr2=0x7fafd40ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd40ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 -- 172.21.15.89:0/3899023289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0009420 con 0x7fafd4070b80 2023-12-07T10:02:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafd8bf0640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 0x7fafd40aab90 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fafd00097c0 tx=0x7fafd001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00abd80 con 0x7fafd4070b80 2023-12-07T10:02:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0004020 con 0x7fafd4070b80 2023-12-07T10:02:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd414fa40 con 0x7fafd4070b80 2023-12-07T10:02:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00043d0 con 0x7fafd4070b80 2023-12-07T10:02:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.671+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd4150100 con 0x7fafd4070b80 2023-12-07T10:02:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.675+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd40ab0d0 con 0x7fafd4070b80 2023-12-07T10:02:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.675+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fafd0003620 con 0x7fafd4070b80 2023-12-07T10:02:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.675+0000 7fafc97fa640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:38.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.675+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fafd011ea90 con 0x7fafd4070b80 2023-12-07T10:02:38.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.675+0000 7fafcbfff640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:38.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.675+0000 7fafcbfff640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fafd414ac30 tx=0x7fafc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:38.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.679+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafd00ebc60 con 0x7fafd4070b80 2023-12-07T10:02:38.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafd4067a40 con 0x7fafd4070b80 2023-12-07T10:02:38.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafc97fa640 1 -- 172.21.15.89:0/3899023289 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16581 (secure 0 0 0) 0x7fafd00ef280 con 0x7fafd4070b80 2023-12-07T10:02:38.836 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:38.836 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":74,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:38.493365+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6836/3031036225":"2023-12-08T10:02:35.481810+0000","172.21.15.89:6834/3031036225":"2023-12-08T10:02:35.481810+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 msgr2=0x7fafc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fafd414ac30 tx=0x7fafc4009040 comp rx=0 tx=0).stop 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 msgr2=0x7fafd40aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 0x7fafd40aab90 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fafd00097c0 tx=0x7fafd001ab50 comp rx=0 tx=0).stop 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 shutdown_connections 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafd414e9d0 0x7fafd40ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fafc00668d0 0x7fafc0068d90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafd40a8470 0x7fafd4142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 --2- 172.21.15.89:0/3899023289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafd4070b80 0x7fafd40aab90 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 >> 172.21.15.89:0/3899023289 conn(0x7fafd40c2ad0 msgr2=0x7fafd4149e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 shutdown_connections 2023-12-07T10:02:38.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.831+0000 7fafdae54640 1 -- 172.21.15.89:0/3899023289 wait complete. 2023-12-07T10:02:38.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T09:59:00.403301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-07T10:02:06.063634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-07T10:02:06.886623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T10:02:38.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T10:02:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.991+0000 7f48af3aa640 1 Processor -- start 2023-12-07T10:02:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.991+0000 7f48af3aa640 1 -- start start 2023-12-07T10:02:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48af3aa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48a80700f0 0x7f48a8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48af3aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a8071be0 con 0x7f48a806df30 2023-12-07T10:02:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48af3aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a8154b90 con 0x7f48a8154000 2023-12-07T10:02:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48af3aa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80a8710 con 0x7f48a80700f0 2023-12-07T10:02:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48ac945640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48a80700f0 0x7f48a8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:38.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48ad947640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f48a806df30 0x7f48a80714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47976/0 (socket says 172.21.15.89:47976) 2023-12-07T10:02:39.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48ad947640 1 -- 172.21.15.89:0/691686997 learned_addr learned my addr 172.21.15.89:0/691686997 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:39.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48ac945640 1 -- 172.21.15.89:0/691686997 >> v1:172.21.15.97:6789/0 conn(0x7f48a8154000 legacy=0x7f48a81543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:39.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48ac945640 1 -- 172.21.15.89:0/691686997 >> v1:172.21.15.89:6789/0 conn(0x7f48a806df30 legacy=0x7f48a80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f48ac945640 1 -- 172.21.15.89:0/691686997 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80abd70 con 0x7f48a80700f0 2023-12-07T10:02:39.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.995+0000 7f489ffff640 1 -- 172.21.15.89:0/691686997 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642442531 0 0) 0x7f48a8071be0 con 0x7f48a806df30 2023-12-07T10:02:39.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48ac945640 1 --2- 172.21.15.89:0/691686997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80700f0 0x7f48a8070f90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f489800a960 tx=0x7f489801d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd6c96209271204 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f489ffff640 1 -- 172.21.15.89:0/691686997 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980a6760 con 0x7f48a80700f0 2023-12-07T10:02:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f489ffff640 1 -- 172.21.15.89:0/691686997 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48980a68c0 con 0x7f48a80700f0 2023-12-07T10:02:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f489ffff640 1 -- 172.21.15.89:0/691686997 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980a6c50 con 0x7f48a80700f0 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 -- 172.21.15.89:0/691686997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80700f0 msgr2=0x7f48a8070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 --2- 172.21.15.89:0/691686997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80700f0 0x7f48a8070f90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f489800a960 tx=0x7f489801d6f0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 -- 172.21.15.89:0/691686997 shutdown_connections 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 --2- 172.21.15.89:0/691686997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80700f0 0x7f48a8070f90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 -- 172.21.15.89:0/691686997 >> 172.21.15.89:0/691686997 conn(0x7f48a80c2a60 msgr2=0x7f48a80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 -- 172.21.15.89:0/691686997 shutdown_connections 2023-12-07T10:02:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 -- 172.21.15.89:0/691686997 wait complete. 2023-12-07T10:02:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 Processor -- start 2023-12-07T10:02:39.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 -- start start 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a806df30 0x7f48a813ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a80700f0 0x7f48a813f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:38.999+0000 7f48af3aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 0x7f48a81ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48af3aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a813b5f0 con 0x7f48a8154000 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48af3aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8144100 con 0x7f48a806df30 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48af3aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a813f840 con 0x7f48a80700f0 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 0x7f48a81ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 0x7f48a81ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39352/0 (socket says 172.21.15.89:39352) 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 -- 172.21.15.89:0/574174434 learned_addr learned my addr 172.21.15.89:0/574174434 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ac945640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a80700f0 0x7f48a813f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad146640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a806df30 0x7f48a813ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 -- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a80700f0 msgr2=0x7f48a813f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a80700f0 0x7f48a813f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 -- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a806df30 msgr2=0x7f48a813ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a806df30 0x7f48a813ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 -- 172.21.15.89:0/574174434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489800a5c0 con 0x7f48a8154000 2023-12-07T10:02:39.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48ad947640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 0x7f48a81ee3c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c780 tx=0x7f48a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000ce90 con 0x7f48a8154000 2023-12-07T10:02:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a000a640 con 0x7f48a8154000 2023-12-07T10:02:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000a9d0 con 0x7f48a8154000 2023-12-07T10:02:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a813fb20 con 0x7f48a8154000 2023-12-07T10:02:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a8147fa0 con 0x7f48a8154000 2023-12-07T10:02:39.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a8140040 con 0x7f48a8154000 2023-12-07T10:02:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.003+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f48a000ab30 con 0x7f48a8154000 2023-12-07T10:02:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.007+0000 7f489dffb640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f488c0668d0 0x7f488c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.007+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f48a0083890 con 0x7f48a8154000 2023-12-07T10:02:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.007+0000 7f48ad146640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f488c0668d0 0x7f488c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.007+0000 7f48ad146640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f488c0668d0 0x7f488c068d90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f48a40098e0 tx=0x7f48a4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.007+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48a8140040 con 0x7f48a8154000 2023-12-07T10:02:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.179+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48a8140040 con 0x7f48a8154000 2023-12-07T10:02:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.179+0000 7f489dffb640 1 -- 172.21.15.89:0/574174434 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48a8140040 con 0x7f48a8154000 2023-12-07T10:02:39.187 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-12-07T10:02:39.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f488c0668d0 msgr2=0x7f488c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f488c0668d0 0x7f488c068d90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f48a40098e0 tx=0x7f48a4009060 comp rx=0 tx=0).stop 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 msgr2=0x7f48a81ee3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 0x7f48a81ee3c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c780 tx=0x7f48a000cc40 comp rx=0 tx=0).stop 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 shutdown_connections 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a8154000 0x7f48a81ee3c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f488c0668d0 0x7f488c068d90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a80700f0 0x7f48a813f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 --2- 172.21.15.89:0/574174434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a806df30 0x7f48a813ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 >> 172.21.15.89:0/574174434 conn(0x7f48a80c2a60 msgr2=0x7f48a80708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 shutdown_connections 2023-12-07T10:02:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.183+0000 7f48af3aa640 1 -- 172.21.15.89:0/574174434 wait complete. 2023-12-07T10:02:39.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-07T10:02:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.343+0000 7ff43e4ad640 1 Processor -- start 2023-12-07T10:02:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.343+0000 7ff43e4ad640 1 -- start start 2023-12-07T10:02:39.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.343+0000 7ff43e4ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff438151d80 0x7ff4380c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff43e4ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff4380c8430 0x7ff43806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff43e4ad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43806cf70 con 0x7ff4380c7f20 2023-12-07T10:02:39.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff43e4ad640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff438152160 con 0x7ff438151d80 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff43e4ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4380c6a30 con 0x7ff4380c8430 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff438151d80 0x7ff4380c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff438151d80 0x7ff4380c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39366/0 (socket says 172.21.15.89:39366) 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 -- 172.21.15.89:0/2559654033 learned_addr learned my addr 172.21.15.89:0/2559654033 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff4377fe640 1 --2- 172.21.15.89:0/2559654033 >> v2:172.21.15.97:3300/0 conn(0x7ff4380c8430 0x7ff43806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 -- 172.21.15.89:0/2559654033 >> v2:172.21.15.97:3300/0 conn(0x7ff4380c8430 msgr2=0x7ff43806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 --2- 172.21.15.89:0/2559654033 >> v2:172.21.15.97:3300/0 conn(0x7ff4380c8430 0x7ff43806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 -- 172.21.15.89:0/2559654033 >> v1:172.21.15.97:6789/0 conn(0x7ff4380c7f20 legacy=0x7ff43806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 -- 172.21.15.89:0/2559654033 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380c72d0 con 0x7ff438151d80 2023-12-07T10:02:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff437fff640 1 --2- 172.21.15.89:0/2559654033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff438151d80 0x7ff4380c49a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff4380c7a40 tx=0x7ff42801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81eb552cfad61a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.347+0000 7ff436ffd640 1 -- 172.21.15.89:0/2559654033 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280ab640 con 0x7ff438151d80 2023-12-07T10:02:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff436ffd640 1 -- 172.21.15.89:0/2559654033 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4280a7070 con 0x7ff438151d80 2023-12-07T10:02:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff436ffd640 1 -- 172.21.15.89:0/2559654033 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280ab9c0 con 0x7ff438151d80 2023-12-07T10:02:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- 172.21.15.89:0/2559654033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff438151d80 msgr2=0x7ff4380c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/2559654033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff438151d80 0x7ff4380c49a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff4380c7a40 tx=0x7ff42801c440 comp rx=0 tx=0).stop 2023-12-07T10:02:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- 172.21.15.89:0/2559654033 shutdown_connections 2023-12-07T10:02:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/2559654033 >> v2:172.21.15.97:3300/0 conn(0x7ff4380c8430 0x7ff43806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/2559654033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff438151d80 0x7ff4380c49a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- 172.21.15.89:0/2559654033 >> 172.21.15.89:0/2559654033 conn(0x7ff4380abd00 msgr2=0x7ff4380ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:39.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- 172.21.15.89:0/2559654033 shutdown_connections 2023-12-07T10:02:39.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- 172.21.15.89:0/2559654033 wait complete. 2023-12-07T10:02:39.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 Processor -- start 2023-12-07T10:02:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- start start 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 0x7ff4380c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4380c8430 0x7ff4381ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff438151d80 0x7ff4381ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380a99a0 con 0x7ff4380c7f20 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438147370 con 0x7ff438151d80 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43e4ad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381ed6c0 con 0x7ff4380c8430 2023-12-07T10:02:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff437fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 0x7ff4380c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff437fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 0x7ff4380c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39370/0 (socket says 172.21.15.89:39370) 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff437fff640 1 -- 172.21.15.89:0/790384872 learned_addr learned my addr 172.21.15.89:0/790384872 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff4377fe640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4380c8430 0x7ff4381ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.351+0000 7ff43ca4a640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff438151d80 0x7ff4381ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff437fff640 1 -- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4380c8430 msgr2=0x7ff4381ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff437fff640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4380c8430 0x7ff4381ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff437fff640 1 -- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff438151d80 msgr2=0x7ff4381ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff437fff640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff438151d80 0x7ff4381ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff437fff640 1 -- 172.21.15.89:0/790384872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280094d0 con 0x7ff4380c7f20 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff4377fe640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4380c8430 0x7ff4381ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff437fff640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 0x7ff4380c8830 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff4280ad040 tx=0x7ff42801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280be3f0 con 0x7ff4380c7f20 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4280be570 con 0x7ff4380c7f20 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4381ed9a0 con 0x7ff4380c7f20 2023-12-07T10:02:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280be920 con 0x7ff4380c7f20 2023-12-07T10:02:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438150a90 con 0x7ff4380c7f20 2023-12-07T10:02:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff438150c80 con 0x7ff4380c7f20 2023-12-07T10:02:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff4280c7440 con 0x7ff4380c7f20 2023-12-07T10:02:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff434ff9640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff4240668d0 0x7ff424068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff42811eeb0 con 0x7ff4380c7f20 2023-12-07T10:02:39.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.355+0000 7ff4377fe640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff4240668d0 0x7ff424068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.359+0000 7ff4377fe640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff4240668d0 0x7ff424068d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff43815e230 tx=0x7ff42c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.359+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4280ec080 con 0x7ff4380c7f20 2023-12-07T10:02:39.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.511+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4381ed800 con 0x7ff4380c7f20 2023-12-07T10:02:39.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.511+0000 7ff434ff9640 1 -- 172.21.15.89:0/790384872 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v74) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff4381ed800 con 0x7ff4380c7f20 2023-12-07T10:02:39.518 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-12-07T10:02:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff4240668d0 msgr2=0x7ff424068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff4240668d0 0x7ff424068d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff43815e230 tx=0x7ff42c008040 comp rx=0 tx=0).stop 2023-12-07T10:02:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 msgr2=0x7ff4380c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 0x7ff4380c8830 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff4280ad040 tx=0x7ff42801ac80 comp rx=0 tx=0).stop 2023-12-07T10:02:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 shutdown_connections 2023-12-07T10:02:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff438151d80 0x7ff4381ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff4240668d0 0x7ff424068d90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff4380c8430 0x7ff4381ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 --2- 172.21.15.89:0/790384872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4380c7f20 0x7ff4380c8830 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 >> 172.21.15.89:0/790384872 conn(0x7ff4380abd00 msgr2=0x7ff4381510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:39.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 shutdown_connections 2023-12-07T10:02:39.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.515+0000 7ff43e4ad640 1 -- 172.21.15.89:0/790384872 wait complete. 2023-12-07T10:02:39.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-07T10:02:39.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 Processor -- start 2023-12-07T10:02:39.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 -- start start 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb990154000 0x7fb9901543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9900700f0 0x7fb990070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb99006df30 0x7fb9900714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9900a8710 con 0x7fb99006df30 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb990154920 con 0x7fb990154000 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.675+0000 7fb9954fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990154b90 con 0x7fb9900700f0 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb99006df30 0x7fb9900714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb99006df30 0x7fb9900714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60320/0 (socket says 172.21.15.89:60320) 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 -- 172.21.15.89:0/3521824469 learned_addr learned my addr 172.21.15.89:0/3521824469 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 -- 172.21.15.89:0/3521824469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9900700f0 msgr2=0x7fb990070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb9867fc640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9900700f0 0x7fb990070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98effd640 1 --2- 172.21.15.89:0/3521824469 >> v2:172.21.15.97:3300/0 conn(0x7fb990154000 0x7fb9901543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9900700f0 0x7fb990070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 -- 172.21.15.89:0/3521824469 >> v2:172.21.15.97:3300/0 conn(0x7fb990154000 msgr2=0x7fb9901543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 --2- 172.21.15.89:0/3521824469 >> v2:172.21.15.97:3300/0 conn(0x7fb990154000 0x7fb9901543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 -- 172.21.15.89:0/3521824469 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900abd70 con 0x7fb99006df30 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb9867fc640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9900700f0 0x7fb990070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98effd640 1 --2- 172.21.15.89:0/3521824469 >> v2:172.21.15.97:3300/0 conn(0x7fb990154000 0x7fb9901543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:39.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98f7fe640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99006df30 0x7fb9900714d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fb9900c3a30 tx=0x7fb98801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9790bab2e1a12a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98e7fc640 1 -- 172.21.15.89:0/3521824469 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880ac620 con 0x7fb99006df30 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98e7fc640 1 -- 172.21.15.89:0/3521824469 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9880ac780 con 0x7fb99006df30 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.679+0000 7fb98e7fc640 1 -- 172.21.15.89:0/3521824469 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880acb10 con 0x7fb99006df30 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- 172.21.15.89:0/3521824469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99006df30 msgr2=0x7fb9900714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99006df30 0x7fb9900714d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fb9900c3a30 tx=0x7fb98801c3e0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- 172.21.15.89:0/3521824469 shutdown_connections 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99006df30 0x7fb9900714d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3521824469 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb9900700f0 0x7fb990070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3521824469 >> v2:172.21.15.97:3300/0 conn(0x7fb990154000 0x7fb9901543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- 172.21.15.89:0/3521824469 >> 172.21.15.89:0/3521824469 conn(0x7fb9900c2a60 msgr2=0x7fb9900c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- 172.21.15.89:0/3521824469 shutdown_connections 2023-12-07T10:02:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- 172.21.15.89:0/3521824469 wait complete. 2023-12-07T10:02:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 Processor -- start 2023-12-07T10:02:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- start start 2023-12-07T10:02:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb99006df30 0x7fb990152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 0x7fb9901539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb990154000 0x7fb9901599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901f0ec0 con 0x7fb9900700f0 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901f0940 con 0x7fb99006df30 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9954fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901f0be0 con 0x7fb990154000 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 0x7fb9901539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 0x7fb9901539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60334/0 (socket says 172.21.15.89:60334) 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb9867fc640 1 -- 172.21.15.89:0/3367800325 learned_addr learned my addr 172.21.15.89:0/3367800325 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb98f7fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb990154000 0x7fb9901599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.683+0000 7fb98effd640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb99006df30 0x7fb990152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9867fc640 1 -- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb990154000 msgr2=0x7fb9901599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9867fc640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb990154000 0x7fb9901599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9867fc640 1 -- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb99006df30 msgr2=0x7fb990152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9867fc640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb99006df30 0x7fb990152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9867fc640 1 -- 172.21.15.89:0/3367800325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880094d0 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb98f7fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb990154000 0x7fb9901599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9867fc640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 0x7fb9901539a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c7f0 tx=0x7fb97800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800cea0 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978007a30 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978007dc0 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99015a440 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb990151c50 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99004e890 con 0x7fb9900700f0 2023-12-07T10:02:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb9780113f0 con 0x7fb9900700f0 2023-12-07T10:02:39.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb987fff640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb970066900 0x7fb970068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:39.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.687+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb9780845f0 con 0x7fb9900700f0 2023-12-07T10:02:39.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.691+0000 7fb98effd640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb970066900 0x7fb970068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:39.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.691+0000 7fb98effd640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb970066900 0x7fb970068dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb980007130 tx=0x7fb980007060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:39.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.691+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9780517c0 con 0x7fb9900700f0 2023-12-07T10:02:39.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.839+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb9900c25f0 con 0x7fb9900700f0 2023-12-07T10:02:39.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.839+0000 7fb987fff640 1 -- 172.21.15.89:0/3367800325 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v74) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb978054de0 con 0x7fb9900700f0 2023-12-07T10:02:39.846 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-12-07T10:02:39.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb970066900 msgr2=0x7fb970068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb970066900 0x7fb970068dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb980007130 tx=0x7fb980007060 comp rx=0 tx=0).stop 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 msgr2=0x7fb9901539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 0x7fb9901539a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c7f0 tx=0x7fb97800ccb0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 shutdown_connections 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb970066900 0x7fb970068dc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb990154000 0x7fb9901599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9900700f0 0x7fb9901539a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 --2- 172.21.15.89:0/3367800325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb99006df30 0x7fb990152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 >> 172.21.15.89:0/3367800325 conn(0x7fb9900c2a60 msgr2=0x7fb9900712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 shutdown_connections 2023-12-07T10:02:39.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.843+0000 7fb9954fe640 1 -- 172.21.15.89:0/3367800325 wait complete. 2023-12-07T10:02:39.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:40.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 Processor -- start 2023-12-07T10:02:40.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 -- start start 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65380ca610 0x7f65380c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65380bd720 0x7f65380c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f653806cd90 0x7f6538158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6538155790 con 0x7f65380ca610 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380c4b00 con 0x7f65380bd720 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653ff3e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65380c4de0 con 0x7f653806cd90 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65380ca610 0x7f65380c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65380ca610 0x7f65380c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60338/0 (socket says 172.21.15.89:60338) 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 -- 172.21.15.89:0/2258744306 learned_addr learned my addr 172.21.15.89:0/2258744306 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653e4db640 1 --2- 172.21.15.89:0/2258744306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f653806cd90 0x7f6538158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653d4d9640 1 --2- 172.21.15.89:0/2258744306 >> v2:172.21.15.97:3300/0 conn(0x7f65380bd720 0x7f65380c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 -- 172.21.15.89:0/2258744306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f653806cd90 msgr2=0x7f6538158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 --2- 172.21.15.89:0/2258744306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f653806cd90 0x7f6538158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 -- 172.21.15.89:0/2258744306 >> v2:172.21.15.97:3300/0 conn(0x7f65380bd720 msgr2=0x7f65380c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 --2- 172.21.15.89:0/2258744306 >> v2:172.21.15.97:3300/0 conn(0x7f65380bd720 0x7f65380c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:39.999+0000 7f653dcda640 1 -- 172.21.15.89:0/2258744306 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538157e30 con 0x7f65380ca610 2023-12-07T10:02:40.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653dcda640 1 --2- 172.21.15.89:0/2258744306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65380c94c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f65380ca380 tx=0x7f653401c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597c77ea0f58ca07 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ccd8640 1 -- 172.21.15.89:0/2258744306 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380c52d0 con 0x7f65380ca610 2023-12-07T10:02:40.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ccd8640 1 -- 172.21.15.89:0/2258744306 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340a4880 con 0x7f65380ca610 2023-12-07T10:02:40.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ccd8640 1 -- 172.21.15.89:0/2258744306 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340a4c10 con 0x7f65380ca610 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 -- 172.21.15.89:0/2258744306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 msgr2=0x7f65380c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2258744306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65380c94c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f65380ca380 tx=0x7f653401c0c0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 -- 172.21.15.89:0/2258744306 shutdown_connections 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2258744306 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f653806cd90 0x7f6538158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2258744306 >> v2:172.21.15.97:3300/0 conn(0x7f65380bd720 0x7f65380c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2258744306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65380c94c0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 -- 172.21.15.89:0/2258744306 >> 172.21.15.89:0/2258744306 conn(0x7f6538071ea0 msgr2=0x7f65380722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 -- 172.21.15.89:0/2258744306 shutdown_connections 2023-12-07T10:02:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.003+0000 7f653ff3e640 1 -- 172.21.15.89:0/2258744306 wait complete. 2023-12-07T10:02:40.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 Processor -- start 2023-12-07T10:02:40.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 -- start start 2023-12-07T10:02:40.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f653806cd90 0x7f653814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.014 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65380bd720 0x7f653814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65381f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65380c14e0 con 0x7f65380ca610 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538151380 con 0x7f653806cd90 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653814daf0 con 0x7f65380bd720 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65381f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65381f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60340/0 (socket says 172.21.15.89:60340) 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 -- 172.21.15.89:0/2011287755 learned_addr learned my addr 172.21.15.89:0/2011287755 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653dcda640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f653806cd90 0x7f653814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653d4d9640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65380bd720 0x7f653814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 -- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65380bd720 msgr2=0x7f653814d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65380bd720 0x7f653814d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 -- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f653806cd90 msgr2=0x7f653814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f653806cd90 0x7f653814d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 -- 172.21.15.89:0/2011287755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65340094d0 con 0x7f65380ca610 2023-12-07T10:02:40.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653e4db640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65381f1700 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f653000eed0 tx=0x7f653000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530010040 con 0x7f65380ca610 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530014400 con 0x7f65380ca610 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530009ea0 con 0x7f65380ca610 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6538151620 con 0x7f65380ca610 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.007+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65380c16f0 con 0x7f65380ca610 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.011+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65380c18e0 con 0x7f65380ca610 2023-12-07T10:02:40.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.011+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f65300147b0 con 0x7f65380ca610 2023-12-07T10:02:40.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.011+0000 7f652e7fc640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f651c066900 0x7f651c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.011+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6530084a40 con 0x7f65380ca610 2023-12-07T10:02:40.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.011+0000 7f653dcda640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f651c066900 0x7f651c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.011+0000 7f653dcda640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f651c066900 0x7f651c068dc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f65340ae000 tx=0x7f6534008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.015+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6530051cc0 con 0x7f65380ca610 2023-12-07T10:02:40.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.195+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f653804e890 con 0x7f65380ca610 2023-12-07T10:02:40.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.195+0000 7f652e7fc640 1 -- 172.21.15.89:0/2011287755 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f6530018090 con 0x7f65380ca610 2023-12-07T10:02:40.202 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:40.202 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1096373049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1096373049},{"type":"v1","addr":"172.21.15.89:6836","nonce":1096373049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:40.202 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 55 2023-12-07T10:02:40.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f651c066900 msgr2=0x7f651c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f651c066900 0x7f651c068dc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f65340ae000 tx=0x7f6534008040 comp rx=0 tx=0).stop 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 msgr2=0x7f65381f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65381f1700 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f653000eed0 tx=0x7f653000b480 comp rx=0 tx=0).stop 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 shutdown_connections 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65380ca610 0x7f65381f1700 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f651c066900 0x7f651c068dc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65380bd720 0x7f653814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 --2- 172.21.15.89:0/2011287755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f653806cd90 0x7f653814d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 >> 172.21.15.89:0/2011287755 conn(0x7f6538071ea0 msgr2=0x7f65380c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 shutdown_connections 2023-12-07T10:02:40.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.199+0000 7f653ff3e640 1 -- 172.21.15.89:0/2011287755 wait complete. 2023-12-07T10:02:40.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:40.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 Processor -- start 2023-12-07T10:02:40.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 -- start start 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff9d814fcc0 0x7ff9d8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9d806d980 0x7ff9d80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d80ab3b0 0x7ff9d80c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80aa340 con 0x7ff9d806d980 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d8152fe0 con 0x7ff9d814fcc0 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9ddc17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81532c0 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.355+0000 7ff9d6ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9d806d980 0x7ff9d80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9d806d980 0x7ff9d80aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60344/0 (socket says 172.21.15.89:60344) 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/1891619673 learned_addr learned my addr 172.21.15.89:0/1891619673 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d7fff640 1 --2- 172.21.15.89:0/1891619673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d80ab3b0 0x7ff9d80c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d77fe640 1 --2- 172.21.15.89:0/1891619673 >> v2:172.21.15.97:3300/0 conn(0x7ff9d814fcc0 0x7ff9d8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/1891619673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d80ab3b0 msgr2=0x7ff9d80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 --2- 172.21.15.89:0/1891619673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d80ab3b0 0x7ff9d80c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/1891619673 >> v2:172.21.15.97:3300/0 conn(0x7ff9d814fcc0 msgr2=0x7ff9d8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 --2- 172.21.15.89:0/1891619673 >> v2:172.21.15.97:3300/0 conn(0x7ff9d814fcc0 0x7ff9d8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/1891619673 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d8155a20 con 0x7ff9d806d980 2023-12-07T10:02:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d6ffd640 1 --2- 172.21.15.89:0/1891619673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d806d980 0x7ff9d80aae70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff9d806e350 tx=0x7ff9cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95d5c663b47a266 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d67fc640 1 -- 172.21.15.89:0/1891619673 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0aa5f0 con 0x7ff9d806d980 2023-12-07T10:02:40.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d67fc640 1 -- 172.21.15.89:0/1891619673 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0aa750 con 0x7ff9d806d980 2023-12-07T10:02:40.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.359+0000 7ff9d67fc640 1 -- 172.21.15.89:0/1891619673 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0aaae0 con 0x7ff9d806d980 2023-12-07T10:02:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- 172.21.15.89:0/1891619673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d806d980 msgr2=0x7ff9d80aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/1891619673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d806d980 0x7ff9d80aae70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff9d806e350 tx=0x7ff9cc01c4d0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- 172.21.15.89:0/1891619673 shutdown_connections 2023-12-07T10:02:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/1891619673 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d80ab3b0 0x7ff9d80c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/1891619673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d806d980 0x7ff9d80aae70 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/1891619673 >> v2:172.21.15.97:3300/0 conn(0x7ff9d814fcc0 0x7ff9d8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- 172.21.15.89:0/1891619673 >> 172.21.15.89:0/1891619673 conn(0x7ff9d80c2ad0 msgr2=0x7ff9d80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:40.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- 172.21.15.89:0/1891619673 shutdown_connections 2023-12-07T10:02:40.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- 172.21.15.89:0/1891619673 wait complete. 2023-12-07T10:02:40.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 Processor -- start 2023-12-07T10:02:40.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- start start 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d806d980 0x7ff9d81f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 0x7ff9d814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9d814cb00 0x7ff9d81ec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d814c770 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81eff10 con 0x7ff9d814cb00 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9ddc17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81f0c10 con 0x7ff9d806d980 2023-12-07T10:02:40.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 0x7ff9d814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 0x7ff9d814ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60358/0 (socket says 172.21.15.89:60358) 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/2525376036 learned_addr learned my addr 172.21.15.89:0/2525376036 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/2525376036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d806d980 msgr2=0x7ff9d81f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d806d980 0x7ff9d81f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/2525376036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9d814cb00 msgr2=0x7ff9d81ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9d814cb00 0x7ff9d81ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.363+0000 7ff9d6ffd640 1 -- 172.21.15.89:0/2525376036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0094d0 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9d6ffd640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 0x7ff9d814ebb0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc01ab80 tx=0x7ff9cc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0aa5f0 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0b3800 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0b3bb0 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d814c1b0 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d81f01b0 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d81efd70 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff9cc0b3d10 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9bffff640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9c40668d0 0x7ff9c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff9cc0a7070 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9d77fe640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9c40668d0 0x7ff9c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.367+0000 7ff9d77fe640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9c40668d0 0x7ff9c4068d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b850 tx=0x7ff9c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.371+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9d81efd70 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d81efd70 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9bffff640 1 -- 172.21.15.89:0/2525376036 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16581 (secure 0 0 0) 0x7ff9d81efd70 con 0x7ff9d80ab3b0 2023-12-07T10:02:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:40.533 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":74,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:38.493365+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6836/3031036225":"2023-12-08T10:02:35.481810+0000","172.21.15.89:6834/3031036225":"2023-12-08T10:02:35.481810+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9c40668d0 msgr2=0x7ff9c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9c40668d0 0x7ff9c4068d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b850 tx=0x7ff9c8008040 comp rx=0 tx=0).stop 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 msgr2=0x7ff9d814ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 0x7ff9d814ebb0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc01ab80 tx=0x7ff9cc01ad10 comp rx=0 tx=0).stop 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 shutdown_connections 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9d814cb00 0x7ff9d81ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d80ab3b0 0x7ff9d814ebb0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff9c40668d0 0x7ff9c4068d90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.527+0000 7ff9ddc17640 1 --2- 172.21.15.89:0/2525376036 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff9d806d980 0x7ff9d81f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.531+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 >> 172.21.15.89:0/2525376036 conn(0x7ff9d80c2ad0 msgr2=0x7ff9d8153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.531+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 shutdown_connections 2023-12-07T10:02:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.531+0000 7ff9ddc17640 1 -- 172.21.15.89:0/2525376036 wait complete. 2023-12-07T10:02:40.556 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-07T10:02:40.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:40.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.687+0000 7f4df50a6640 1 Processor -- start 2023-12-07T10:02:40.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.687+0000 7f4df50a6640 1 -- start start 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df50a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 0x7f4df006e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df50a6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4df006ed60 0x7f4df0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df50a6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df0158b70 con 0x7f4df006b710 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df50a6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df0072050 con 0x7f4df006ed60 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df50a6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0157db0 con 0x7f4df014ea80 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4def7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4df006b710 0x7f4df0154620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56454/0 (socket says 172.21.15.89:56454) 2023-12-07T10:02:40.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4def7fe640 1 -- 172.21.15.89:0/3620193373 learned_addr learned my addr 172.21.15.89:0/3620193373 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:40.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deffff640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 0x7f4df006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154712256 0 0) 0x7f4df0158b70 con 0x7f4df006b710 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 --2- 172.21.15.89:0/3620193373 >> v2:172.21.15.97:3300/0 conn(0x7f4df006ed60 0x7f4df0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd8003530 con 0x7f4df006b710 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2844668075 0 0) 0x7f4dd8003530 con 0x7f4df006b710 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 msgr2=0x7f4df006e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 0x7f4df006e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 >> v2:172.21.15.97:3300/0 conn(0x7f4df006ed60 msgr2=0x7f4df0154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 --2- 172.21.15.89:0/3620193373 >> v2:172.21.15.97:3300/0 conn(0x7f4df006ed60 0x7f4df0154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0158090 con 0x7f4df006b710 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f4de4001680 con 0x7f4df006b710 2023-12-07T10:02:40.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 >> v1:172.21.15.89:6789/0 conn(0x7f4df006b710 legacy=0x7f4df0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dd8003980 0x7f4dd8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 0x7f4dd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4dd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0072050 con 0x7f4dd8004d10 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0157db0 con 0x7f4dd8003980 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd800b990 con 0x7f4df014ea80 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4dd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4deffff640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dd8003980 0x7f4dd8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4def7fe640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 0x7f4dd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 -- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 msgr2=0x7f4dd80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df014ea80 0x7f4dd80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 -- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dd8003980 msgr2=0x7f4dd8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dd8003980 0x7f4dd8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.691+0000 7f4df48a5640 1 -- 172.21.15.89:0/3620193373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8003530 con 0x7f4dd8004d10 2023-12-07T10:02:40.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df48a5640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4dd8005190 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009fc0 tx=0x7f4de801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc7ef381f368917 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80a5cb0 con 0x7f4dd8004d10 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de800f040 con 0x7f4dd8004d10 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4deeffd640 1 -- 172.21.15.89:0/3620193373 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80ad680 con 0x7f4dd8004d10 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 -- 172.21.15.89:0/3620193373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 msgr2=0x7f4dd8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 --2- 172.21.15.89:0/3620193373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4dd8005190 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009fc0 tx=0x7f4de801cca0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df48a5640 1 -- 172.21.15.89:0/3620193373 reap_dead start 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 -- 172.21.15.89:0/3620193373 shutdown_connections 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 -- 172.21.15.89:0/3620193373 >> 172.21.15.89:0/3620193373 conn(0x7f4df006a5a0 msgr2=0x7f4df006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 -- 172.21.15.89:0/3620193373 shutdown_connections 2023-12-07T10:02:40.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 -- 172.21.15.89:0/3620193373 wait complete. 2023-12-07T10:02:40.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.695+0000 7f4df50a6640 1 Processor -- start 2023-12-07T10:02:40.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- start start 2023-12-07T10:02:40.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4df01ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df00abce0 0x7f4df0154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df014f2c0 0x7f4df00a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01ea5c0 con 0x7f4dd8004d10 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01554e0 con 0x7f4df014f2c0 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01e9f20 con 0x7f4df00abce0 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4df01ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4df01ea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60376/0 (socket says 172.21.15.89:60376) 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 -- 172.21.15.89:0/2129375671 learned_addr learned my addr 172.21.15.89:0/2129375671 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df48a5640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df014f2c0 0x7f4df00a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4def7fe640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df00abce0 0x7f4df0154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 -- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df00abce0 msgr2=0x7f4df0154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df00abce0 0x7f4df0154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 -- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df014f2c0 msgr2=0x7f4df00a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df014f2c0 0x7f4df00a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 -- 172.21.15.89:0/2129375671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df01edf40 con 0x7f4dd8004d10 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df48a5640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df014f2c0 0x7f4df00a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4deffff640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4df01ea9e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4de0011960 tx=0x7f4de0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000faf0 con 0x7f4dd8004d10 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000fc50 con 0x7f4dd8004d10 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0014440 con 0x7f4dd8004d10 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df01ee220 con 0x7f4dd8004d10 2023-12-07T10:02:40.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df01551e0 con 0x7f4dd8004d10 2023-12-07T10:02:40.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.699+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df004e890 con 0x7f4dd8004d10 2023-12-07T10:02:40.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.703+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4de00145a0 con 0x7f4dd8004d10 2023-12-07T10:02:40.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.703+0000 7f4decff9640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4ddc0668d0 0x7f4ddc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:40.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.703+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4de0084d40 con 0x7f4dd8004d10 2023-12-07T10:02:40.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.703+0000 7f4def7fe640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4ddc0668d0 0x7f4ddc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:40.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.703+0000 7f4def7fe640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4ddc0668d0 0x7f4ddc068d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4df00aa820 tx=0x7f4de4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:40.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.707+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4de0051f10 con 0x7f4dd8004d10 2023-12-07T10:02:40.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.883+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4df0152270 con 0x7f4dd8004d10 2023-12-07T10:02:40.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.883+0000 7f4decff9640 1 -- 172.21.15.89:0/2129375671 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f4de0022020 con 0x7f4dd8004d10 2023-12-07T10:02:40.890 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:40.890 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1096373049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1096373049},{"type":"v1","addr":"172.21.15.89:6836","nonce":1096373049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:40.890 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 55 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4ddc0668d0 msgr2=0x7f4ddc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4ddc0668d0 0x7f4ddc068d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4df00aa820 tx=0x7f4de4009040 comp rx=0 tx=0).stop 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 msgr2=0x7f4df01ea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4df01ea9e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4de0011960 tx=0x7f4de0011e20 comp rx=0 tx=0).stop 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 shutdown_connections 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4df014f2c0 0x7f4df00a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4ddc0668d0 0x7f4ddc068d90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4df00abce0 0x7f4df0154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 --2- 172.21.15.89:0/2129375671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd8004d10 0x7f4df01ea9e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:40.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 >> 172.21.15.89:0/2129375671 conn(0x7f4df006a5a0 msgr2=0x7f4df014c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:40.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 shutdown_connections 2023-12-07T10:02:40.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:40.887+0000 7f4df50a6640 1 -- 172.21.15.89:0/2129375671 wait complete. 2023-12-07T10:02:40.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:02:41.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.043+0000 7fd6a939d640 1 Processor -- start 2023-12-07T10:02:41.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.043+0000 7fd6a939d640 1 -- start start 2023-12-07T10:02:41.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a939d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a939d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6a4070b80 0x7fd6a40c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a939d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a406d320 con 0x7fd6a40c1f20 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a939d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40721b0 con 0x7fd6a4070b80 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a939d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a40c2830 con 0x7fd6a414e9d0 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd69a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6a4070b80 0x7fd6a40c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a37fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd6a40c1f20 0x7fd6a406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56460/0 (socket says 172.21.15.89:56460) 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a37fe640 1 -- 172.21.15.89:0/1895639955 learned_addr learned my addr 172.21.15.89:0/1895639955 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a2ffd640 1 --2- 172.21.15.89:0/1895639955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd69a7fc640 1 -- 172.21.15.89:0/1895639955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 msgr2=0x7fd6a4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd69a7fc640 1 --2- 172.21.15.89:0/1895639955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd69a7fc640 1 -- 172.21.15.89:0/1895639955 >> v1:172.21.15.89:6789/0 conn(0x7fd6a40c1f20 legacy=0x7fd6a406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd69a7fc640 1 -- 172.21.15.89:0/1895639955 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4072450 con 0x7fd6a4070b80 2023-12-07T10:02:41.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.047+0000 7fd6a27fc640 1 -- 172.21.15.89:0/1895639955 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406969193 0 0) 0x7fd6a406d320 con 0x7fd6a40c1f20 2023-12-07T10:02:41.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd69a7fc640 1 --2- 172.21.15.89:0/1895639955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a4070b80 0x7fd6a40c19e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0097c0 tx=0x7fd68c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21bdbcedd8b8cc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a27fc640 1 -- 172.21.15.89:0/1895639955 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0ab600 con 0x7fd6a4070b80 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a27fc640 1 -- 172.21.15.89:0/1895639955 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c0a7050 con 0x7fd6a4070b80 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a27fc640 1 -- 172.21.15.89:0/1895639955 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0ab980 con 0x7fd6a4070b80 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 -- 172.21.15.89:0/1895639955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a4070b80 msgr2=0x7fd6a40c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 --2- 172.21.15.89:0/1895639955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a4070b80 0x7fd6a40c19e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0097c0 tx=0x7fd68c01c3f0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 -- 172.21.15.89:0/1895639955 shutdown_connections 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 --2- 172.21.15.89:0/1895639955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a4070b80 0x7fd6a40c19e0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 --2- 172.21.15.89:0/1895639955 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 -- 172.21.15.89:0/1895639955 >> 172.21.15.89:0/1895639955 conn(0x7fd6a40c2ad0 msgr2=0x7fd6a40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:41.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 -- 172.21.15.89:0/1895639955 shutdown_connections 2023-12-07T10:02:41.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 -- 172.21.15.89:0/1895639955 wait complete. 2023-12-07T10:02:41.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 Processor -- start 2023-12-07T10:02:41.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.051+0000 7fd6a939d640 1 -- start start 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6a4070b80 0x7fd6a41551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 0x7fd6a4148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a41491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a41496e0 con 0x7fd6a40c1f20 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4151f90 con 0x7fd6a4070b80 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4150a10 con 0x7fd6a414e9d0 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 0x7fd6a4148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 0x7fd6a4148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60396/0 (socket says 172.21.15.89:60396) 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 -- 172.21.15.89:0/2196203400 learned_addr learned my addr 172.21.15.89:0/2196203400 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a2ffd640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6a4070b80 0x7fd6a41551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a37fe640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a41491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 -- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 msgr2=0x7fd6a41491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a41491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 -- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6a4070b80 msgr2=0x7fd6a41551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6a4070b80 0x7fd6a41551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 -- 172.21.15.89:0/2196203400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c009420 con 0x7fd6a40c1f20 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69a7fc640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 0x7fd6a4148c60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd68c019000 tx=0x7fd68c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0b48d0 con 0x7fd6a40c1f20 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c0b4a30 con 0x7fd6a40c1f20 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a4150cf0 con 0x7fd6a40c1f20 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0b4de0 con 0x7fd6a40c1f20 2023-12-07T10:02:41.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a4151790 con 0x7fd6a40c1f20 2023-12-07T10:02:41.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a4151210 con 0x7fd6a40c1f20 2023-12-07T10:02:41.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.055+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd68c0b2040 con 0x7fd6a40c1f20 2023-12-07T10:02:41.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.059+0000 7fd69bfff640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd6840668d0 0x7fd684068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.059+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd68c11e820 con 0x7fd6a40c1f20 2023-12-07T10:02:41.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.059+0000 7fd6a2ffd640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd6840668d0 0x7fd684068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.059+0000 7fd6a2ffd640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd6840668d0 0x7fd684068d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd694003ab0 tx=0x7fd694009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.063+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6a4151210 con 0x7fd6a40c1f20 2023-12-07T10:02:41.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:41.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:41.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6a41515f0 con 0x7fd6a40c1f20 2023-12-07T10:02:41.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd69bfff640 1 -- 172.21.15.89:0/2196203400 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fd6a41515f0 con 0x7fd6a40c1f20 2023-12-07T10:02:41.248 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:41.248 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1096373049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1096373049},{"type":"v1","addr":"172.21.15.89:6836","nonce":1096373049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T10:02:07.890007+0000","modified":"2023-12-07T10:02:10.912747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6202":{"gid":6202,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":7,"addr":"172.21.15.97:6835/1453304685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":1453304685},{"type":"v1","addr":"172.21.15.97:6835","nonce":1453304685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-07T10:02:41.249 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 55 2023-12-07T10:02:41.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd6840668d0 msgr2=0x7fd684068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd6840668d0 0x7fd684068d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd694003ab0 tx=0x7fd694009830 comp rx=0 tx=0).stop 2023-12-07T10:02:41.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 msgr2=0x7fd6a4148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 0x7fd6a4148c60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd68c019000 tx=0x7fd68c019190 comp rx=0 tx=0).stop 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 shutdown_connections 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd6840668d0 0x7fd684068d90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd6a414e9d0 0x7fd6a41491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a40c1f20 0x7fd6a4148c60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 --2- 172.21.15.89:0/2196203400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6a4070b80 0x7fd6a41551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.243+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 >> 172.21.15.89:0/2196203400 conn(0x7fd6a40c2ad0 msgr2=0x7fd6a414d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.247+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 shutdown_connections 2023-12-07T10:02:41.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.247+0000 7fd6a939d640 1 -- 172.21.15.89:0/2196203400 wait complete. 2023-12-07T10:02:41.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:41.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b32bb640 1 Processor -- start 2023-12-07T10:02:41.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b32bb640 1 -- start start 2023-12-07T10:02:41.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b32bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 0x7f19ac158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b32bb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac155790 con 0x7f19ac0ca610 2023-12-07T10:02:41.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b32bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac0c4b00 con 0x7f19ac06cd90 2023-12-07T10:02:41.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b32bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0c4de0 con 0x7f19ac0bd720 2023-12-07T10:02:41.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b1057640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f19ac0ca610 0x7f19ac0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56462/0 (socket says 172.21.15.89:56462) 2023-12-07T10:02:41.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b1057640 1 -- 172.21.15.89:0/3449619487 learned_addr learned my addr 172.21.15.89:0/3449619487 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 0x7f19ac158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940155830 0 0) 0x7f19ac155790 con 0x7f19ac0ca610 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1998003530 con 0x7f19ac0ca610 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245962515 0 0) 0x7f1998003530 con 0x7f19ac0ca610 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 msgr2=0x7f19ac158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 0x7f19ac158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 >> v1:172.21.15.97:6789/0 conn(0x7f19ac06cd90 legacy=0x7f19ac0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac157e30 con 0x7f19ac0ca610 2023-12-07T10:02:41.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f19a8001680 con 0x7f19ac0ca610 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 >> v1:172.21.15.89:6789/0 conn(0x7f19ac0ca610 legacy=0x7f19ac0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 0x7f19980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998003ef0 0x7f19980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1998004d10 0x7f1998005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0c4de0 con 0x7f1998003ef0 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199800bb50 con 0x7f1998004d10 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199800bd10 con 0x7f19ac0bd720 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998003ef0 0x7f19980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b1057640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 0x7f19980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b1858640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1998004d10 0x7f1998005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 -- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 msgr2=0x7f19980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f19ac0bd720 0x7f19980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 -- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1998004d10 msgr2=0x7f1998005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:41.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1998004d10 0x7f1998005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.443+0000 7f19b0856640 1 -- 172.21.15.89:0/3449619487 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998003530 con 0x7f1998003ef0 2023-12-07T10:02:41.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b0856640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998003ef0 0x7f19980047d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f199c009ae0 tx=0x7f199c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48d41b55977534c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0c52d0 con 0x7f1998003ef0 2023-12-07T10:02:41.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0a4b90 con 0x7f1998003ef0 2023-12-07T10:02:41.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19a3fff640 1 -- 172.21.15.89:0/3449619487 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0ac440 con 0x7f1998003ef0 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b32bb640 1 -- 172.21.15.89:0/3449619487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998003ef0 msgr2=0x7f19980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3449619487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998003ef0 0x7f19980047d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f199c009ae0 tx=0x7f199c01c730 comp rx=0 tx=0).stop 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b1858640 1 -- 172.21.15.89:0/3449619487 reap_dead start 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b32bb640 1 -- 172.21.15.89:0/3449619487 shutdown_connections 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b32bb640 1 -- 172.21.15.89:0/3449619487 >> 172.21.15.89:0/3449619487 conn(0x7f19ac071ea0 msgr2=0x7f19ac0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b32bb640 1 -- 172.21.15.89:0/3449619487 shutdown_connections 2023-12-07T10:02:41.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.447+0000 7f19b32bb640 1 -- 172.21.15.89:0/3449619487 wait complete. 2023-12-07T10:02:41.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 Processor -- start 2023-12-07T10:02:41.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 -- start start 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1998003ef0 0x7f19ac153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 0x7f19ac0ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19ac0ab540 0x7f19ac0a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0c4240 con 0x7f19ac1f2180 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1f26b0 con 0x7f19ac0ab540 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0ac610 con 0x7f1998003ef0 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 0x7f19ac0ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 0x7f19ac0ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60408/0 (socket says 172.21.15.89:60408) 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 -- 172.21.15.89:0/3941094384 learned_addr learned my addr 172.21.15.89:0/3941094384 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:41.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b1858640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19ac0ab540 0x7f19ac0a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b1057640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1998003ef0 0x7f19ac153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 -- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1998003ef0 msgr2=0x7f19ac153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1998003ef0 0x7f19ac153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 -- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19ac0ab540 msgr2=0x7f19ac0a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19ac0ab540 0x7f19ac0a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 -- 172.21.15.89:0/3941094384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0c3c80 con 0x7f19ac1f2180 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b1057640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1998003ef0 0x7f19ac153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b0856640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 0x7f19ac0ab000 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f199c009ae0 tx=0x7f1998005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0bd070 con 0x7f19ac1f2180 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00f0c0 con 0x7f19ac1f2180 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0accc0 con 0x7f19ac1f2180 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac0c3f60 con 0x7f19ac1f2180 2023-12-07T10:02:41.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.451+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac154800 con 0x7f19ac1f2180 2023-12-07T10:02:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.455+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac0ac330 con 0x7f19ac1f2180 2023-12-07T10:02:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.455+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f199c0b3040 con 0x7f19ac1f2180 2023-12-07T10:02:41.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.455+0000 7f19a1ffb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1990066900 0x7f1990068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.455+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f199c11d6f0 con 0x7f19ac1f2180 2023-12-07T10:02:41.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.455+0000 7f19b1057640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1990066900 0x7f1990068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.455+0000 7f19b1057640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1990066900 0x7f1990068dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19ac15f3b0 tx=0x7f19a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.459+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19ac0ac330 con 0x7f19ac1f2180 2023-12-07T10:02:41.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19ac0ac330 con 0x7f19ac1f2180 2023-12-07T10:02:41.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19a1ffb640 1 -- 172.21.15.89:0/3941094384 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f19ac0ac330 con 0x7f19ac1f2180 2023-12-07T10:02:41.620 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:41.620 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":74,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:38.493365+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-07T10:02:06.063634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-07T10:02:06.886623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6836/3031036225":"2023-12-08T10:02:35.481810+0000","172.21.15.89:6834/3031036225":"2023-12-08T10:02:35.481810+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:41.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1990066900 msgr2=0x7f1990068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1990066900 0x7f1990068dc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19ac15f3b0 tx=0x7f19a8009040 comp rx=0 tx=0).stop 2023-12-07T10:02:41.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 msgr2=0x7f19ac0ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 0x7f19ac0ab000 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f199c009ae0 tx=0x7f1998005800 comp rx=0 tx=0).stop 2023-12-07T10:02:41.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 shutdown_connections 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19ac0ab540 0x7f19ac0a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19ac1f2180 0x7f19ac0ab000 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1990066900 0x7f1990068dc0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 --2- 172.21.15.89:0/3941094384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1998003ef0 0x7f19ac153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 >> 172.21.15.89:0/3941094384 conn(0x7f19ac071ea0 msgr2=0x7f19ac0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 shutdown_connections 2023-12-07T10:02:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.615+0000 7f19b32bb640 1 -- 172.21.15.89:0/3941094384 wait complete. 2023-12-07T10:02:41.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-07T10:02:41.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 Processor -- start 2023-12-07T10:02:41.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 -- start start 2023-12-07T10:02:41.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3000c1f20 0x7fe30006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30006d320 con 0x7fe300070b80 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000721b0 con 0x7fe3000c1f20 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe305f01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000c2830 con 0x7fe30014e9d0 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60418/0 (socket says 172.21.15.89:60418) 2023-12-07T10:02:41.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 -- 172.21.15.89:0/2115357832 learned_addr learned my addr 172.21.15.89:0/2115357832 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2fffff640 1 --2- 172.21.15.89:0/2115357832 >> v2:172.21.15.97:3300/0 conn(0x7fe3000c1f20 0x7fe30006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2ff7fe640 1 --2- 172.21.15.89:0/2115357832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 -- 172.21.15.89:0/2115357832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe30014e9d0 msgr2=0x7fe300151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 --2- 172.21.15.89:0/2115357832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 -- 172.21.15.89:0/2115357832 >> v2:172.21.15.97:3300/0 conn(0x7fe3000c1f20 msgr2=0x7fe30006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 --2- 172.21.15.89:0/2115357832 >> v2:172.21.15.97:3300/0 conn(0x7fe3000c1f20 0x7fe30006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.775+0000 7fe2feffd640 1 -- 172.21.15.89:0/2115357832 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300072450 con 0x7fe300070b80 2023-12-07T10:02:41.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe2feffd640 1 --2- 172.21.15.89:0/2115357832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe300070b80 0x7fe3000c19e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe3000704f0 tx=0x7fe2f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9808e046fd579104 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe2fe7fc640 1 -- 172.21.15.89:0/2115357832 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ab600 con 0x7fe300070b80 2023-12-07T10:02:41.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe2fe7fc640 1 -- 172.21.15.89:0/2115357832 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40a7050 con 0x7fe300070b80 2023-12-07T10:02:41.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe2fe7fc640 1 -- 172.21.15.89:0/2115357832 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ab980 con 0x7fe300070b80 2023-12-07T10:02:41.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 -- 172.21.15.89:0/2115357832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe300070b80 msgr2=0x7fe3000c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 --2- 172.21.15.89:0/2115357832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe300070b80 0x7fe3000c19e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe3000704f0 tx=0x7fe2f401c470 comp rx=0 tx=0).stop 2023-12-07T10:02:41.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 -- 172.21.15.89:0/2115357832 shutdown_connections 2023-12-07T10:02:41.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 --2- 172.21.15.89:0/2115357832 >> v2:172.21.15.97:3300/0 conn(0x7fe3000c1f20 0x7fe30006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 --2- 172.21.15.89:0/2115357832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe300070b80 0x7fe3000c19e0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 --2- 172.21.15.89:0/2115357832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe30014e9d0 0x7fe300151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 -- 172.21.15.89:0/2115357832 >> 172.21.15.89:0/2115357832 conn(0x7fe3000c2ad0 msgr2=0x7fe3000c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:41.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 -- 172.21.15.89:0/2115357832 shutdown_connections 2023-12-07T10:02:41.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.779+0000 7fe305f01640 1 -- 172.21.15.89:0/2115357832 wait complete. 2023-12-07T10:02:41.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 Processor -- start 2023-12-07T10:02:41.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 -- start start 2023-12-07T10:02:41.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe300070b80 0x7fe3001ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 0x7fe3000bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe30014e9d0 0x7fe3000c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001ee5f0 con 0x7fe3000c1f20 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001edb30 con 0x7fe30014e9d0 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe300152e60 con 0x7fe300070b80 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 0x7fe3000bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 0x7fe3000bf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60434/0 (socket says 172.21.15.89:60434) 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 -- 172.21.15.89:0/1872749920 learned_addr learned my addr 172.21.15.89:0/1872749920 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2fffff640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe30014e9d0 0x7fe3000c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2ff7fe640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe300070b80 0x7fe3001ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 -- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe300070b80 msgr2=0x7fe3001ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe300070b80 0x7fe3001ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 -- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe30014e9d0 msgr2=0x7fe3000c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe30014e9d0 0x7fe3000c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 -- 172.21.15.89:0/1872749920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40094d0 con 0x7fe3000c1f20 2023-12-07T10:02:41.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2ff7fe640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe300070b80 0x7fe3001ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:41.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2feffd640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 0x7fe3000bf660 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe2f401ab20 tx=0x7fe2f4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ac220 con 0x7fe3000c1f20 2023-12-07T10:02:41.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40aa5b0 con 0x7fe3000c1f20 2023-12-07T10:02:41.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40aa960 con 0x7fe3000c1f20 2023-12-07T10:02:41.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe300152900 con 0x7fe3000c1f20 2023-12-07T10:02:41.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.783+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3001530b0 con 0x7fe3000c1f20 2023-12-07T10:02:41.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.787+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30004e890 con 0x7fe3000c1f20 2023-12-07T10:02:41.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.787+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2f40b2070 con 0x7fe3000c1f20 2023-12-07T10:02:41.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.787+0000 7fe2e7fff640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ec0668d0 0x7fe2ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:41.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.787+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe2f411e060 con 0x7fe3000c1f20 2023-12-07T10:02:41.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.787+0000 7fe2ff7fe640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ec0668d0 0x7fe2ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:41.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.787+0000 7fe2ff7fe640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ec0668d0 0x7fe2ec068d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000b9f0 tx=0x7fe2f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:41.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.791+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2f40eb3f0 con 0x7fe3000c1f20 2023-12-07T10:02:41.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.975+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fe30015bb40 con 0x7fe3000c1f20 2023-12-07T10:02:41.981 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-12-07T10:02:41.975+0000 7fc1856e0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T10:02:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe2e7fff640 1 -- 172.21.15.89:0/1872749920 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe2f40eea10 con 0x7fe3000c1f20 2023-12-07T10:02:41.983 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T10:02:41.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ec0668d0 msgr2=0x7fe2ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ec0668d0 0x7fe2ec068d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000b9f0 tx=0x7fe2f0008040 comp rx=0 tx=0).stop 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 msgr2=0x7fe3000bf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 0x7fe3000bf660 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe2f401ab20 tx=0x7fe2f4019210 comp rx=0 tx=0).stop 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 shutdown_connections 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe30014e9d0 0x7fe3000c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3000c1f20 0x7fe3000bf660 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe2ec0668d0 0x7fe2ec068d90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 --2- 172.21.15.89:0/1872749920 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe300070b80 0x7fe3001ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.979+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 >> 172.21.15.89:0/1872749920 conn(0x7fe3000c2ad0 msgr2=0x7fe30006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.983+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 shutdown_connections 2023-12-07T10:02:41.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:41.983+0000 7fe305f01640 1 -- 172.21.15.89:0/1872749920 wait complete. 2023-12-07T10:02:41.997 INFO:tasks.ceph.mds.b.smithi097.stderr: -4499> 2023-12-07T10:02:12.202+0000 7fe3e04a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T10:02:42.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-07T10:02:42.048 INFO:tasks.ceph.mds.b.smithi097.stdout:starting mds.b at 2023-12-07T10:02:42.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 Processor -- start 2023-12-07T10:02:42.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 -- start start 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57d814eaf0 0x7f57d8151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57d8151f90 0x7f57d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d806de00 con 0x7f57d80c0370 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d8070390 con 0x7f57d8151f90 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57de2fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d814eed0 con 0x7f57d814eaf0 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57d8151f90 0x7f57d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57d8151f90 0x7f57d806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60448/0 (socket says 172.21.15.89:60448) 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 -- 172.21.15.89:0/1471085741 learned_addr learned my addr 172.21.15.89:0/1471085741 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:42.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d7fff640 1 --2- 172.21.15.89:0/1471085741 >> v2:172.21.15.97:3300/0 conn(0x7f57d814eaf0 0x7f57d8151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:42.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 -- 172.21.15.89:0/1471085741 >> v2:172.21.15.97:3300/0 conn(0x7f57d814eaf0 msgr2=0x7f57d8151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:42.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 --2- 172.21.15.89:0/1471085741 >> v2:172.21.15.97:3300/0 conn(0x7f57d814eaf0 0x7f57d8151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 -- 172.21.15.89:0/1471085741 >> v1:172.21.15.89:6789/0 conn(0x7f57d80c0370 legacy=0x7f57d806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:42.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d77fe640 1 -- 172.21.15.89:0/1471085741 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8151270 con 0x7f57d8151f90 2023-12-07T10:02:42.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.143+0000 7f57d6ffd640 1 -- 172.21.15.89:0/1471085741 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763963058 0 0) 0x7f57d806de00 con 0x7f57d80c0370 2023-12-07T10:02:42.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57d77fe640 1 --2- 172.21.15.89:0/1471085741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d8151f90 0x7f57d806d110 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f57d80c3b00 tx=0x7f57cc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13518dd351268f1b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:42.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57d6ffd640 1 -- 172.21.15.89:0/1471085741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0ac410 con 0x7f57d8151f90 2023-12-07T10:02:42.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57d6ffd640 1 -- 172.21.15.89:0/1471085741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc0ac570 con 0x7f57d8151f90 2023-12-07T10:02:42.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57d6ffd640 1 -- 172.21.15.89:0/1471085741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0ac900 con 0x7f57d8151f90 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 -- 172.21.15.89:0/1471085741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d8151f90 msgr2=0x7f57d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 --2- 172.21.15.89:0/1471085741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d8151f90 0x7f57d806d110 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f57d80c3b00 tx=0x7f57cc01c3b0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 -- 172.21.15.89:0/1471085741 shutdown_connections 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 --2- 172.21.15.89:0/1471085741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d8151f90 0x7f57d806d110 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 --2- 172.21.15.89:0/1471085741 >> v2:172.21.15.97:3300/0 conn(0x7f57d814eaf0 0x7f57d8151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 -- 172.21.15.89:0/1471085741 >> 172.21.15.89:0/1471085741 conn(0x7f57d80c2a60 msgr2=0x7f57d80c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 -- 172.21.15.89:0/1471085741 shutdown_connections 2023-12-07T10:02:42.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 -- 172.21.15.89:0/1471085741 wait complete. 2023-12-07T10:02:42.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.147+0000 7f57de2fe640 1 Processor -- start 2023-12-07T10:02:42.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- start start 2023-12-07T10:02:42.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 0x7f57d815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:42.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d814eaf0 0x7f57d80bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e6a0 0x7f57d81ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80c3b50 con 0x7f57d80c0370 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d81ed000 con 0x7f57d815e6a0 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8152570 con 0x7f57d814eaf0 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 0x7f57d815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 0x7f57d815cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60460/0 (socket says 172.21.15.89:60460) 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 -- 172.21.15.89:0/2180956365 learned_addr learned my addr 172.21.15.89:0/2180956365 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d77fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d814eaf0 0x7f57d80bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57dc89b640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e6a0 0x7f57d81ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 -- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d814eaf0 msgr2=0x7f57d80bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d814eaf0 0x7f57d80bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 -- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e6a0 msgr2=0x7f57d81ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e6a0 0x7f57d81ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 -- 172.21.15.89:0/2180956365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0094d0 con 0x7f57d80c0370 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d77fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d814eaf0 0x7f57d80bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d7fff640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 0x7f57d815cc00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f57c800e9b0 tx=0x7f57c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80096b0 con 0x7f57d80c0370 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c800c9a0 con 0x7f57d80c0370 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800cd30 con 0x7f57d80c0370 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d8152850 con 0x7f57d80c0370 2023-12-07T10:02:42.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d80bfb30 con 0x7f57d80c0370 2023-12-07T10:02:42.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.151+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d8152a40 con 0x7f57d80c0370 2023-12-07T10:02:42.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.155+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f57c8013470 con 0x7f57d80c0370 2023-12-07T10:02:42.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.155+0000 7f57d4ff9640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c40668d0 0x7f57c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:42.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.155+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f57c8084670 con 0x7f57d80c0370 2023-12-07T10:02:42.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.155+0000 7f57d77fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c40668d0 0x7f57c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:42.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.155+0000 7f57d77fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c40668d0 0x7f57c4068d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0ae000 tx=0x7f57cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:42.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.159+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57d8152a40 con 0x7f57d80c0370 2023-12-07T10:02:42.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.343+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f57d8152a40 con 0x7f57d80c0370 2023-12-07T10:02:42.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.979+0000 7f57d4ff9640 1 -- 172.21.15.89:0/2180956365 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7f57d8152a40 con 0x7f57d80c0370 2023-12-07T10:02:42.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c40668d0 msgr2=0x7f57c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c40668d0 0x7f57c4068d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0ae000 tx=0x7f57cc009040 comp rx=0 tx=0).stop 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 msgr2=0x7f57d815cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 0x7f57d815cc00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f57c800e9b0 tx=0x7f57c800ee70 comp rx=0 tx=0).stop 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 shutdown_connections 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57d815e6a0 0x7f57d81ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f57c40668d0 0x7f57c4068d90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57d814eaf0 0x7f57d80bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 --2- 172.21.15.89:0/2180956365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d80c0370 0x7f57d815cc00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 >> 172.21.15.89:0/2180956365 conn(0x7f57d80c2a60 msgr2=0x7f57d81502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 shutdown_connections 2023-12-07T10:02:42.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:42.983+0000 7f57de2fe640 1 -- 172.21.15.89:0/2180956365 wait complete. 2023-12-07T10:02:43.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-07T10:02:43.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.147+0000 7f892689c640 1 Processor -- start 2023-12-07T10:02:43.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.147+0000 7f892689c640 1 -- start start 2023-12-07T10:02:43.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.147+0000 7f892689c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 0x7f8920155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.147+0000 7f892689c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89201559d0 con 0x7f8920070260 2023-12-07T10:02:43.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f892689c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892006d910 con 0x7f892006b0c0 2023-12-07T10:02:43.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f892689c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8920070da0 con 0x7f8920154ea0 2023-12-07T10:02:43.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f8924e39640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8920070260 0x7f8920070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56476/0 (socket says 172.21.15.89:56476) 2023-12-07T10:02:43.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f8924e39640 1 -- 172.21.15.89:0/2060972216 learned_addr learned my addr 172.21.15.89:0/2060972216 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:43.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 0x7f8920155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373324360 0 0) 0x7f89201559d0 con 0x7f8920070260 2023-12-07T10:02:43.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8908003530 con 0x7f8920070260 2023-12-07T10:02:43.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958584340 0 0) 0x7f892006d910 con 0x7f892006b0c0 2023-12-07T10:02:43.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89201559d0 con 0x7f892006b0c0 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 489756180 0 0) 0x7f8908003530 con 0x7f8920070260 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 msgr2=0x7f8920155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 0x7f8920155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 >> v1:172.21.15.97:6789/0 conn(0x7f892006b0c0 legacy=0x7f892014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200c1230 con 0x7f8920070260 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f8918001a00 con 0x7f8920070260 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 >> v1:172.21.15.89:6789/0 conn(0x7f8920070260 legacy=0x7f8920070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f8908003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89080047d0 0x7f8908004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 0x7f89080051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8920070da0 con 0x7f8908003b40 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890800baa0 con 0x7f89080047d0 2023-12-07T10:02:43.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890800bc60 con 0x7f8920154ea0 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f8908003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891f7fe640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89080047d0 0x7f8908004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f8924e39640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 0x7f89080051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 -- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 msgr2=0x7f89080051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920154ea0 0x7f89080051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 -- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89080047d0 msgr2=0x7f8908004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89080047d0 0x7f8908004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891ffff640 1 -- 172.21.15.89:0/2060972216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8908003530 con 0x7f8908003b40 2023-12-07T10:02:43.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.151+0000 7f891f7fe640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89080047d0 0x7f8908004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:43.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f891ffff640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f8908003f40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8910009ae0 tx=0x7f891001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5560ae47275e157 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:43.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a55f0 con 0x7f8908003b40 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100a5750 con 0x7f8908003b40 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f891effd640 1 -- 172.21.15.89:0/2060972216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a5b00 con 0x7f8908003b40 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 -- 172.21.15.89:0/2060972216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 msgr2=0x7f8908003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 --2- 172.21.15.89:0/2060972216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f8908003f40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8910009ae0 tx=0x7f891001ca20 comp rx=0 tx=0).stop 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f8924e39640 1 -- 172.21.15.89:0/2060972216 reap_dead start 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 -- 172.21.15.89:0/2060972216 shutdown_connections 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 -- 172.21.15.89:0/2060972216 >> 172.21.15.89:0/2060972216 conn(0x7f892006a5a0 msgr2=0x7f892006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 -- 172.21.15.89:0/2060972216 shutdown_connections 2023-12-07T10:02:43.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 -- 172.21.15.89:0/2060972216 wait complete. 2023-12-07T10:02:43.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 Processor -- start 2023-12-07T10:02:43.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.155+0000 7f892689c640 1 -- start start 2023-12-07T10:02:43.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f89200abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920145100 0x7f89201408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89200c3d60 0x7f89201ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200ab070 con 0x7f8908003b40 2023-12-07T10:02:43.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200aa030 con 0x7f89200c3d60 2023-12-07T10:02:43.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200aa5f0 con 0x7f8920145100 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f89200abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f89200abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60476/0 (socket says 172.21.15.89:60476) 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 -- 172.21.15.89:0/3757319842 learned_addr learned my addr 172.21.15.89:0/3757319842 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891f7fe640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920145100 0x7f89201408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f8924e39640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89200c3d60 0x7f89201ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 -- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920145100 msgr2=0x7f89201408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920145100 0x7f89201408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 -- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89200c3d60 msgr2=0x7f89201ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89200c3d60 0x7f89201ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 -- 172.21.15.89:0/3757319842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89201f1790 con 0x7f8908003b40 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891f7fe640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920145100 0x7f89201408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891ffff640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f89200abf00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8910009ae0 tx=0x7f8908005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a55f0 con 0x7f8908003b40 2023-12-07T10:02:43.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910004020 con 0x7f8908003b40 2023-12-07T10:02:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89201f1a70 con 0x7f8908003b40 2023-12-07T10:02:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100043b0 con 0x7f8908003b40 2023-12-07T10:02:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8920140e30 con 0x7f8908003b40 2023-12-07T10:02:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892004e890 con 0x7f8908003b40 2023-12-07T10:02:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.159+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89100b4040 con 0x7f8908003b40 2023-12-07T10:02:43.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.163+0000 7f891cff9640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f890c066900 0x7f890c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:43.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.163+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f891011e670 con 0x7f8908003b40 2023-12-07T10:02:43.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.163+0000 7f891f7fe640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f890c066900 0x7f890c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:43.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.163+0000 7f891f7fe640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f890c066900 0x7f890c068dc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89200ab910 tx=0x7f8914009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.167+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89100eb9c0 con 0x7f8908003b40 2023-12-07T10:02:43.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:43.319+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8920148b70 con 0x7f8908003b40 2023-12-07T10:02:44.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.251+0000 7f891cff9640 1 -- 172.21.15.89:0/3757319842 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v76) v1 ==== 184+0+0 (secure 0 0 0) 0x7f89100eefe0 con 0x7f8908003b40 2023-12-07T10:02:44.256 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_metadata' removed 2023-12-07T10:02:44.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f890c066900 msgr2=0x7f890c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f890c066900 0x7f890c068dc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f89200ab910 tx=0x7f8914009040 comp rx=0 tx=0).stop 2023-12-07T10:02:44.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 msgr2=0x7f89200abf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f89200abf00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8910009ae0 tx=0x7f8908005800 comp rx=0 tx=0).stop 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 shutdown_connections 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89200c3d60 0x7f89201ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f890c066900 0x7f890c068dc0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8920145100 0x7f89201408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 --2- 172.21.15.89:0/3757319842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8908003b40 0x7f89200abf00 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 >> 172.21.15.89:0/3757319842 conn(0x7f892006a5a0 msgr2=0x7f892015c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 shutdown_connections 2023-12-07T10:02:44.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.255+0000 7f892689c640 1 -- 172.21.15.89:0/3757319842 wait complete. 2023-12-07T10:02:44.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-07T10:02:44.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f092b45a640 1 Processor -- start 2023-12-07T10:02:44.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f092b45a640 1 -- start start 2023-12-07T10:02:44.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f092b45a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f092406b0c0 0x7f0924155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:44.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f092b45a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09241559d0 con 0x7f0924070260 2023-12-07T10:02:44.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f092b45a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092406d910 con 0x7f0924154ea0 2023-12-07T10:02:44.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f092b45a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09241557c0 con 0x7f092406b0c0 2023-12-07T10:02:44.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09289f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f092406b0c0 0x7f0924155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:44.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09299f7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0924070260 0x7f09240706d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56482/0 (socket says 172.21.15.89:56482) 2023-12-07T10:02:44.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09299f7640 1 -- 172.21.15.89:0/336613070 learned_addr learned my addr 172.21.15.89:0/336613070 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:44.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09289f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f092406b0c0 0x7f0924155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60488/0 (socket says 172.21.15.89:60488) 2023-12-07T10:02:44.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09289f5640 1 -- 172.21.15.89:0/336613070 >> v1:172.21.15.97:6789/0 conn(0x7f0924154ea0 legacy=0x7f092414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09289f5640 1 -- 172.21.15.89:0/336613070 >> v1:172.21.15.89:6789/0 conn(0x7f0924070260 legacy=0x7f09240706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f091bfff640 1 -- 172.21.15.89:0/336613070 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469128161 0 0) 0x7f09241559d0 con 0x7f0924070260 2023-12-07T10:02:44.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.435+0000 7f09289f5640 1 -- 172.21.15.89:0/336613070 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240c1230 con 0x7f092406b0c0 2023-12-07T10:02:44.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f09289f5640 1 --2- 172.21.15.89:0/336613070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f092406b0c0 0x7f0924155280 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f091400ba60 tx=0x7f091401ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58296162a9061ea server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:44.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f091bfff640 1 -- 172.21.15.89:0/336613070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09140a7b60 con 0x7f092406b0c0 2023-12-07T10:02:44.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f091bfff640 1 -- 172.21.15.89:0/336613070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140a7cc0 con 0x7f092406b0c0 2023-12-07T10:02:44.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f091bfff640 1 -- 172.21.15.89:0/336613070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09140af660 con 0x7f092406b0c0 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 -- 172.21.15.89:0/336613070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f092406b0c0 msgr2=0x7f0924155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 --2- 172.21.15.89:0/336613070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f092406b0c0 0x7f0924155280 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f091400ba60 tx=0x7f091401ea90 comp rx=0 tx=0).stop 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 -- 172.21.15.89:0/336613070 shutdown_connections 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 --2- 172.21.15.89:0/336613070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f092406b0c0 0x7f0924155280 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 -- 172.21.15.89:0/336613070 >> 172.21.15.89:0/336613070 conn(0x7f092406a5a0 msgr2=0x7f092406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 -- 172.21.15.89:0/336613070 shutdown_connections 2023-12-07T10:02:44.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.439+0000 7f092b45a640 1 -- 172.21.15.89:0/336613070 wait complete. 2023-12-07T10:02:44.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 Processor -- start 2023-12-07T10:02:44.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 -- start start 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f092406b0c0 0x7f09240c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0924070260 0x7f09241ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 0x7f09241edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240abf90 con 0x7f0924154ea0 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09241535a0 con 0x7f0924070260 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240aa030 con 0x7f092406b0c0 2023-12-07T10:02:44.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 0x7f09241edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:44.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09289f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0924070260 0x7f09241ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:44.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 0x7f09241edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60502/0 (socket says 172.21.15.89:60502) 2023-12-07T10:02:44.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09289f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0924070260 0x7f09241ed6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:56634/0 (socket says 172.21.15.89:56634) 2023-12-07T10:02:44.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 -- 172.21.15.89:0/980979028 learned_addr learned my addr 172.21.15.89:0/980979028 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:44.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09291f6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f092406b0c0 0x7f09240c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:44.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 -- 172.21.15.89:0/980979028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f092406b0c0 msgr2=0x7f09240c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f092406b0c0 0x7f09240c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 -- 172.21.15.89:0/980979028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0924070260 msgr2=0x7f09241ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:44.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0924070260 0x7f09241ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:44.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 -- 172.21.15.89:0/980979028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091400b6c0 con 0x7f0924154ea0 2023-12-07T10:02:44.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f09299f7640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 0x7f09241edbf0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c7a0 tx=0x7f091c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:44.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00a640 con 0x7f0924154ea0 2023-12-07T10:02:44.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00a7a0 con 0x7f0924154ea0 2023-12-07T10:02:44.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00abd0 con 0x7f0924154ea0 2023-12-07T10:02:44.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0924154330 con 0x7f0924154ea0 2023-12-07T10:02:44.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.443+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0924153a90 con 0x7f0924154ea0 2023-12-07T10:02:44.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.447+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924067a40 con 0x7f0924154ea0 2023-12-07T10:02:44.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.447+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f091c00ad30 con 0x7f0924154ea0 2023-12-07T10:02:44.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.447+0000 7f0919ffb640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09080668d0 0x7f0908068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:44.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.447+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f091c083820 con 0x7f0924154ea0 2023-12-07T10:02:44.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.447+0000 7f09291f6640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09080668d0 0x7f0908068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:44.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.447+0000 7f09291f6640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09080668d0 0x7f0908068d90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0920007fd0 tx=0x7f0920009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:44.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.451+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f091c050c00 con 0x7f0924154ea0 2023-12-07T10:02:44.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:44.603+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f092404e890 con 0x7f0924154ea0 2023-12-07T10:02:45.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.255+0000 7f0919ffb640 1 -- 172.21.15.89:0/980979028 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v77) v1 ==== 172+0+0 (secure 0 0 0) 0x7f091c018020 con 0x7f0924154ea0 2023-12-07T10:02:45.263 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs2_data' removed 2023-12-07T10:02:45.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09080668d0 msgr2=0x7f0908068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09080668d0 0x7f0908068d90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0920007fd0 tx=0x7f0920009040 comp rx=0 tx=0).stop 2023-12-07T10:02:45.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 msgr2=0x7f09241edbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 0x7f09241edbf0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c7a0 tx=0x7f091c00cc60 comp rx=0 tx=0).stop 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 shutdown_connections 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0924154ea0 0x7f09241edbf0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0924070260 0x7f09241ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f09080668d0 0x7f0908068d90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 --2- 172.21.15.89:0/980979028 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f092406b0c0 0x7f09240c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 >> 172.21.15.89:0/980979028 conn(0x7f092406a5a0 msgr2=0x7f092414e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 shutdown_connections 2023-12-07T10:02:45.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.259+0000 7f092b45a640 1 -- 172.21.15.89:0/980979028 wait complete. 2023-12-07T10:02:45.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-07T10:02:45.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 Processor -- start 2023-12-07T10:02:45.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 -- start start 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f219c151d80 0x7f219c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c06cf70 con 0x7f219c0c8430 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219c152160 con 0x7f219c151d80 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f21a1e94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0c6a30 con 0x7f219c0c7f20 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f219c151d80 0x7f219c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f219c151d80 0x7f219c0c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60518/0 (socket says 172.21.15.89:60518) 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 -- 172.21.15.89:0/1562589014 learned_addr learned my addr 172.21.15.89:0/1562589014 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:45.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219bfff640 1 --2- 172.21.15.89:0/1562589014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 -- 172.21.15.89:0/1562589014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 msgr2=0x7f219c06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:45.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 --2- 172.21.15.89:0/1562589014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c06be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 -- 172.21.15.89:0/1562589014 >> v1:172.21.15.97:6789/0 conn(0x7f219c0c8430 legacy=0x7f219c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:45.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.423+0000 7f219b7fe640 1 -- 172.21.15.89:0/1562589014 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0c72d0 con 0x7f219c151d80 2023-12-07T10:02:45.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f219b7fe640 1 --2- 172.21.15.89:0/1562589014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c0c49a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f218c009870 tx=0x7f218c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78575e44fe8052a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:45.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f219affd640 1 -- 172.21.15.89:0/1562589014 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0ab680 con 0x7f219c151d80 2023-12-07T10:02:45.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f219affd640 1 -- 172.21.15.89:0/1562589014 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0ab7e0 con 0x7f219c151d80 2023-12-07T10:02:45.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f219affd640 1 -- 172.21.15.89:0/1562589014 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0abb70 con 0x7f219c151d80 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 -- 172.21.15.89:0/1562589014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 msgr2=0x7f219c0c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 --2- 172.21.15.89:0/1562589014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c0c49a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f218c009870 tx=0x7f218c01c480 comp rx=0 tx=0).stop 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 -- 172.21.15.89:0/1562589014 shutdown_connections 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 --2- 172.21.15.89:0/1562589014 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c06be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 --2- 172.21.15.89:0/1562589014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c0c49a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 -- 172.21.15.89:0/1562589014 >> 172.21.15.89:0/1562589014 conn(0x7f219c0abd00 msgr2=0x7f219c0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 -- 172.21.15.89:0/1562589014 shutdown_connections 2023-12-07T10:02:45.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.427+0000 7f21a1e94640 1 -- 172.21.15.89:0/1562589014 wait complete. 2023-12-07T10:02:45.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 Processor -- start 2023-12-07T10:02:45.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 -- start start 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f219c0c8430 0x7f219c1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0be560 con 0x7f219c151d80 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c146980 con 0x7f219c0c8430 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c1ed910 con 0x7f219c0c7f20 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60534/0 (socket says 172.21.15.89:60534) 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 -- 172.21.15.89:0/198968726 learned_addr learned my addr 172.21.15.89:0/198968726 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219b7fe640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f2193fff640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f219c0c8430 0x7f219c1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 -- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 msgr2=0x7f219c145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 -- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f219c0c8430 msgr2=0x7f219c1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f219c0c8430 0x7f219c1432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 -- 172.21.15.89:0/198968726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0094d0 con 0x7f219c151d80 2023-12-07T10:02:45.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f219bfff640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c143800 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2194007cf0 tx=0x7f219400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194014420 con 0x7f219c151d80 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21940145a0 con 0x7f219c151d80 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194014950 con 0x7f219c151d80 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c1ede40 con 0x7f219c151d80 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.431+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c0ab590 con 0x7f219c151d80 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.435+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c0bf120 con 0x7f219c151d80 2023-12-07T10:02:45.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.435+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2194014ab0 con 0x7f219c151d80 2023-12-07T10:02:45.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.435+0000 7f2198ff9640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f217c0668d0 0x7f217c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.435+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2194084860 con 0x7f219c151d80 2023-12-07T10:02:45.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.435+0000 7f219b7fe640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f217c0668d0 0x7f217c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.435+0000 7f219b7fe640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f217c0668d0 0x7f217c068d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f218c0af000 tx=0x7f218c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:45.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.439+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f219c0bf120 con 0x7f219c151d80 2023-12-07T10:02:45.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.587+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f219c0bf120 con 0x7f219c151d80 2023-12-07T10:02:45.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f2198ff9640 1 -- 172.21.15.89:0/198968726 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f219c0bf120 con 0x7f219c151d80 2023-12-07T10:02:45.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f217c0668d0 msgr2=0x7f217c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f217c0668d0 0x7f217c068d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f218c0af000 tx=0x7f218c0b6040 comp rx=0 tx=0).stop 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 msgr2=0x7f219c143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c143800 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2194007cf0 tx=0x7f219400e4b0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 shutdown_connections 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c151d80 0x7f219c143800 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f219c0c8430 0x7f219c1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f217c0668d0 0x7f217c068d90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 --2- 172.21.15.89:0/198968726 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f219c0c7f20 0x7f219c145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 >> 172.21.15.89:0/198968726 conn(0x7f219c0abd00 msgr2=0x7f219c0c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 shutdown_connections 2023-12-07T10:02:45.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.595+0000 7f21a1e94640 1 -- 172.21.15.89:0/198968726 wait complete. 2023-12-07T10:02:45.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-07T10:02:45.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.751+0000 7f466d417640 1 Processor -- start 2023-12-07T10:02:45.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.751+0000 7f466d417640 1 -- start start 2023-12-07T10:02:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f466d417640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46681520f0 0x7f46680c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f466d417640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46680c7f70 0x7f46680c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f466d417640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46680c5520 con 0x7f4668155660 2023-12-07T10:02:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f466d417640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466806c020 con 0x7f46680c7f70 2023-12-07T10:02:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f466d417640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46681524d0 con 0x7f46681520f0 2023-12-07T10:02:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46680c7f70 0x7f46680c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46680c7f70 0x7f46680c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60536/0 (socket says 172.21.15.89:60536) 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 -- 172.21.15.89:0/2266870592 learned_addr learned my addr 172.21.15.89:0/2266870592 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f4666ffd640 1 --2- 172.21.15.89:0/2266870592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46681520f0 0x7f46680c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 -- 172.21.15.89:0/2266870592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46681520f0 msgr2=0x7f46680c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 --2- 172.21.15.89:0/2266870592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46681520f0 0x7f46680c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 -- 172.21.15.89:0/2266870592 >> v1:172.21.15.97:6789/0 conn(0x7f4668155660 legacy=0x7f466806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.755+0000 7f46677fe640 1 -- 172.21.15.89:0/2266870592 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46680c9a80 con 0x7f46680c7f70 2023-12-07T10:02:45.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f46677fe640 1 --2- 172.21.15.89:0/2266870592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c83f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4668152610 tx=0x7f466001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20506ddd7f78bef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:45.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f46667fc640 1 -- 172.21.15.89:0/2266870592 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600a57f0 con 0x7f46680c7f70 2023-12-07T10:02:45.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f46667fc640 1 -- 172.21.15.89:0/2266870592 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600a5950 con 0x7f46680c7f70 2023-12-07T10:02:45.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f46667fc640 1 -- 172.21.15.89:0/2266870592 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600a5ce0 con 0x7f46680c7f70 2023-12-07T10:02:45.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 -- 172.21.15.89:0/2266870592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 msgr2=0x7f46680c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 --2- 172.21.15.89:0/2266870592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c83f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4668152610 tx=0x7f466001c930 comp rx=0 tx=0).stop 2023-12-07T10:02:45.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 -- 172.21.15.89:0/2266870592 shutdown_connections 2023-12-07T10:02:45.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 --2- 172.21.15.89:0/2266870592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c83f0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 --2- 172.21.15.89:0/2266870592 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46681520f0 0x7f46680c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 -- 172.21.15.89:0/2266870592 >> 172.21.15.89:0/2266870592 conn(0x7f46680ca070 msgr2=0x7f46680ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:45.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 -- 172.21.15.89:0/2266870592 shutdown_connections 2023-12-07T10:02:45.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 -- 172.21.15.89:0/2266870592 wait complete. 2023-12-07T10:02:45.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 Processor -- start 2023-12-07T10:02:45.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 -- start start 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46681520f0 0x7f46681f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.759+0000 7f466d417640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4668155660 0x7f4668150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f466d417640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46680c28e0 con 0x7f46680c7f70 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f466d417640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46680c1870 con 0x7f46681520f0 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f466d417640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46681f0470 con 0x7f4668155660 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60544/0 (socket says 172.21.15.89:60544) 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 -- 172.21.15.89:0/1044863519 learned_addr learned my addr 172.21.15.89:0/1044863519 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f46677fe640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4668155660 0x7f4668150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465e7fc640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46681520f0 0x7f46681f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 -- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4668155660 msgr2=0x7f4668150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4668155660 0x7f4668150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 -- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46681520f0 msgr2=0x7f46681f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:45.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46681520f0 0x7f46681f0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:45.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 -- 172.21.15.89:0/1044863519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009b30 con 0x7f46680c7f70 2023-12-07T10:02:45.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465e7fc640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46681520f0 0x7f46681f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f4666ffd640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c23a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f465800e930 tx=0x7f465800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658009690 con 0x7f46680c7f70 2023-12-07T10:02:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465800c8e0 con 0x7f46680c7f70 2023-12-07T10:02:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466815ea20 con 0x7f46680c7f70 2023-12-07T10:02:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800cc50 con 0x7f46680c7f70 2023-12-07T10:02:45.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46681ed9b0 con 0x7f46680c7f70 2023-12-07T10:02:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466804e890 con 0x7f46680c7f70 2023-12-07T10:02:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4658013470 con 0x7f46680c7f70 2023-12-07T10:02:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.763+0000 7f465ffff640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46480668d0 0x7f4648068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.767+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4658084650 con 0x7f46680c7f70 2023-12-07T10:02:45.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.767+0000 7f465e7fc640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46480668d0 0x7f4648068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:45.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.767+0000 7f465e7fc640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46480668d0 0x7f4648068d90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4668149030 tx=0x7f4650009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:45.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.767+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4658051bd0 con 0x7f46680c7f70 2023-12-07T10:02:45.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:45.967+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f46680c8710 con 0x7f46680c7f70 2023-12-07T10:02:46.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.259+0000 7f465ffff640 1 -- 172.21.15.89:0/1044863519 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v230) v1 ==== 159+0+0 (secure 0 0 0) 0x7f46580551f0 con 0x7f46680c7f70 2023-12-07T10:02:46.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46480668d0 msgr2=0x7f4648068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:46.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46480668d0 0x7f4648068d90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4668149030 tx=0x7f4650009040 comp rx=0 tx=0).stop 2023-12-07T10:02:46.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 msgr2=0x7f46680c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:46.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c23a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f465800e930 tx=0x7f465800edf0 comp rx=0 tx=0).stop 2023-12-07T10:02:46.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 shutdown_connections 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f46480668d0 0x7f4648068d90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4668155660 0x7f4668150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46681520f0 0x7f46681f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 --2- 172.21.15.89:0/1044863519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46680c7f70 0x7f46680c23a0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 >> 172.21.15.89:0/1044863519 conn(0x7f46680ca070 msgr2=0x7f46680c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 shutdown_connections 2023-12-07T10:02:46.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:46.263+0000 7f466d417640 1 -- 172.21.15.89:0/1044863519 wait complete. 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner: 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-07T10:02:46.316 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-07T10:02:46.317 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:Ran 3 tests in 189.634s 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-07T10:02:46.318 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-07T10:02:46.319 INFO:tasks.cephfs_test_runner: 2023-12-07T10:02:46.320 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-07T10:02:46.395 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=faf96035c25b4b46b9227b5812a9bf01 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bd0bfa458b4399e7266c56d8215a2cf3a6091a0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-07T10:02:46.397 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-07T10:02:46.406 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-07T10:02:46.432 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-07T10:02:46.432 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T10:02:46.432 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:46.460 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354512k,nr_inodes=4088628,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6560 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,nr_inodes=818837,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-07T10:02:46.460 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-07T10:02:46.460 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T10:02:46.471 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-07T10:02:46.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:46.471 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-07T10:02:46.511 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T10:02:46.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:46.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T10:02:46.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:46.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-12-07T10:02:46.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:46.789 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-07T10:02:46.799 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T10:02:46.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:46.800 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T10:02:46.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T10:02:46.871 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2023-12-07T10:02:47.103 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-07T10:02:47.112 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-07T10:02:47.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:02:47.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.247+0000 7f53e68ea640 1 Processor -- start 2023-12-07T10:02:47.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.247+0000 7f53e68ea640 1 -- start start 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e68ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e006cd90 0x7f53e0160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e68ea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e0155790 con 0x7f53e00ca610 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e68ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00c4b00 con 0x7f53e00bd720 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e68ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00c4de0 con 0x7f53e006cd90 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53dffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f53e00ca610 0x7f53e00c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56488/0 (socket says 172.21.15.89:56488) 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53dffff640 1 -- 172.21.15.89:0/2678435837 learned_addr learned my addr 172.21.15.89:0/2678435837 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:47.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e4e87640 1 --2- 172.21.15.89:0/2678435837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e006cd90 0x7f53e0160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199915 0 0) 0x7f53e0155790 con 0x7f53e00ca610 2023-12-07T10:02:47.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c8003530 con 0x7f53e00ca610 2023-12-07T10:02:47.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308609784 0 0) 0x7f53e00c4b00 con 0x7f53e00bd720 2023-12-07T10:02:47.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e0155790 con 0x7f53e00bd720 2023-12-07T10:02:47.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e4e87640 1 -- 172.21.15.89:0/2678435837 >> v1:172.21.15.97:6789/0 conn(0x7f53e00bd720 legacy=0x7f53e0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e4e87640 1 -- 172.21.15.89:0/2678435837 >> v1:172.21.15.89:6789/0 conn(0x7f53e00ca610 legacy=0x7f53e00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e4e87640 1 -- 172.21.15.89:0/2678435837 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0157e30 con 0x7f53e006cd90 2023-12-07T10:02:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.251+0000 7f53e4e87640 1 --2- 172.21.15.89:0/2678435837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e006cd90 0x7f53e0160130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009dc0 tx=0x7f53d801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b7cb543c2f4c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e00c52d0 con 0x7f53e006cd90 2023-12-07T10:02:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d80a4e80 con 0x7f53e006cd90 2023-12-07T10:02:47.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53deffd640 1 -- 172.21.15.89:0/2678435837 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80ac660 con 0x7f53e006cd90 2023-12-07T10:02:47.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- 172.21.15.89:0/2678435837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e006cd90 msgr2=0x7f53e0160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2678435837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e006cd90 0x7f53e0160130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009dc0 tx=0x7f53d801c530 comp rx=0 tx=0).stop 2023-12-07T10:02:47.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- 172.21.15.89:0/2678435837 shutdown_connections 2023-12-07T10:02:47.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2678435837 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e006cd90 0x7f53e0160130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- 172.21.15.89:0/2678435837 >> 172.21.15.89:0/2678435837 conn(0x7f53e0071ea0 msgr2=0x7f53e00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:47.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- 172.21.15.89:0/2678435837 shutdown_connections 2023-12-07T10:02:47.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- 172.21.15.89:0/2678435837 wait complete. 2023-12-07T10:02:47.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 Processor -- start 2023-12-07T10:02:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- start start 2023-12-07T10:02:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 0x7f53e01eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53e00bd720 0x7f53e00ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e00ca610 0x7f53e00aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00ab240 con 0x7f53e006cd90 2023-12-07T10:02:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00a9c80 con 0x7f53e00bd720 2023-12-07T10:02:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53e68ea640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00aa740 con 0x7f53e00ca610 2023-12-07T10:02:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.255+0000 7f53dffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 0x7f53e01eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 0x7f53e01eecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60554/0 (socket says 172.21.15.89:60554) 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 -- 172.21.15.89:0/2279503569 learned_addr learned my addr 172.21.15.89:0/2279503569 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 -- 172.21.15.89:0/2279503569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e00ca610 msgr2=0x7f53e00aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e00ca610 0x7f53e00aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 -- 172.21.15.89:0/2279503569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53e00bd720 msgr2=0x7f53e00ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53e00bd720 0x7f53e00ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 -- 172.21.15.89:0/2279503569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8009a70 con 0x7f53e006cd90 2023-12-07T10:02:47.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dffff640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 0x7f53e01eecd0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c4d0 tx=0x7f53d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0005cf0 con 0x7f53e006cd90 2023-12-07T10:02:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0005e50 con 0x7f53e006cd90 2023-12-07T10:02:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00a9f20 con 0x7f53e006cd90 2023-12-07T10:02:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0007290 con 0x7f53e006cd90 2023-12-07T10:02:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e01ee4d0 con 0x7f53e006cd90 2023-12-07T10:02:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e004e890 con 0x7f53e006cd90 2023-12-07T10:02:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.259+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53d00073f0 con 0x7f53e006cd90 2023-12-07T10:02:47.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.263+0000 7f53dcff9640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53cc0668d0 0x7f53cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.263+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f53d0083720 con 0x7f53e006cd90 2023-12-07T10:02:47.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.263+0000 7f53df7fe640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53cc0668d0 0x7f53cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.263+0000 7f53df7fe640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53cc0668d0 0x7f53cc068d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f53d4007fd0 tx=0x7f53d4007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.267+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53d0050c90 con 0x7f53e006cd90 2023-12-07T10:02:47.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.415+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53e006cb70 con 0x7f53cc0668d0 2023-12-07T10:02:47.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.415+0000 7f53dcff9640 1 -- 172.21.15.89:0/2279503569 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50422 (secure 0 0 0) 0x7f53e006cb70 con 0x7f53cc0668d0 2023-12-07T10:02:47.421 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53cc0668d0 msgr2=0x7f53cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53cc0668d0 0x7f53cc068d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f53d4007fd0 tx=0x7f53d4007960 comp rx=0 tx=0).stop 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 msgr2=0x7f53e01eecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 0x7f53e01eecd0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c4d0 tx=0x7f53d000c990 comp rx=0 tx=0).stop 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 shutdown_connections 2023-12-07T10:02:47.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f53cc0668d0 0x7f53cc068d90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53e00ca610 0x7f53e00aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f53e00bd720 0x7f53e00ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 --2- 172.21.15.89:0/2279503569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e006cd90 0x7f53e01eecd0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 >> 172.21.15.89:0/2279503569 conn(0x7f53e0071ea0 msgr2=0x7f53e0149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:47.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 shutdown_connections 2023-12-07T10:02:47.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.419+0000 7f53e68ea640 1 -- 172.21.15.89:0/2279503569 wait complete. 2023-12-07T10:02:47.442 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2023-12-07T10:02:46.386637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258024,"kb_used_data":8576,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716696,"statfs":{"total":773094113280,"available":772829896704,"internally_reserved":0,"allocated":8781824,"data_stored":4546841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001030"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-07T10:02:44.259608+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:02:44.259608+0000","last_peered":"2023-12-07T10:02:44.259608+0000","last_clean":"2023-12-07T10:02:44.259608+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:44.259608+0000","last_undegraded":"2023-12-07T10:02:44.259608+0000","last_fullsized":"2023-12-07T10:02:44.259608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1540096,"data_stored":1010390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88900000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77600000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.77600000000000002,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.74099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82099999999999995,"5min":1.008,"15min":1.008},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.753},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.75,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0229999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.622}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.84199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.161,"15min":1.161},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.79800000000000004,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.81999999999999995,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":0.88,"15min":0.88},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.438,"15min":0.438},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53300000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":1.248,"15min":1.248},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.91300000000000003,"5min":1.091,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94999999999999996,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.079,"15min":1.079},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":1.274,"15min":1.274},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":1.306,"15min":1.306},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72999999999999998,"15min":0.77200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.80900000000000005},"min":{"1min":0.56000000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.046}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.56000000000000005,"15min":0.63800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69699999999999995,"5min":5.516,"15min":5.516},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50900000000000001,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":1.464,"15min":1.464},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.488,"15min":1.488},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57099999999999995,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.501},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61399999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.599,"15min":1.599},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.84599999999999997},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1020000000000001,"5min":4.617,"15min":4.617},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.077,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.997}]},{"osd":6,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.046,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.94299999999999995,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.81899999999999995,"15min":0.85599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.012,"5min":3.468,"15min":3.468},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57899999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":1.841,"15min":1.841},"last":0.89600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.55600000000000005,"15min":0.624},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71599999999999997,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.81399999999999995,"15min":0.97999999999999998},"min":{"1min":0.31900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.171,"5min":13.016,"15min":13.016},"last":0.88500000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.85399999999999998},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6760000000000002,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92600000000000005,"15min":1.1120000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.915,"5min":13.166,"15min":13.166},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90100000000000002,"15min":0.999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":8.5660000000000007,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.89300000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.714,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.214}]},{"osd":4,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.84699999999999998,"15min":0.92300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96799999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":1.0069999999999999,"15min":1.131},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.0489999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.97099999999999997,"15min":1.0760000000000001},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.3599999999999999,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89600000000000002,"15min":0.94199999999999995},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.7519999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":1.365}]},{"osd":6,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":1.0429999999999999,"15min":1.1879999999999999},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.417,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.002,"15min":1.103},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.3969999999999998,"5min":5.75,"15min":5.75},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":1.0649999999999999,"15min":1.2190000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2130000000000001,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0209999999999999,"15min":1.0980000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5110000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.65800000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.623},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.45300000000000001,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61599999999999999,"5min":0.87,"15min":0.87},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.748},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":1.01,"15min":1.01},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.083,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.002,"5min":1.012,"15min":1.012},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":1010390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.47499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70999999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":1.119}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.66400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79400000000000004,"5min":4.173,"15min":4.173},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.52600000000000002,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":1.3260000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.73599999999999999,"15min":0.83899999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":6.048,"15min":6.048},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":1.266,"15min":1.266},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2110000000000001,"5min":2.456,"15min":2.456},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.83499999999999996},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.90000000000000002,"15min":0.96999999999999997},"min":{"1min":0.57399999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.133,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.081},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1679999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:47.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:02:47.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6e17640 1 Processor -- start 2023-12-07T10:02:47.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6e17640 1 -- start start 2023-12-07T10:02:47.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6e17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cc0151770 0x7f1cc0071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6e17640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc0070940 con 0x7f1cc0071790 2023-12-07T10:02:47.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6e17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00c1bd0 con 0x7f1cc0070dd0 2023-12-07T10:02:47.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6e17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00c19e0 con 0x7f1cc0151770 2023-12-07T10:02:47.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc5614640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cc0151770 0x7f1cc0071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc5614640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cc0151770 0x7f1cc0071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60566/0 (socket says 172.21.15.89:60566) 2023-12-07T10:02:47.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc5614640 1 -- 172.21.15.89:0/2390913632 learned_addr learned my addr 172.21.15.89:0/2390913632 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:47.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc6616640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1cc0071790 0x7f1cc006bf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56502/0 (socket says 172.21.15.89:56502) 2023-12-07T10:02:47.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc5614640 1 -- 172.21.15.89:0/2390913632 >> v1:172.21.15.97:6789/0 conn(0x7f1cc0070dd0 legacy=0x7f1cc006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc5614640 1 -- 172.21.15.89:0/2390913632 >> v1:172.21.15.89:6789/0 conn(0x7f1cc0071790 legacy=0x7f1cc006bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc5614640 1 -- 172.21.15.89:0/2390913632 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0070010 con 0x7f1cc0151770 2023-12-07T10:02:47.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.579+0000 7f1cc4e13640 1 -- 172.21.15.89:0/2390913632 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111899134 0 0) 0x7f1cc0070940 con 0x7f1cc0071790 2023-12-07T10:02:47.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc5614640 1 --2- 172.21.15.89:0/2390913632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0151770 0x7f1cc0071250 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000bb10 tx=0x7f1cb001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bc7aa839432d6d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc4e13640 1 -- 172.21.15.89:0/2390913632 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00a7b20 con 0x7f1cc0151770 2023-12-07T10:02:47.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc4e13640 1 -- 172.21.15.89:0/2390913632 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb00a7c80 con 0x7f1cc0151770 2023-12-07T10:02:47.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc4e13640 1 -- 172.21.15.89:0/2390913632 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00af440 con 0x7f1cc0151770 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 -- 172.21.15.89:0/2390913632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0151770 msgr2=0x7f1cc0071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/2390913632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0151770 0x7f1cc0071250 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000bb10 tx=0x7f1cb001eb50 comp rx=0 tx=0).stop 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 -- 172.21.15.89:0/2390913632 shutdown_connections 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/2390913632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0151770 0x7f1cc0071250 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 -- 172.21.15.89:0/2390913632 >> 172.21.15.89:0/2390913632 conn(0x7f1cc00c5fd0 msgr2=0x7f1cc00c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 -- 172.21.15.89:0/2390913632 shutdown_connections 2023-12-07T10:02:47.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 -- 172.21.15.89:0/2390913632 wait complete. 2023-12-07T10:02:47.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.583+0000 7f1cc6e17640 1 Processor -- start 2023-12-07T10:02:47.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- start start 2023-12-07T10:02:47.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 0x7f1cc0154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cc0071790 0x7f1cc013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cc0151770 0x7f1cc013dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0157c20 con 0x7f1cc0070dd0 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0152d40 con 0x7f1cc0151770 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0156810 con 0x7f1cc0071790 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 0x7f1cc0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 0x7f1cc0154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60570/0 (socket says 172.21.15.89:60570) 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 -- 172.21.15.89:0/3760879921 learned_addr learned my addr 172.21.15.89:0/3760879921 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:47.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6616640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cc0151770 0x7f1cc013dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5614640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cc0071790 0x7f1cc013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 -- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cc0071790 msgr2=0x7f1cc013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cc0071790 0x7f1cc013d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 -- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cc0151770 msgr2=0x7f1cc013dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cc0151770 0x7f1cc013dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 -- 172.21.15.89:0/3760879921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb000b770 con 0x7f1cc0070dd0 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc5e15640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 0x7f1cc0154590 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c500 tx=0x7f1cbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc005220 con 0x7f1cc0070dd0 2023-12-07T10:02:47.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc005380 con 0x7f1cc0070dd0 2023-12-07T10:02:47.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc0152780 con 0x7f1cc0070dd0 2023-12-07T10:02:47.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc007270 con 0x7f1cc0070dd0 2023-12-07T10:02:47.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0153020 con 0x7f1cc0070dd0 2023-12-07T10:02:47.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.587+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc004e890 con 0x7f1cc0070dd0 2023-12-07T10:02:47.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.591+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1cbc0073d0 con 0x7f1cc0070dd0 2023-12-07T10:02:47.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.591+0000 7f1cb67fc640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ca40668d0 0x7f1ca4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.591+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1cbc083dc0 con 0x7f1cc0070dd0 2023-12-07T10:02:47.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.591+0000 7f1cc5614640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ca40668d0 0x7f1ca4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.591+0000 7f1cc5614640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ca40668d0 0x7f1ca4068d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00b1000 tx=0x7f1cb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.595+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cbc051290 con 0x7f1cc0070dd0 2023-12-07T10:02:47.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.739+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cc00a88d0 con 0x7f1ca40668d0 2023-12-07T10:02:47.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cb67fc640 1 -- 172.21.15.89:0/3760879921 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50422 (secure 0 0 0) 0x7f1cc00a88d0 con 0x7f1ca40668d0 2023-12-07T10:02:47.747 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:47.748 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:47.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ca40668d0 msgr2=0x7f1ca4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ca40668d0 0x7f1ca4068d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00b1000 tx=0x7f1cb0008040 comp rx=0 tx=0).stop 2023-12-07T10:02:47.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 msgr2=0x7f1cc0154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 0x7f1cc0154590 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c500 tx=0x7f1cbc00c9c0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 shutdown_connections 2023-12-07T10:02:47.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cc0151770 0x7f1cc013dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f1ca40668d0 0x7f1ca4068d90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1cc0071790 0x7f1cc013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 --2- 172.21.15.89:0/3760879921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cc0070dd0 0x7f1cc0154590 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 >> 172.21.15.89:0/3760879921 conn(0x7f1cc00c5fd0 msgr2=0x7f1cc006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:47.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 shutdown_connections 2023-12-07T10:02:47.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.743+0000 7f1cc6e17640 1 -- 172.21.15.89:0/3760879921 wait complete. 2023-12-07T10:02:47.768 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2023-12-07T10:02:46.386637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258024,"kb_used_data":8576,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716696,"statfs":{"total":773094113280,"available":772829896704,"internally_reserved":0,"allocated":8781824,"data_stored":4546841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001030"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-07T10:02:44.259608+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:02:44.259608+0000","last_peered":"2023-12-07T10:02:44.259608+0000","last_clean":"2023-12-07T10:02:44.259608+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:44.259608+0000","last_undegraded":"2023-12-07T10:02:44.259608+0000","last_fullsized":"2023-12-07T10:02:44.259608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1540096,"data_stored":1010390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88900000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77600000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.77600000000000002,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.74099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82099999999999995,"5min":1.008,"15min":1.008},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.753},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.75,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0229999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.622}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.84199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.161,"15min":1.161},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.79800000000000004,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.81999999999999995,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":0.88,"15min":0.88},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.438,"15min":0.438},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53300000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":1.248,"15min":1.248},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.91300000000000003,"5min":1.091,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94999999999999996,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.079,"15min":1.079},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":1.274,"15min":1.274},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":1.306,"15min":1.306},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72999999999999998,"15min":0.77200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.80900000000000005},"min":{"1min":0.56000000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.046}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.56000000000000005,"15min":0.63800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69699999999999995,"5min":5.516,"15min":5.516},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50900000000000001,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":1.464,"15min":1.464},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.488,"15min":1.488},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57099999999999995,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.501},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61399999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.599,"15min":1.599},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.84599999999999997},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1020000000000001,"5min":4.617,"15min":4.617},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.077,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.997}]},{"osd":6,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.046,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.94299999999999995,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.81899999999999995,"15min":0.85599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.012,"5min":3.468,"15min":3.468},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57899999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":1.841,"15min":1.841},"last":0.89600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.55600000000000005,"15min":0.624},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71599999999999997,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.81399999999999995,"15min":0.97999999999999998},"min":{"1min":0.31900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.171,"5min":13.016,"15min":13.016},"last":0.88500000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.85399999999999998},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6760000000000002,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92600000000000005,"15min":1.1120000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.915,"5min":13.166,"15min":13.166},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90100000000000002,"15min":0.999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":8.5660000000000007,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.89300000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.714,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.214}]},{"osd":4,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.84699999999999998,"15min":0.92300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96799999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":1.0069999999999999,"15min":1.131},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.0489999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.97099999999999997,"15min":1.0760000000000001},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.3599999999999999,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89600000000000002,"15min":0.94199999999999995},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.7519999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":1.365}]},{"osd":6,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":1.0429999999999999,"15min":1.1879999999999999},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.417,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.002,"15min":1.103},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.3969999999999998,"5min":5.75,"15min":5.75},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":1.0649999999999999,"15min":1.2190000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2130000000000001,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0209999999999999,"15min":1.0980000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5110000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.65800000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.623},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.45300000000000001,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61599999999999999,"5min":0.87,"15min":0.87},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.748},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":1.01,"15min":1.01},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.083,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.002,"5min":1.012,"15min":1.012},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":1010390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.47499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70999999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":1.119}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.66400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79400000000000004,"5min":4.173,"15min":4.173},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.52600000000000002,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":1.3260000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.73599999999999999,"15min":0.83899999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":6.048,"15min":6.048},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":1.266,"15min":1.266},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2110000000000001,"5min":2.456,"15min":2.456},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.83499999999999996},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.90000000000000002,"15min":0.96999999999999997},"min":{"1min":0.57399999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.133,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.081},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1679999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:47.769 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-07T10:02:47.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:02:47.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 Processor -- start 2023-12-07T10:02:47.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 -- start start 2023-12-07T10:02:47.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f33f00ca610 0x7f33f00c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33f006cd90 0x7f33f00c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f0155790 con 0x7f33f00bd720 2023-12-07T10:02:47.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00c4b00 con 0x7f33f006cd90 2023-12-07T10:02:47.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f6879640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00c4de0 con 0x7f33f00ca610 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33f006cd90 0x7f33f00c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33f006cd90 0x7f33f00c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60576/0 (socket says 172.21.15.89:60576) 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 -- 172.21.15.89:0/906735768 learned_addr learned my addr 172.21.15.89:0/906735768 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33effff640 1 --2- 172.21.15.89:0/906735768 >> v2:172.21.15.97:3300/0 conn(0x7f33f00ca610 0x7f33f00c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 -- 172.21.15.89:0/906735768 >> v2:172.21.15.97:3300/0 conn(0x7f33f00ca610 msgr2=0x7f33f00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 --2- 172.21.15.89:0/906735768 >> v2:172.21.15.97:3300/0 conn(0x7f33f00ca610 0x7f33f00c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 -- 172.21.15.89:0/906735768 >> v1:172.21.15.89:6789/0 conn(0x7f33f00bd720 legacy=0x7f33f0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33f4e16640 1 -- 172.21.15.89:0/906735768 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0157e30 con 0x7f33f006cd90 2023-12-07T10:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.903+0000 7f33eeffd640 1 -- 172.21.15.89:0/906735768 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143807703 0 0) 0x7f33f0155790 con 0x7f33f00bd720 2023-12-07T10:02:47.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f4e16640 1 --2- 172.21.15.89:0/906735768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00c9a00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f33f00acc80 tx=0x7f33e801c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52025f9a6b9d0ce1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33eeffd640 1 -- 172.21.15.89:0/906735768 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f00c52d0 con 0x7f33f006cd90 2023-12-07T10:02:47.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33eeffd640 1 -- 172.21.15.89:0/906735768 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80090d0 con 0x7f33f006cd90 2023-12-07T10:02:47.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33eeffd640 1 -- 172.21.15.89:0/906735768 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80ac610 con 0x7f33f006cd90 2023-12-07T10:02:47.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 -- 172.21.15.89:0/906735768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 msgr2=0x7f33f00c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 --2- 172.21.15.89:0/906735768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00c9a00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f33f00acc80 tx=0x7f33e801c590 comp rx=0 tx=0).stop 2023-12-07T10:02:47.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 -- 172.21.15.89:0/906735768 shutdown_connections 2023-12-07T10:02:47.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 --2- 172.21.15.89:0/906735768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00c9a00 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 --2- 172.21.15.89:0/906735768 >> v2:172.21.15.97:3300/0 conn(0x7f33f00ca610 0x7f33f00c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 -- 172.21.15.89:0/906735768 >> 172.21.15.89:0/906735768 conn(0x7f33f0071ea0 msgr2=0x7f33f00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:47.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 -- 172.21.15.89:0/906735768 shutdown_connections 2023-12-07T10:02:47.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.907+0000 7f33f6879640 1 -- 172.21.15.89:0/906735768 wait complete. 2023-12-07T10:02:47.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 Processor -- start 2023-12-07T10:02:47.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- start start 2023-12-07T10:02:47.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33f00bd720 0x7f33f014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33f00ca610 0x7f33f01428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00ab330 con 0x7f33f006cd90 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01edd90 con 0x7f33f00ca610 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01edfa0 con 0x7f33f00bd720 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60592/0 (socket says 172.21.15.89:60592) 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 -- 172.21.15.89:0/1830706662 learned_addr learned my addr 172.21.15.89:0/1830706662 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:47.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f4e16640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33f00ca610 0x7f33f01428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33ef7fe640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33f00bd720 0x7f33f014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 -- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33f00bd720 msgr2=0x7f33f014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33f00bd720 0x7f33f014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 -- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33f00ca610 msgr2=0x7f33f01428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33f00ca610 0x7f33f01428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 -- 172.21.15.89:0/1830706662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8009b30 con 0x7f33f006cd90 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33ef7fe640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33f00bd720 0x7f33f014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:47.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33effff640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00a9cd0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f33e000d5f0 tx=0x7f33e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00125f0 con 0x7f33f006cd90 2023-12-07T10:02:47.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0012750 con 0x7f33f006cd90 2023-12-07T10:02:47.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0012ae0 con 0x7f33f006cd90 2023-12-07T10:02:47.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f00ab910 con 0x7f33f006cd90 2023-12-07T10:02:47.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f00abed0 con 0x7f33f006cd90 2023-12-07T10:02:47.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.911+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f004e890 con 0x7f33f006cd90 2023-12-07T10:02:47.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.915+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f33e0012c40 con 0x7f33f006cd90 2023-12-07T10:02:47.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.915+0000 7f33ecff9640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f33dc066900 0x7f33dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:47.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.915+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f33e00845a0 con 0x7f33f006cd90 2023-12-07T10:02:47.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.915+0000 7f33ef7fe640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f33dc066900 0x7f33dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:47.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.915+0000 7f33ef7fe640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f33dc066900 0x7f33dc068dc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f33f00c10a0 tx=0x7f33e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:47.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:47.919+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33e0051a70 con 0x7f33f006cd90 2023-12-07T10:02:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.063+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33f006cb70 con 0x7f33dc066900 2023-12-07T10:02:48.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33ecff9640 1 -- 172.21.15.89:0/1830706662 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50422 (secure 0 0 0) 0x7f33f006cb70 con 0x7f33dc066900 2023-12-07T10:02:48.072 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:48.072 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f33dc066900 msgr2=0x7f33dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f33dc066900 0x7f33dc068dc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f33f00c10a0 tx=0x7f33e4009040 comp rx=0 tx=0).stop 2023-12-07T10:02:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 msgr2=0x7f33f00a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00a9cd0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f33e000d5f0 tx=0x7f33e000dab0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 shutdown_connections 2023-12-07T10:02:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33f00ca610 0x7f33f01428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f33dc066900 0x7f33dc068dc0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f33f00bd720 0x7f33f014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 --2- 172.21.15.89:0/1830706662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f006cd90 0x7f33f00a9cd0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 >> 172.21.15.89:0/1830706662 conn(0x7f33f0071ea0 msgr2=0x7f33f014fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 shutdown_connections 2023-12-07T10:02:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.067+0000 7f33f6879640 1 -- 172.21.15.89:0/1830706662 wait complete. 2023-12-07T10:02:48.093 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2023-12-07T10:02:46.386637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258024,"kb_used_data":8576,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716696,"statfs":{"total":773094113280,"available":772829896704,"internally_reserved":0,"allocated":8781824,"data_stored":4546841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001030"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-07T10:02:44.259608+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:02:44.259608+0000","last_peered":"2023-12-07T10:02:44.259608+0000","last_clean":"2023-12-07T10:02:44.259608+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:44.259608+0000","last_undegraded":"2023-12-07T10:02:44.259608+0000","last_fullsized":"2023-12-07T10:02:44.259608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1540096,"data_stored":1010390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88900000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77600000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.77600000000000002,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.74099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82099999999999995,"5min":1.008,"15min":1.008},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.753},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.75,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0229999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.622}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.84199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.161,"15min":1.161},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.79800000000000004,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.81999999999999995,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":0.88,"15min":0.88},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.438,"15min":0.438},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53300000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":1.248,"15min":1.248},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.91300000000000003,"5min":1.091,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94999999999999996,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.079,"15min":1.079},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":1.274,"15min":1.274},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":1.306,"15min":1.306},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72999999999999998,"15min":0.77200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.80900000000000005},"min":{"1min":0.56000000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.046}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.56000000000000005,"15min":0.63800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69699999999999995,"5min":5.516,"15min":5.516},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50900000000000001,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":1.464,"15min":1.464},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.488,"15min":1.488},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57099999999999995,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.501},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61399999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.599,"15min":1.599},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.84599999999999997},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1020000000000001,"5min":4.617,"15min":4.617},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.077,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.997}]},{"osd":6,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.046,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.94299999999999995,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.81899999999999995,"15min":0.85599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.012,"5min":3.468,"15min":3.468},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57899999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":1.841,"15min":1.841},"last":0.89600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.55600000000000005,"15min":0.624},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71599999999999997,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.81399999999999995,"15min":0.97999999999999998},"min":{"1min":0.31900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.171,"5min":13.016,"15min":13.016},"last":0.88500000000000001}]},{"osd":1,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.85399999999999998},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6760000000000002,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92600000000000005,"15min":1.1120000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.915,"5min":13.166,"15min":13.166},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90100000000000002,"15min":0.999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":8.5660000000000007,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.89300000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.714,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":1.214}]},{"osd":4,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.84699999999999998,"15min":0.92300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96799999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":1.0069999999999999,"15min":1.131},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.0489999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.97099999999999997,"15min":1.0760000000000001},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.3599999999999999,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89600000000000002,"15min":0.94199999999999995},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.7519999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":1.365}]},{"osd":6,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":1.0429999999999999,"15min":1.1879999999999999},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.417,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.002,"15min":1.103},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.3969999999999998,"5min":5.75,"15min":5.75},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":1.0649999999999999,"15min":1.2190000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2130000000000001,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0209999999999999,"15min":1.0980000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5110000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.65800000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.623},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.45300000000000001,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61599999999999999,"5min":0.87,"15min":0.87},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.748},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":1.01,"15min":1.01},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.083,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.002,"5min":1.012,"15min":1.012},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":1010390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.47499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70999999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":1.119}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.66400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79400000000000004,"5min":4.173,"15min":4.173},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.52600000000000002,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":1.3260000000000001}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.73599999999999999,"15min":0.83899999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":6.048,"15min":6.048},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":1.266,"15min":1.266},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2110000000000001,"5min":2.456,"15min":2.456},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.83499999999999996},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.90000000000000002,"15min":0.96999999999999997},"min":{"1min":0.57399999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.133,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":1.081},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1679999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:48.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T10:02:48.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb13dcad640 1 Processor -- start 2023-12-07T10:02:48.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb13dcad640 1 -- start start 2023-12-07T10:02:48.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb13dcad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 0x7fb138071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb13dcad640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb138157d00 con 0x7fb138151f40 2023-12-07T10:02:48.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb13dcad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13806d1f0 con 0x7fb1380c0700 2023-12-07T10:02:48.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb13dcad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380c0be0 con 0x7fb13806ec90 2023-12-07T10:02:48.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1377fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb138151f40 0x7fb1380c1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56524/0 (socket says 172.21.15.89:56524) 2023-12-07T10:02:48.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1377fe640 1 -- 172.21.15.89:0/1350124614 learned_addr learned my addr 172.21.15.89:0/1350124614 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:48.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb137fff640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 0x7fb138071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:48.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731258807 0 0) 0x7fb138157d00 con 0x7fb138151f40 2023-12-07T10:02:48.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb120003530 con 0x7fb138151f40 2023-12-07T10:02:48.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890250602 0 0) 0x7fb13806d1f0 con 0x7fb1380c0700 2023-12-07T10:02:48.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138157d00 con 0x7fb1380c0700 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1388673328 0 0) 0x7fb120003530 con 0x7fb138151f40 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 msgr2=0x7fb138071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 0x7fb138071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 >> v1:172.21.15.97:6789/0 conn(0x7fb1380c0700 legacy=0x7fb138071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13806cf30 con 0x7fb138151f40 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fb1280016a0 con 0x7fb138151f40 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 >> v1:172.21.15.89:6789/0 conn(0x7fb138151f40 legacy=0x7fb1380c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb120003b40 0x7fb120003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb120004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 0x7fb120005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380c0be0 con 0x7fb1200047d0 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12000bbc0 con 0x7fb120003b40 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12000bd80 con 0x7fb13806ec90 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb136ffd640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb120004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb1377fe640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb120003b40 0x7fb120003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:48.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.227+0000 7fb137fff640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 0x7fb120005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb136ffd640 1 -- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 msgr2=0x7fb120005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb136ffd640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb13806ec90 0x7fb120005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb136ffd640 1 -- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb120003b40 msgr2=0x7fb120003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb136ffd640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb120003b40 0x7fb120003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb136ffd640 1 -- 172.21.15.89:0/1350124614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120003530 con 0x7fb1200047d0 2023-12-07T10:02:48.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb136ffd640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb120004c50 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0018d0 tx=0x7fb12c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d2b855193d810d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:48.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0052d0 con 0x7fb1200047d0 2023-12-07T10:02:48.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c005450 con 0x7fb1200047d0 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb1367fc640 1 -- 172.21.15.89:0/1350124614 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c003840 con 0x7fb1200047d0 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb13dcad640 1 -- 172.21.15.89:0/1350124614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 msgr2=0x7fb120004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb13dcad640 1 --2- 172.21.15.89:0/1350124614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb120004c50 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0018d0 tx=0x7fb12c01c530 comp rx=0 tx=0).stop 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb137fff640 1 -- 172.21.15.89:0/1350124614 reap_dead start 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb13dcad640 1 -- 172.21.15.89:0/1350124614 shutdown_connections 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.231+0000 7fb13dcad640 1 -- 172.21.15.89:0/1350124614 >> 172.21.15.89:0/1350124614 conn(0x7fb1380c2ce0 msgr2=0x7fb1380c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- 172.21.15.89:0/1350124614 shutdown_connections 2023-12-07T10:02:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- 172.21.15.89:0/1350124614 wait complete. 2023-12-07T10:02:48.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 Processor -- start 2023-12-07T10:02:48.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- start start 2023-12-07T10:02:48.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb1381ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb13814c7b0 0x7fb1381455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1380c47e0 0x7fb1380c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1381edcf0 con 0x7fb1200047d0 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1381523b0 con 0x7fb13814c7b0 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb138152690 con 0x7fb1380c47e0 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb1381ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb1381ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60610/0 (socket says 172.21.15.89:60610) 2023-12-07T10:02:48.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 -- 172.21.15.89:0/653286012 learned_addr learned my addr 172.21.15.89:0/653286012 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 -- 172.21.15.89:0/653286012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1380c47e0 msgr2=0x7fb1380c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1380c47e0 0x7fb1380c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 -- 172.21.15.89:0/653286012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb13814c7b0 msgr2=0x7fb1381455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb13814c7b0 0x7fb1381455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 -- 172.21.15.89:0/653286012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380abdd0 con 0x7fb1200047d0 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb1377fe640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb1381ed7b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fb128001d40 tx=0x7fb128007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128007770 con 0x7fb1200047d0 2023-12-07T10:02:48.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12800f730 con 0x7fb1200047d0 2023-12-07T10:02:48.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800fb00 con 0x7fb1200047d0 2023-12-07T10:02:48.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.235+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1380ac0b0 con 0x7fb1200047d0 2023-12-07T10:02:48.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb138152970 con 0x7fb1200047d0 2023-12-07T10:02:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1381f02d0 con 0x7fb1200047d0 2023-12-07T10:02:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb12800fc60 con 0x7fb1200047d0 2023-12-07T10:02:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb11ffff640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb124066900 0x7fb124068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb128084020 con 0x7fb1200047d0 2023-12-07T10:02:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb136ffd640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb124066900 0x7fb124068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.239+0000 7fb136ffd640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb124066900 0x7fb124068dc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0ad000 tx=0x7fb12c0012e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:48.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.243+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1381f02d0 con 0x7fb1200047d0 2023-12-07T10:02:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.395+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1381f02d0 con 0x7fb1200047d0 2023-12-07T10:02:48.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb11ffff640 1 -- 172.21.15.89:0/653286012 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13057 (secure 0 0 0) 0x7fb1381f02d0 con 0x7fb1200047d0 2023-12-07T10:02:48.403 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:48.403 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":77,"fsid":"06923b89-f6c6-4736-b27e-9e03456ddc01","created":"2023-12-07T09:58:47.359554+0000","modified":"2023-12-07T10:02:45.255443+0000","last_up_change":"2023-12-07T09:58:59.767805+0000","last_in_change":"2023-12-07T09:58:49.865809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T09:59:00.403301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"befa1fe9-60c5-4fd7-a2e7-6c936c0cd21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6801","nonce":1485321757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6803","nonce":1485321757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6807","nonce":1485321757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1485321757},{"type":"v1","addr":"172.21.15.89:6805","nonce":1485321757}]},"public_addr":"172.21.15.89:6801/1485321757","cluster_addr":"172.21.15.89:6803/1485321757","heartbeat_back_addr":"172.21.15.89:6807/1485321757","heartbeat_front_addr":"172.21.15.89:6805/1485321757","state":["exists","up"]},{"osd":1,"uuid":"d0f855f7-b40d-4225-9746-c81fc2f74753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6824","nonce":1573279697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6827","nonce":1573279697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6831","nonce":1573279697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1573279697},{"type":"v1","addr":"172.21.15.89:6829","nonce":1573279697}]},"public_addr":"172.21.15.89:6824/1573279697","cluster_addr":"172.21.15.89:6827/1573279697","heartbeat_back_addr":"172.21.15.89:6831/1573279697","heartbeat_front_addr":"172.21.15.89:6829/1573279697","state":["exists","up"]},{"osd":2,"uuid":"18ffb54a-4429-4fd0-a386-e7e3e71837b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6817","nonce":746240021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6819","nonce":746240021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6825","nonce":746240021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":746240021},{"type":"v1","addr":"172.21.15.89:6821","nonce":746240021}]},"public_addr":"172.21.15.89:6817/746240021","cluster_addr":"172.21.15.89:6819/746240021","heartbeat_back_addr":"172.21.15.89:6825/746240021","heartbeat_front_addr":"172.21.15.89:6821/746240021","state":["exists","up"]},{"osd":3,"uuid":"88e0d0d3-1306-4d18-8b59-87b4b49609be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6809","nonce":2109259736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6811","nonce":2109259736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6815","nonce":2109259736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2109259736},{"type":"v1","addr":"172.21.15.89:6813","nonce":2109259736}]},"public_addr":"172.21.15.89:6809/2109259736","cluster_addr":"172.21.15.89:6811/2109259736","heartbeat_back_addr":"172.21.15.89:6815/2109259736","heartbeat_front_addr":"172.21.15.89:6813/2109259736","state":["exists","up"]},{"osd":4,"uuid":"fb307243-e50f-4819-af38-0ed8cbe5bf81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6817","nonce":811237390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6819","nonce":811237390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6823","nonce":811237390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":811237390},{"type":"v1","addr":"172.21.15.97:6821","nonce":811237390}]},"public_addr":"172.21.15.97:6817/811237390","cluster_addr":"172.21.15.97:6819/811237390","heartbeat_back_addr":"172.21.15.97:6823/811237390","heartbeat_front_addr":"172.21.15.97:6821/811237390","state":["exists","up"]},{"osd":5,"uuid":"7406c73f-f4e4-4b84-b98f-8dd5060c426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6804","nonce":3253961744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6808","nonce":3253961744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6815","nonce":3253961744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3253961744},{"type":"v1","addr":"172.21.15.97:6811","nonce":3253961744}]},"public_addr":"172.21.15.97:6804/3253961744","cluster_addr":"172.21.15.97:6808/3253961744","heartbeat_back_addr":"172.21.15.97:6815/3253961744","heartbeat_front_addr":"172.21.15.97:6811/3253961744","state":["exists","up"]},{"osd":6,"uuid":"d06a5bc5-e9a6-4bf8-88f0-2c51b01034d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6825","nonce":2141814588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6827","nonce":2141814588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6831","nonce":2141814588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2141814588},{"type":"v1","addr":"172.21.15.97:6829","nonce":2141814588}]},"public_addr":"172.21.15.97:6825/2141814588","cluster_addr":"172.21.15.97:6827/2141814588","heartbeat_back_addr":"172.21.15.97:6831/2141814588","heartbeat_front_addr":"172.21.15.97:6829/2141814588","state":["exists","up"]},{"osd":7,"uuid":"f9be2c35-4439-4b94-bb78-245a9a5f6e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6801","nonce":1479824909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6805","nonce":1479824909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6814","nonce":1479824909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1479824909},{"type":"v1","addr":"172.21.15.97:6809","nonce":1479824909}]},"public_addr":"172.21.15.97:6801/1479824909","cluster_addr":"172.21.15.97:6805/1479824909","heartbeat_back_addr":"172.21.15.97:6814/1479824909","heartbeat_front_addr":"172.21.15.97:6809/1479824909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.412716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.621493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.542918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.599388+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.778979+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.439960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.625163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T09:58:55.569032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/1453304685":"2023-12-08T10:02:41.980229+0000","172.21.15.97:6833/1453304685":"2023-12-08T10:02:41.980229+0000","172.21.15.89:6836/3031036225":"2023-12-08T10:02:35.481810+0000","172.21.15.89:6834/3031036225":"2023-12-08T10:02:35.481810+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T10:02:48.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb124066900 msgr2=0x7fb124068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb124066900 0x7fb124068dc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0ad000 tx=0x7fb12c0012e0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 msgr2=0x7fb1381ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:48.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb1381ed7b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fb128001d40 tx=0x7fb128007430 comp rx=0 tx=0).stop 2023-12-07T10:02:48.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 shutdown_connections 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fb124066900 0x7fb124068dc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb1380c47e0 0x7fb1380c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb13814c7b0 0x7fb1381455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 --2- 172.21.15.89:0/653286012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1200047d0 0x7fb1381ed7b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 >> 172.21.15.89:0/653286012 conn(0x7fb1380c2ce0 msgr2=0x7fb1380c1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 shutdown_connections 2023-12-07T10:02:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:48.399+0000 7fb13dcad640 1 -- 172.21.15.89:0/653286012 wait complete. 2023-12-07T10:02:49.425 INFO:tasks.ceph:Scrubbing osd.0 2023-12-07T10:02:49.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:49.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff8439f5640 1 Processor -- start 2023-12-07T10:02:49.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff8439f5640 1 -- start start 2023-12-07T10:02:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff8439f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff83c070970 0x7ff83c155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff8439f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c1559d0 con 0x7ff83c154ea0 2023-12-07T10:02:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff8439f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c06d910 con 0x7ff83c06b0c0 2023-12-07T10:02:49.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff8439f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c1557c0 con 0x7ff83c070970 2023-12-07T10:02:49.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff841f92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff83c070970 0x7ff83c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff841791640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff83c154ea0 0x7ff83c14e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47990/0 (socket says 172.21.15.89:47990) 2023-12-07T10:02:49.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.571+0000 7ff841791640 1 -- 172.21.15.89:0/2129092016 learned_addr learned my addr 172.21.15.89:0/2129092016 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:49.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff841f92640 1 -- 172.21.15.89:0/2129092016 >> v1:172.21.15.97:6789/0 conn(0x7ff83c06b0c0 legacy=0x7ff83c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff841f92640 1 -- 172.21.15.89:0/2129092016 >> v1:172.21.15.89:6789/0 conn(0x7ff83c154ea0 legacy=0x7ff83c14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff841f92640 1 -- 172.21.15.89:0/2129092016 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0c1230 con 0x7ff83c070970 2023-12-07T10:02:49.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff841f92640 1 --2- 172.21.15.89:0/2129092016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c155280 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff834009d90 tx=0x7ff83401eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887a06e264ce3c82 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff833fff640 1 -- 172.21.15.89:0/2129092016 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340a7b70 con 0x7ff83c070970 2023-12-07T10:02:49.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff833fff640 1 -- 172.21.15.89:0/2129092016 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340a7cd0 con 0x7ff83c070970 2023-12-07T10:02:49.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.575+0000 7ff833fff640 1 -- 172.21.15.89:0/2129092016 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340af660 con 0x7ff83c070970 2023-12-07T10:02:49.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- 172.21.15.89:0/2129092016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 msgr2=0x7ff83c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 --2- 172.21.15.89:0/2129092016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c155280 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff834009d90 tx=0x7ff83401eaa0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- 172.21.15.89:0/2129092016 shutdown_connections 2023-12-07T10:02:49.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 --2- 172.21.15.89:0/2129092016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c155280 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- 172.21.15.89:0/2129092016 >> 172.21.15.89:0/2129092016 conn(0x7ff83c06a5a0 msgr2=0x7ff83c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:49.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- 172.21.15.89:0/2129092016 shutdown_connections 2023-12-07T10:02:49.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- 172.21.15.89:0/2129092016 wait complete. 2023-12-07T10:02:49.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 Processor -- start 2023-12-07T10:02:49.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- start start 2023-12-07T10:02:49.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff83c06b0c0 0x7ff83c146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff83c154ea0 0x7ff83c144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c150570 con 0x7ff83c070970 2023-12-07T10:02:49.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c145810 con 0x7ff83c154ea0 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff8439f5640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c14ff20 con 0x7ff83c06b0c0 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58534/0 (socket says 172.21.15.89:58534) 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 -- 172.21.15.89:0/475328745 learned_addr learned my addr 172.21.15.89:0/475328745 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff841791640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff83c06b0c0 0x7ff83c146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff841f92640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff83c154ea0 0x7ff83c144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 -- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff83c06b0c0 msgr2=0x7ff83c146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff83c06b0c0 0x7ff83c146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 -- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff83c154ea0 msgr2=0x7ff83c144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff83c154ea0 0x7ff83c144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff840f90640 1 -- 172.21.15.89:0/475328745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009a70 con 0x7ff83c070970 2023-12-07T10:02:49.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.579+0000 7ff841f92640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff83c154ea0 0x7ff83c144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:49.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff840f90640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c144870 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00c530 tx=0x7ff82c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0052d0 con 0x7ff83c070970 2023-12-07T10:02:49.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c005430 con 0x7ff83c070970 2023-12-07T10:02:49.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c145a60 con 0x7ff83c070970 2023-12-07T10:02:49.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c012830 con 0x7ff83c070970 2023-12-07T10:02:49.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c145d40 con 0x7ff83c070970 2023-12-07T10:02:49.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff83c06dd80 con 0x7ff83c070970 2023-12-07T10:02:49.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff82c012990 con 0x7ff83c070970 2023-12-07T10:02:49.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8200668d0 0x7ff820068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff82c083bb0 con 0x7ff83c070970 2023-12-07T10:02:49.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff841791640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8200668d0 0x7ff820068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7ff82006c7d0 0x7ff82006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 --> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff82006f2a0 con 0x7ff82006c7d0 2023-12-07T10:02:49.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff82c0882a0 con 0x7ff83c070970 2023-12-07T10:02:49.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.583+0000 7ff841f92640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7ff82006c7d0 0x7ff82006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.587+0000 7ff841791640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8200668d0 0x7ff820068d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff838005890 tx=0x7ff838009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.587+0000 7ff841f92640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7ff82006c7d0 0x7ff82006ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.587+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== osd.0 v2:172.21.15.89:6800/1485321757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff82006f2a0 con 0x7ff82006c7d0 2023-12-07T10:02:49.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 --> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff83c04e890 con 0x7ff82006c7d0 2023-12-07T10:02:49.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff831ffb640 1 -- 172.21.15.89:0/475328745 <== osd.0 v2:172.21.15.89:6800/1485321757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff83c04e890 con 0x7ff82006c7d0 2023-12-07T10:02:49.604 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:49.605 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:49.605 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7ff82006c7d0 msgr2=0x7ff82006ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6800/1485321757,v1:172.21.15.89:6801/1485321757] conn(0x7ff82006c7d0 0x7ff82006ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8200668d0 msgr2=0x7ff820068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7ff8200668d0 0x7ff820068d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff838005890 tx=0x7ff838009040 comp rx=0 tx=0).stop 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 msgr2=0x7ff83c144870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 --2- 172.21.15.89:0/475328745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c070970 0x7ff83c144870 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00c530 tx=0x7ff82c00c9f0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff841f92640 1 -- 172.21.15.89:0/475328745 reap_dead start 2023-12-07T10:02:49.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 shutdown_connections 2023-12-07T10:02:49.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 >> 172.21.15.89:0/475328745 conn(0x7ff83c06a5a0 msgr2=0x7ff83c0bfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:49.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 shutdown_connections 2023-12-07T10:02:49.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.599+0000 7ff8439f5640 1 -- 172.21.15.89:0/475328745 wait complete. 2023-12-07T10:02:49.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-07T10:02:49.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.755+0000 7fd84e69c640 1 Processor -- start 2023-12-07T10:02:49.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.755+0000 7fd84e69c640 1 -- start start 2023-12-07T10:02:49.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.755+0000 7fd84e69c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd84806e9a0 0x7fd848154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.755+0000 7fd84e69c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8480c2100 con 0x7fd84806eed0 2023-12-07T10:02:49.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.755+0000 7fd84e69c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84806d6a0 con 0x7fd848151dc0 2023-12-07T10:02:49.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.755+0000 7fd84e69c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480c1930 con 0x7fd84806e9a0 2023-12-07T10:02:49.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd8477fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd84806e9a0 0x7fd848154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd84cc39640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd84806eed0 0x7fd848155220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48000/0 (socket says 172.21.15.89:48000) 2023-12-07T10:02:49.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd84cc39640 1 -- 172.21.15.89:0/236142381 learned_addr learned my addr 172.21.15.89:0/236142381 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:49.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd8477fe640 1 -- 172.21.15.89:0/236142381 >> v1:172.21.15.97:6789/0 conn(0x7fd848151dc0 legacy=0x7fd84806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:49.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd8477fe640 1 -- 172.21.15.89:0/236142381 >> v1:172.21.15.89:6789/0 conn(0x7fd84806eed0 legacy=0x7fd848155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd8477fe640 1 -- 172.21.15.89:0/236142381 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848158b60 con 0x7fd84806e9a0 2023-12-07T10:02:49.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd846ffd640 1 -- 172.21.15.89:0/236142381 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544566315 0 0) 0x7fd8480c2100 con 0x7fd84806eed0 2023-12-07T10:02:49.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd8477fe640 1 --2- 172.21.15.89:0/236142381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84806e9a0 0x7fd848154ce0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0097c0 tx=0x7fd83c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d817e53a3138a08f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd846ffd640 1 -- 172.21.15.89:0/236142381 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0ab600 con 0x7fd84806e9a0 2023-12-07T10:02:49.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd846ffd640 1 -- 172.21.15.89:0/236142381 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0a7050 con 0x7fd84806e9a0 2023-12-07T10:02:49.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.759+0000 7fd846ffd640 1 -- 172.21.15.89:0/236142381 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0ab980 con 0x7fd84806e9a0 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- 172.21.15.89:0/236142381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84806e9a0 msgr2=0x7fd848154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 --2- 172.21.15.89:0/236142381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84806e9a0 0x7fd848154ce0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0097c0 tx=0x7fd83c01c440 comp rx=0 tx=0).stop 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- 172.21.15.89:0/236142381 shutdown_connections 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 --2- 172.21.15.89:0/236142381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84806e9a0 0x7fd848154ce0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- 172.21.15.89:0/236142381 >> 172.21.15.89:0/236142381 conn(0x7fd8480c3240 msgr2=0x7fd8480c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- 172.21.15.89:0/236142381 shutdown_connections 2023-12-07T10:02:49.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- 172.21.15.89:0/236142381 wait complete. 2023-12-07T10:02:49.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 Processor -- start 2023-12-07T10:02:49.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- start start 2023-12-07T10:02:49.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd84806e9a0 0x7fd848155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84806eed0 0x7fd848071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 0x7fd84814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848149970 con 0x7fd848151dc0 2023-12-07T10:02:49.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848156140 con 0x7fd84806e9a0 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84e69c640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84814e3c0 con 0x7fd84806eed0 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 0x7fd84814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 0x7fd84814ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58542/0 (socket says 172.21.15.89:58542) 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 -- 172.21.15.89:0/2268898312 learned_addr learned my addr 172.21.15.89:0/2268898312 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd8477fe640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84806eed0 0x7fd848071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd847fff640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd84806e9a0 0x7fd848155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 -- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84806eed0 msgr2=0x7fd848071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84806eed0 0x7fd848071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 -- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd84806e9a0 msgr2=0x7fd848155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd84806e9a0 0x7fd848155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd84cc39640 1 -- 172.21.15.89:0/2268898312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c009420 con 0x7fd848151dc0 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.763+0000 7fd8477fe640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84806eed0 0x7fd848071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd84cc39640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 0x7fd84814ce20 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd840001570 tx=0x7fd84000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000a640 con 0x7fd848151dc0 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000a7c0 con 0x7fd848151dc0 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000ab70 con 0x7fd848151dc0 2023-12-07T10:02:49.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84814e6a0 con 0x7fd848151dc0 2023-12-07T10:02:49.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84814d360 con 0x7fd848151dc0 2023-12-07T10:02:49.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd848071270 con 0x7fd848151dc0 2023-12-07T10:02:49.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd84000acd0 con 0x7fd848151dc0 2023-12-07T10:02:49.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd844ff9640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8340668d0 0x7fd834068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:49.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd8400836e0 con 0x7fd848151dc0 2023-12-07T10:02:49.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd847fff640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8340668d0 0x7fd834068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:49.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.767+0000 7fd847fff640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8340668d0 0x7fd834068d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd848153970 tx=0x7fd838008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.771+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd848071270 con 0x7fd848151dc0 2023-12-07T10:02:49.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.919+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd848153e70 con 0x7fd8340668d0 2023-12-07T10:02:49.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.919+0000 7fd844ff9640 1 -- 172.21.15.89:0/2268898312 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd848153e70 con 0x7fd8340668d0 2023-12-07T10:02:49.926 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2023-12-07T10:02:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8340668d0 msgr2=0x7fd834068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8340668d0 0x7fd834068d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd848153970 tx=0x7fd838008040 comp rx=0 tx=0).stop 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 msgr2=0x7fd84814ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 0x7fd84814ce20 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd840001570 tx=0x7fd84000cca0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 shutdown_connections 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd848151dc0 0x7fd84814ce20 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd8340668d0 0x7fd834068d90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd84806eed0 0x7fd848071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 --2- 172.21.15.89:0/2268898312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd84806e9a0 0x7fd848155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:49.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 >> 172.21.15.89:0/2268898312 conn(0x7fd8480c3240 msgr2=0x7fd848152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:49.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 shutdown_connections 2023-12-07T10:02:49.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:49.923+0000 7fd84e69c640 1 -- 172.21.15.89:0/2268898312 wait complete. 2023-12-07T10:02:49.947 INFO:tasks.ceph:Scrubbing osd.1 2023-12-07T10:02:49.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:50.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.083+0000 7f84af33e640 1 Processor -- start 2023-12-07T10:02:50.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.083+0000 7f84af33e640 1 -- start start 2023-12-07T10:02:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84af33e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f84a8155f00 0x7f84a80a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84af33e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a81562e0 0x7f84a806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84af33e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80abb60 con 0x7f84a8156740 2023-12-07T10:02:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84af33e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a806c7a0 con 0x7f84a8155f00 2023-12-07T10:02:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84af33e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80abdb0 con 0x7f84a81562e0 2023-12-07T10:02:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad0da640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f84a8155f00 0x7f84a80a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ac8d9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a81562e0 0x7f84a806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad8db640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f84a8156740 0x7f84a80c2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:57298/0 (socket says 172.21.15.89:57298) 2023-12-07T10:02:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad8db640 1 -- 172.21.15.89:0/2913098558 learned_addr learned my addr 172.21.15.89:0/2913098558 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f849ffff640 1 -- 172.21.15.89:0/2913098558 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793390198 0 0) 0x7f84a80abb60 con 0x7f84a8156740 2023-12-07T10:02:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f849ffff640 1 -- 172.21.15.89:0/2913098558 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8494003530 con 0x7f84a8156740 2023-12-07T10:02:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad0da640 1 -- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a81562e0 msgr2=0x7f84a806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad0da640 1 --2- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a81562e0 0x7f84a806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad0da640 1 -- 172.21.15.89:0/2913098558 >> v1:172.21.15.97:6789/0 conn(0x7f84a8156740 legacy=0x7f84a80c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.087+0000 7f84ad0da640 1 -- 172.21.15.89:0/2913098558 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80ac090 con 0x7f84a8155f00 2023-12-07T10:02:50.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84ad0da640 1 --2- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8155f00 0x7f84a80a9770 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f84a40097c0 tx=0x7f84a401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=712c1067c323b265 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f849ffff640 1 -- 172.21.15.89:0/2913098558 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40ab600 con 0x7f84a8155f00 2023-12-07T10:02:50.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f849ffff640 1 -- 172.21.15.89:0/2913098558 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a40a7050 con 0x7f84a8155f00 2023-12-07T10:02:50.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f849ffff640 1 -- 172.21.15.89:0/2913098558 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40ab980 con 0x7f84a8155f00 2023-12-07T10:02:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 -- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8155f00 msgr2=0x7f84a80a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 --2- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8155f00 0x7f84a80a9770 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f84a40097c0 tx=0x7f84a401c3f0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 -- 172.21.15.89:0/2913098558 shutdown_connections 2023-12-07T10:02:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 --2- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a81562e0 0x7f84a806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 --2- 172.21.15.89:0/2913098558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8155f00 0x7f84a80a9770 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 -- 172.21.15.89:0/2913098558 >> 172.21.15.89:0/2913098558 conn(0x7f84a806a5a0 msgr2=0x7f84a806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 -- 172.21.15.89:0/2913098558 shutdown_connections 2023-12-07T10:02:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 -- 172.21.15.89:0/2913098558 wait complete. 2023-12-07T10:02:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 Processor -- start 2023-12-07T10:02:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.091+0000 7f84af33e640 1 -- start start 2023-12-07T10:02:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a8155f00 0x7f84a80ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a81562e0 0x7f84a813e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8156740 0x7f84a813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a813ef60 con 0x7f84a81562e0 2023-12-07T10:02:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8148520 con 0x7f84a8156740 2023-12-07T10:02:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a81ed8c0 con 0x7f84a8155f00 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a81562e0 0x7f84a813e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a81562e0 0x7f84a813e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58546/0 (socket says 172.21.15.89:58546) 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 -- 172.21.15.89:0/2511260627 learned_addr learned my addr 172.21.15.89:0/2511260627 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ad0da640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a8155f00 0x7f84a80ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ad8db640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8156740 0x7f84a813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 -- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a8155f00 msgr2=0x7f84a80ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f84a8155f00 0x7f84a80ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 -- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8156740 msgr2=0x7f84a813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8156740 0x7f84a813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 -- 172.21.15.89:0/2511260627 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4009420 con 0x7f84a81562e0 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ad8db640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84a8156740 0x7f84a813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84ac8d9640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a81562e0 0x7f84a813e4e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f849800e870 tx=0x7f849800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498009510 con 0x7f84a81562e0 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a81edba0 con 0x7f84a81562e0 2023-12-07T10:02:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849800eec0 con 0x7f84a81562e0 2023-12-07T10:02:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800cb40 con 0x7f84a81562e0 2023-12-07T10:02:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a80c4040 con 0x7f84a81562e0 2023-12-07T10:02:50.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84a8154ff0 con 0x7f84a81562e0 2023-12-07T10:02:50.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.095+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f849800cca0 con 0x7f84a81562e0 2023-12-07T10:02:50.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f849dffb640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f848c0668d0 0x7f848c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8498084380 con 0x7f84a81562e0 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f84ad0da640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f848c0668d0 0x7f848c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f849dffb640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7f848c06c7d0 0x7f848c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 --> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f848c06f2a0 con 0x7f848c06c7d0 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8498086960 con 0x7f84a81562e0 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f84ad8db640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7f848c06c7d0 0x7f848c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f84ad0da640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f848c0668d0 0x7f848c068d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f84a40ad000 tx=0x7f84a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f84ad8db640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7f848c06c7d0 0x7f848c06ebf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.099+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== osd.1 v2:172.21.15.89:6822/1573279697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f848c06f2a0 con 0x7f848c06c7d0 2023-12-07T10:02:50.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 --> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84a80c0890 con 0x7f848c06c7d0 2023-12-07T10:02:50.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f849dffb640 1 -- 172.21.15.89:0/2511260627 <== osd.1 v2:172.21.15.89:6822/1573279697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f84a00070e0 con 0x7f848c06c7d0 2023-12-07T10:02:50.118 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:50.118 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:50.118 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:50.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7f848c06c7d0 msgr2=0x7f848c06ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6822/1573279697,v1:172.21.15.89:6824/1573279697] conn(0x7f848c06c7d0 0x7f848c06ebf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f848c0668d0 msgr2=0x7f848c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f848c0668d0 0x7f848c068d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f84a40ad000 tx=0x7f84a4008040 comp rx=0 tx=0).stop 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a81562e0 msgr2=0x7f84a813e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.111+0000 7f84af33e640 1 --2- 172.21.15.89:0/2511260627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a81562e0 0x7f84a813e4e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f849800e870 tx=0x7f849800ec70 comp rx=0 tx=0).stop 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.115+0000 7f84ad8db640 1 -- 172.21.15.89:0/2511260627 reap_dead start 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.115+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 shutdown_connections 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.115+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 >> 172.21.15.89:0/2511260627 conn(0x7f84a806a5a0 msgr2=0x7f84a815c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.115+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 shutdown_connections 2023-12-07T10:02:50.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.115+0000 7f84af33e640 1 -- 172.21.15.89:0/2511260627 wait complete. 2023-12-07T10:02:50.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-07T10:02:50.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92af59e640 1 Processor -- start 2023-12-07T10:02:50.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92af59e640 1 -- start start 2023-12-07T10:02:50.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92af59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92b00ca620 0x7f92b00caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92af59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b006b7d0 con 0x7f92b00c4890 2023-12-07T10:02:50.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92af59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b0155160 con 0x7f92b00bd5a0 2023-12-07T10:02:50.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92af59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b006b180 con 0x7f92b00ca620 2023-12-07T10:02:50.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92ae59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92b00ca620 0x7f92b00caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92a5d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f92b00c4890 0x7f92b00c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48008/0 (socket says 172.21.15.89:48008) 2023-12-07T10:02:50.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92a5d9b640 1 -- 172.21.15.89:0/1808660321 learned_addr learned my addr 172.21.15.89:0/1808660321 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:50.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92ae59c640 1 -- 172.21.15.89:0/1808660321 >> v1:172.21.15.97:6789/0 conn(0x7f92b00bd5a0 legacy=0x7f92b00c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:50.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92ae59c640 1 -- 172.21.15.89:0/1808660321 >> v1:172.21.15.89:6789/0 conn(0x7f92b00c4890 legacy=0x7f92b00c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92ae59c640 1 -- 172.21.15.89:0/1808660321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b006b460 con 0x7f92b00ca620 2023-12-07T10:02:50.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.271+0000 7f92add9b640 1 -- 172.21.15.89:0/1808660321 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923971892 0 0) 0x7f92b006b7d0 con 0x7f92b00c4890 2023-12-07T10:02:50.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92ae59c640 1 --2- 172.21.15.89:0/1808660321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00ca620 0x7f92b00caa00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f92a00097c0 tx=0x7f92a001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9a97371e144056 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92add9b640 1 -- 172.21.15.89:0/1808660321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a47b0 con 0x7f92b00ca620 2023-12-07T10:02:50.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92add9b640 1 -- 172.21.15.89:0/1808660321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b00c9da0 con 0x7f92b00ca620 2023-12-07T10:02:50.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92add9b640 1 -- 172.21.15.89:0/1808660321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a4b30 con 0x7f92b00ca620 2023-12-07T10:02:50.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 -- 172.21.15.89:0/1808660321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00ca620 msgr2=0x7f92b00caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 --2- 172.21.15.89:0/1808660321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00ca620 0x7f92b00caa00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f92a00097c0 tx=0x7f92a001c000 comp rx=0 tx=0).stop 2023-12-07T10:02:50.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 -- 172.21.15.89:0/1808660321 shutdown_connections 2023-12-07T10:02:50.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 --2- 172.21.15.89:0/1808660321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00ca620 0x7f92b00caa00 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 -- 172.21.15.89:0/1808660321 >> 172.21.15.89:0/1808660321 conn(0x7f92b00ac0a0 msgr2=0x7f92b00c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 -- 172.21.15.89:0/1808660321 shutdown_connections 2023-12-07T10:02:50.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.275+0000 7f92af59e640 1 -- 172.21.15.89:0/1808660321 wait complete. 2023-12-07T10:02:50.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 Processor -- start 2023-12-07T10:02:50.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- start start 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92b00bd5a0 0x7f92b01edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 0x7f92b014cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92b00ca620 0x7f92b00c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0158b40 con 0x7f92b00c4890 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00bef00 con 0x7f92b00bd5a0 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0151400 con 0x7f92b00ca620 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 0x7f92b014cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 0x7f92b014cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58568/0 (socket says 172.21.15.89:58568) 2023-12-07T10:02:50.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 -- 172.21.15.89:0/2221623373 learned_addr learned my addr 172.21.15.89:0/2221623373 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92ae59c640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92b00bd5a0 0x7f92b01edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92aed9d640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92b00ca620 0x7f92b00c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 -- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92b00ca620 msgr2=0x7f92b00c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92b00ca620 0x7f92b00c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 -- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92b00bd5a0 msgr2=0x7f92b01edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92b00bd5a0 0x7f92b01edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 -- 172.21.15.89:0/2221623373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0009420 con 0x7f92b00c4890 2023-12-07T10:02:50.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92aed9d640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92b00ca620 0x7f92b00c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a5d9b640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 0x7f92b014cd00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f929800c450 tx=0x7f929800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980074e0 con 0x7f92b00c4890 2023-12-07T10:02:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9298007640 con 0x7f92b00c4890 2023-12-07T10:02:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00bdc10 con 0x7f92b00c4890 2023-12-07T10:02:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980049f0 con 0x7f92b00c4890 2023-12-07T10:02:50.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b00be1d0 con 0x7f92b00c4890 2023-12-07T10:02:50.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.279+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b00becd0 con 0x7f92b00c4890 2023-12-07T10:02:50.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.283+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9298004b50 con 0x7f92b00c4890 2023-12-07T10:02:50.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.283+0000 7f92a77fe640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9290066900 0x7f9290068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.283+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9298083650 con 0x7f92b00c4890 2023-12-07T10:02:50.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.283+0000 7f92ae59c640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9290066900 0x7f9290068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.283+0000 7f92ae59c640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9290066900 0x7f9290068dc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f92a00ae000 tx=0x7f92a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.287+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92b00becd0 con 0x7f92b00c4890 2023-12-07T10:02:50.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.439+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f92b00becd0 con 0x7f9290066900 2023-12-07T10:02:50.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.439+0000 7f92a77fe640 1 -- 172.21.15.89:0/2221623373 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92b00becd0 con 0x7f9290066900 2023-12-07T10:02:50.446 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9290066900 msgr2=0x7f9290068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9290066900 0x7f9290068dc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f92a00ae000 tx=0x7f92a0008040 comp rx=0 tx=0).stop 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 msgr2=0x7f92b014cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 0x7f92b014cd00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f929800c450 tx=0x7f929800c910 comp rx=0 tx=0).stop 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 shutdown_connections 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f9290066900 0x7f9290068dc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f92b00ca620 0x7f92b00c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92b00c4890 0x7f92b014cd00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 --2- 172.21.15.89:0/2221623373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f92b00bd5a0 0x7f92b01edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 >> 172.21.15.89:0/2221623373 conn(0x7f92b00ac0a0 msgr2=0x7f92b0153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 shutdown_connections 2023-12-07T10:02:50.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.443+0000 7f92af59e640 1 -- 172.21.15.89:0/2221623373 wait complete. 2023-12-07T10:02:50.467 INFO:tasks.ceph:Scrubbing osd.2 2023-12-07T10:02:50.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:50.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 Processor -- start 2023-12-07T10:02:50.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 -- start start 2023-12-07T10:02:50.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f00d40abde0 0x7f00d40c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00d41545a0 0x7f00d41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d414e770 con 0x7f00d414e390 2023-12-07T10:02:50.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d406b2e0 con 0x7f00d41545a0 2023-12-07T10:02:50.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d931d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d41518d0 con 0x7f00d40abde0 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00d41545a0 0x7f00d41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00d41545a0 0x7f00d41549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58578/0 (socket says 172.21.15.89:58578) 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00d37fe640 1 -- 172.21.15.89:0/3943917564 learned_addr learned my addr 172.21.15.89:0/3943917564 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.603+0000 7f00ca7fc640 1 --2- 172.21.15.89:0/3943917564 >> v2:172.21.15.97:3300/0 conn(0x7f00d40abde0 0x7f00d40c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d37fe640 1 -- 172.21.15.89:0/3943917564 >> v2:172.21.15.97:3300/0 conn(0x7f00d40abde0 msgr2=0x7f00d40c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d37fe640 1 --2- 172.21.15.89:0/3943917564 >> v2:172.21.15.97:3300/0 conn(0x7f00d40abde0 0x7f00d40c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d37fe640 1 -- 172.21.15.89:0/3943917564 >> v1:172.21.15.97:6789/0 conn(0x7f00d414e390 legacy=0x7f00d40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d37fe640 1 -- 172.21.15.89:0/3943917564 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4151bb0 con 0x7f00d41545a0 2023-12-07T10:02:50.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d37fe640 1 --2- 172.21.15.89:0/3943917564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d41549d0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f00d4071fc0 tx=0x7f00cc01d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e492b74b28b4d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d27fc640 1 -- 172.21.15.89:0/3943917564 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0ac620 con 0x7f00d41545a0 2023-12-07T10:02:50.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d27fc640 1 -- 172.21.15.89:0/3943917564 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0ac780 con 0x7f00d41545a0 2023-12-07T10:02:50.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d27fc640 1 -- 172.21.15.89:0/3943917564 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0acb10 con 0x7f00d41545a0 2023-12-07T10:02:50.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d931d640 1 -- 172.21.15.89:0/3943917564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 msgr2=0x7f00d41549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d931d640 1 --2- 172.21.15.89:0/3943917564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d41549d0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f00d4071fc0 tx=0x7f00cc01d580 comp rx=0 tx=0).stop 2023-12-07T10:02:50.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.607+0000 7f00d931d640 1 -- 172.21.15.89:0/3943917564 shutdown_connections 2023-12-07T10:02:50.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 --2- 172.21.15.89:0/3943917564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d41549d0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 --2- 172.21.15.89:0/3943917564 >> v2:172.21.15.97:3300/0 conn(0x7f00d40abde0 0x7f00d40c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- 172.21.15.89:0/3943917564 >> 172.21.15.89:0/3943917564 conn(0x7f00d406a5a0 msgr2=0x7f00d406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- 172.21.15.89:0/3943917564 shutdown_connections 2023-12-07T10:02:50.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- 172.21.15.89:0/3943917564 wait complete. 2023-12-07T10:02:50.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 Processor -- start 2023-12-07T10:02:50.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- start start 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d40abde0 0x7f00d40c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d414e390 0x7f00d4145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41509d0 con 0x7f00d41545a0 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c42a0 con 0x7f00d40abde0 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d931d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41528d0 con 0x7f00d414e390 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d414ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58590/0 (socket says 172.21.15.89:58590) 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 -- 172.21.15.89:0/741337203 learned_addr learned my addr 172.21.15.89:0/741337203 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d2ffd640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d40abde0 0x7f00d40c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00ca7fc640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d414e390 0x7f00d4145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 -- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d414e390 msgr2=0x7f00d4145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d414e390 0x7f00d4145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 -- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d40abde0 msgr2=0x7f00d40c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00d40abde0 0x7f00d40c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 -- 172.21.15.89:0/741337203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc0094d0 con 0x7f00d41545a0 2023-12-07T10:02:50.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00ca7fc640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f00d414e390 0x7f00d4145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:50.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00d37fe640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d414ef60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f00cc01a190 tx=0x7f00cc01a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.611+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0acd00 con 0x7f00d41545a0 2023-12-07T10:02:50.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0ace60 con 0x7f00d41545a0 2023-12-07T10:02:50.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4152bb0 con 0x7f00d41545a0 2023-12-07T10:02:50.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b5640 con 0x7f00d41545a0 2023-12-07T10:02:50.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d4150660 con 0x7f00d41545a0 2023-12-07T10:02:50.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00d415d740 con 0x7f00d41545a0 2023-12-07T10:02:50.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f00cc0b57a0 con 0x7f00d41545a0 2023-12-07T10:02:50.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f00b40668d0 0x7f00b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f00cc11e5d0 con 0x7f00d41545a0 2023-12-07T10:02:50.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00d2ffd640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f00b40668d0 0x7f00b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f00b406c7d0 0x7f00b406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 --> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00b406f2a0 con 0x7f00b406c7d0 2023-12-07T10:02:50.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00cc11e940 con 0x7f00d41545a0 2023-12-07T10:02:50.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00ca7fc640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f00b406c7d0 0x7f00b406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00d2ffd640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f00b40668d0 0x7f00b4068d90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f00c40012f0 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.615+0000 7f00ca7fc640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f00b406c7d0 0x7f00b406ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.619+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== osd.2 v2:172.21.15.89:6816/746240021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f00b406f2a0 con 0x7f00b406c7d0 2023-12-07T10:02:50.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 --> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00d4150b10 con 0x7f00b406c7d0 2023-12-07T10:02:50.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00cbfff640 1 -- 172.21.15.89:0/741337203 <== osd.2 v2:172.21.15.89:6816/746240021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00d4150b10 con 0x7f00b406c7d0 2023-12-07T10:02:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:50.636 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:50.636 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:50.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f00b406c7d0 msgr2=0x7f00b406ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6816/746240021,v1:172.21.15.89:6817/746240021] conn(0x7f00b406c7d0 0x7f00b406ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f00b40668d0 msgr2=0x7f00b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f00b40668d0 0x7f00b4068d90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f00c40012f0 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 msgr2=0x7f00d414ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 --2- 172.21.15.89:0/741337203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00d41545a0 0x7f00d414ef60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f00cc01a190 tx=0x7f00cc01a320 comp rx=0 tx=0).stop 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d37fe640 1 -- 172.21.15.89:0/741337203 reap_dead start 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 shutdown_connections 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 >> 172.21.15.89:0/741337203 conn(0x7f00d406a5a0 msgr2=0x7f00d4070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 shutdown_connections 2023-12-07T10:02:50.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.631+0000 7f00d931d640 1 -- 172.21.15.89:0/741337203 wait complete. 2023-12-07T10:02:50.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-07T10:02:50.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.787+0000 7f4bb7d1d640 1 Processor -- start 2023-12-07T10:02:50.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb7d1d640 1 -- start start 2023-12-07T10:02:50.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb7d1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4bb014fcc0 0x7f4bb0156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb7d1d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00ab580 con 0x7f4bb006d980 2023-12-07T10:02:50.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb7d1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb0152fe0 con 0x7f4bb00c19e0 2023-12-07T10:02:50.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb7d1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00aa340 con 0x7f4bb014fcc0 2023-12-07T10:02:50.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4bb006d980 0x7f4bb00aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48018/0 (socket says 172.21.15.89:48018) 2023-12-07T10:02:50.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 -- 172.21.15.89:0/2768854281 learned_addr learned my addr 172.21.15.89:0/2768854281 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:50.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb5ab9640 1 --2- 172.21.15.89:0/2768854281 >> v2:172.21.15.97:3300/0 conn(0x7f4bb014fcc0 0x7f4bb0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818184283 0 0) 0x7f4bb00ab580 con 0x7f4bb006d980 2023-12-07T10:02:50.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b9c003530 con 0x7f4bb006d980 2023-12-07T10:02:50.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2558119412 0 0) 0x7f4b9c003530 con 0x7f4bb006d980 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 >> v2:172.21.15.97:3300/0 conn(0x7f4bb014fcc0 msgr2=0x7f4bb0156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 --2- 172.21.15.89:0/2768854281 >> v2:172.21.15.97:3300/0 conn(0x7f4bb014fcc0 0x7f4bb0156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 >> v1:172.21.15.97:6789/0 conn(0x7f4bb00c19e0 legacy=0x7f4bb00c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb01532c0 con 0x7f4bb006d980 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f4ba0001680 con 0x7f4bb006d980 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 >> v1:172.21.15.89:6789/0 conn(0x7f4bb006d980 legacy=0x7f4bb00aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c003980 0x7f4b9c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b9c0047d0 0x7f4b9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c005190 0x7f4b9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00bfb0 con 0x7f4b9c0047d0 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00c120 con 0x7f4b9c005190 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00c2e0 con 0x7f4b9c003980 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b9c0047d0 0x7f4b9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb62ba640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c005190 0x7f4b9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb5ab9640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c003980 0x7f4b9c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 -- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c003980 msgr2=0x7f4b9c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c003980 0x7f4b9c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 -- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c005190 msgr2=0x7f4b9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:50.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b9c005190 0x7f4b9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb52b8640 1 -- 172.21.15.89:0/2768854281 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c003530 con 0x7f4b9c0047d0 2023-12-07T10:02:50.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.791+0000 7f4bb62ba640 1 -- 172.21.15.89:0/2768854281 reap_dead start 2023-12-07T10:02:50.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb52b8640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b9c0047d0 0x7f4b9c004c50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c190 tx=0x7f4ba001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc8850324079baa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0005ae0 con 0x7f4b9c0047d0 2023-12-07T10:02:50.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0005c40 con 0x7f4b9c0047d0 2023-12-07T10:02:50.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb4ab7640 1 -- 172.21.15.89:0/2768854281 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00a5840 con 0x7f4b9c0047d0 2023-12-07T10:02:50.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/2768854281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b9c0047d0 msgr2=0x7f4b9c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b9c0047d0 0x7f4b9c004c50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c190 tx=0x7f4ba001cbd0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/2768854281 shutdown_connections 2023-12-07T10:02:50.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/2768854281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b9c0047d0 0x7f4b9c004c50 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/2768854281 >> 172.21.15.89:0/2768854281 conn(0x7f4bb00c2ad0 msgr2=0x7f4bb00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/2768854281 shutdown_connections 2023-12-07T10:02:50.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.795+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/2768854281 wait complete. 2023-12-07T10:02:50.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 Processor -- start 2023-12-07T10:02:50.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- start start 2023-12-07T10:02:50.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c0047d0 0x7f4bb0150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb014d820 0x7f4bb0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 0x7f4bb01522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01ed690 con 0x7f4bb011f150 2023-12-07T10:02:50.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01ed970 con 0x7f4bb014d820 2023-12-07T10:02:50.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0151290 con 0x7f4b9c0047d0 2023-12-07T10:02:50.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 0x7f4bb01522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 0x7f4bb01522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58608/0 (socket says 172.21.15.89:58608) 2023-12-07T10:02:50.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 -- 172.21.15.89:0/83404404 learned_addr learned my addr 172.21.15.89:0/83404404 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:50.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb5ab9640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c0047d0 0x7f4bb0150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb52b8640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb014d820 0x7f4bb0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 -- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c0047d0 msgr2=0x7f4bb0150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c0047d0 0x7f4bb0150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 -- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb014d820 msgr2=0x7f4bb0151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb014d820 0x7f4bb0151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 -- 172.21.15.89:0/83404404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb0151570 con 0x7f4bb011f150 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb52b8640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb014d820 0x7f4bb0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb62ba640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 0x7f4bb01522b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00c3a10 tx=0x7f4ba800feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8006d70 con 0x7f4bb011f150 2023-12-07T10:02:50.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8003980 con 0x7f4bb011f150 2023-12-07T10:02:50.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8003cf0 con 0x7f4bb011f150 2023-12-07T10:02:50.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb0151850 con 0x7f4bb011f150 2023-12-07T10:02:50.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb006c800 con 0x7f4bb011f150 2023-12-07T10:02:50.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.799+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0151a40 con 0x7f4bb011f150 2023-12-07T10:02:50.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.803+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4ba80050d0 con 0x7f4bb011f150 2023-12-07T10:02:50.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.803+0000 7f4ba67fc640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b94066900 0x7f4b94068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:50.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.803+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4ba80835f0 con 0x7f4bb011f150 2023-12-07T10:02:50.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.803+0000 7f4bb5ab9640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b94066900 0x7f4b94068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:50.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.803+0000 7f4bb5ab9640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b94066900 0x7f4b94068dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4bb014b6e0 tx=0x7f4bac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:50.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.807+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ba8050a40 con 0x7f4bb011f150 2023-12-07T10:02:50.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.955+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb01edae0 con 0x7f4b94066900 2023-12-07T10:02:50.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.955+0000 7f4ba67fc640 1 -- 172.21.15.89:0/83404404 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4bb01edae0 con 0x7f4b94066900 2023-12-07T10:02:50.961 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.955+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b94066900 msgr2=0x7f4b94068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b94066900 0x7f4b94068dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4bb014b6e0 tx=0x7f4bac009190 comp rx=0 tx=0).stop 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 msgr2=0x7f4bb01522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 0x7f4bb01522b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00c3a10 tx=0x7f4ba800feb0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 shutdown_connections 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb011f150 0x7f4bb01522b0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb014d820 0x7f4bb0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f4b94066900 0x7f4b94068dc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 --2- 172.21.15.89:0/83404404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4b9c0047d0 0x7f4bb0150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:50.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 >> 172.21.15.89:0/83404404 conn(0x7f4bb00c2ad0 msgr2=0x7f4bb01544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:50.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 shutdown_connections 2023-12-07T10:02:50.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:50.959+0000 7f4bb7d1d640 1 -- 172.21.15.89:0/83404404 wait complete. 2023-12-07T10:02:50.981 INFO:tasks.ceph:Scrubbing osd.3 2023-12-07T10:02:50.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:51.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 Processor -- start 2023-12-07T10:02:51.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 -- start start 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f146c155f00 0x7f146c0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f146c1562e0 0x7f146c06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c156770 0x7f146c0c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c0abb60 con 0x7f146c1562e0 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c06c7a0 con 0x7f146c155f00 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1472957640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0abdb0 con 0x7f146c156770 2023-12-07T10:02:51.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f146c1562e0 0x7f146c06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f146c1562e0 0x7f146c06cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58620/0 (socket says 172.21.15.89:58620) 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 -- 172.21.15.89:0/4183482638 learned_addr learned my addr 172.21.15.89:0/4183482638 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146bfff640 1 --2- 172.21.15.89:0/4183482638 >> v2:172.21.15.97:3300/0 conn(0x7f146c155f00 0x7f146c0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f1470ef4640 1 --2- 172.21.15.89:0/4183482638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c156770 0x7f146c0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 -- 172.21.15.89:0/4183482638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c156770 msgr2=0x7f146c0c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 --2- 172.21.15.89:0/4183482638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c156770 0x7f146c0c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 -- 172.21.15.89:0/4183482638 >> v2:172.21.15.97:3300/0 conn(0x7f146c155f00 msgr2=0x7f146c0a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 --2- 172.21.15.89:0/4183482638 >> v2:172.21.15.97:3300/0 conn(0x7f146c155f00 0x7f146c0a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.119+0000 7f146b7fe640 1 -- 172.21.15.89:0/4183482638 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c0ac090 con 0x7f146c1562e0 2023-12-07T10:02:51.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f146b7fe640 1 --2- 172.21.15.89:0/4183482638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c1562e0 0x7f146c06cf10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1460009870 tx=0x7f146001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5440b4d7f7402b75 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f146affd640 1 -- 172.21.15.89:0/4183482638 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600ab600 con 0x7f146c1562e0 2023-12-07T10:02:51.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f146affd640 1 -- 172.21.15.89:0/4183482638 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14600a7050 con 0x7f146c1562e0 2023-12-07T10:02:51.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f146affd640 1 -- 172.21.15.89:0/4183482638 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600ab980 con 0x7f146c1562e0 2023-12-07T10:02:51.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 -- 172.21.15.89:0/4183482638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c1562e0 msgr2=0x7f146c06cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 --2- 172.21.15.89:0/4183482638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c1562e0 0x7f146c06cf10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1460009870 tx=0x7f146001c470 comp rx=0 tx=0).stop 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 -- 172.21.15.89:0/4183482638 shutdown_connections 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 --2- 172.21.15.89:0/4183482638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c156770 0x7f146c0c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 --2- 172.21.15.89:0/4183482638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c1562e0 0x7f146c06cf10 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 --2- 172.21.15.89:0/4183482638 >> v2:172.21.15.97:3300/0 conn(0x7f146c155f00 0x7f146c0a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 -- 172.21.15.89:0/4183482638 >> 172.21.15.89:0/4183482638 conn(0x7f146c06a5a0 msgr2=0x7f146c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 -- 172.21.15.89:0/4183482638 shutdown_connections 2023-12-07T10:02:51.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.123+0000 7f1472957640 1 -- 172.21.15.89:0/4183482638 wait complete. 2023-12-07T10:02:51.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 Processor -- start 2023-12-07T10:02:51.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- start start 2023-12-07T10:02:51.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c155f00 0x7f146c14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c1562e0 0x7f146c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f146c156770 0x7f146c1f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c1f0590 con 0x7f146c155f00 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c14c510 con 0x7f146c156770 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c1f0800 con 0x7f146c1562e0 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c155f00 0x7f146c14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c155f00 0x7f146c14d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58632/0 (socket says 172.21.15.89:58632) 2023-12-07T10:02:51.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 -- 172.21.15.89:0/3903106127 learned_addr learned my addr 172.21.15.89:0/3903106127 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1470ef4640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f146c156770 0x7f146c1f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146b7fe640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c1562e0 0x7f146c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 -- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c1562e0 msgr2=0x7f146c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f146c1562e0 0x7f146c14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 -- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f146c156770 msgr2=0x7f146c1f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f146c156770 0x7f146c1f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 -- 172.21.15.89:0/3903106127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600094d0 con 0x7f146c155f00 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1470ef4640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f146c156770 0x7f146c1f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:51.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f146bfff640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c155f00 0x7f146c14d5d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f145c00e8b0 tx=0x7f145c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00c940 con 0x7f146c155f00 2023-12-07T10:02:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c00caa0 con 0x7f146c155f00 2023-12-07T10:02:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00ce30 con 0x7f146c155f00 2023-12-07T10:02:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c14f830 con 0x7f146c155f00 2023-12-07T10:02:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c14fdb0 con 0x7f146c155f00 2023-12-07T10:02:51.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.127+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f146c0aa690 con 0x7f146c155f00 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f145c013470 con 0x7f146c155f00 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f14580668d0 0x7f1458068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f145c084710 con 0x7f146c155f00 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f146b7fe640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f14580668d0 0x7f1458068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7f145806c7d0 0x7f145806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 --> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f145806f2a0 con 0x7f145806c7d0 2023-12-07T10:02:51.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f145c086cf0 con 0x7f146c155f00 2023-12-07T10:02:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1470ef4640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7f145806c7d0 0x7f145806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f146b7fe640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f14580668d0 0x7f1458068d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f14600ad000 tx=0x7f1460008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1470ef4640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7f145806c7d0 0x7f145806ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.131+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== osd.3 v2:172.21.15.89:6808/2109259736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f145806f2a0 con 0x7f145806c7d0 2023-12-07T10:02:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 --> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f146c0a9df0 con 0x7f145806c7d0 2023-12-07T10:02:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1468ff9640 1 -- 172.21.15.89:0/3903106127 <== osd.3 v2:172.21.15.89:6808/2109259736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f146c0a9df0 con 0x7f145806c7d0 2023-12-07T10:02:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:51.152 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7f145806c7d0 msgr2=0x7f145806ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6808/2109259736,v1:172.21.15.89:6809/2109259736] conn(0x7f145806c7d0 0x7f145806ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f14580668d0 msgr2=0x7f1458068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f14580668d0 0x7f1458068d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f14600ad000 tx=0x7f1460008040 comp rx=0 tx=0).stop 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c155f00 msgr2=0x7f146c14d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 --2- 172.21.15.89:0/3903106127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f146c155f00 0x7f146c14d5d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f145c00e8b0 tx=0x7f145c00ed70 comp rx=0 tx=0).stop 2023-12-07T10:02:51.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1470ef4640 1 -- 172.21.15.89:0/3903106127 reap_dead start 2023-12-07T10:02:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 shutdown_connections 2023-12-07T10:02:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 >> 172.21.15.89:0/3903106127 conn(0x7f146c06a5a0 msgr2=0x7f146c06d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 shutdown_connections 2023-12-07T10:02:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.147+0000 7f1472957640 1 -- 172.21.15.89:0/3903106127 wait complete. 2023-12-07T10:02:51.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-07T10:02:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057c508640 1 Processor -- start 2023-12-07T10:02:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057c508640 1 -- start start 2023-12-07T10:02:51.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057c508640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057c508640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057406d320 con 0x7f0574070b80 2023-12-07T10:02:51.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057c508640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05740721b0 con 0x7f05740a8470 2023-12-07T10:02:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057c508640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c2830 con 0x7f057414e9d0 2023-12-07T10:02:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f0579aa3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0574070b80 0x7f05740c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48034/0 (socket says 172.21.15.89:48034) 2023-12-07T10:02:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f0579aa3640 1 -- 172.21.15.89:0/2573571909 learned_addr learned my addr 172.21.15.89:0/2573571909 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f057a2a4640 1 --2- 172.21.15.89:0/2573571909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.303+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922519504 0 0) 0x7f057406d320 con 0x7f0574070b80 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0560003530 con 0x7f0574070b80 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 <== mon.1 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234345724 0 0) 0x7f05740721b0 con 0x7f05740a8470 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057406d320 con 0x7f05740a8470 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f057a2a4640 1 -- 172.21.15.89:0/2573571909 >> v1:172.21.15.97:6789/0 conn(0x7f05740a8470 legacy=0x7f057406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f057a2a4640 1 -- 172.21.15.89:0/2573571909 >> v1:172.21.15.89:6789/0 conn(0x7f0574070b80 legacy=0x7f05740c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f057a2a4640 1 -- 172.21.15.89:0/2573571909 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574072450 con 0x7f057414e9d0 2023-12-07T10:02:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f057a2a4640 1 --2- 172.21.15.89:0/2573571909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574151e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05700097f0 tx=0x7f057001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b3a155457cc3c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 <== mon.2 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700ab600 con 0x7f057414e9d0 2023-12-07T10:02:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 <== mon.2 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05700a7050 con 0x7f057414e9d0 2023-12-07T10:02:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.307+0000 7f05792a2640 1 -- 172.21.15.89:0/2573571909 <== mon.2 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700ab980 con 0x7f057414e9d0 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- 172.21.15.89:0/2573571909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 msgr2=0x7f0574151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 --2- 172.21.15.89:0/2573571909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574151e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05700097f0 tx=0x7f057001c430 comp rx=0 tx=0).stop 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- 172.21.15.89:0/2573571909 shutdown_connections 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 --2- 172.21.15.89:0/2573571909 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574151e60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- 172.21.15.89:0/2573571909 >> 172.21.15.89:0/2573571909 conn(0x7f05740c2ad0 msgr2=0x7f05740c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- 172.21.15.89:0/2573571909 shutdown_connections 2023-12-07T10:02:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- 172.21.15.89:0/2573571909 wait complete. 2023-12-07T10:02:51.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 Processor -- start 2023-12-07T10:02:51.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- start start 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0574070b80 0x7f0574151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 0x7f0574141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0574150130 con 0x7f05740a8470 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057414fc40 con 0x7f0574070b80 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057c508640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c40d0 con 0x7f057414e9d0 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 0x7f0574141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 0x7f0574141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58648/0 (socket says 172.21.15.89:58648) 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 -- 172.21.15.89:0/1428502228 learned_addr learned my addr 172.21.15.89:0/1428502228 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057aaa5640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f057a2a4640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0574070b80 0x7f0574151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 -- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 msgr2=0x7f0574141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 -- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0574070b80 msgr2=0x7f0574151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0574070b80 0x7f0574151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 -- 172.21.15.89:0/1428502228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009420 con 0x7f05740a8470 2023-12-07T10:02:51.319 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f0579aa3640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 0x7f0574141830 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0564005890 tx=0x7f056400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564005cf0 con 0x7f05740a8470 2023-12-07T10:02:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564005e50 con 0x7f05740a8470 2023-12-07T10:02:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.311+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640072b0 con 0x7f05740a8470 2023-12-07T10:02:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057414fe50 con 0x7f05740a8470 2023-12-07T10:02:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05741422b0 con 0x7f05740a8470 2023-12-07T10:02:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0574067a40 con 0x7f05740a8470 2023-12-07T10:02:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0564007410 con 0x7f05740a8470 2023-12-07T10:02:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f056affd640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f05580668d0 0x7f0558068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f05640837f0 con 0x7f05740a8470 2023-12-07T10:02:51.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.315+0000 7f057a2a4640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f05580668d0 0x7f0558068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.319+0000 7f057a2a4640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f05580668d0 0x7f0558068d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f057406e350 tx=0x7f05700a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.319+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0564050c30 con 0x7f05740a8470 2023-12-07T10:02:51.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f05740c3bc0 con 0x7f05580668d0 2023-12-07T10:02:51.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f056affd640 1 -- 172.21.15.89:0/1428502228 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05740c3bc0 con 0x7f05580668d0 2023-12-07T10:02:51.476 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2023-12-07T10:02:51.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f05580668d0 msgr2=0x7f0558068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f05580668d0 0x7f0558068d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f057406e350 tx=0x7f05700a6000 comp rx=0 tx=0).stop 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 msgr2=0x7f0574141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 0x7f0574141830 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0564005890 tx=0x7f056400c960 comp rx=0 tx=0).stop 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 shutdown_connections 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f05580668d0 0x7f0558068d90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f057414e9d0 0x7f0574141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05740a8470 0x7f0574141830 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 --2- 172.21.15.89:0/1428502228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0574070b80 0x7f0574151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 >> 172.21.15.89:0/1428502228 conn(0x7f05740c2ad0 msgr2=0x7f05740bfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 shutdown_connections 2023-12-07T10:02:51.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.471+0000 7f057c508640 1 -- 172.21.15.89:0/1428502228 wait complete. 2023-12-07T10:02:51.496 INFO:tasks.ceph:Scrubbing osd.4 2023-12-07T10:02:51.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:51.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 Processor -- start 2023-12-07T10:02:51.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 -- start start 2023-12-07T10:02:51.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe580c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe5806db60 0x7fbe580c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5806e2d0 con 0x7fbe580c0d30 2023-12-07T10:02:51.641 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe580c5de0 con 0x7fbe5806db60 2023-12-07T10:02:51.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5fe17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580a63d0 con 0x7fbe580a5ff0 2023-12-07T10:02:51.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5d3b2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbe580c0d30 0x7fbe580c4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48036/0 (socket says 172.21.15.89:48036) 2023-12-07T10:02:51.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5d3b2640 1 -- 172.21.15.89:0/2016143183 learned_addr learned my addr 172.21.15.89:0/2016143183 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:51.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5dbb3640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe580c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2016143183 >> v2:172.21.15.97:3300/0 conn(0x7fbe5806db60 0x7fbe580c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709750267 0 0) 0x7fbe5806e2d0 con 0x7fbe580c0d30 2023-12-07T10:02:51.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe44003530 con 0x7fbe580c0d30 2023-12-07T10:02:51.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1351846747 0 0) 0x7fbe44003530 con 0x7fbe580c0d30 2023-12-07T10:02:51.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 msgr2=0x7fbe580c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.635+0000 7fbe5cbb1640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe580c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 >> v2:172.21.15.97:3300/0 conn(0x7fbe5806db60 msgr2=0x7fbe580c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 --2- 172.21.15.89:0/2016143183 >> v2:172.21.15.97:3300/0 conn(0x7fbe5806db60 0x7fbe580c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580c6050 con 0x7fbe580c0d30 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7fbe48001680 con 0x7fbe580c0d30 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5dbb3640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe580c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2016143183 >> v2:172.21.15.97:3300/0 conn(0x7fbe5806db60 0x7fbe580c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 >> v1:172.21.15.89:6789/0 conn(0x7fbe580c0d30 legacy=0x7fbe580c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe44003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe44003ec0 0x7fbe440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe44004d10 0x7fbe44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580c5de0 con 0x7fbe44004d10 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580a63d0 con 0x7fbe44003ec0 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4400b990 con 0x7fbe580a5ff0 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe44004d10 0x7fbe44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5dbb3640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe44003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5d3b2640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe44003ec0 0x7fbe440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 msgr2=0x7fbe44003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe580a5ff0 0x7fbe44003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe44003ec0 msgr2=0x7fbe440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe44003ec0 0x7fbe440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.647 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2016143183 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5400a5c0 con 0x7fbe44004d10 2023-12-07T10:02:51.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.639+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe44004d10 0x7fbe44005190 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbe50010700 tx=0x7fbe5001f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881955e7ce4aa290 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500ab6c0 con 0x7fbe44004d10 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe500ab820 con 0x7fbe44004d10 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5cbb1640 1 -- 172.21.15.89:0/2016143183 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500abc10 con 0x7fbe44004d10 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2016143183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe44004d10 msgr2=0x7fbe44005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 --2- 172.21.15.89:0/2016143183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe44004d10 0x7fbe44005190 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbe50010700 tx=0x7fbe5001f590 comp rx=0 tx=0).stop 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2016143183 reap_dead start 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2016143183 shutdown_connections 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2016143183 >> 172.21.15.89:0/2016143183 conn(0x7fbe580a8640 msgr2=0x7fbe580a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2016143183 shutdown_connections 2023-12-07T10:02:51.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2016143183 wait complete. 2023-12-07T10:02:51.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 Processor -- start 2023-12-07T10:02:51.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- start start 2023-12-07T10:02:51.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe44004d10 0x7fbe581e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe5814e010 0x7fbe580bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5814f0e0 0x7fbe5814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5814fad0 con 0x7fbe5814f0e0 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5814ec50 con 0x7fbe5814e010 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5fe17640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe581e9fb0 con 0x7fbe44004d10 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5e3b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5814f0e0 0x7fbe5814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5e3b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5814f0e0 0x7fbe5814f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58674/0 (socket says 172.21.15.89:58674) 2023-12-07T10:02:51.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.643+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2250466249 learned_addr learned my addr 172.21.15.89:0/2250466249 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5dbb3640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe44004d10 0x7fbe581e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5d3b2640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe5814e010 0x7fbe580bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe44004d10 msgr2=0x7fbe581e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbe44004d10 0x7fbe581e9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe5814e010 msgr2=0x7fbe580bff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe5814e010 0x7fbe580bff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2250466249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe581ea250 con 0x7fbe5814f0e0 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5e3b4640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5814f0e0 0x7fbe5814f590 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fbe50002240 tx=0x7fbe50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50009470 con 0x7fbe5814f0e0 2023-12-07T10:02:51.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000e140 con 0x7fbe5814f0e0 2023-12-07T10:02:51.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500abdc0 con 0x7fbe5814f0e0 2023-12-07T10:02:51.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe581ea530 con 0x7fbe5814f0e0 2023-12-07T10:02:51.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe580c0460 con 0x7fbe5814f0e0 2023-12-07T10:02:51.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe5814ea40 con 0x7fbe5814f0e0 2023-12-07T10:02:51.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbe500b33f0 con 0x7fbe5814f0e0 2023-12-07T10:02:51.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe4e7fc640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe3c066900 0x7fbe3c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbe5011f4b0 con 0x7fbe5814f0e0 2023-12-07T10:02:51.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.647+0000 7fbe5dbb3640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe3c066900 0x7fbe3c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe4e7fc640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fbe3c06c800 0x7fbe3c06ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 --> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe3c06f2d0 con 0x7fbe3c06c800 2023-12-07T10:02:51.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe5011f820 con 0x7fbe5814f0e0 2023-12-07T10:02:51.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe5d3b2640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fbe3c06c800 0x7fbe3c06ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe5dbb3640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe3c066900 0x7fbe3c068dc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400adb0 tx=0x7fbe54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe5d3b2640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fbe3c06c800 0x7fbe3c06ec20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.651+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== osd.4 v2:172.21.15.97:6816/811237390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbe3c06f2d0 con 0x7fbe3c06c800 2023-12-07T10:02:51.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.663+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 --> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe5814fad0 con 0x7fbe3c06c800 2023-12-07T10:02:51.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.663+0000 7fbe4e7fc640 1 -- 172.21.15.89:0/2250466249 <== osd.4 v2:172.21.15.97:6816/811237390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbe5814fad0 con 0x7fbe3c06c800 2023-12-07T10:02:51.672 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:51.673 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fbe3c06c800 msgr2=0x7fbe3c06ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.97:6816/811237390,v1:172.21.15.97:6817/811237390] conn(0x7fbe3c06c800 0x7fbe3c06ec20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe3c066900 msgr2=0x7fbe3c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fbe3c066900 0x7fbe3c068dc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400adb0 tx=0x7fbe54008040 comp rx=0 tx=0).stop 2023-12-07T10:02:51.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5814f0e0 msgr2=0x7fbe5814f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 --2- 172.21.15.89:0/2250466249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5814f0e0 0x7fbe5814f590 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fbe50002240 tx=0x7fbe50009750 comp rx=0 tx=0).stop 2023-12-07T10:02:51.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5e3b4640 1 -- 172.21.15.89:0/2250466249 reap_dead start 2023-12-07T10:02:51.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 shutdown_connections 2023-12-07T10:02:51.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 >> 172.21.15.89:0/2250466249 conn(0x7fbe580a8640 msgr2=0x7fbe580a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 shutdown_connections 2023-12-07T10:02:51.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.667+0000 7fbe5fe17640 1 -- 172.21.15.89:0/2250466249 wait complete. 2023-12-07T10:02:51.688 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-07T10:02:51.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5da19df640 1 Processor -- start 2023-12-07T10:02:51.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5da19df640 1 -- start start 2023-12-07T10:02:51.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5da19df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d9c0c49e0 0x7f5d9c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5da19df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c0c5a30 con 0x7f5d9c151ee0 2023-12-07T10:02:51.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5da19df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c1522c0 con 0x7f5d9c0c6400 2023-12-07T10:02:51.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5da19df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c06bc70 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5d9affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5d9c151ee0 0x7f5d9c06b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48050/0 (socket says 172.21.15.89:48050) 2023-12-07T10:02:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5d927fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d9c0c49e0 0x7f5d9c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5d9affd640 1 -- 172.21.15.89:0/3172990622 learned_addr learned my addr 172.21.15.89:0/3172990622 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5d927fc640 1 -- 172.21.15.89:0/3172990622 >> v1:172.21.15.97:6789/0 conn(0x7f5d9c0c6400 legacy=0x7f5d9c15f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5d927fc640 1 -- 172.21.15.89:0/3172990622 >> v1:172.21.15.89:6789/0 conn(0x7f5d9c151ee0 legacy=0x7f5d9c06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.823+0000 7f5d927fc640 1 -- 172.21.15.89:0/3172990622 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c0c6890 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5d927fc640 1 --2- 172.21.15.89:0/3172990622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c5ec0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097c0 tx=0x7f5d8401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8f2fdb5ae4ff33 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5d9a7fc640 1 -- 172.21.15.89:0/3172990622 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840ad680 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5d9a7fc640 1 -- 172.21.15.89:0/3172990622 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840ad7e0 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5d9a7fc640 1 -- 172.21.15.89:0/3172990622 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840adb70 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 -- 172.21.15.89:0/3172990622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 msgr2=0x7f5d9c0c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 --2- 172.21.15.89:0/3172990622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c5ec0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097c0 tx=0x7f5d8401c380 comp rx=0 tx=0).stop 2023-12-07T10:02:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 -- 172.21.15.89:0/3172990622 shutdown_connections 2023-12-07T10:02:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 --2- 172.21.15.89:0/3172990622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c5ec0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 -- 172.21.15.89:0/3172990622 >> 172.21.15.89:0/3172990622 conn(0x7f5d9c0ca060 msgr2=0x7f5d9c0ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 -- 172.21.15.89:0/3172990622 shutdown_connections 2023-12-07T10:02:51.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 -- 172.21.15.89:0/3172990622 wait complete. 2023-12-07T10:02:51.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.827+0000 7f5da19df640 1 Processor -- start 2023-12-07T10:02:51.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- start start 2023-12-07T10:02:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5d9c0c6400 0x7f5d9c0c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5d9c151ee0 0x7f5d9c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0c2220 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c1edfa0 con 0x7f5d9c0c6400 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0c24c0 con 0x7f5d9c151ee0 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58694/0 (socket says 172.21.15.89:58694) 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 -- 172.21.15.89:0/409879508 learned_addr learned my addr 172.21.15.89:0/409879508 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d927fc640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5d9c0c6400 0x7f5d9c0c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9b7fe640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5d9c151ee0 0x7f5d9c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 -- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5d9c151ee0 msgr2=0x7f5d9c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5d9c151ee0 0x7f5d9c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 -- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5d9c0c6400 msgr2=0x7f5d9c0c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5d9c0c6400 0x7f5d9c0c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 -- 172.21.15.89:0/409879508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009420 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d927fc640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5d9c0c6400 0x7f5d9c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d9affd640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c2cc0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c400 tx=0x7f5d8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c005cf0 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c005e50 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0072d0 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c0c27a0 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c14dc00 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.831+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c067a40 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.835+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5d8c007430 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.835+0000 7f5d98ff9640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5d7c066900 0x7f5d7c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.835+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5d8c083600 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.835+0000 7f5d927fc640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5d7c066900 0x7f5d7c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.835+0000 7f5d927fc640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5d7c066900 0x7f5d7c068dc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d840af000 tx=0x7f5d84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.839+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d8c050ba0 con 0x7f5d9c0c49e0 2023-12-07T10:02:51.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.987+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d9c04e890 con 0x7f5d7c066900 2023-12-07T10:02:51.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.987+0000 7f5d98ff9640 1 -- 172.21.15.89:0/409879508 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5d9c04e890 con 0x7f5d7c066900 2023-12-07T10:02:51.994 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 4 to deep-scrub 2023-12-07T10:02:51.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5d7c066900 msgr2=0x7f5d7c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5d7c066900 0x7f5d7c068dc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d840af000 tx=0x7f5d84008040 comp rx=0 tx=0).stop 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 msgr2=0x7f5d9c0c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c2cc0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c400 tx=0x7f5d8c00c8c0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 shutdown_connections 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f5d7c066900 0x7f5d7c068dc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5d9c151ee0 0x7f5d9c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5d9c0c6400 0x7f5d9c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 --2- 172.21.15.89:0/409879508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0c49e0 0x7f5d9c0c2cc0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:51.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 >> 172.21.15.89:0/409879508 conn(0x7f5d9c0ca060 msgr2=0x7f5d9c14c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:51.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 shutdown_connections 2023-12-07T10:02:51.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:51.991+0000 7f5da19df640 1 -- 172.21.15.89:0/409879508 wait complete. 2023-12-07T10:02:52.014 INFO:tasks.ceph:Scrubbing osd.5 2023-12-07T10:02:52.015 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:52.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 Processor -- start 2023-12-07T10:02:52.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 -- start start 2023-12-07T10:02:52.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2c006b490 0x7fa2c0155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c0151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00c8020 con 0x7fa2c0151ea0 2023-12-07T10:02:52.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c01555b0 con 0x7fa2c006b490 2023-12-07T10:02:52.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2c4da1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c6f30 con 0x7fa2c00bd720 2023-12-07T10:02:52.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2c006b490 0x7fa2c0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2c006b490 0x7fa2c0155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58706/0 (socket says 172.21.15.89:58706) 2023-12-07T10:02:52.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 -- 172.21.15.89:0/3053327400 learned_addr learned my addr 172.21.15.89:0/3053327400 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 -- 172.21.15.89:0/3053327400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 msgr2=0x7fa2c0151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:52.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2b5d9b640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c0151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c0151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 -- 172.21.15.89:0/3053327400 >> v1:172.21.15.97:6789/0 conn(0x7fa2c0151ea0 legacy=0x7fa2c00c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:52.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2be59c640 1 -- 172.21.15.89:0/3053327400 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00c7210 con 0x7fa2c006b490 2023-12-07T10:02:52.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.151+0000 7fa2b5d9b640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c0151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:52.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2be59c640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c0155070 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009870 tx=0x7fa2b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdc705385348813 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2bdd9b640 1 -- 172.21.15.89:0/3053327400 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00ab600 con 0x7fa2c006b490 2023-12-07T10:02:52.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2bdd9b640 1 -- 172.21.15.89:0/3053327400 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b00a7050 con 0x7fa2c006b490 2023-12-07T10:02:52.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2bdd9b640 1 -- 172.21.15.89:0/3053327400 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00ab980 con 0x7fa2c006b490 2023-12-07T10:02:52.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 -- 172.21.15.89:0/3053327400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 msgr2=0x7fa2c0155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c0155070 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009870 tx=0x7fa2b001c470 comp rx=0 tx=0).stop 2023-12-07T10:02:52.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 -- 172.21.15.89:0/3053327400 shutdown_connections 2023-12-07T10:02:52.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c0151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 --2- 172.21.15.89:0/3053327400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c0155070 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 -- 172.21.15.89:0/3053327400 >> 172.21.15.89:0/3053327400 conn(0x7fa2c00abfc0 msgr2=0x7fa2c00ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 -- 172.21.15.89:0/3053327400 shutdown_connections 2023-12-07T10:02:52.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.155+0000 7fa2c4da1640 1 -- 172.21.15.89:0/3053327400 wait complete. 2023-12-07T10:02:52.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 Processor -- start 2023-12-07T10:02:52.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 -- start start 2023-12-07T10:02:52.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c01f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2c0151ea0 0x7fa2c014f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c01546c0 con 0x7fa2c006b490 2023-12-07T10:02:52.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0154100 con 0x7fa2c0151ea0 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c01543e0 con 0x7fa2c00bd720 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c01f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c01f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58720/0 (socket says 172.21.15.89:58720) 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 -- 172.21.15.89:0/760509970 learned_addr learned my addr 172.21.15.89:0/760509970 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2b5d9b640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2bed9d640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2c0151ea0 0x7fa2c014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 -- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 msgr2=0x7fa2c014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa2c00bd720 0x7fa2c014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 -- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2c0151ea0 msgr2=0x7fa2c014f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2c0151ea0 0x7fa2c014f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 -- 172.21.15.89:0/760509970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00094d0 con 0x7fa2c006b490 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2be59c640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c01f0520 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ae040 tx=0x7fa2b001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00b6620 con 0x7fa2c006b490 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b00b67a0 con 0x7fa2c006b490 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c014f000 con 0x7fa2c006b490 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00b6b50 con 0x7fa2c006b490 2023-12-07T10:02:52.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.159+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c014fa60 con 0x7fa2c006b490 2023-12-07T10:02:52.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2c0154270 con 0x7fa2c006b490 2023-12-07T10:02:52.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa2b00b2040 con 0x7fa2c006b490 2023-12-07T10:02:52.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b77fe640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2a00668d0 0x7fa2a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa2b011eb40 con 0x7fa2c006b490 2023-12-07T10:02:52.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b77fe640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7fa2a006c7d0 0x7fa2a006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 --> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2a006f2a0 con 0x7fa2a006c7d0 2023-12-07T10:02:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2b011eeb0 con 0x7fa2c006b490 2023-12-07T10:02:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b5d9b640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2a00668d0 0x7fa2a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2bed9d640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7fa2a006c7d0 0x7fa2a006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2b5d9b640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2a00668d0 0x7fa2a0068d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80075b0 tx=0x7fa2a8007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.163+0000 7fa2bed9d640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7fa2a006c7d0 0x7fa2a006ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.167+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== osd.5 v2:172.21.15.97:6802/3253961744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa2a006f2a0 con 0x7fa2a006c7d0 2023-12-07T10:02:52.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 --> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa2c0066360 con 0x7fa2a006c7d0 2023-12-07T10:02:52.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2b77fe640 1 -- 172.21.15.89:0/760509970 <== osd.5 v2:172.21.15.97:6802/3253961744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa2c0066360 con 0x7fa2a006c7d0 2023-12-07T10:02:52.184 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:52.185 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:52.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7fa2a006c7d0 msgr2=0x7fa2a006ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.97:6802/3253961744,v1:172.21.15.97:6804/3253961744] conn(0x7fa2a006c7d0 0x7fa2a006ebf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2a00668d0 msgr2=0x7fa2a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fa2a00668d0 0x7fa2a0068d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80075b0 tx=0x7fa2a8007540 comp rx=0 tx=0).stop 2023-12-07T10:02:52.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 msgr2=0x7fa2c01f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 --2- 172.21.15.89:0/760509970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2c006b490 0x7fa2c01f0520 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ae040 tx=0x7fa2b001acb0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2bed9d640 1 -- 172.21.15.89:0/760509970 reap_dead start 2023-12-07T10:02:52.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 shutdown_connections 2023-12-07T10:02:52.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 >> 172.21.15.89:0/760509970 conn(0x7fa2c00abfc0 msgr2=0x7fa2c01445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 shutdown_connections 2023-12-07T10:02:52.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.179+0000 7fa2c4da1640 1 -- 172.21.15.89:0/760509970 wait complete. 2023-12-07T10:02:52.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-07T10:02:52.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 Processor -- start 2023-12-07T10:02:52.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 -- start start 2023-12-07T10:02:52.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc30c0c2a50 0x7fc30c0c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c06b5b0 0x7fc30c06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0c2290 con 0x7fc30c14e4d0 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0c2e30 con 0x7fc30c0c2a50 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc3134aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c073c00 con 0x7fc30c06b5b0 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc30c0c2a50 0x7fc30c0c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc30c0c2a50 0x7fc30c0c19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58726/0 (socket says 172.21.15.89:58726) 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 -- 172.21.15.89:0/1806578867 learned_addr learned my addr 172.21.15.89:0/1806578867 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc310a45640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc30c14e4d0 0x7fc30c0734f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48062/0 (socket says 172.21.15.89:48062) 2023-12-07T10:02:52.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311a47640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c06b5b0 0x7fc30c06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 -- 172.21.15.89:0/1806578867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c06b5b0 msgr2=0x7fc30c06ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:52.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c06b5b0 0x7fc30c06ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 -- 172.21.15.89:0/1806578867 >> v1:172.21.15.89:6789/0 conn(0x7fc30c14e4d0 legacy=0x7fc30c0734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311246640 1 -- 172.21.15.89:0/1806578867 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0c3010 con 0x7fc30c0c2a50 2023-12-07T10:02:52.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.339+0000 7fc311a47640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c06b5b0 0x7fc30c06ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:52.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc311246640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0c19f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098a0 tx=0x7fc30801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc023fa61f664b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc303fff640 1 -- 172.21.15.89:0/1806578867 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080ab670 con 0x7fc30c0c2a50 2023-12-07T10:02:52.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc303fff640 1 -- 172.21.15.89:0/1806578867 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080ab7d0 con 0x7fc30c0c2a50 2023-12-07T10:02:52.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc303fff640 1 -- 172.21.15.89:0/1806578867 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080abb60 con 0x7fc30c0c2a50 2023-12-07T10:02:52.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 -- 172.21.15.89:0/1806578867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c0c2a50 msgr2=0x7fc30c0c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0c19f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098a0 tx=0x7fc30801c470 comp rx=0 tx=0).stop 2023-12-07T10:02:52.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 -- 172.21.15.89:0/1806578867 shutdown_connections 2023-12-07T10:02:52.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c06b5b0 0x7fc30c06ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 --2- 172.21.15.89:0/1806578867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0c19f0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 -- 172.21.15.89:0/1806578867 >> 172.21.15.89:0/1806578867 conn(0x7fc30c0c3240 msgr2=0x7fc30c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 -- 172.21.15.89:0/1806578867 shutdown_connections 2023-12-07T10:02:52.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 -- 172.21.15.89:0/1806578867 wait complete. 2023-12-07T10:02:52.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 Processor -- start 2023-12-07T10:02:52.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.343+0000 7fc3134aa640 1 -- start start 2023-12-07T10:02:52.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 0x7fc30c13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c14e4d0 0x7fc30c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1f0330 con 0x7fc30c06b5b0 2023-12-07T10:02:52.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1f0580 con 0x7fc30c0c2a50 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1f0860 con 0x7fc30c14e4d0 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 0x7fc30c13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 0x7fc30c13ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58728/0 (socket says 172.21.15.89:58728) 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 -- 172.21.15.89:0/3443397943 learned_addr learned my addr 172.21.15.89:0/3443397943 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311a47640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c14e4d0 0x7fc30c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc310a45640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 -- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c14e4d0 msgr2=0x7fc30c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c14e4d0 0x7fc30c13b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 -- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc30c0c2a50 msgr2=0x7fc30c0bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 -- 172.21.15.89:0/3443397943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080094d0 con 0x7fc30c06b5b0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc311246640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 0x7fc30c13ed90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc3080ad040 tx=0x7fc30801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080b4800 con 0x7fc30c06b5b0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080b4980 con 0x7fc30c06b5b0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0c28a0 con 0x7fc30c06b5b0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080b4d30 con 0x7fc30c06b5b0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c1f0e20 con 0x7fc30c06b5b0 2023-12-07T10:02:52.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.347+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c1ecdc0 con 0x7fc30c06b5b0 2023-12-07T10:02:52.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.351+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc3080c7440 con 0x7fc30c06b5b0 2023-12-07T10:02:52.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.351+0000 7fc301ffb640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2f00668d0 0x7fc2f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.351+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc30811ee60 con 0x7fc30c06b5b0 2023-12-07T10:02:52.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.351+0000 7fc310a45640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2f00668d0 0x7fc2f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.351+0000 7fc310a45640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2f00668d0 0x7fc2f0068d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0aca80 tx=0x7fc2fc007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.355+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3080ec3d0 con 0x7fc30c06b5b0 2023-12-07T10:02:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc30c0c2720 con 0x7fc2f00668d0 2023-12-07T10:02:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc301ffb640 1 -- 172.21.15.89:0/3443397943 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc2fc005a60 con 0x7fc2f00668d0 2023-12-07T10:02:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 5 to deep-scrub 2023-12-07T10:02:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2f00668d0 msgr2=0x7fc2f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2f00668d0 0x7fc2f0068d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0aca80 tx=0x7fc2fc007c90 comp rx=0 tx=0).stop 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 msgr2=0x7fc30c13ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 0x7fc30c13ed90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc3080ad040 tx=0x7fc30801acb0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 shutdown_connections 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fc2f00668d0 0x7fc2f0068d90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc30c14e4d0 0x7fc30c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc30c0c2a50 0x7fc30c0bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 --2- 172.21.15.89:0/3443397943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc30c06b5b0 0x7fc30c13ed90 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 >> 172.21.15.89:0/3443397943 conn(0x7fc30c0c3240 msgr2=0x7fc30c0c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 shutdown_connections 2023-12-07T10:02:52.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.507+0000 7fc3134aa640 1 -- 172.21.15.89:0/3443397943 wait complete. 2023-12-07T10:02:52.531 INFO:tasks.ceph:Scrubbing osd.6 2023-12-07T10:02:52.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:52.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.667+0000 7f03eefdf640 1 Processor -- start 2023-12-07T10:02:52.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.667+0000 7f03eefdf640 1 -- start start 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.667+0000 7f03eefdf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.667+0000 7f03eefdf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03e806b0c0 0x7f03e814e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03eefdf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e81559d0 con 0x7f03e814edc0 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03eefdf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e81557c0 con 0x7f03e806b0c0 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03eefdf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e806d910 con 0x7f03e8154ea0 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03e806b0c0 0x7f03e814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03e806b0c0 0x7f03e814e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58742/0 (socket says 172.21.15.89:58742) 2023-12-07T10:02:52.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 -- 172.21.15.89:0/2020195599 learned_addr learned my addr 172.21.15.89:0/2020195599 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03ecd7b640 1 --2- 172.21.15.89:0/2020195599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 -- 172.21.15.89:0/2020195599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 msgr2=0x7f03e8155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:52.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 --2- 172.21.15.89:0/2020195599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 -- 172.21.15.89:0/2020195599 >> v1:172.21.15.97:6789/0 conn(0x7f03e814edc0 legacy=0x7f03e8070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:52.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 -- 172.21.15.89:0/2020195599 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80c1230 con 0x7f03e806b0c0 2023-12-07T10:02:52.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03dffff640 1 --2- 172.21.15.89:0/2020195599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e806b0c0 0x7f03e814e880 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009870 tx=0x7f03d801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76dc56e51c5b8d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03df7fe640 1 -- 172.21.15.89:0/2020195599 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80ac640 con 0x7f03e806b0c0 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03df7fe640 1 -- 172.21.15.89:0/2020195599 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d80ac7a0 con 0x7f03e806b0c0 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.671+0000 7f03df7fe640 1 -- 172.21.15.89:0/2020195599 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80acb30 con 0x7f03e806b0c0 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- 172.21.15.89:0/2020195599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e806b0c0 msgr2=0x7f03e814e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 --2- 172.21.15.89:0/2020195599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e806b0c0 0x7f03e814e880 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009870 tx=0x7f03d801c440 comp rx=0 tx=0).stop 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- 172.21.15.89:0/2020195599 shutdown_connections 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 --2- 172.21.15.89:0/2020195599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e806b0c0 0x7f03e814e880 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 --2- 172.21.15.89:0/2020195599 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- 172.21.15.89:0/2020195599 >> 172.21.15.89:0/2020195599 conn(0x7f03e806a5a0 msgr2=0x7f03e806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- 172.21.15.89:0/2020195599 shutdown_connections 2023-12-07T10:02:52.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- 172.21.15.89:0/2020195599 wait complete. 2023-12-07T10:02:52.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 Processor -- start 2023-12-07T10:02:52.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- start start 2023-12-07T10:02:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03e806b0c0 0x7f03e8140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e814edc0 0x7f03e8143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e80abb80 con 0x7f03e814edc0 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e814ae50 con 0x7f03e806b0c0 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03eefdf640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e814ab70 con 0x7f03e8154ea0 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e814edc0 0x7f03e8143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e814edc0 0x7f03e8143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58750/0 (socket says 172.21.15.89:58750) 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 -- 172.21.15.89:0/2030985272 learned_addr learned my addr 172.21.15.89:0/2030985272 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03ecd7b640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03e806b0c0 0x7f03e8140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03ed57c640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 -- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 msgr2=0x7f03e8143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f03e8154ea0 0x7f03e8143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 -- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03e806b0c0 msgr2=0x7f03e8140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03e806b0c0 0x7f03e8140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.675+0000 7f03dffff640 1 -- 172.21.15.89:0/2030985272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80094d0 con 0x7f03e814edc0 2023-12-07T10:02:52.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dffff640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e814edc0 0x7f03e8143aa0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f03d80af040 tx=0x7f03d801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80b7830 con 0x7f03e814edc0 2023-12-07T10:02:52.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d80b7990 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e8142f40 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80b7d40 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e8143500 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03e806dd80 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f03d80b3040 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03d40668d0 0x7f03d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f03d811e7e0 con 0x7f03e814edc0 2023-12-07T10:02:52.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03ecd7b640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03d40668d0 0x7f03d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f03d406c7d0 0x7f03d406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 --> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03d406f2a0 con 0x7f03d406c7d0 2023-12-07T10:02:52.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.679+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03d8120dc0 con 0x7f03e814edc0 2023-12-07T10:02:52.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.683+0000 7f03ed57c640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f03d406c7d0 0x7f03d406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.683+0000 7f03ecd7b640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03d40668d0 0x7f03d4068d90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f03e806abf0 tx=0x7f03e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.683+0000 7f03ed57c640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f03d406c7d0 0x7f03d406ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.683+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== osd.6 v2:172.21.15.97:6824/2141814588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f03d406f2a0 con 0x7f03d406c7d0 2023-12-07T10:02:52.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 --> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f03e80abcf0 con 0x7f03d406c7d0 2023-12-07T10:02:52.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03dd7fa640 1 -- 172.21.15.89:0/2030985272 <== osd.6 v2:172.21.15.97:6824/2141814588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f03e80abcf0 con 0x7f03d406c7d0 2023-12-07T10:02:52.702 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:52.702 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:52.702 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:52.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f03d406c7d0 msgr2=0x7f03d406ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.97:6824/2141814588,v1:172.21.15.97:6825/2141814588] conn(0x7f03d406c7d0 0x7f03d406ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03d40668d0 msgr2=0x7f03d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f03d40668d0 0x7f03d4068d90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f03e806abf0 tx=0x7f03e4008040 comp rx=0 tx=0).stop 2023-12-07T10:02:52.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e814edc0 msgr2=0x7f03e8143aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 --2- 172.21.15.89:0/2030985272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03e814edc0 0x7f03e8143aa0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f03d80af040 tx=0x7f03d801ac80 comp rx=0 tx=0).stop 2023-12-07T10:02:52.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03ed57c640 1 -- 172.21.15.89:0/2030985272 reap_dead start 2023-12-07T10:02:52.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 shutdown_connections 2023-12-07T10:02:52.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 >> 172.21.15.89:0/2030985272 conn(0x7f03e806a5a0 msgr2=0x7f03e815b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 shutdown_connections 2023-12-07T10:02:52.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.695+0000 7f03eefdf640 1 -- 172.21.15.89:0/2030985272 wait complete. 2023-12-07T10:02:52.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-07T10:02:52.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.851+0000 7fe878009640 1 Processor -- start 2023-12-07T10:02:52.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.851+0000 7fe878009640 1 -- start start 2023-12-07T10:02:52.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe878009640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe870156500 0x7fe87006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe878009640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8700c19e0 0x7fe8700c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe878009640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87006dec0 con 0x7fe87014fcc0 2023-12-07T10:02:52.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe878009640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8700aa340 con 0x7fe870156500 2023-12-07T10:02:52.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe878009640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870156980 con 0x7fe8700c19e0 2023-12-07T10:02:52.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8765a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8700c19e0 0x7fe8700c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe870156500 0x7fe87006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe870156500 0x7fe87006d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.89:58490/0 (socket says 172.21.15.89:58490) 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8765a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8700c19e0 0x7fe8700c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.89:39982/0 (socket says 172.21.15.89:39982) 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe875da5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe87014fcc0 0x7fe8700aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.89:57382/0 (socket says 172.21.15.89:57382) 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 -- 172.21.15.89:0/1687791626 learned_addr learned my addr 172.21.15.89:0/1687791626 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 -- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8700c19e0 msgr2=0x7fe8700c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 --2- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8700c19e0 0x7fe8700c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 -- 172.21.15.89:0/1687791626 >> v1:172.21.15.97:6789/0 conn(0x7fe87014fcc0 legacy=0x7fe8700aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.855+0000 7fe8755a4640 1 -- 172.21.15.89:0/1687791626 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8700ab580 con 0x7fe870156500 2023-12-07T10:02:52.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe8755a4640 1 --2- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe870156500 0x7fe87006d980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe860009870 tx=0x7fe86001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc925c8f87af924f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe874da3640 1 -- 172.21.15.89:0/1687791626 <== mon.1 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8600ab620 con 0x7fe870156500 2023-12-07T10:02:52.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe874da3640 1 -- 172.21.15.89:0/1687791626 <== mon.1 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8600ab780 con 0x7fe870156500 2023-12-07T10:02:52.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe874da3640 1 -- 172.21.15.89:0/1687791626 <== mon.1 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8600abb10 con 0x7fe870156500 2023-12-07T10:02:52.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 -- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe870156500 msgr2=0x7fe87006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 --2- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe870156500 0x7fe87006d980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe860009870 tx=0x7fe86001c510 comp rx=0 tx=0).stop 2023-12-07T10:02:52.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 -- 172.21.15.89:0/1687791626 shutdown_connections 2023-12-07T10:02:52.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 --2- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8700c19e0 0x7fe8700c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 --2- 172.21.15.89:0/1687791626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe870156500 0x7fe87006d980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 -- 172.21.15.89:0/1687791626 >> 172.21.15.89:0/1687791626 conn(0x7fe8700c2ad0 msgr2=0x7fe8700c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:52.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 -- 172.21.15.89:0/1687791626 shutdown_connections 2023-12-07T10:02:52.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 -- 172.21.15.89:0/1687791626 wait complete. 2023-12-07T10:02:52.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.859+0000 7fe878009640 1 Processor -- start 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- start start 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8700c19e0 0x7fe8701f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe870156500 0x7fe870070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 0x7fe87015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700c57c0 con 0x7fe87014b8d0 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700c5a60 con 0x7fe8700c19e0 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701f07a0 con 0x7fe870156500 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 0x7fe87015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 0x7fe87015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58756/0 (socket says 172.21.15.89:58756) 2023-12-07T10:02:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 -- 172.21.15.89:0/672401635 learned_addr learned my addr 172.21.15.89:0/672401635 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe875da5640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8700c19e0 0x7fe8701f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8755a4640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe870156500 0x7fe870070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 -- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe870156500 msgr2=0x7fe870070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe870156500 0x7fe870070270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 -- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8700c19e0 msgr2=0x7fe8701f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8700c19e0 0x7fe8701f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 -- 172.21.15.89:0/672401635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600094d0 con 0x7fe87014b8d0 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe875da5640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8700c19e0 0x7fe8701f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8755a4640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe870156500 0x7fe870070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8765a6640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 0x7fe87015b3f0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe86800efc0 tx=0x7fe86800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868014480 con 0x7fe87014b8d0 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800f040 con 0x7fe87014b8d0 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8701f0a80 con 0x7fe87014b8d0 2023-12-07T10:02:52.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868014820 con 0x7fe87014b8d0 2023-12-07T10:02:52.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87015b930 con 0x7fe87014b8d0 2023-12-07T10:02:52.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.863+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87004e890 con 0x7fe87014b8d0 2023-12-07T10:02:52.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.867+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe868014980 con 0x7fe87014b8d0 2023-12-07T10:02:52.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.867+0000 7fe8667fc640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8540668d0 0x7fe854068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:52.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.867+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe868084d10 con 0x7fe87014b8d0 2023-12-07T10:02:52.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.867+0000 7fe875da5640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8540668d0 0x7fe854068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:52.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.867+0000 7fe875da5640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8540668d0 0x7fe854068d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000f70 tx=0x7fe86c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:52.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:52.871+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8680521f0 con 0x7fe87014b8d0 2023-12-07T10:02:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.019+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe870155fe0 con 0x7fe8540668d0 2023-12-07T10:02:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.019+0000 7fe8667fc640 1 -- 172.21.15.89:0/672401635 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe86c001cd0 con 0x7fe8540668d0 2023-12-07T10:02:53.026 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 6 to deep-scrub 2023-12-07T10:02:53.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8540668d0 msgr2=0x7fe854068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8540668d0 0x7fe854068d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000f70 tx=0x7fe86c009040 comp rx=0 tx=0).stop 2023-12-07T10:02:53.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 msgr2=0x7fe87015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 0x7fe87015b3f0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe86800efc0 tx=0x7fe86800c490 comp rx=0 tx=0).stop 2023-12-07T10:02:53.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 shutdown_connections 2023-12-07T10:02:53.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe87014b8d0 0x7fe87015b3f0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fe8540668d0 0x7fe854068d90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe870156500 0x7fe870070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 --2- 172.21.15.89:0/672401635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8700c19e0 0x7fe8701f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 >> 172.21.15.89:0/672401635 conn(0x7fe8700c2ad0 msgr2=0x7fe87014bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 shutdown_connections 2023-12-07T10:02:53.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.023+0000 7fe878009640 1 -- 172.21.15.89:0/672401635 wait complete. 2023-12-07T10:02:53.046 INFO:tasks.ceph:Scrubbing osd.7 2023-12-07T10:02:53.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-07T10:02:53.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 Processor -- start 2023-12-07T10:02:53.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 -- start start 2023-12-07T10:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f24280a9770 0x7f242806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24280c2070 0x7f24280c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24281569f0 con 0x7f2428155f00 2023-12-07T10:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280abb60 con 0x7f24280c2070 2023-12-07T10:02:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242f1f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242806c7a0 con 0x7f24280a9770 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242d795640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24280c2070 0x7f24280c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242cf94640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2428155f00 0x7f24281562e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48068/0 (socket says 172.21.15.89:48068) 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242cf94640 1 -- 172.21.15.89:0/2436200199 learned_addr learned my addr 172.21.15.89:0/2436200199 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242d795640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24280c2070 0x7f24280c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58762/0 (socket says 172.21.15.89:58762) 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f241ffff640 1 --2- 172.21.15.89:0/2436200199 >> v2:172.21.15.97:3300/0 conn(0x7f24280a9770 0x7f242806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242d795640 1 -- 172.21.15.89:0/2436200199 >> v2:172.21.15.97:3300/0 conn(0x7f24280a9770 msgr2=0x7f242806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:53.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242d795640 1 --2- 172.21.15.89:0/2436200199 >> v2:172.21.15.97:3300/0 conn(0x7f24280a9770 0x7f242806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242d795640 1 -- 172.21.15.89:0/2436200199 >> v1:172.21.15.89:6789/0 conn(0x7f2428155f00 legacy=0x7f24281562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f242d795640 1 -- 172.21.15.89:0/2436200199 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280abdb0 con 0x7f24280c2070 2023-12-07T10:02:53.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.187+0000 7f241ffff640 1 --2- 172.21.15.89:0/2436200199 >> v2:172.21.15.97:3300/0 conn(0x7f24280a9770 0x7f242806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:02:53.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242d795640 1 --2- 172.21.15.89:0/2436200199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24280c2070 0x7f24280c24e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f2420009d90 tx=0x7f242001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc79d4ec532f6062 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f241f7fe640 1 -- 172.21.15.89:0/2436200199 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200a5740 con 0x7f24280c2070 2023-12-07T10:02:53.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f241f7fe640 1 -- 172.21.15.89:0/2436200199 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200a58a0 con 0x7f24280c2070 2023-12-07T10:02:53.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f241f7fe640 1 -- 172.21.15.89:0/2436200199 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200a5c30 con 0x7f24280c2070 2023-12-07T10:02:53.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 -- 172.21.15.89:0/2436200199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24280c2070 msgr2=0x7f24280c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 --2- 172.21.15.89:0/2436200199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24280c2070 0x7f24280c24e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f2420009d90 tx=0x7f242001c880 comp rx=0 tx=0).stop 2023-12-07T10:02:53.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 -- 172.21.15.89:0/2436200199 shutdown_connections 2023-12-07T10:02:53.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 --2- 172.21.15.89:0/2436200199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24280c2070 0x7f24280c24e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 --2- 172.21.15.89:0/2436200199 >> v2:172.21.15.97:3300/0 conn(0x7f24280a9770 0x7f242806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 -- 172.21.15.89:0/2436200199 >> 172.21.15.89:0/2436200199 conn(0x7f242806a5a0 msgr2=0x7f242806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 -- 172.21.15.89:0/2436200199 shutdown_connections 2023-12-07T10:02:53.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.191+0000 7f242f1f8640 1 -- 172.21.15.89:0/2436200199 wait complete. 2023-12-07T10:02:53.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 Processor -- start 2023-12-07T10:02:53.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- start start 2023-12-07T10:02:53.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24280a9770 0x7f2428144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24280c2070 0x7f242814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2428155f00 0x7f242814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428152910 con 0x7f2428155f00 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242815cec0 con 0x7f24280a9770 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242814caa0 con 0x7f24280c2070 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2428155f00 0x7f242814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2428155f00 0x7f242814dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58778/0 (socket says 172.21.15.89:58778) 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 -- 172.21.15.89:0/3786802091 learned_addr learned my addr 172.21.15.89:0/3786802091 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242cf94640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24280a9770 0x7f2428144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f241ffff640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24280c2070 0x7f242814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 -- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24280c2070 msgr2=0x7f242814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24280c2070 0x7f242814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 -- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24280a9770 msgr2=0x7f2428144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24280a9770 0x7f2428144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 -- 172.21.15.89:0/3786802091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009a70 con 0x7f2428155f00 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242cf94640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24280a9770 0x7f2428144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:53.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242d795640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2428155f00 0x7f242814dfc0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f24200b0040 tx=0x7f2420019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200b9860 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200b99c0 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200b9d70 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24281eb8f0 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242815c6c0 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.195+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24280aa690 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f24200ad440 con 0x7f2428155f00 2023-12-07T10:02:53.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2414066900 0x7f2414068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f242011f5e0 con 0x7f2428155f00 2023-12-07T10:02:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f242cf94640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2414066900 0x7f2414068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f241406c800 0x7f241406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 --> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f241406f2d0 con 0x7f241406c800 2023-12-07T10:02:53.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2420121bc0 con 0x7f2428155f00 2023-12-07T10:02:53.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241ffff640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f241406c800 0x7f241406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f242cf94640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2414066900 0x7f2414068dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2424007fd0 tx=0x7f2424009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241ffff640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f241406c800 0x7f241406ec20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.199+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== osd.7 v2:172.21.15.97:6800/1479824909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f241406f2d0 con 0x7f241406c800 2023-12-07T10:02:53.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 --> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f242815c260 con 0x7f241406c800 2023-12-07T10:02:53.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f241d7fa640 1 -- 172.21.15.89:0/3786802091 <== osd.7 v2:172.21.15.97:6800/1479824909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f241800a670 con 0x7f241406c800 2023-12-07T10:02:53.220 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T10:02:53.220 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T10:02:53.220 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T10:02:53.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f241406c800 msgr2=0x7f241406ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.97:6800/1479824909,v1:172.21.15.97:6801/1479824909] conn(0x7f241406c800 0x7f241406ec20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2414066900 msgr2=0x7f2414068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2414066900 0x7f2414068dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2424007fd0 tx=0x7f2424009040 comp rx=0 tx=0).stop 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2428155f00 msgr2=0x7f242814dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 --2- 172.21.15.89:0/3786802091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2428155f00 0x7f242814dfc0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f24200b0040 tx=0x7f2420019620 comp rx=0 tx=0).stop 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242d795640 1 -- 172.21.15.89:0/3786802091 reap_dead start 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 shutdown_connections 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 >> 172.21.15.89:0/3786802091 conn(0x7f242806a5a0 msgr2=0x7f24280c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 shutdown_connections 2023-12-07T10:02:53.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.215+0000 7f242f1f8640 1 -- 172.21.15.89:0/3786802091 wait complete. 2023-12-07T10:02:53.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-07T10:02:53.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 Processor -- start 2023-12-07T10:02:53.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 -- start start 2023-12-07T10:02:53.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2bdc14e9d0 0x7f2bdc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc070b80 0x7f2bdc0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2bdc0c1f20 0x7f2bdc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc06d320 con 0x7f2bdc0c1f20 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0721b0 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.371+0000 7f2be3c32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c2830 con 0x7f2bdc070b80 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2bdc0c1f20 0x7f2bdc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2bdc0c1f20 0x7f2bdc06d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58782/0 (socket says 172.21.15.89:58782) 2023-12-07T10:02:53.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 -- 172.21.15.89:0/2955623254 learned_addr learned my addr 172.21.15.89:0/2955623254 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be11cd640 1 --2- 172.21.15.89:0/2955623254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc070b80 0x7f2bdc0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be19ce640 1 --2- 172.21.15.89:0/2955623254 >> v2:172.21.15.97:3300/0 conn(0x7f2bdc14e9d0 0x7f2bdc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 -- 172.21.15.89:0/2955623254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc070b80 msgr2=0x7f2bdc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 --2- 172.21.15.89:0/2955623254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc070b80 0x7f2bdc0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 -- 172.21.15.89:0/2955623254 >> v2:172.21.15.97:3300/0 conn(0x7f2bdc14e9d0 msgr2=0x7f2bdc151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 --2- 172.21.15.89:0/2955623254 >> v2:172.21.15.97:3300/0 conn(0x7f2bdc14e9d0 0x7f2bdc151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 -- 172.21.15.89:0/2955623254 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc072450 con 0x7f2bdc0c1f20 2023-12-07T10:02:53.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be21cf640 1 --2- 172.21.15.89:0/2955623254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc0c1f20 0x7f2bdc06d7b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0c3980 tx=0x7f2bd401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42887cbf134b170e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be09cc640 1 -- 172.21.15.89:0/2955623254 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40a56d0 con 0x7f2bdc0c1f20 2023-12-07T10:02:53.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be09cc640 1 -- 172.21.15.89:0/2955623254 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40a5830 con 0x7f2bdc0c1f20 2023-12-07T10:02:53.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.375+0000 7f2be09cc640 1 -- 172.21.15.89:0/2955623254 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40a5bc0 con 0x7f2bdc0c1f20 2023-12-07T10:02:53.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- 172.21.15.89:0/2955623254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc0c1f20 msgr2=0x7f2bdc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- 172.21.15.89:0/2955623254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc0c1f20 0x7f2bdc06d7b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0c3980 tx=0x7f2bd401c940 comp rx=0 tx=0).stop 2023-12-07T10:02:53.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- 172.21.15.89:0/2955623254 shutdown_connections 2023-12-07T10:02:53.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- 172.21.15.89:0/2955623254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc0c1f20 0x7f2bdc06d7b0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- 172.21.15.89:0/2955623254 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc070b80 0x7f2bdc0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- 172.21.15.89:0/2955623254 >> v2:172.21.15.97:3300/0 conn(0x7f2bdc14e9d0 0x7f2bdc151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- 172.21.15.89:0/2955623254 >> 172.21.15.89:0/2955623254 conn(0x7f2bdc0c2ad0 msgr2=0x7f2bdc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- 172.21.15.89:0/2955623254 shutdown_connections 2023-12-07T10:02:53.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- 172.21.15.89:0/2955623254 wait complete. 2023-12-07T10:02:53.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 Processor -- start 2023-12-07T10:02:53.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- start start 2023-12-07T10:02:53.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bdc070b80 0x7f2bdc1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc0c1f20 0x7f2bdc1f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 0x7f2bdc15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1f0d20 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc153290 con 0x7f2bdc070b80 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be3c32640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc14c610 con 0x7f2bdc0c1f20 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 0x7f2bdc15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 0x7f2bdc15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58790/0 (socket says 172.21.15.89:58790) 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 -- 172.21.15.89:0/1271676677 learned_addr learned my addr 172.21.15.89:0/1271676677 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:53.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be11cd640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc0c1f20 0x7f2bdc1f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be19ce640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bdc070b80 0x7f2bdc1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 -- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc0c1f20 msgr2=0x7f2bdc1f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc0c1f20 0x7f2bdc1f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 -- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bdc070b80 msgr2=0x7f2bdc1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bdc070b80 0x7f2bdc1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be21cf640 1 -- 172.21.15.89:0/1271676677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009b30 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be11cd640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc0c1f20 0x7f2bdc1f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.379+0000 7f2be19ce640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bdc070b80 0x7f2bdc1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:53.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2be21cf640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 0x7f2bdc15a3a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40af040 tx=0x7f2bd40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b8670 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40b87d0 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc14b140 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b8b80 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc1f0660 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc1f0e60 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2bd40b8ce0 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2bd27fc640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc0066900 0x7f2bc0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.383+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2bd411f5b0 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.387+0000 7f2be19ce640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc0066900 0x7f2bc0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.387+0000 7f2be19ce640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc0066900 0x7f2bc0068dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800b9f0 tx=0x7f2bd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.387+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bdc1f0e60 con 0x7f2bdc14e9d0 2023-12-07T10:02:53.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bdc14d8e0 con 0x7f2bc0066900 2023-12-07T10:02:53.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2bd27fc640 1 -- 172.21.15.89:0/1271676677 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2bdc14d8e0 con 0x7f2bc0066900 2023-12-07T10:02:53.543 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 7 to deep-scrub 2023-12-07T10:02:53.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc0066900 msgr2=0x7f2bc0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc0066900 0x7f2bc0068dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800b9f0 tx=0x7f2bd8008040 comp rx=0 tx=0).stop 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 msgr2=0x7f2bdc15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 0x7f2bdc15a3a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40af040 tx=0x7f2bd40196e0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 shutdown_connections 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bdc14e9d0 0x7f2bdc15a3a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f2bc0066900 0x7f2bc0068dc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2bdc0c1f20 0x7f2bdc1f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 --2- 172.21.15.89:0/1271676677 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bdc070b80 0x7f2bdc1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 >> 172.21.15.89:0/1271676677 conn(0x7f2bdc0c2ad0 msgr2=0x7f2bdc147a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 shutdown_connections 2023-12-07T10:02:53.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.539+0000 7f2be3c32640 1 -- 172.21.15.89:0/1271676677 wait complete. 2023-12-07T10:02:53.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:02:53.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f24a611d640 1 Processor -- start 2023-12-07T10:02:53.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f24a611d640 1 -- start start 2023-12-07T10:02:53.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f24a611d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24a0158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f24a611d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a0155790 con 0x7f24a00ca610 2023-12-07T10:02:53.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f24a611d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00c4b00 con 0x7f24a006cd90 2023-12-07T10:02:53.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f24a611d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c4de0 con 0x7f24a00bd720 2023-12-07T10:02:53.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249f7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f24a00ca610 0x7f24a00c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48078/0 (socket says 172.21.15.89:48078) 2023-12-07T10:02:53.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249f7fe640 1 -- 172.21.15.89:0/2135880596 learned_addr learned my addr 172.21.15.89:0/2135880596 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T10:02:53.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249effd640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24a0158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832579154 0 0) 0x7f24a0155790 con 0x7f24a00ca610 2023-12-07T10:02:53.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2488003530 con 0x7f24a00ca610 2023-12-07T10:02:53.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 680107049 0 0) 0x7f2488003530 con 0x7f24a00ca610 2023-12-07T10:02:53.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 msgr2=0x7f24a0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:53.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24a0158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 >> v1:172.21.15.97:6789/0 conn(0x7f24a006cd90 legacy=0x7f24a00c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0157e30 con 0x7f24a00ca610 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2415386718 0 0) 0x7f2490001680 con 0x7f24a00ca610 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 >> v1:172.21.15.89:6789/0 conn(0x7f24a00ca610 legacy=0x7f24a00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24880039b0 0x7f2488003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2488004d10 0x7f2488005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c4de0 con 0x7f2488004d10 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248800bba0 con 0x7f24880039b0 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248800bd60 con 0x7f24a00bd720 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249ffff640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2488004d10 0x7f2488005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249f7fe640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24880039b0 0x7f2488003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.699+0000 7f249effd640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 -- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 msgr2=0x7f24880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 -- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24880039b0 msgr2=0x7f2488003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:02:53.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24880039b0 0x7f2488003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 -- 172.21.15.89:0/2135880596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488003530 con 0x7f2488004d10 2023-12-07T10:02:53.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249effd640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00bd720 0x7f24880047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:02:53.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2488004d10 0x7f2488005170 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2498001e70 tx=0x7f249801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d9fa920a3ccfcb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00c52d0 con 0x7f2488004d10 2023-12-07T10:02:53.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980a4ba0 con 0x7f2488004d10 2023-12-07T10:02:53.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249e7fc640 1 -- 172.21.15.89:0/2135880596 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498003980 con 0x7f2488004d10 2023-12-07T10:02:53.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f24a611d640 1 -- 172.21.15.89:0/2135880596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2488004d10 msgr2=0x7f2488005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f24a611d640 1 --2- 172.21.15.89:0/2135880596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2488004d10 0x7f2488005170 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2498001e70 tx=0x7f249801c440 comp rx=0 tx=0).stop 2023-12-07T10:02:53.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f249ffff640 1 -- 172.21.15.89:0/2135880596 reap_dead start 2023-12-07T10:02:53.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f24a611d640 1 -- 172.21.15.89:0/2135880596 shutdown_connections 2023-12-07T10:02:53.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f24a611d640 1 -- 172.21.15.89:0/2135880596 >> 172.21.15.89:0/2135880596 conn(0x7f24a0071ea0 msgr2=0x7f24a00722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f24a611d640 1 -- 172.21.15.89:0/2135880596 shutdown_connections 2023-12-07T10:02:53.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.703+0000 7f24a611d640 1 -- 172.21.15.89:0/2135880596 wait complete. 2023-12-07T10:02:53.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 Processor -- start 2023-12-07T10:02:53.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 -- start start 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00c3840 0x7f24a01f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 0x7f24a0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24a01f1ab0 0x7f24a0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00abb90 con 0x7f24a00c0890 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01edfa0 con 0x7f24a01f1ab0 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f24a611d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00ab4e0 con 0x7f24a00c3840 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 0x7f24a0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 0x7f24a0153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58808/0 (socket says 172.21.15.89:58808) 2023-12-07T10:02:53.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 -- 172.21.15.89:0/713447948 learned_addr learned my addr 172.21.15.89:0/713447948 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249f7fe640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00c3840 0x7f24a01f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249ffff640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24a01f1ab0 0x7f24a0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 -- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00c3840 msgr2=0x7f24a01f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00c3840 0x7f24a01f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 -- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24a01f1ab0 msgr2=0x7f24a0153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24a01f1ab0 0x7f24a0153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 -- 172.21.15.89:0/713447948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00ab200 con 0x7f24a00c0890 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.707+0000 7f249effd640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 0x7f24a0153520 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f2494009fd0 tx=0x7f2494011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494004220 con 0x7f24a00c0890 2023-12-07T10:02:53.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2494004380 con 0x7f24a00c0890 2023-12-07T10:02:53.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400f980 con 0x7f24a00c0890 2023-12-07T10:02:53.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a01ee190 con 0x7f24a00c0890 2023-12-07T10:02:53.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a01ee750 con 0x7f24a00c0890 2023-12-07T10:02:53.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a004e890 con 0x7f24a00c0890 2023-12-07T10:02:53.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f249400fae0 con 0x7f24a00c0890 2023-12-07T10:02:53.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f2487fff640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f248c066900 0x7f248c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:02:53.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f24940846b0 con 0x7f24a00c0890 2023-12-07T10:02:53.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f249f7fe640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f248c066900 0x7f248c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:02:53.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.711+0000 7f249f7fe640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f248c066900 0x7f248c068dc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2490001ec0 tx=0x7f2490000f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:02:53.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.715+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2494051c30 con 0x7f24a00c0890 2023-12-07T10:02:53.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.863+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24a006cb70 con 0x7f248c066900 2023-12-07T10:02:53.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.863+0000 7f2487fff640 1 -- 172.21.15.89:0/713447948 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50434 (secure 0 0 0) 0x7f24a006cb70 con 0x7f248c066900 2023-12-07T10:02:53.870 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:02:53.871 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f248c066900 msgr2=0x7f248c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f248c066900 0x7f248c068dc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2490001ec0 tx=0x7f2490000f90 comp rx=0 tx=0).stop 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 msgr2=0x7f24a0153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 0x7f24a0153520 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f2494009fd0 tx=0x7f2494011b30 comp rx=0 tx=0).stop 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 shutdown_connections 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24a01f1ab0 0x7f24a0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00c0890 0x7f24a0153520 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f248c066900 0x7f248c068dc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 --2- 172.21.15.89:0/713447948 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f24a00c3840 0x7f24a01f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:02:53.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 >> 172.21.15.89:0/713447948 conn(0x7f24a0071ea0 msgr2=0x7f24a0156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:02:53.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 shutdown_connections 2023-12-07T10:02:53.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:02:53.867+0000 7f24a611d640 1 -- 172.21.15.89:0/713447948 wait complete. 2023-12-07T10:02:53.891 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-07T10:02:52.387676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258144,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716576,"statfs":{"total":773094113280,"available":772829773824,"internally_reserved":0,"allocated":8888320,"data_stored":4586136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.131007"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-07T10:02:44.259608+0000","last_change":"2023-12-07T09:59:02.475111+0000","last_active":"2023-12-07T10:02:44.259608+0000","last_peered":"2023-12-07T10:02:44.259608+0000","last_clean":"2023-12-07T10:02:44.259608+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:44.259608+0000","last_undegraded":"2023-12-07T10:02:44.259608+0000","last_fullsized":"2023-12-07T10:02:44.259608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T09:59:00.770235+0000","last_clean_scrub_stamp":"2023-12-07T09:59:00.770235+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T15:44:07.117840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1556480,"data_stored":1016043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77600000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.77600000000000002,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.752}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.74099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82099999999999995,"5min":1.008,"15min":1.008},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.753},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.75,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0229999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.84199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.161,"15min":1.161},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.79800000000000004,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.81999999999999995,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.626},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.71599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.875,"5min":0.88,"15min":0.88},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.65000000000000002},"min":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91000000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.438,"15min":0.438},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.629}]},{"osd":2,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53300000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":0.84999999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":1.248,"15min":1.248},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.503},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.91300000000000003,"5min":1.091,"15min":1.091},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92400000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89300000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94999999999999996,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.079,"15min":1.079},"last":0.38}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.94999999999999996,"5min":1.274,"15min":1.274},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":1.306,"15min":1.306},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72999999999999998,"15min":0.77200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.80900000000000005},"min":{"1min":0.56000000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.56000000000000005,"15min":0.63800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69699999999999995,"5min":5.516,"15min":5.516},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50900000000000001,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65900000000000003,"5min":1.464,"15min":1.464},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.488,"15min":1.488},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57099999999999995,"15min":0.61299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61399999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.599,"15min":1.599},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.84599999999999997},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1020000000000001,"5min":4.617,"15min":4.617},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.077,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.92600000000000005}]},{"osd":6,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.046,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.94299999999999995,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.81899999999999995,"15min":0.85599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.012,"5min":3.468,"15min":3.468},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57899999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97299999999999998,"5min":1.841,"15min":1.841},"last":0.91300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.55600000000000005,"15min":0.624},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71599999999999997,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.81399999999999995,"15min":0.97999999999999998},"min":{"1min":0.31900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.171,"5min":13.016,"15min":13.016},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.85399999999999998},"min":{"1min":0.35699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":3.6760000000000002,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92600000000000005,"15min":1.1120000000000001},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.915,"5min":13.166,"15min":13.166},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90100000000000002,"15min":0.999},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":8.5660000000000007,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.314},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.89300000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.714,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.84699999999999998,"15min":0.92300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96799999999999997,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":1.0069999999999999,"15min":1.131},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.0489999999999999,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.97099999999999997,"15min":1.0760000000000001},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.3599999999999999,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89600000000000002,"15min":0.94199999999999995},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.7519999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.751}]},{"osd":6,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":1.0429999999999999,"15min":1.1879999999999999},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.417,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.002,"15min":1.103},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.3969999999999998,"5min":5.75,"15min":5.75},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Dec 7 10:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":1.0649999999999999,"15min":1.2190000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2130000000000001,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0209999999999999,"15min":1.0980000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5110000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.65800000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.45300000000000001,"15min":0.47599999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47099999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.61599999999999999,"5min":0.87,"15min":0.87},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.69199999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":1.01,"15min":1.01},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96499999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.083,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.002,"5min":1.012,"15min":1.012},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1556480,"data_stored":1016043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.47499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70999999999999996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71499999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.317}]},{"osd":2,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.66400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79400000000000004,"5min":4.173,"15min":4.173},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.52600000000000002,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.73599999999999999,"15min":0.83899999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64100000000000001,"5min":6.048,"15min":6.048},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":1.266,"15min":1.266},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2110000000000001,"5min":2.456,"15min":2.456},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81000000000000005,"15min":0.83499999999999996},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.90000000000000002,"15min":0.96999999999999997},"min":{"1min":0.57399999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.133,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1679999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:02:53.894 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T09:59:00.770235+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=9, tm_min=59, tm_sec=0, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=10, tm_min=2, tm_sec=48, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T10:02:53.895 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T10:03:11.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:11.227 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:13.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T10:03:14.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aae301640 1 Processor -- start 2023-12-07T10:03:14.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aae301640 1 -- start start 2023-12-07T10:03:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aae301640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8aa806c570 0x7f8aa81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aae301640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa81556c0 con 0x7f8aa8155170 2023-12-07T10:03:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aae301640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa8157a50 con 0x7f8aa8157670 2023-12-07T10:03:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aae301640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa806ba10 con 0x7f8aa806c570 2023-12-07T10:03:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aac89e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8aa806c570 0x7f8aa81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aac89e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8aa806c570 0x7f8aa81583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36450/0 (socket says 172.21.15.89:36450) 2023-12-07T10:03:14.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aac89e640 1 -- 172.21.15.89:0/3268124122 learned_addr learned my addr 172.21.15.89:0/3268124122 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:03:14.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aac89e640 1 -- 172.21.15.89:0/3268124122 >> v1:172.21.15.97:6789/0 conn(0x7f8aa8157670 legacy=0x7f8aa806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:03:14.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aac89e640 1 -- 172.21.15.89:0/3268124122 >> v1:172.21.15.89:6789/0 conn(0x7f8aa8155170 legacy=0x7f8aa8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.039+0000 7f8aac89e640 1 -- 172.21.15.89:0/3268124122 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80c4d70 con 0x7f8aa806c570 2023-12-07T10:03:14.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aac89e640 1 --2- 172.21.15.89:0/3268124122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa806c570 0x7f8aa81583f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009e50 tx=0x7f8aa001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232af420a557da44 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aa6ffd640 1 -- 172.21.15.89:0/3268124122 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00a56e0 con 0x7f8aa806c570 2023-12-07T10:03:14.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aa6ffd640 1 -- 172.21.15.89:0/3268124122 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00a5840 con 0x7f8aa806c570 2023-12-07T10:03:14.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aa6ffd640 1 -- 172.21.15.89:0/3268124122 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00a5bd0 con 0x7f8aa806c570 2023-12-07T10:03:14.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 -- 172.21.15.89:0/3268124122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa806c570 msgr2=0x7f8aa81583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 --2- 172.21.15.89:0/3268124122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa806c570 0x7f8aa81583f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009e50 tx=0x7f8aa001c880 comp rx=0 tx=0).stop 2023-12-07T10:03:14.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 -- 172.21.15.89:0/3268124122 shutdown_connections 2023-12-07T10:03:14.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 --2- 172.21.15.89:0/3268124122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa806c570 0x7f8aa81583f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 -- 172.21.15.89:0/3268124122 >> 172.21.15.89:0/3268124122 conn(0x7f8aa80abe70 msgr2=0x7f8aa80ac280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:03:14.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 -- 172.21.15.89:0/3268124122 shutdown_connections 2023-12-07T10:03:14.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 -- 172.21.15.89:0/3268124122 wait complete. 2023-12-07T10:03:14.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.043+0000 7f8aae301640 1 Processor -- start 2023-12-07T10:03:14.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- start start 2023-12-07T10:03:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa806c570 0x7f8aa8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8aa8155170 0x7f8aa80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 0x7f8aa81ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80c1c30 con 0x7f8aa8157670 2023-12-07T10:03:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80c3b50 con 0x7f8aa806c570 2023-12-07T10:03:14.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80c1e10 con 0x7f8aa8155170 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 0x7f8aa81ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 0x7f8aa81ec7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36456/0 (socket says 172.21.15.89:36456) 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 -- 172.21.15.89:0/1810522522 learned_addr learned my addr 172.21.15.89:0/1810522522 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aa7fff640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa806c570 0x7f8aa8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aa77fe640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8aa8155170 0x7f8aa80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 -- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8aa8155170 msgr2=0x7f8aa80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8aa8155170 0x7f8aa80c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 -- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa806c570 msgr2=0x7f8aa8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa806c570 0x7f8aa8150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 -- 172.21.15.89:0/1810522522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0009b30 con 0x7f8aa8157670 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aa7fff640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa806c570 0x7f8aa8150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aac89e640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 0x7f8aa81ec7d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00af040 tx=0x7f8aa0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00b8670 con 0x7f8aa8157670 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00b87d0 con 0x7f8aa8157670 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00b8b80 con 0x7f8aa8157670 2023-12-07T10:03:14.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa806d350 con 0x7f8aa8157670 2023-12-07T10:03:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa80c37e0 con 0x7f8aa8157670 2023-12-07T10:03:14.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.047+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa80c3ce0 con 0x7f8aa8157670 2023-12-07T10:03:14.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.051+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8aa00b8ce0 con 0x7f8aa8157670 2023-12-07T10:03:14.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.051+0000 7f8aa4ff9640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a940668d0 0x7f8a94068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.051+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8aa011f940 con 0x7f8aa8157670 2023-12-07T10:03:14.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.051+0000 7f8aa7fff640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a940668d0 0x7f8a94068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.051+0000 7f8aa7fff640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a940668d0 0x7f8a94068d90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80c0b50 tx=0x7f8a98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.055+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8aa00ecea0 con 0x7f8aa8157670 2023-12-07T10:03:14.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.199+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 --> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8aa806d1d0 con 0x7f8a940668d0 2023-12-07T10:03:14.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aa4ff9640 1 -- 172.21.15.89:0/1810522522 <== mgr.4103 v2:172.21.15.89:6832/2483427308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50288 (secure 0 0 0) 0x7f8a980094c0 con 0x7f8a940668d0 2023-12-07T10:03:14.207 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:03:14.208 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T10:03:14.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a940668d0 msgr2=0x7f8a94068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a940668d0 0x7f8a94068d90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80c0b50 tx=0x7f8a98008040 comp rx=0 tx=0).stop 2023-12-07T10:03:14.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 msgr2=0x7f8aa81ec7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 0x7f8aa81ec7d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00af040 tx=0x7f8aa0019620 comp rx=0 tx=0).stop 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 shutdown_connections 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8157670 0x7f8aa81ec7d0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f8a940668d0 0x7f8a94068d90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8aa8155170 0x7f8aa80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 --2- 172.21.15.89:0/1810522522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8aa806c570 0x7f8aa8150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 >> 172.21.15.89:0/1810522522 conn(0x7f8aa80abe70 msgr2=0x7f8aa80c9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:03:14.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 shutdown_connections 2023-12-07T10:03:14.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.203+0000 7f8aae301640 1 -- 172.21.15.89:0/1810522522 wait complete. 2023-12-07T10:03:14.228 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2023-12-07T10:03:12.391639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258132,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716588,"statfs":{"total":773094113280,"available":772829786112,"internally_reserved":0,"allocated":8888320,"data_stored":4586136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002467"},"pg_stats":[{"pgid":"1.0","version":"77'119","reported_seq":235,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-07T10:02:53.660045+0000","last_change":"2023-12-07T10:02:53.660045+0000","last_active":"2023-12-07T10:02:53.660045+0000","last_peered":"2023-12-07T10:02:53.660045+0000","last_clean":"2023-12-07T10:02:53.660045+0000","last_became_active":"2023-12-07T09:59:02.473960+0000","last_became_peered":"2023-12-07T09:59:02.473960+0000","last_unstale":"2023-12-07T10:02:53.660045+0000","last_undegraded":"2023-12-07T10:02:53.660045+0000","last_fullsized":"2023-12-07T10:02:53.660045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'119","last_scrub_stamp":"2023-12-07T10:02:53.659920+0000","last_deep_scrub":"77'119","last_deep_scrub_stamp":"2023-12-07T10:02:53.659920+0000","last_clean_scrub_stamp":"2023-12-07T10:02:53.659920+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:50:31.676525+0000","scrub_duration":0.0066622770000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1556480,"data_stored":1016043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.70899999999999996},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0609999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.53700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.877}]},{"osd":2,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.024,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.83499999999999996},"min":{"1min":0.55500000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98699999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.77100000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97399999999999998,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.65800000000000003,"15min":0.72799999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":1.008,"15min":1.008},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.68500000000000005,"15min":0.74099999999999999},"min":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82299999999999995,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.62}]},{"osd":5,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.78400000000000003},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.872,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73099999999999998,"15min":0.80500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0009999999999999,"5min":1.091,"15min":1.091},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Dec 7 10:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.76700000000000002,"15min":0.82899999999999996},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85299999999999998,"5min":1.161,"15min":1.161},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.75900000000000001,"15min":0.82199999999999995},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.89500000000000002,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.81299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.749},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83199999999999996,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93700000000000006,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88500000000000001,"5min":1.649,"15min":1.649},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72299999999999998,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85799999999999998,"5min":1.633,"15min":1.633},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.55500000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":0.998,"15min":0.998},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83999999999999997,"5min":1.095,"15min":1.095},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92000000000000004,"5min":1.431,"15min":1.431},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Dec 7 10:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.39000000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.874,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.79900000000000004,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84999999999999998,"5min":1.248,"15min":1.248},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90800000000000003,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.44},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88500000000000001,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70299999999999996,"15min":0.73999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96599999999999997,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.497}]},{"osd":7,"last update":"Thu Dec 7 10:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78200000000000003,"15min":0.81100000000000005},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94299999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65700000000000003,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88300000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.83799999999999997,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96399999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67000000000000004,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.86599999999999999,"5min":1.091,"15min":1.091},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.51800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82399999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.54200000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.02,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.748},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0069999999999999,"5min":1.079,"15min":1.079},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70199999999999996,"15min":0.75},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.98099999999999998,"5min":1.274,"15min":1.274},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.81799999999999995},"min":{"1min":0.505,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.071,"5min":1.306,"15min":1.306},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Dec 7 10:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70099999999999996,"15min":0.76300000000000001},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":1.149,"15min":1.149},"last":0.443},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.79900000000000004},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0900000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.47799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.503,"15min":0.61899999999999999},"min":{"1min":0.30299999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53300000000000003,"5min":5.516,"15min":5.516},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.54400000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47799999999999998,"15min":0.502},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.95199999999999996,"5min":1.464,"15min":1.464},"last":0.622},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65600000000000003,"5min":1.488,"15min":1.488},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54600000000000004,"15min":0.60499999999999998},"min":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.02,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.51000000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91100000000000003,"5min":1.599,"15min":1.599},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77800000000000002,"15min":0.83799999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.087,"5min":4.617,"15min":4.617},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0049999999999999,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0189999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0569999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.873,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95399999999999996,"5min":8.5030000000000001,"15min":8.5030000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Dec 7 10:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78800000000000003,"15min":0.84599999999999997},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":1.0589999999999999,"5min":3.468,"15min":3.468},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.107,"5min":1.841,"15min":1.841},"last":0.90300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.50900000000000001,"15min":0.60899999999999999},"min":{"1min":0.251,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.95099999999999996,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.499},{"interface":"front","average":{"1min":0.443,"5min":0.68999999999999995,"15min":0.93899999999999995},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.88500000000000001,"5min":13.016,"15min":13.016},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.67100000000000004,"15min":0.82499999999999996},"min":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1599999999999999,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78000000000000003,"15min":1.0629999999999999},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":13.166,"15min":13.166},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.78300000000000003,"15min":0.95899999999999996},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.93200000000000005,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.71299999999999997,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.214,"5min":9.0809999999999995,"15min":9.0809999999999995},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79400000000000004,"15min":0.90600000000000003},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3220000000000001,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.90600000000000003,"15min":1.0980000000000001},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.008,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.879,"15min":1.0449999999999999},"min":{"1min":0.47599999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98099999999999998,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.84999999999999998,"15min":0.92600000000000005},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.365,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.93600000000000005,"15min":1.1519999999999999},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0940000000000001,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.91200000000000003,"15min":1.073},"min":{"1min":0.54400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90100000000000002,"5min":5.75,"15min":5.75},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Dec 7 10:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.95099999999999996,"15min":1.181},"min":{"1min":0.52800000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93999999999999995,"5min":9.8239999999999998,"15min":9.8239999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93600000000000005,"15min":1.0700000000000001},"min":{"1min":0.51500000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0489999999999999,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":425675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42799999999999999},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.63700000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.51700000000000002},"min":{"1min":0.317,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77700000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.443,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55900000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48899999999999999,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.628,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72899999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51100000000000001,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60699999999999998,"5min":0.87,"15min":0.87},"last":0.502}]},{"osd":4,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.877,"5min":1.01,"15min":1.01},"last":0.877}]},{"osd":5,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.77600000000000002},"min":{"1min":0.54200000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1060000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73199999999999998,"15min":0.75800000000000001},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.52900000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0389999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.081,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.437,"15min":0.437},"max":{"1min":0.96699999999999997,"5min":1.012,"15min":1.012},"last":0.76000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1556480,"data_stored":1016043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.439,"15min":0.47199999999999998},"min":{"1min":0.25800000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.73299999999999998,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.28699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56499999999999995,"15min":0.65200000000000002},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3460000000000001,"5min":4.173,"15min":4.173},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.499}]},{"osd":3,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77400000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.67200000000000004,"15min":0.81799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3839999999999999,"5min":6.048,"15min":6.048},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.77200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1419999999999999,"5min":1.266,"15min":1.266},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72099999999999997,"15min":0.72599999999999998},"min":{"1min":0.53600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.747,"15min":0.749},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.169,"5min":1.248,"15min":1.248},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81100000000000005,"15min":0.86699999999999999},"min":{"1min":0.52800000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.2470000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.873},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2909999999999999,"5min":2.456,"15min":2.456},"last":0.87},{"interface":"front","average":{"1min":0.745,"5min":0.78900000000000003,"15min":0.82799999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2130000000000001,"5min":1.23,"15min":1.23},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Dec 7 10:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.84999999999999998,"15min":0.95299999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1060000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.505,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95599999999999996,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.81799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T10:03:14.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-07T10:03:14.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.359+0000 7f6fea1d0640 1 Processor -- start 2023-12-07T10:03:14.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.359+0000 7f6fea1d0640 1 -- start start 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fea1d0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6fe414e590 0x7f6fe4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fea1d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6fe40c7d40 0x7f6fe40c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fea1d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe406b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fea1d0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe41554a0 con 0x7f6fe414e590 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fea1d0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe406b3d0 con 0x7f6fe40c7d40 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fea1d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe414e970 con 0x7f6fe40c4d00 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6fe414e590 0x7f6fe4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6fe414e590 0x7f6fe4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36464/0 (socket says 172.21.15.89:36464) 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 -- 172.21.15.89:0/3020410211 learned_addr learned my addr 172.21.15.89:0/3020410211 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe89cd640 1 --2- 172.21.15.89:0/3020410211 >> v2:172.21.15.97:3300/0 conn(0x7f6fe40c7d40 0x7f6fe40c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe99cf640 1 --2- 172.21.15.89:0/3020410211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 -- 172.21.15.89:0/3020410211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 msgr2=0x7f6fe406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 --2- 172.21.15.89:0/3020410211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe406b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 -- 172.21.15.89:0/3020410211 >> v2:172.21.15.97:3300/0 conn(0x7f6fe40c7d40 msgr2=0x7f6fe40c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 --2- 172.21.15.89:0/3020410211 >> v2:172.21.15.97:3300/0 conn(0x7f6fe40c7d40 0x7f6fe40c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 -- 172.21.15.89:0/3020410211 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40bd720 con 0x7f6fe414e590 2023-12-07T10:03:14.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe89cd640 1 --2- 172.21.15.89:0/3020410211 >> v2:172.21.15.97:3300/0 conn(0x7f6fe40c7d40 0x7f6fe40c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T10:03:14.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.363+0000 7f6fe91ce640 1 --2- 172.21.15.89:0/3020410211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe414e590 0x7f6fe4154f60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40cae50 tx=0x7f6fe001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a73f9c23e68316 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fdbfff640 1 -- 172.21.15.89:0/3020410211 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00a7070 con 0x7f6fe414e590 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fdbfff640 1 -- 172.21.15.89:0/3020410211 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe00ab430 con 0x7f6fe414e590 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fdbfff640 1 -- 172.21.15.89:0/3020410211 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00ab7c0 con 0x7f6fe414e590 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- 172.21.15.89:0/3020410211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe414e590 msgr2=0x7f6fe4154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/3020410211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe414e590 0x7f6fe4154f60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40cae50 tx=0x7f6fe001c470 comp rx=0 tx=0).stop 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- 172.21.15.89:0/3020410211 shutdown_connections 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/3020410211 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe406b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/3020410211 >> v2:172.21.15.97:3300/0 conn(0x7f6fe40c7d40 0x7f6fe40c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/3020410211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe414e590 0x7f6fe4154f60 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- 172.21.15.89:0/3020410211 >> 172.21.15.89:0/3020410211 conn(0x7f6fe40abd70 msgr2=0x7f6fe40ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:03:14.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- 172.21.15.89:0/3020410211 shutdown_connections 2023-12-07T10:03:14.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- 172.21.15.89:0/3020410211 wait complete. 2023-12-07T10:03:14.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 Processor -- start 2023-12-07T10:03:14.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- start start 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe414b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 0x7f6fe414bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fe414e590 0x7f6fe414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe414eb60 con 0x7f6fe40c7d40 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe414f5d0 con 0x7f6fe414e590 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fea1d0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe414c320 con 0x7f6fe40c4d00 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.367+0000 7f6fe89cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 0x7f6fe414bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 0x7f6fe414bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36476/0 (socket says 172.21.15.89:36476) 2023-12-07T10:03:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 -- 172.21.15.89:0/665169017 learned_addr learned my addr 172.21.15.89:0/665169017 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:03:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe91ce640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe414b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe99cf640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fe414e590 0x7f6fe414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 -- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 msgr2=0x7f6fe414b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe414b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 -- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fe414e590 msgr2=0x7f6fe414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fe414e590 0x7f6fe414a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 -- 172.21.15.89:0/665169017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00094d0 con 0x7f6fe40c7d40 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fe89cd640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 0x7f6fe414bde0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e840 tx=0x7f6fd400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400c8d0 con 0x7f6fe40c7d40 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd400ca30 con 0x7f6fe40c7d40 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe40c3f90 con 0x7f6fe40c7d40 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400cdc0 con 0x7f6fe40c7d40 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe414ed40 con 0x7f6fe40c7d40 2023-12-07T10:03:14.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe4074970 con 0x7f6fe40c7d40 2023-12-07T10:03:14.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.371+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6fd4013410 con 0x7f6fe40c7d40 2023-12-07T10:03:14.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.375+0000 7f6fd9ffb640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6fc8066900 0x7f6fc8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.375+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6fd4083eb0 con 0x7f6fe40c7d40 2023-12-07T10:03:14.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.375+0000 7f6fe91ce640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6fc8066900 0x7f6fc8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.375+0000 7f6fe91ce640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6fc8066900 0x7f6fc8068dc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00af000 tx=0x7f6fe0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.379+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6fd4051430 con 0x7f6fe40c7d40 2023-12-07T10:03:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.547+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6fe406c9c0 con 0x7f6fe40c7d40 2023-12-07T10:03:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6fd4009480 con 0x7f6fe40c7d40 2023-12-07T10:03:14.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fd9ffb640 1 -- 172.21.15.89:0/665169017 <== mon.0 v2:172.21.15.89:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6fd4051430 con 0x7f6fe40c7d40 2023-12-07T10:03:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6fc8066900 msgr2=0x7f6fc8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6fc8066900 0x7f6fc8068dc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00af000 tx=0x7f6fe0008040 comp rx=0 tx=0).stop 2023-12-07T10:03:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 msgr2=0x7f6fe414bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 0x7f6fe414bde0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e840 tx=0x7f6fd400ed00 comp rx=0 tx=0).stop 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 shutdown_connections 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6fe414e590 0x7f6fe414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe40c7d40 0x7f6fe414bde0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7f6fc8066900 0x7f6fc8068dc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 --2- 172.21.15.89:0/665169017 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6fe40c4d00 0x7f6fe414b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.555+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 >> 172.21.15.89:0/665169017 conn(0x7f6fe40abd70 msgr2=0x7f6fe40ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.559+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 shutdown_connections 2023-12-07T10:03:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.559+0000 7f6fea1d0640 1 -- 172.21.15.89:0/665169017 wait complete. 2023-12-07T10:03:14.581 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-07T10:03:14.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T10:03:14.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1798e3640 1 Processor -- start 2023-12-07T10:03:14.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1798e3640 1 -- start start 2023-12-07T10:03:14.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1798e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1740c49e0 0x7fd1740c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1798e3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740c5a30 con 0x7fd1740c6400 2023-12-07T10:03:14.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1798e3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1741522c0 con 0x7fd174151ee0 2023-12-07T10:03:14.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1798e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17406bc70 con 0x7fd1740c49e0 2023-12-07T10:03:14.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd16a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1740c49e0 0x7fd1740c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd16a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1740c49e0 0x7fd1740c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36492/0 (socket says 172.21.15.89:36492) 2023-12-07T10:03:14.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd1737fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd1740c6400 0x7fd17415f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42642/0 (socket says 172.21.15.89:42642) 2023-12-07T10:03:14.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd16a7fc640 1 -- 172.21.15.89:0/473667823 learned_addr learned my addr 172.21.15.89:0/473667823 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:03:14.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd16a7fc640 1 -- 172.21.15.89:0/473667823 >> v1:172.21.15.97:6789/0 conn(0x7fd174151ee0 legacy=0x7fd17406b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T10:03:14.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.715+0000 7fd16a7fc640 1 -- 172.21.15.89:0/473667823 >> v1:172.21.15.89:6789/0 conn(0x7fd1740c6400 legacy=0x7fd17415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1727fc640 1 -- 172.21.15.89:0/473667823 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824527854 0 0) 0x7fd1740c5a30 con 0x7fd1740c6400 2023-12-07T10:03:14.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd16a7fc640 1 -- 172.21.15.89:0/473667823 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740c6890 con 0x7fd1740c49e0 2023-12-07T10:03:14.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd16a7fc640 1 --2- 172.21.15.89:0/473667823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c49e0 0x7fd1740c5ec0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009e50 tx=0x7fd15c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcf5c8066473f4b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1727fc640 1 -- 172.21.15.89:0/473667823 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0a57d0 con 0x7fd1740c49e0 2023-12-07T10:03:14.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1727fc640 1 -- 172.21.15.89:0/473667823 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd15c0a5930 con 0x7fd1740c49e0 2023-12-07T10:03:14.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1727fc640 1 -- 172.21.15.89:0/473667823 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0a5ce0 con 0x7fd1740c49e0 2023-12-07T10:03:14.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 -- 172.21.15.89:0/473667823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c49e0 msgr2=0x7fd1740c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 --2- 172.21.15.89:0/473667823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c49e0 0x7fd1740c5ec0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009e50 tx=0x7fd15c01c910 comp rx=0 tx=0).stop 2023-12-07T10:03:14.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 -- 172.21.15.89:0/473667823 shutdown_connections 2023-12-07T10:03:14.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 --2- 172.21.15.89:0/473667823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c49e0 0x7fd1740c5ec0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 -- 172.21.15.89:0/473667823 >> 172.21.15.89:0/473667823 conn(0x7fd1740ca060 msgr2=0x7fd1740ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:03:14.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 -- 172.21.15.89:0/473667823 shutdown_connections 2023-12-07T10:03:14.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.719+0000 7fd1798e3640 1 -- 172.21.15.89:0/473667823 wait complete. 2023-12-07T10:03:14.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 Processor -- start 2023-12-07T10:03:14.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 -- start start 2023-12-07T10:03:14.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1740c49e0 0x7fd1740c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 0x7fd1740c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd174151ee0 0x7fd1741f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c12d0 con 0x7fd1740c6400 2023-12-07T10:03:14.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c1c30 con 0x7fd174151ee0 2023-12-07T10:03:14.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17414fa90 con 0x7fd1740c49e0 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 0x7fd1740c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 0x7fd1740c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36494/0 (socket says 172.21.15.89:36494) 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 -- 172.21.15.89:0/977710119 learned_addr learned my addr 172.21.15.89:0/977710119 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1737fe640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd174151ee0 0x7fd1741f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd172ffd640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1740c49e0 0x7fd1740c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 -- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1740c49e0 msgr2=0x7fd1740c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1740c49e0 0x7fd1740c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 -- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd174151ee0 msgr2=0x7fd1741f0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd174151ee0 0x7fd1741f0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 -- 172.21.15.89:0/977710119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c009b30 con 0x7fd1740c6400 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd172ffd640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1740c49e0 0x7fd1740c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd16a7fc640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 0x7fd1740c8e80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd15c01a540 tx=0x7fd15c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0b8880 con 0x7fd1740c6400 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd15c0b8a20 con 0x7fd1740c6400 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd174152fc0 con 0x7fd1740c6400 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0b8df0 con 0x7fd1740c6400 2023-12-07T10:03:14.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.723+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd174153540 con 0x7fd1740c6400 2023-12-07T10:03:14.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.727+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd174067a40 con 0x7fd1740c6400 2023-12-07T10:03:14.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.727+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd15c0039a0 con 0x7fd1740c6400 2023-12-07T10:03:14.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.727+0000 7fd170ff9640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd154066900 0x7fd154068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T10:03:14.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.727+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd15c11f5c0 con 0x7fd1740c6400 2023-12-07T10:03:14.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.727+0000 7fd172ffd640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd154066900 0x7fd154068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T10:03:14.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.727+0000 7fd172ffd640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd154066900 0x7fd154068dc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd16400a850 tx=0x7fd164008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T10:03:14.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.731+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd15c0eca00 con 0x7fd1740c6400 2023-12-07T10:03:14.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.911+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd174067a40 con 0x7fd1740c6400 2023-12-07T10:03:14.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.911+0000 7fd170ff9640 1 -- 172.21.15.89:0/977710119 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fd15c0f0020 con 0x7fd1740c6400 2023-12-07T10:03:14.917 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T10:03:14.917 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3347995891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6833","nonce":3347995891},{"type":"v1","addr":"172.21.15.97:6835","nonce":3347995891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57},{"gid":6196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4004674995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4004674995},{"type":"v1","addr":"172.21.15.89:6837","nonce":4004674995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6834/2839771702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2839771702},{"type":"v1","addr":"172.21.15.97:6834","nonce":2839771702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1096373049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1096373049},{"type":"v1","addr":"172.21.15.89:6836","nonce":1096373049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[]} 2023-12-07T10:03:14.918 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 57 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd154066900 msgr2=0x7fd154068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd154066900 0x7fd154068dc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd16400a850 tx=0x7fd164008040 comp rx=0 tx=0).stop 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 msgr2=0x7fd1740c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 0x7fd1740c8e80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd15c01a540 tx=0x7fd15c0196b0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 shutdown_connections 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd174151ee0 0x7fd1741f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1740c6400 0x7fd1740c8e80 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.89:6832/2483427308,v1:172.21.15.89:6833/2483427308] conn(0x7fd154066900 0x7fd154068dc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 --2- 172.21.15.89:0/977710119 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd1740c49e0 0x7fd1740c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T10:03:14.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 >> 172.21.15.89:0/977710119 conn(0x7fd1740ca060 msgr2=0x7fd174147c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T10:03:14.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 shutdown_connections 2023-12-07T10:03:14.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T10:03:14.915+0000 7fd1798e3640 1 -- 172.21.15.89:0/977710119 wait complete. 2023-12-07T10:03:14.938 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-07T10:03:14.938 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-07T10:03:14.938 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-07T10:03:14.938 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:14.951 INFO:tasks.ceph.mds.a:Stopped 2023-12-07T10:03:14.951 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-07T10:03:14.951 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:15.006 INFO:tasks.ceph.mds.c:Stopped 2023-12-07T10:03:15.006 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-07T10:03:15.006 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:15.021 INFO:tasks.ceph.mds.b:Stopped 2023-12-07T10:03:15.022 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-07T10:03:15.022 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:15.079 INFO:tasks.ceph.mds.d:Stopped 2023-12-07T10:03:15.079 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-07T10:03:15.080 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-07T10:03:15.080 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:15.165 INFO:tasks.ceph.osd.0:Stopped 2023-12-07T10:03:15.165 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-07T10:03:15.165 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:15.258 INFO:tasks.ceph.osd.1:Stopped 2023-12-07T10:03:15.259 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-07T10:03:15.259 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:20.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-07T10:03:21.362 INFO:tasks.ceph.osd.2:Stopped 2023-12-07T10:03:21.363 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-07T10:03:21.363 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.428 INFO:tasks.ceph.osd.3:Stopped 2023-12-07T10:03:21.428 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-07T10:03:21.428 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.501 INFO:tasks.ceph.osd.4:Stopped 2023-12-07T10:03:21.502 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-07T10:03:21.502 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.568 INFO:tasks.ceph.osd.5:Stopped 2023-12-07T10:03:21.569 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-07T10:03:21.569 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.638 INFO:tasks.ceph.osd.6:Stopped 2023-12-07T10:03:21.639 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-07T10:03:21.639 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.698 INFO:tasks.ceph.osd.7:Stopped 2023-12-07T10:03:21.699 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-07T10:03:21.699 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-07T10:03:21.699 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.756 INFO:tasks.ceph.mgr.y:Stopped 2023-12-07T10:03:21.757 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-07T10:03:21.757 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.806 INFO:tasks.ceph.mgr.x:Stopped 2023-12-07T10:03:21.806 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-07T10:03:21.807 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-07T10:03:21.807 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.827 INFO:tasks.ceph.mon.a:Stopped 2023-12-07T10:03:21.827 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-07T10:03:21.827 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.843 INFO:tasks.ceph.mon.b:Stopped 2023-12-07T10:03:21.844 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-07T10:03:21.844 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T10:03:21.904 INFO:tasks.ceph.mon.c:Stopped 2023-12-07T10:03:21.905 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-07T10:03:21.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-07T10:03:21.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:03:21.935 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-07T10:03:22.252 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:03:22.253 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-07T10:03:22.473 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:03:22.474 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-07T10:03:22.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:03:22.669 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-07T10:03:22.847 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:03:22.847 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-07T10:03:23.087 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:03:23.087 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-07T10:03:23.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:03:23.256 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-07T10:03:23.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:03:23.431 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-07T10:03:23.606 INFO:tasks.ceph:Archiving mon data... 2023-12-07T10:03:23.607 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/data/mon.a.tgz 2023-12-07T10:03:23.607 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T10:03:23.617 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.KMjJYBOYm5 2023-12-07T10:03:23.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KMjJYBOYm5 2023-12-07T10:03:23.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.KMjJYBOYm5 2023-12-07T10:03:23.846 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.KMjJYBOYm5 is 440KB 2023-12-07T10:03:23.912 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.KMjJYBOYm5 2023-12-07T10:03:23.921 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/data/mon.b.tgz 2023-12-07T10:03:23.921 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-07T10:03:23.930 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.IYEZIYIQmT 2023-12-07T10:03:23.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IYEZIYIQmT 2023-12-07T10:03:24.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.IYEZIYIQmT 2023-12-07T10:03:24.187 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.IYEZIYIQmT is 572KB 2023-12-07T10:03:24.259 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.IYEZIYIQmT 2023-12-07T10:03:24.268 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/data/mon.c.tgz 2023-12-07T10:03:24.268 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-07T10:03:24.319 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.grbtlm6x13 2023-12-07T10:03:24.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.grbtlm6x13 2023-12-07T10:03:24.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.grbtlm6x13 2023-12-07T10:03:24.572 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.grbtlm6x13 is 572KB 2023-12-07T10:03:24.642 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.grbtlm6x13 2023-12-07T10:03:24.651 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-07T10:03:24.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-07T10:03:24.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-07T10:03:24.726 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-07T10:03:24.767 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-07T10:03:24.767 INFO:tasks.ceph:Archiving crash dumps... 2023-12-07T10:03:24.769 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/remote/smithi089/crash 2023-12-07T10:03:24.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-07T10:03:24.795 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/remote/smithi097/crash 2023-12-07T10:03:24.796 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-07T10:03:24.837 INFO:tasks.ceph:Shutting down logrotate 2023-12-07T10:03:24.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:24.842 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:24.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:24.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:24.971 INFO:tasks.ceph:Compressing logs... 2023-12-07T10:03:24.971 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T10:03:24.997 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T10:03:25.022 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2023-12-07T10:03:25.024 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45804.log 2023-12-07T10:03:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52284.log 2023-12-07T10:03:25.025 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2023-12-07T10:03:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.45804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45804.log.gz 2023-12-07T10:03:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51081.log 2023-12-07T10:03:25.028 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45048.log 2023-12-07T10:03:25.028 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52284.log.gz 2023-12-07T10:03:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51081.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51081.log.gz 2023-12-07T10:03:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2023-12-07T10:03:25.031 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47298.log 2023-12-07T10:03:25.031 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45048.log.gz 2023-12-07T10:03:25.031 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46041.log 2023-12-07T10:03:25.031 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2023-12-07T10:03:25.032 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54880.log 2023-12-07T10:03:25.032 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47298.log.gz 2023-12-07T10:03:25.032 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46041.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46041.log.gz 2023-12-07T10:03:25.032 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50963.log 2023-12-07T10:03:25.033 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2023-12-07T10:03:25.033 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54880.log.gz 2023-12-07T10:03:25.034 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50963.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50963.log.gz 2023-12-07T10:03:25.034 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50991.log 2023-12-07T10:03:25.035 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52589.log 2023-12-07T10:03:25.035 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2023-12-07T10:03:25.036 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50991.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50991.log.gz 2023-12-07T10:03:25.036 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.54511.log 2023-12-07T10:03:25.037 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54277.log 2023-12-07T10:03:25.037 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52589.log.gz 2023-12-07T10:03:25.038 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2023-12-07T10:03:25.038 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54511.log.gz 2023-12-07T10:03:25.040 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54277.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.55954.log -- replaced with /var/log/ceph/ceph-client.admin.54277.log.gz 2023-12-07T10:03:25.040 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.042 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51475.log 2023-12-07T10:03:25.042 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2023-12-07T10:03:25.044 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38198.log 2023-12-07T10:03:25.045 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43899.log 2023-12-07T10:03:25.045 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38318.log 2023-12-07T10:03:25.045 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38198.log.gz 2023-12-07T10:03:25.045 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.43899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43899.log.gz 2023-12-07T10:03:25.045 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38246.log 2023-12-07T10:03:25.046 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55954.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55954.log.gz 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54810.log 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51475.log.gz 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51241.log 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44856.log 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54810.log.gz 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49899.log 2023-12-07T10:03:25.047 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51241.log.gz 2023-12-07T10:03:25.048 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44856.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44856.log.gz 2023-12-07T10:03:25.048 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55805.log 2023-12-07T10:03:25.050 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47076.log 2023-12-07T10:03:25.050 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49899.log.gz 2023-12-07T10:03:25.050 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2023-12-07T10:03:25.051 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55805.log.gz 2023-12-07T10:03:25.051 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56358.log 2023-12-07T10:03:25.051 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47076.log.gz 2023-12-07T10:03:25.051 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46966.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2023-12-07T10:03:25.051 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38222.log 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38318.log.gz 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38246.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38246.log.gz 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38222.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38222.log.gz 2023-12-07T10:03:25.053 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44171.log 2023-12-07T10:03:25.054 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44227.log 2023-12-07T10:03:25.054 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.44171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44171.log.gz 2023-12-07T10:03:25.054 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44021.log 2023-12-07T10:03:25.054 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.44227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44227.log.gz 2023-12-07T10:03:25.054 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38174.log 2023-12-07T10:03:25.054 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.44021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44021.log.gz 2023-12-07T10:03:25.055 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-07T10:03:25.055 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38270.log 2023-12-07T10:03:25.055 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38174.log.gz 2023-12-07T10:03:25.057 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.44284.log 2023-12-07T10:03:25.057 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38270.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2023-12-07T10:03:25.058 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-07T10:03:25.058 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.testuser.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-07T10:03:25.058 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.44284.log.gz 2023-12-07T10:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56358.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.56358.log.gz 2023-12-07T10:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2023-12-07T10:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54225.log 2023-12-07T10:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47376.log 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54225.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.54225.log.gz 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49566.log 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54303.log 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47376.log.gz 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56775.log 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49566.log.gz 2023-12-07T10:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48735.log 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54303.log.gz 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50264.log 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56775.log.gz 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48735.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 88.7% 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48735.log.gz 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50264.log.gz 2023-12-07T10:03:25.063 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50406.log 2023-12-07T10:03:25.068 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2023-12-07T10:03:25.068 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2023-12-07T10:03:25.068 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45061.log 2023-12-07T10:03:25.068 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50406.log.gz 2023-12-07T10:03:25.068 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46654.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2023-12-07T10:03:25.068 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52050.log 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52745.log 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45061.log.gz 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56644.log 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52050.log.gz 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52745.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52745.log.gz 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.51161.log 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44069.log 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43853.log 2023-12-07T10:03:25.069 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.44069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44069.log.gz 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.43853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43853.log.gz 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38294.log 2023-12-07T10:03:25.070 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-07T10:03:25.071 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38294.log.gz 2023-12-07T10:03:25.072 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.b.log: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-07T10:03:25.072 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-07T10:03:25.073 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56644.log.gz 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50764.log 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51161.log.gz 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.50764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50764.log.gz 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55383.log 2023-12-07T10:03:25.074 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54037.log 2023-12-07T10:03:25.075 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz 2023-12-07T10:03:25.075 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-07T10:03:25.076 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55383.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55383.log.gz 2023-12-07T10:03:25.076 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2023-12-07T10:03:25.076 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53456.log 2023-12-07T10:03:25.077 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54037.log.gz 2023-12-07T10:03:25.077 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44029.log 2023-12-07T10:03:25.078 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2023-12-07T10:03:25.078 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55850.log 2023-12-07T10:03:25.078 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53456.log.gz 2023-12-07T10:03:25.080 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44029.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44029.log.gz 2023-12-07T10:03:25.080 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2023-12-07T10:03:25.080 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38342.log 2023-12-07T10:03:25.081 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51213.log 2023-12-07T10:03:25.081 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55850.log.gz 2023-12-07T10:03:25.082 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48497.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2023-12-07T10:03:25.082 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51527.log 2023-12-07T10:03:25.084 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43713.log 2023-12-07T10:03:25.084 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38342.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38342.log.gz 2023-12-07T10:03:25.084 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45690.log 2023-12-07T10:03:25.085 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51213.log.gz 2023-12-07T10:03:25.085 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51527.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51527.log.gz 2023-12-07T10:03:25.085 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44645.log 2023-12-07T10:03:25.085 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.1.43713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43713.log.gz 2023-12-07T10:03:25.086 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54011.log 2023-12-07T10:03:25.086 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45690.log.gz 2023-12-07T10:03:25.087 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44645.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44645.log.gz 2023-12-07T10:03:25.087 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2023-12-07T10:03:25.088 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48839.log 2023-12-07T10:03:25.088 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54011.log.gz 2023-12-07T10:03:25.089 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47220.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2023-12-07T10:03:25.090 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55519.log 2023-12-07T10:03:25.090 INFO:teuthology.orchestra.run.smithi097.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-07T10:03:25.091 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2023-12-07T10:03:25.091 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48839.log.gz 2023-12-07T10:03:25.092 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2023-12-07T10:03:25.092 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55519.log.gz 2023-12-07T10:03:25.093 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53207.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2023-12-07T10:03:25.093 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44517.log 2023-12-07T10:03:25.094 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45049.log 2023-12-07T10:03:25.094 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2023-12-07T10:03:25.095 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44517.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44517.log.gz 2023-12-07T10:03:25.095 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49514.log 2023-12-07T10:03:25.096 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2023-12-07T10:03:25.097 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45049.log.gz 2023-12-07T10:03:25.097 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49514.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49514.log.gz 2023-12-07T10:03:25.098 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54485.log 2023-12-07T10:03:25.099 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44631.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2023-12-07T10:03:25.099 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50538.log 2023-12-07T10:03:25.099 INFO:teuthology.orchestra.run.smithi089.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-07T10:03:25.100 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2023-12-07T10:03:25.100 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54485.log.gz 2023-12-07T10:03:25.101 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2023-12-07T10:03:25.101 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50538.log.gz 2023-12-07T10:03:25.102 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48709.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2023-12-07T10:03:25.103 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2023-12-07T10:03:25.103 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 2023-12-07T10:03:25.103 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2023-12-07T10:03:25.104 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45885.log 2023-12-07T10:03:25.105 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2023-12-07T10:03:25.105 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2023-12-07T10:03:25.105 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2023-12-07T10:03:25.107 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53838.log 2023-12-07T10:03:25.107 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45885.log.gz 2023-12-07T10:03:25.107 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46836.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2023-12-07T10:03:25.108 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2023-12-07T10:03:25.108 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.53838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53838.log.gz 2023-12-07T10:03:25.109 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50290.log 2023-12-07T10:03:25.109 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55980.log 2023-12-07T10:03:25.110 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2023-12-07T10:03:25.111 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46576.log 2023-12-07T10:03:25.111 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50290.log.gz 2023-12-07T10:03:25.112 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55753.log 2023-12-07T10:03:25.112 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55980.log.gz 2023-12-07T10:03:25.112 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46732.log 2023-12-07T10:03:25.113 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46576.log.gz 2023-12-07T10:03:25.113 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55753.log.gz 2023-12-07T10:03:25.114 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38086.log 2023-12-07T10:03:25.114 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55649.log 2023-12-07T10:03:25.115 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46732.log.gz 2023-12-07T10:03:25.115 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49826.log 2023-12-07T10:03:25.116 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38086.log.gz 2023-12-07T10:03:25.116 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52154.log 2023-12-07T10:03:25.117 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55649.log.gz 2023-12-07T10:03:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49670.log 2023-12-07T10:03:25.118 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49826.log.gz 2023-12-07T10:03:25.119 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52154.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52154.log.gz 2023-12-07T10:03:25.119 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2023-12-07T10:03:25.120 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 89.0% 2023-12-07T10:03:25.120 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49670.log.gz 2023-12-07T10:03:25.120 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51713.log 2023-12-07T10:03:25.121 INFO:teuthology.orchestra.run.smithi089.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2023-12-07T10:03:25.121 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50120.log 2023-12-07T10:03:25.122 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2023-12-07T10:03:25.123 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56084.log 2023-12-07T10:03:25.123 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51713.log.gz 2023-12-07T10:03:25.123 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50120.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50120.log.gz 2023-12-07T10:03:25.124 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55902.log 2023-12-07T10:03:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52440.log 2023-12-07T10:03:25.125 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56084.log.gz 2023-12-07T10:03:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38199.log 2023-12-07T10:03:25.126 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55902.log.gz 2023-12-07T10:03:25.126 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52440.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52440.log.gz 2023-12-07T10:03:25.126 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56058.log 2023-12-07T10:03:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49150.log 2023-12-07T10:03:25.128 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38199.log.gz 2023-12-07T10:03:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2023-12-07T10:03:25.128 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56058.log.gz 2023-12-07T10:03:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45531.log 2023-12-07T10:03:25.130 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49150.log.gz 2023-12-07T10:03:25.131 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50832.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 87.8% 2023-12-07T10:03:25.131 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz 2023-12-07T10:03:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45531.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45531.log.gz 2023-12-07T10:03:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55928.log 2023-12-07T10:03:25.132 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50937.log 2023-12-07T10:03:25.133 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2023-12-07T10:03:25.134 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55928.log.gz 2023-12-07T10:03:25.134 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51631.log 2023-12-07T10:03:25.135 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50937.log.gz 2023-12-07T10:03:25.135 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48813.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2023-12-07T10:03:25.136 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2023-12-07T10:03:25.137 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2023-12-07T10:03:25.137 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51631.log.gz 2023-12-07T10:03:25.138 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44838.log 2023-12-07T10:03:25.138 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2023-12-07T10:03:25.139 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49410.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2023-12-07T10:03:25.139 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50486.log 2023-12-07T10:03:25.140 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47484.log 2023-12-07T10:03:25.141 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44838.log.gz 2023-12-07T10:03:25.141 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50486.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50486.log.gz 2023-12-07T10:03:25.141 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44491.log 2023-12-07T10:03:25.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51107.log 2023-12-07T10:03:25.143 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47484.log.gz 2023-12-07T10:03:25.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44491.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44491.log.gz 2023-12-07T10:03:25.144 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48315.log 2023-12-07T10:03:25.145 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56112.log 2023-12-07T10:03:25.145 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51107.log.gz 2023-12-07T10:03:25.146 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48315.log: gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/ceph-client.admin.48315.log.gz 2023-12-07T10:03:25.146 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.49748.log 2023-12-07T10:03:25.147 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2023-12-07T10:03:25.147 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56112.log.gz 2023-12-07T10:03:25.148 INFO:teuthology.orchestra.run.smithi097.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-07T10:03:25.148 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49748.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49748.log.gz 2023-12-07T10:03:25.148 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44857.log 2023-12-07T10:03:25.149 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2023-12-07T10:03:25.149 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2023-12-07T10:03:25.150 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44857.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44857.log.gz 2023-12-07T10:03:25.151 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53234.log 2023-12-07T10:03:25.151 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45963.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2023-12-07T10:03:25.152 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50911.log 2023-12-07T10:03:25.153 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53234.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.53234.log.gz 2023-12-07T10:03:25.153 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2023-12-07T10:03:25.154 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50911.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50911.log.gz 2023-12-07T10:03:25.154 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-07T10:03:25.155 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46301.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2023-12-07T10:03:25.155 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55357.log 2023-12-07T10:03:25.156 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46706.log 2023-12-07T10:03:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55357.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55357.log.gz 2023-12-07T10:03:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56242.log 2023-12-07T10:03:25.158 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52896.log 2023-12-07T10:03:25.159 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46706.log.gz 2023-12-07T10:03:25.159 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56242.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56242.log.gz 2023-12-07T10:03:25.160 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2023-12-07T10:03:25.161 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47945.log 2023-12-07T10:03:25.161 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52896.log.gz 2023-12-07T10:03:25.162 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46249.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2023-12-07T10:03:25.163 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52180.log 2023-12-07T10:03:25.163 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.47945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47945.log.gz 2023-12-07T10:03:25.164 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48261.log 2023-12-07T10:03:25.165 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52180.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52180.log.gz 2023-12-07T10:03:25.165 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55331.log 2023-12-07T10:03:25.166 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56384.log 2023-12-07T10:03:25.167 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48261.log.gz 2023-12-07T10:03:25.167 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55331.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55331.log.gz 2023-12-07T10:03:25.168 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49176.log 2023-12-07T10:03:25.169 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54197.log 2023-12-07T10:03:25.169 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56384.log.gz 2023-12-07T10:03:25.170 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49176.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49176.log.gz 2023-12-07T10:03:25.170 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56697.log 2023-12-07T10:03:25.171 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54197.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54197.log.gz 2023-12-07T10:03:25.172 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55305.log 2023-12-07T10:03:25.173 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53716.log 2023-12-07T10:03:25.173 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56697.log.gz 2023-12-07T10:03:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2023-12-07T10:03:25.175 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55305.log.gz 2023-12-07T10:03:25.176 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53716.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2023-12-07T10:03:25.176 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50512.log 2023-12-07T10:03:25.177 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54592.log 2023-12-07T10:03:25.177 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2023-12-07T10:03:25.178 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50512.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50512.log.gz 2023-12-07T10:03:25.178 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2023-12-07T10:03:25.180 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54592.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54592.log.gz 2023-12-07T10:03:25.180 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2023-12-07T10:03:25.181 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52206.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2023-12-07T10:03:25.181 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54537.log 2023-12-07T10:03:25.182 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45479.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2023-12-07T10:03:25.183 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47246.log 2023-12-07T10:03:25.184 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51345.log 2023-12-07T10:03:25.184 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54537.log.gz 2023-12-07T10:03:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47246.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47246.log.gz 2023-12-07T10:03:25.185 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2023-12-07T10:03:25.187 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51345.log.gz 2023-12-07T10:03:25.187 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47402.log 2023-12-07T10:03:25.188 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50056.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2023-12-07T10:03:25.188 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2023-12-07T10:03:25.189 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2023-12-07T10:03:25.190 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47402.log.gz 2023-12-07T10:03:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51817.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2023-12-07T10:03:25.191 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55092.log 2023-12-07T10:03:25.192 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45505.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2023-12-07T10:03:25.192 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.51605.log 2023-12-07T10:03:25.194 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55092.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.56592.log -- replaced with /var/log/ceph/ceph-client.admin.55092.log.gz 2023-12-07T10:03:25.194 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.195 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51605.log: gzip -5 --verbose 87.6% -- /var/log/ceph/ceph-client.admin.47987.log -- replaced with /var/log/ceph/ceph-client.admin.51605.log.gz 2023-12-07T10:03:25.195 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.197 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2023-12-07T10:03:25.197 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56592.log.gz 2023-12-07T10:03:25.198 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52511.log 2023-12-07T10:03:25.198 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47987.log.gz 2023-12-07T10:03:25.200 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53000.log 2023-12-07T10:03:25.200 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz 2023-12-07T10:03:25.201 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52511.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52511.log.gz 2023-12-07T10:03:25.201 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2023-12-07T10:03:25.202 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49462.log 2023-12-07T10:03:25.203 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53000.log.gz 2023-12-07T10:03:25.204 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45911.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2023-12-07T10:03:25.204 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50564.log 2023-12-07T10:03:25.205 INFO:teuthology.orchestra.run.smithi097.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-07T10:03:25.205 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49462.log.gz 2023-12-07T10:03:25.206 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2023-12-07T10:03:25.206 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2023-12-07T10:03:25.207 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50564.log.gz 2023-12-07T10:03:25.207 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45059.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2023-12-07T10:03:25.208 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44309.log 2023-12-07T10:03:25.209 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46015.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2023-12-07T10:03:25.209 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45349.log 2023-12-07T10:03:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49228.log 2023-12-07T10:03:25.211 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44309.log.gz 2023-12-07T10:03:25.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45349.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45349.log.gz 2023-12-07T10:03:25.212 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55036.log 2023-12-07T10:03:25.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49228.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49228.log.gz 2023-12-07T10:03:25.213 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51423.log 2023-12-07T10:03:25.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53314.log 2023-12-07T10:03:25.215 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55036.log.gz 2023-12-07T10:03:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51423.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51423.log.gz 2023-12-07T10:03:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44832.log 2023-12-07T10:03:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53314.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53314.log.gz 2023-12-07T10:03:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49358.log 2023-12-07T10:03:25.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47018.log 2023-12-07T10:03:25.219 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44832.log.gz 2023-12-07T10:03:25.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49358.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49358.log.gz 2023-12-07T10:03:25.220 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55279.log 2023-12-07T10:03:25.221 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47018.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47018.log.gz 2023-12-07T10:03:25.221 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46940.log 2023-12-07T10:03:25.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2023-12-07T10:03:25.223 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55279.log.gz 2023-12-07T10:03:25.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46940.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46940.log.gz 2023-12-07T10:03:25.224 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45037.log 2023-12-07T10:03:25.225 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2023-12-07T10:03:25.225 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53907.log 2023-12-07T10:03:25.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2023-12-07T10:03:25.227 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45037.log.gz 2023-12-07T10:03:25.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53907.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53907.log.gz 2023-12-07T10:03:25.228 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53690.log 2023-12-07T10:03:25.229 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46602.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2023-12-07T10:03:25.229 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2023-12-07T10:03:25.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53342.log 2023-12-07T10:03:25.231 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53690.log.gz 2023-12-07T10:03:25.232 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50185.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2023-12-07T10:03:25.232 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2023-12-07T10:03:25.233 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53342.log.gz 2023-12-07T10:03:25.233 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46888.log 2023-12-07T10:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50858.log 2023-12-07T10:03:25.235 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2023-12-07T10:03:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46888.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46888.log.gz 2023-12-07T10:03:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51579.log 2023-12-07T10:03:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50858.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50858.log.gz 2023-12-07T10:03:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2023-12-07T10:03:25.239 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54065.log 2023-12-07T10:03:25.239 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51579.log.gz 2023-12-07T10:03:25.240 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49098.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2023-12-07T10:03:25.240 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2023-12-07T10:03:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54065.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54065.log.gz 2023-12-07T10:03:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49436.log 2023-12-07T10:03:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48627.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2023-12-07T10:03:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52667.log 2023-12-07T10:03:25.245 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49436.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49436.log.gz 2023-12-07T10:03:25.245 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51849.log 2023-12-07T10:03:25.246 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52667.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52667.log.gz 2023-12-07T10:03:25.246 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2023-12-07T10:03:25.247 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51849.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51849.log.gzgzip 2023-12-07T10:03:25.248 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2023-12-07T10:03:25.249 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz -5 2023-12-07T10:03:25.249 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2023-12-07T10:03:25.251 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52537.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2023-12-07T10:03:25.251 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2023-12-07T10:03:25.252 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47614.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2023-12-07T10:03:25.252 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53026.log 2023-12-07T10:03:25.254 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47588.log 2023-12-07T10:03:25.254 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2023-12-07T10:03:25.255 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53026.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53026.log.gz 2023-12-07T10:03:25.255 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51661.log 2023-12-07T10:03:25.256 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47588.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-07T10:03:25.257 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47588.log.gz 2023-12-07T10:03:25.257 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51661.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51661.log.gz 2023-12-07T10:03:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2023-12-07T10:03:25.259 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55779.log 2023-12-07T10:03:25.260 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47536.log 2023-12-07T10:03:25.261 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2023-12-07T10:03:25.262 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45065.log 2023-12-07T10:03:25.262 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55779.log.gz 2023-12-07T10:03:25.263 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2023-12-07T10:03:25.263 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47536.log.gz 2023-12-07T10:03:25.265 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45065.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.45065.log.gz --verbose 2023-12-07T10:03:25.265 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.47430.log 2023-12-07T10:03:25.266 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2023-12-07T10:03:25.266 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2023-12-07T10:03:25.268 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47430.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2023-12-07T10:03:25.268 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52693.log 2023-12-07T10:03:25.269 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2023-12-07T10:03:25.269 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2023-12-07T10:03:25.270 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52693.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52693.log.gz 2023-12-07T10:03:25.271 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2023-12-07T10:03:25.272 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56032.log 2023-12-07T10:03:25.272 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2023-12-07T10:03:25.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46223.log 2023-12-07T10:03:25.274 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2023-12-07T10:03:25.275 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2023-12-07T10:03:25.275 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56032.log.gz 2023-12-07T10:03:25.276 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44225.log 2023-12-07T10:03:25.277 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46223.log.gz 2023-12-07T10:03:25.278 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44852.log 2023-12-07T10:03:25.278 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2023-12-07T10:03:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2023-12-07T10:03:25.279 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44225.log.gz 2023-12-07T10:03:25.281 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56216.log 2023-12-07T10:03:25.281 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44852.log.gz 2023-12-07T10:03:25.282 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56488.log 2023-12-07T10:03:25.282 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2023-12-07T10:03:25.283 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44637.log 2023-12-07T10:03:25.284 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56216.log.gz 2023-12-07T10:03:25.285 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52842.log 2023-12-07T10:03:25.285 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56488.log.gz 2023-12-07T10:03:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47692.log 2023-12-07T10:03:25.287 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44637.log.gz 2023-12-07T10:03:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52842.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52842.log.gz 2023-12-07T10:03:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2023-12-07T10:03:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46784.log 2023-12-07T10:03:25.290 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47692.log.gz 2023-12-07T10:03:25.290 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2023-12-07T10:03:25.291 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2023-12-07T10:03:25.292 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.54865.log 2023-12-07T10:03:25.292 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46784.log.gz 2023-12-07T10:03:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55170.log 2023-12-07T10:03:25.294 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2023-12-07T10:03:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.testuser.54865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.54865.log.gz 2023-12-07T10:03:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48419.log 2023-12-07T10:03:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55170.log.gz 2023-12-07T10:03:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.51904.log 2023-12-07T10:03:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45046.log 2023-12-07T10:03:25.298 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48419.log.gz 2023-12-07T10:03:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.testuser.51904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.51904.log.gz 2023-12-07T10:03:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53090.log 2023-12-07T10:03:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54171.log 2023-12-07T10:03:25.301 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45046.log.gz 2023-12-07T10:03:25.302 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47562.log 2023-12-07T10:03:25.302 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53090.log.gz 2023-12-07T10:03:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52868.log 2023-12-07T10:03:25.304 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54171.log.gz 2023-12-07T10:03:25.305 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2023-12-07T10:03:25.305 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47562.log.gz 2023-12-07T10:03:25.307 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2023-12-07T10:03:25.307 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52868.log.gz 2023-12-07T10:03:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48994.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-07T10:03:25.308 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2023-12-07T10:03:25.310 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44543.log 2023-12-07T10:03:25.310 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2023-12-07T10:03:25.311 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2023-12-07T10:03:25.312 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44543.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44543.log.gz 2023-12-07T10:03:25.312 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55248.log 2023-12-07T10:03:25.314 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51972.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2023-12-07T10:03:25.314 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2023-12-07T10:03:25.315 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55248.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55248.log.gz 2023-12-07T10:03:25.316 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50590.log 2023-12-07T10:03:25.317 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46810.log 2023-12-07T10:03:25.317 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2023-12-07T10:03:25.318 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50590.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50590.log.gz 2023-12-07T10:03:25.319 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55623.log 2023-12-07T10:03:25.319 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46810.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46810.log.gz 2023-12-07T10:03:25.320 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45859.log 2023-12-07T10:03:25.321 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55623.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.55623.log.gz 2023-12-07T10:03:25.322 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2023-12-07T10:03:25.323 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2023-12-07T10:03:25.323 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45859.log.gz 2023-12-07T10:03:25.324 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54906.log 2023-12-07T10:03:25.324 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2023-12-07T10:03:25.326 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44094.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2023-12-07T10:03:25.326 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2023-12-07T10:03:25.327 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56436.log 2023-12-07T10:03:25.327 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54906.log.gz 2023-12-07T10:03:25.329 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48761.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2023-12-07T10:03:25.329 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53959.log 2023-12-07T10:03:25.330 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56436.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56436.log.gz 2023-12-07T10:03:25.330 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-07T10:03:25.331 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2023-12-07T10:03:25.332 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53959.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53959.log.gz 2023-12-07T10:03:25.332 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50316.log 2023-12-07T10:03:25.333 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2023-12-07T10:03:25.334 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2023-12-07T10:03:25.334 INFO:teuthology.orchestra.run.smithi097.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-07T10:03:25.335 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53560.log 2023-12-07T10:03:25.335 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50316.log.gz 2023-12-07T10:03:25.337 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51019.log 2023-12-07T10:03:25.337 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2023-12-07T10:03:25.337 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2023-12-07T10:03:25.337 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53560.log.gz 2023-12-07T10:03:25.339 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51019.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51019.log.gz 2023-12-07T10:03:25.339 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56566.log 2023-12-07T10:03:25.341 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50780.log 2023-12-07T10:03:25.341 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2023-12-07T10:03:25.342 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48601.log 2023-12-07T10:03:25.342 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56566.log.gz 2023-12-07T10:03:25.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2023-12-07T10:03:25.344 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50780.log.gz 2023-12-07T10:03:25.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56880.log 2023-12-07T10:03:25.345 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48601.log.gz 2023-12-07T10:03:25.346 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52128.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2023-12-07T10:03:25.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2023-12-07T10:03:25.348 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56880.log.gz 2023-12-07T10:03:25.348 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55597.log 2023-12-07T10:03:25.350 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55876.log 2023-12-07T10:03:25.350 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2023-12-07T10:03:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47666.log 2023-12-07T10:03:25.352 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55597.log.gz 2023-12-07T10:03:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55876.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55876.log.gz 2023-12-07T10:03:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53058.log 2023-12-07T10:03:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47640.log 2023-12-07T10:03:25.355 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47666.log.gz 2023-12-07T10:03:25.356 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53286.log 2023-12-07T10:03:25.356 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53058.log.gz 2023-12-07T10:03:25.357 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56514.log 2023-12-07T10:03:25.358 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47640.log.gz 2023-12-07T10:03:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53638.log 2023-12-07T10:03:25.359 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53286.log.gz 2023-12-07T10:03:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48341.log 2023-12-07T10:03:25.361 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56514.log.gz 2023-12-07T10:03:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53933.log 2023-12-07T10:03:25.362 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53638.log.gz 2023-12-07T10:03:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44854.log 2023-12-07T10:03:25.363 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48341.log.gz 2023-12-07T10:03:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54700.log 2023-12-07T10:03:25.365 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53933.log.gz 2023-12-07T10:03:25.366 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50806.log 2023-12-07T10:03:25.366 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44854.log.gz 2023-12-07T10:03:25.367 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54700.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54700.log.gz 2023-12-07T10:03:25.368 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44595.log 2023-12-07T10:03:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50806.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50806.log.gz 2023-12-07T10:03:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51791.log 2023-12-07T10:03:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44595.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44595.log.gz 2023-12-07T10:03:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2023-12-07T10:03:25.372 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51791.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.51687.log -- replaced with /var/log/ceph/ceph-client.admin.51791.log.gz 2023-12-07T10:03:25.373 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38321.log 2023-12-07T10:03:25.374 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2023-12-07T10:03:25.375 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49332.log 2023-12-07T10:03:25.375 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51687.log.gz 2023-12-07T10:03:25.376 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38321.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38321.log.gz 2023-12-07T10:03:25.377 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56190.log 2023-12-07T10:03:25.378 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49332.log: gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.46327.log -- replaced with /var/log/ceph/ceph-client.admin.49332.log.gz 2023-12-07T10:03:25.379 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.380 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2023-12-07T10:03:25.380 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56190.log.gz 2023-12-07T10:03:25.381 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2023-12-07T10:03:25.381 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46327.log.gz 2023-12-07T10:03:25.383 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56801.log 2023-12-07T10:03:25.383 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2023-12-07T10:03:25.384 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45271.log 2023-12-07T10:03:25.384 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2023-12-07T10:03:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56801.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.56801.log.gz 2023-12-07T10:03:25.386 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2023-12-07T10:03:25.387 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2023-12-07T10:03:25.387 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45271.log.gz 2023-12-07T10:03:25.388 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53376.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2023-12-07T10:03:25.389 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2023-12-07T10:03:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52414.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz 2023-12-07T10:03:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2023-12-07T10:03:25.392 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2023-12-07T10:03:25.392 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2023-12-07T10:03:25.393 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47899.log 2023-12-07T10:03:25.393 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2023-12-07T10:03:25.394 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56906.log 2023-12-07T10:03:25.395 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2023-12-07T10:03:25.395 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47899.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47899.log.gz 2023-12-07T10:03:25.396 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-07T10:03:25.397 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2023-12-07T10:03:25.398 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56906.log.gz 2023-12-07T10:03:25.399 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56138.log 2023-12-07T10:03:25.400 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49873.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-07T10:03:25.400 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2023-12-07T10:03:25.401 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53985.log 2023-12-07T10:03:25.402 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56138.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56138.log.gz 2023-12-07T10:03:25.402 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2023-12-07T10:03:25.404 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2023-12-07T10:03:25.404 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53985.log.gz 2023-12-07T10:03:25.405 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2023-12-07T10:03:25.406 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2023-12-07T10:03:25.407 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48145.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz -5 2023-12-07T10:03:25.407 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46545.log 2023-12-07T10:03:25.408 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46992.log 2023-12-07T10:03:25.408 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2023-12-07T10:03:25.410 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56856.log 2023-12-07T10:03:25.410 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46545.log.gz 2023-12-07T10:03:25.411 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2023-12-07T10:03:25.411 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46992.log.gz 2023-12-07T10:03:25.413 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56856.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.56856.log.gz --verbose 2023-12-07T10:03:25.413 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.46758.log 2023-12-07T10:03:25.414 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47458.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2023-12-07T10:03:25.414 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52336.log 2023-12-07T10:03:25.415 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46758.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46758.log.gz 2023-12-07T10:03:25.416 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52102.log 2023-12-07T10:03:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53260.log 2023-12-07T10:03:25.417 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52336.log.gz 2023-12-07T10:03:25.418 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52102.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52102.log.gz 2023-12-07T10:03:25.419 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44173.log 2023-12-07T10:03:25.420 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2023-12-07T10:03:25.420 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53260.log.gz 2023-12-07T10:03:25.422 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46517.log 2023-12-07T10:03:25.422 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44173.log.gz 2023-12-07T10:03:25.423 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50432.log 2023-12-07T10:03:25.423 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2023-12-07T10:03:25.425 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53612.log 2023-12-07T10:03:25.425 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46517.log.gz 2023-12-07T10:03:25.426 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49696.log 2023-12-07T10:03:25.426 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50432.log.gz 2023-12-07T10:03:25.428 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56618.log 2023-12-07T10:03:25.428 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53612.log.gz 2023-12-07T10:03:25.429 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49696.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.49696.log.gz -5 2023-12-07T10:03:25.429 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49540.log 2023-12-07T10:03:25.431 INFO:teuthology.orchestra.run.smithi097.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-07T10:03:25.431 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54119.log 2023-12-07T10:03:25.431 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56618.log.gz 2023-12-07T10:03:25.432 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49540.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.49540.log.gz 2023-12-07T10:03:25.432 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55196.log 2023-12-07T10:03:25.434 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54119.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54119.log.gz 2023-12-07T10:03:25.434 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48093.log 2023-12-07T10:03:25.435 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55196.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55196.log.gz 2023-12-07T10:03:25.435 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2023-12-07T10:03:25.437 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52563.log 2023-12-07T10:03:25.437 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48093.log.gz 2023-12-07T10:03:25.438 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47324.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2023-12-07T10:03:25.439 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50458.log 2023-12-07T10:03:25.439 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52563.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52563.log.gz 2023-12-07T10:03:25.440 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51293.log 2023-12-07T10:03:25.441 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50458.log.gz 2023-12-07T10:03:25.442 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53482.log 2023-12-07T10:03:25.443 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-07T10:03:25.443 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56827.log 2023-12-07T10:03:25.443 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51293.log.gz 2023-12-07T10:03:25.444 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51765.log 2023-12-07T10:03:25.445 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53482.log.gz 2023-12-07T10:03:25.446 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2023-12-07T10:03:25.446 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56827.log.gz 2023-12-07T10:03:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51765.log: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-07T10:03:25.450 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51765.log.gz 2023-12-07T10:03:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54566.log 2023-12-07T10:03:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46067.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2023-12-07T10:03:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52948.log 2023-12-07T10:03:25.451 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54566.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54566.log.gz 2023-12-07T10:03:25.451 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52922.log 2023-12-07T10:03:25.452 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-07T10:03:25.452 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-07T10:03:25.452 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m0.432s 2023-12-07T10:03:25.452 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m1.826s 2023-12-07T10:03:25.452 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m0.197s 2023-12-07T10:03:25.453 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.52948.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54648.log 2023-12-07T10:03:25.453 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52948.log.gz 2023-12-07T10:03:25.453 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52922.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52922.log.gz 2023-12-07T10:03:25.454 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53742.log 2023-12-07T10:03:25.454 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53664.log 2023-12-07T10:03:25.455 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54648.log.gz 2023-12-07T10:03:25.455 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 91.0% 2023-12-07T10:03:25.455 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53742.log.gz 2023-12-07T10:03:25.456 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47272.log 2023-12-07T10:03:25.457 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53664.log.gz 2023-12-07T10:03:25.457 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50237.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2023-12-07T10:03:25.458 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55409.log 2023-12-07T10:03:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56410.log 2023-12-07T10:03:25.460 INFO:teuthology.orchestra.run.smithi089.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47272.log.gz 2023-12-07T10:03:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55409.log.gz 2023-12-07T10:03:25.460 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53586.log 2023-12-07T10:03:25.461 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.56410.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45297.log 2023-12-07T10:03:25.462 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56410.log.gz 2023-12-07T10:03:25.462 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53586.log: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-07T10:03:25.463 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53586.log.gz 2023-12-07T10:03:25.463 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54674.log 2023-12-07T10:03:25.464 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56540.log 2023-12-07T10:03:25.464 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54674.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45297.log.gz 2023-12-07T10:03:25.465 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2023-12-07T10:03:25.465 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54674.log.gz 2023-12-07T10:03:25.466 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2023-12-07T10:03:25.466 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56540.log.gz 2023-12-07T10:03:25.467 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46275.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2023-12-07T10:03:25.467 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54932.log 2023-12-07T10:03:25.468 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49800.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2023-12-07T10:03:25.468 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2023-12-07T10:03:25.469 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54932.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54932.log.gz 2023-12-07T10:03:25.469 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51946.log 2023-12-07T10:03:25.470 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45609.log 2023-12-07T10:03:25.471 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2023-12-07T10:03:25.471 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51946.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51946.log.gz -5 2023-12-07T10:03:25.472 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50030.log 2023-12-07T10:03:25.472 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45609.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45609.log.gz 2023-12-07T10:03:25.473 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2023-12-07T10:03:25.474 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50030.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50030.log.gz -- 2023-12-07T10:03:25.474 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.46439.log 2023-12-07T10:03:25.475 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2023-12-07T10:03:25.475 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2023-12-07T10:03:25.476 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46439.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46439.log.gz 2023-12-07T10:03:25.476 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54984.log 2023-12-07T10:03:25.477 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51135.log 2023-12-07T10:03:25.477 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2023-12-07T10:03:25.478 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54984.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54984.log.gz 2023-12-07T10:03:25.478 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2023-12-07T10:03:25.480 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48653.log 2023-12-07T10:03:25.480 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51135.log.gz 2023-12-07T10:03:25.481 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46465.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2023-12-07T10:03:25.481 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52232.log 2023-12-07T10:03:25.482 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48653.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48653.log.gz 2023-12-07T10:03:25.482 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48393.log 2023-12-07T10:03:25.483 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52232.log.gz 2023-12-07T10:03:25.483 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48523.log 2023-12-07T10:03:25.484 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48393.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48393.log.gz 2023-12-07T10:03:25.485 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2023-12-07T10:03:25.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2023-12-07T10:03:25.486 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48523.log.gz 2023-12-07T10:03:25.487 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49280.log 2023-12-07T10:03:25.487 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2023-12-07T10:03:25.488 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2023-12-07T10:03:25.488 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56671.log 2023-12-07T10:03:25.489 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52974.log 2023-12-07T10:03:25.489 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2023-12-07T10:03:25.490 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56671.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56671.log.gz 2023-12-07T10:03:25.490 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55727.log 2023-12-07T10:03:25.491 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52615.log 2023-12-07T10:03:25.491 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52974.log.gz 2023-12-07T10:03:25.492 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55727.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55727.log.gz 2023-12-07T10:03:25.492 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-07T10:03:25.493 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55062.log 2023-12-07T10:03:25.494 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52615.log.gz 2023-12-07T10:03:25.494 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-07T10:03:25.495 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55062.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55062.log.gz 2023-12-07T10:03:25.496 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2023-12-07T10:03:25.496 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-07T10:03:25.497 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-mds.c.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53881.log 2023-12-07T10:03:25.498 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44387.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2023-12-07T10:03:25.498 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50642.log 2023-12-07T10:03:25.499 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54329.log 2023-12-07T10:03:25.500 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2023-12-07T10:03:25.500 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50642.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50642.log.gz 2023-12-07T10:03:25.501 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52362.log 2023-12-07T10:03:25.502 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56332.log 2023-12-07T10:03:25.502 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54329.log.gz 2023-12-07T10:03:25.503 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52362.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52362.log.gz 2023-12-07T10:03:25.503 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45557.log 2023-12-07T10:03:25.504 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48235.log 2023-12-07T10:03:25.505 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56332.log.gz 2023-12-07T10:03:25.506 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45557.log.gz 2023-12-07T10:03:25.506 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-07T10:03:25.507 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48235.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48235.log.gz 2023-12-07T10:03:25.507 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47961.log 2023-12-07T10:03:25.508 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47350.log 2023-12-07T10:03:25.510 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47961.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47961.log.gz 2023-12-07T10:03:25.510 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52076.log 2023-12-07T10:03:25.512 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47350.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47350.log.gz 2023-12-07T10:03:25.512 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2023-12-07T10:03:25.513 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52076.log: gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.51053.log -- replaced with /var/log/ceph/ceph-client.admin.52076.log.gz 2023-12-07T10:03:25.513 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.514 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45401.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2023-12-07T10:03:25.515 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2023-12-07T10:03:25.516 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51053.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51053.log.gz 2023-12-07T10:03:25.516 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55467.log 2023-12-07T10:03:25.518 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52719.log 2023-12-07T10:03:25.518 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2023-12-07T10:03:25.519 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55467.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55467.log.gz 2023-12-07T10:03:25.519 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50004.log 2023-12-07T10:03:25.521 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2023-12-07T10:03:25.521 INFO:teuthology.orchestra.run.smithi089.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-07T10:03:25.521 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52719.log.gz 2023-12-07T10:03:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50004.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50004.log.gz 2023-12-07T10:03:25.522 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2023-12-07T10:03:25.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53508.log 2023-12-07T10:03:25.524 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2023-12-07T10:03:25.525 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46197.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2023-12-07T10:03:25.525 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2023-12-07T10:03:25.526 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56462.log 2023-12-07T10:03:25.526 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53508.log.gz 2023-12-07T10:03:25.527 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46680.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2023-12-07T10:03:25.528 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44199.log 2023-12-07T10:03:25.529 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48065.log 87.9% 2023-12-07T10:03:25.529 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56462.log.gz 2023-12-07T10:03:25.531 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44199.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44199.log.gz 2023-12-07T10:03:25.531 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52771.log 2023-12-07T10:03:25.532 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56749.log 2023-12-07T10:03:25.532 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48065.log.gz 2023-12-07T10:03:25.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52771.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52771.log.gz 2023-12-07T10:03:25.533 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47718.log 2023-12-07T10:03:25.534 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2023-12-07T10:03:25.535 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56749.log.gz 2023-12-07T10:03:25.535 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47718.log.gz 2023-12-07T10:03:25.536 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52310.log 2023-12-07T10:03:25.537 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54622.log 2023-12-07T10:03:25.537 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2023-12-07T10:03:25.538 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52310.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52310.log.gz 2023-12-07T10:03:25.538 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47044.log 2023-12-07T10:03:25.539 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54355.log 2023-12-07T10:03:25.540 INFO:teuthology.orchestra.run.smithi089.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54622.log.gz 2023-12-07T10:03:25.540 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47044.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47044.log.gz 2023-12-07T10:03:25.540 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54459.log 2023-12-07T10:03:25.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56306.log 2023-12-07T10:03:25.542 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54355.log.gz 2023-12-07T10:03:25.543 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54459.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54459.log.gz 2023-12-07T10:03:25.543 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2023-12-07T10:03:25.544 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2023-12-07T10:03:25.544 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56306.log.gz 2023-12-07T10:03:25.545 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43928.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2023-12-07T10:03:25.545 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2023-12-07T10:03:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2023-12-07T10:03:25.547 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2023-12-07T10:03:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52388.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2023-12-07T10:03:25.548 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52485.log 2023-12-07T10:03:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44569.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2023-12-07T10:03:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46379.log 2023-12-07T10:03:25.551 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52485.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52485.log.gz 2023-12-07T10:03:25.551 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54381.log 2023-12-07T10:03:25.552 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46379.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2023-12-07T10:03:25.552 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2023-12-07T10:03:25.553 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2023-12-07T10:03:25.554 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54381.log.gz 2023-12-07T10:03:25.555 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47167.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2023-12-07T10:03:25.555 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2023-12-07T10:03:25.556 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49020.log 2023-12-07T10:03:25.556 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2023-12-07T10:03:25.557 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2023-12-07T10:03:25.557 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2023-12-07T10:03:25.558 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55545.log 2023-12-07T10:03:25.559 INFO:teuthology.orchestra.run.smithi089.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2023-12-07T10:03:25.560 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44147.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2023-12-07T10:03:25.560 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2023-12-07T10:03:25.562 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55545.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55545.log.gz 2023-12-07T10:03:25.562 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49618.log 2023-12-07T10:03:25.563 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48287.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2023-12-07T10:03:25.563 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55571.log 2023-12-07T10:03:25.564 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49618.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49618.log.gz 2023-12-07T10:03:25.564 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55493.log 2023-12-07T10:03:25.566 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48173.log 2023-12-07T10:03:25.566 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55571.log.gz 2023-12-07T10:03:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55493.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55493.log.gz 2023-12-07T10:03:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49774.log 2023-12-07T10:03:25.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48173.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48173.log.gz 2023-12-07T10:03:25.569 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44439.log 2023-12-07T10:03:25.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51267.log 2023-12-07T10:03:25.570 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49774.log.gz 2023-12-07T10:03:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44439.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44439.log.gz 2023-12-07T10:03:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50885.log 2023-12-07T10:03:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51267.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51267.log.gz 2023-12-07T10:03:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46628.log 2023-12-07T10:03:25.574 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50885.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50885.log.gz 2023-12-07T10:03:25.575 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2023-12-07T10:03:25.575 INFO:teuthology.orchestra.run.smithi089.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-07T10:03:25.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46628.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46628.log.gz 2023-12-07T10:03:25.576 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2023-12-07T10:03:25.577 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44648.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2023-12-07T10:03:25.577 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44633.log 2023-12-07T10:03:25.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2023-12-07T10:03:25.578 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2023-12-07T10:03:25.580 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44633.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2023-12-07T10:03:25.580 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56723.log 2023-12-07T10:03:25.581 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48679.log 2023-12-07T10:03:25.581 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz 2023-12-07T10:03:25.582 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56723.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56723.log.gz 2023-12-07T10:03:25.582 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52258.log 2023-12-07T10:03:25.582 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-07T10:03:25.583 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46914.log 2023-12-07T10:03:25.583 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48679.log.gz 2023-12-07T10:03:25.584 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52258.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52258.log.gz 2023-12-07T10:03:25.584 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2023-12-07T10:03:25.585 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44281.log 2023-12-07T10:03:25.585 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46914.log.gz 2023-12-07T10:03:25.586 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45453.log 2023-12-07T10:03:25.586 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2023-12-07T10:03:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53155.log 2023-12-07T10:03:25.587 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44281.log.gz 2023-12-07T10:03:25.588 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2023-12-07T10:03:25.588 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45453.log.gz 2023-12-07T10:03:25.589 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2023-12-07T10:03:25.589 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53155.log.gz 2023-12-07T10:03:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47823.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2023-12-07T10:03:25.590 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2023-12-07T10:03:25.591 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2023-12-07T10:03:25.591 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2023-12-07T10:03:25.592 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55675.log 2023-12-07T10:03:25.592 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2023-12-07T10:03:25.593 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2023-12-07T10:03:25.593 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2023-12-07T10:03:25.594 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2023-12-07T10:03:25.594 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55675.log.gz 2023-12-07T10:03:25.595 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44465.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2023-12-07T10:03:25.595 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54145.log 2023-12-07T10:03:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54093.log 2023-12-07T10:03:25.596 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2023-12-07T10:03:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54145.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33251.log 2023-12-07T10:03:25.597 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54145.log.gz 2023-12-07T10:03:25.598 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2023-12-07T10:03:25.598 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54093.log.gz 2023-12-07T10:03:25.598 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.33251.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33251.log.gz 2023-12-07T10:03:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52024.log 2023-12-07T10:03:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.48952.log 2023-12-07T10:03:25.600 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2023-12-07T10:03:25.600 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2023-12-07T10:03:25.601 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52024.log.gz 2023-12-07T10:03:25.601 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.testuser.48952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.48952.log.gz 2023-12-07T10:03:25.601 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45833.log 2023-12-07T10:03:25.602 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48575.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2023-12-07T10:03:25.603 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53181.log 2023-12-07T10:03:25.603 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54251.log 2023-12-07T10:03:25.604 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45833.log.gz 2023-12-07T10:03:25.604 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50088.log 2023-12-07T10:03:25.604 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53181.log.gz 2023-12-07T10:03:25.605 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55144.log 2023-12-07T10:03:25.605 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54251.log.gz 2023-12-07T10:03:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50088.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50088.log.gz 2023-12-07T10:03:25.606 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53534.log 2023-12-07T10:03:25.607 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51553.log 2023-12-07T10:03:25.607 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55144.log.gz 2023-12-07T10:03:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48787.log 2023-12-07T10:03:25.608 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53534.log.gz 2023-12-07T10:03:25.609 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56268.log 2023-12-07T10:03:25.609 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51553.log.gz 2023-12-07T10:03:25.610 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48787.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48787.log.gz 2023-12-07T10:03:25.610 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2023-12-07T10:03:25.611 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54778.log 2023-12-07T10:03:25.611 INFO:teuthology.orchestra.run.smithi089.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56268.log.gz 2023-12-07T10:03:25.612 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54752.log 2023-12-07T10:03:25.612 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2023-12-07T10:03:25.613 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51998.log 2023-12-07T10:03:25.613 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54778.log.gz 2023-12-07T10:03:25.614 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2023-12-07T10:03:25.614 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54752.log.gz 2023-12-07T10:03:25.615 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 87.8% 2023-12-07T10:03:25.615 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51998.log.gz 2023-12-07T10:03:25.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-07T10:03:25.616 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54958.log 2023-12-07T10:03:25.616 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2023-12-07T10:03:25.617 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.48201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54407.log 2023-12-07T10:03:25.617 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2023-12-07T10:03:25.618 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54958.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.54958.log.gz 2023-12-07T10:03:25.618 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51319.log 2023-12-07T10:03:25.619 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55010.log 2023-12-07T10:03:25.619 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54407.log.gz 2023-12-07T10:03:25.620 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51319.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.51319.log.gz 2023-12-07T10:03:25.620 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46491.log 2023-12-07T10:03:25.621 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52641.log 2023-12-07T10:03:25.621 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55010.log.gz 2023-12-07T10:03:25.622 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46491.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46491.log.gz -- 2023-12-07T10:03:25.622 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.49978.log 2023-12-07T10:03:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.52641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55701.log 2023-12-07T10:03:25.623 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52641.log.gz 2023-12-07T10:03:25.623 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49978.log: gzip -5 89.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz -- 2023-12-07T10:03:25.624 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.51920.log 2023-12-07T10:03:25.624 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45063.log 2023-12-07T10:03:25.625 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55701.log.gz 2023-12-07T10:03:25.625 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54726.log 2023-12-07T10:03:25.626 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51920.log.gz 2023-12-07T10:03:25.626 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2023-12-07T10:03:25.626 INFO:teuthology.orchestra.run.smithi089.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45063.log.gz 2023-12-07T10:03:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54726.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54726.log.gz 2023-12-07T10:03:25.627 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50718.log 2023-12-07T10:03:25.628 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.53792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55435.log 2023-12-07T10:03:25.629 INFO:teuthology.orchestra.run.smithi089.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2023-12-07T10:03:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.50718.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50718.log.gz 2023-12-07T10:03:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55118.log 2023-12-07T10:03:25.630 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55435.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55435.log.gz 2023-12-07T10:03:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56006.log 2023-12-07T10:03:25.631 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.55118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51187.log 2023-12-07T10:03:25.632 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55118.log.gz 2023-12-07T10:03:25.632 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.56006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54433.log 2023-12-07T10:03:25.633 INFO:teuthology.orchestra.run.smithi089.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56006.log.gz 2023-12-07T10:03:25.634 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.51187.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51187.log.gz 2023-12-07T10:03:25.634 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49644.log 2023-12-07T10:03:25.635 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.54433.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54433.log.gz 2023-12-07T10:03:25.636 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.49644.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49644.log.gz 2023-12-07T10:03:25.700 INFO:teuthology.orchestra.run.smithi089.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-07T10:03:25.726 INFO:teuthology.orchestra.run.smithi089.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-07T10:03:25.728 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T10:03:25.728 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m0.727s 2023-12-07T10:03:25.728 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m2.540s 2023-12-07T10:03:25.728 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.999s 2023-12-07T10:03:25.729 INFO:tasks.ceph:Archiving logs... 2023-12-07T10:03:25.729 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/remote/smithi089/log 2023-12-07T10:03:25.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T10:03:26.398 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/remote/smithi097/log 2023-12-07T10:03:26.399 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T10:03:26.622 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-07T10:03:26.632 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-07T10:03:26.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-07T10:03:26.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-07T10:03:26.722 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-07T10:03:26.731 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-07T10:03:26.732 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T10:03:26.735 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T10:03:26.747 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2023-12-07T10:03:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2023-12-07T10:03:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:*hv01.front.sepi 44.4.53.2 2 u 35 64 377 0.066 -2.371 0.967 2023-12-07T10:03:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.064 +0.852 1.691 2023-12-07T10:03:26.747 INFO:teuthology.orchestra.run.smithi089.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.099 -1.790 1.232 2023-12-07T10:03:26.748 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T10:03:26.751 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2023-12-07T10:03:26.752 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2023-12-07T10:03:26.752 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 44.4.53.2 2 u 29 64 377 0.069 -1.031 0.924 2023-12-07T10:03:26.752 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.096 +0.304 0.728 2023-12-07T10:03:26.752 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 35 64 377 0.085 -1.046 0.643 2023-12-07T10:03:26.752 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-07T10:03:26.753 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-07T10:03:26.763 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-07T10:03:26.764 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-07T10:03:26.807 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-07T10:03:26.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-07T10:03:26.873 INFO:teuthology.task.internal:Duration was 1023.533451 seconds 2023-12-07T10:03:26.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-07T10:03:26.907 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-07T10:03:26.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T10:03:26.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T10:03:27.005 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-07T10:03:27.006 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T10:03:27.006 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T10:03:27.027 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2023-12-07T10:03:27.027 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T10:03:27.050 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-07T10:03:27.050 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T10:03:27.077 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T10:03:27.133 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-07T10:03:27.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T10:03:27.153 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T10:03:27.242 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-07T10:03:27.252 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-07T10:03:27.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T10:03:27.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T10:03:27.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-07T10:03:27.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T10:03:27.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T10:03:27.335 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-12-07T10:03:27.357 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2023-12-07T10:03:27.376 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T10:03:27.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T10:03:27.409 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T10:03:27.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T10:03:27.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-07T10:03:27.443 INFO:teuthology.task.internal:Transferring archived files... 2023-12-07T10:03:27.443 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/remote/smithi089 2023-12-07T10:03:27.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T10:03:27.478 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865/remote/smithi097 2023-12-07T10:03:27.479 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T10:03:27.503 INFO:teuthology.task.internal:Removing archive directory... 2023-12-07T10:03:27.503 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T10:03:27.520 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T10:03:27.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-07T10:03:27.572 INFO:teuthology.task.internal:Not uploading archives. 2023-12-07T10:03:27.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-07T10:03:27.590 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-07T10:03:27.591 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T10:03:27.594 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T10:03:27.600 INFO:teuthology.orchestra.run.smithi089.stdout: 655475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 10:03 /home/ubuntu/cephtest 2023-12-07T10:03:27.612 INFO:teuthology.orchestra.run.smithi097.stdout: 658045 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 10:03 /home/ubuntu/cephtest 2023-12-07T10:03:27.614 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-07T10:03:27.646 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-07T10:03:27.718 INFO:teuthology.nuke:Checking targets against current locks 2023-12-07T10:03:27.745 DEBUG:teuthology.nuke:shortname: smithi089 2023-12-07T10:03:27.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T10:03:27.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:37:02.887386', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh7IohZXctJxzWSQcXdoedlQsCFs/6i+OOU6mb2eAxbe+6PVlcgVdsNJi/UxM9KPXej+j6EFoQrBzuXva83530='} 2023-12-07T10:03:27.774 DEBUG:teuthology.nuke:shortname: smithi097 2023-12-07T10:03:27.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T10:03:27.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:37:02.886059', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZNgc0FESPAPeleHTMuq3nqgKH5dEkd4OeaOJcyEP7k1nQp7mISc2Y0/xOjnmOVbRBv8L7FFKey3HkAGcUSIgA='} 2023-12-07T10:03:27.830 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-07T10:03:27.831 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T10:03:27.847 INFO:teuthology.orchestra.console.smithi097:Power off 2023-12-07T10:03:27.848 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T10:03:27.858 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-07T10:03:27.858 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:27.869 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-12-07T10:03:27.869 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:27.883 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-07T10:03:27.895 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-07T10:03:31.884 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:31.896 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:31.996 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-07T10:03:32.007 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-07T10:03:35.997 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:36.008 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:36.107 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-07T10:03:36.117 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-07T10:03:36.218 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-12-07T10:03:40.110 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T10:03:40.220 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-07T10:03:40.321 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-07T10:03:40.427 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae client.1-kernel-sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1023.5334510803223 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=faf96035c25b4b46b9227b5812a9bf01 status: fail success: false 2023-12-07T10:03:40.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:03:40.503 INFO:teuthology.run:FAIL